Mehdi Ouazza @mehdio.com · Feb 20

According to the AWS Redshift team, 94% of workloads don’t exceed 10 TB. I look at my 4 TB SSD and wonder: Do we really need massive data centers for this? Do we really need distributed compute? Our idea of “big” #databs has changed, but most design decisions remain a decade old.

14 likes 2 replies

?

Replies

josh fr · Feb 20

Outbound egress costs can quickly escalate, effectively trapping orgs in the cloud. AWS knows this and will literally send a truck of hard drives to a business to bring all of their data in (naturally inbound transfer is free).

Dani Solà · Feb 20

That's a big part of the appeal of @duckdb.org. This post was pretty controversial back in the day, but not so much anymore motherduck.com/blog/big-dat...