Programming for the Planet @propl.dev · Jun 15 1 / 2
Since it's a big storage system, stability is super important for a cloud-native weather format. Public providers are moving to it, for example for weather forecasts and cloud data. It supports 'virtual' datasets built from piles of other data so you can compose vast datasets via 'symlinking'
0 likes 1 replies
?
Replies
@deepakcherian.bsky.social notes that Icechunk requires a level of homogeneity which doesn't work well for some data. Need cross-language FFIs (something @neurocy.bsky.social also observed). Earth sciences is missing database ideas like incremental view/streaming compute and derived fields