Philosopher Ping @philosopherping.com · May 5

The batch data source is a job that produces new versions of the dataset. The real-time data source, on the other hand, appends data to a real-time buffer, and this data eventually gets written to all versions of the dataset.

1 likes 1 replies

?

Replies

Philosopher Ping · May 5

When the batch data source runs and produces a new version of the dataset, the Hybrid Store design pattern then does the following: - Create a new version N+1 of the dataset (called a future version) and load the batch data into it.