fig (aka:[phil]) @bad-example.com · Mar 19 ok *this* change in slope is means we're closing in on finishing backfill. most mushrooms done, we're at mostly retries and slower hosts. (35M syncs completed so far) (21G was an over-estimate, it might just break 11GB)
6 likes 1 replies
?
Replies
OKAY that is the first pass at the full crawl done: 36M repos discovered, 35M synchronizations completed, 0.7M is imprecise here (multiple ways to get into that queue) but some is retries. (35M is also double counting repos that synced and then re-synced but that shouldn't be many)