fig (aka:[phil]) @bad-example.com · Mar 18 1 / 4
got lightrail backfilling over 400 repos/sec for bits, though it's settling closer to 300/s so looking like over 24h for full-network backfill (it's not actually disk- or cpu-bound, this is all limited by scheduling resyncs from enough different PDS hosts concurrently)
12 likes 1 replies
?
Replies
lightrail mostly doesn't do `getRepo` so it's very light in terms of bandwidth, but it needs ~two requests per repo (need rev for accuracy!) instead of one like normal (just `getRepo`) so i'm not feeling bad about pushing out 600–800 repo req/sec and having the 2x throttle per-host penalty.