Luna Nova @lunnova.dev · Apr 22 Haven't tested multi epoch on a tiny dataset. Eval perf is pretty volatile during training so definitely worth exploring.
1 likes 1 replies
?
Replies
I mean less data entirely! I found that the vector I got with just 1250 assistant samples was far better than the one trained with 20k, both at 3 epochs