Efog @efog.tech · Dec 16

RTX 3090, 10 minute 185 Mb video, 40 sec to first token, perfect response. Freshly released Apollo-3b. Mind blowing honestly.

0 likes 1 replies

?

Replies

Efog · Dec 16

github.com/efogdev/apollo Repo to deploy locally. I think even ~12Gb of VRAM is enough (for small videos, not sure however).