Chris Blume @programmax.net · May 4 I think I figured out what is going on. I have some control here. 54% of the tokens (321.7k) are just "messages". I think it is loading all the previous context. So effectively starting each new session gets more and more expensive until I /compact or /clear.
0 likes 1 replies
?
Replies
I think maybe the play is continue like normal for this session, since all that context is already loaded. Then try to end the session at a nice point where everything is wrapped up. If it is so wrapped up that I don't need previous context (and can just reload the code), /clear