Matt Pocock @mattpocock.com · Jan 10 1 / 2
LLM routers seem like a fascinating pattern to me. - Lets you separate concerns into different prompts - Makes your system more testable Really interesting for agents/workflows with several discreet concerns, like searching, handling git, and file editing.
37 likes 3 replies
?
Replies
Every time I work on productionizing a prompt, I find that I have to split it up like you illustrated. The challenge then becomes the orchestration between the different calls.
* 2 days later * 'We somehow created the AI version of git branches, and now they're in merge hell, which is a nice way of saying that they're technologically Cronenberged'