Jonathan Baker @jonathan.boxcake.net · Jan 9

I have many servers running different models at home and I wanted an easy way for a client to find and use a model wherever it was - so I made a zeroconf/avahi announcer for available models, and a python client to find them by name or tag. Will put it in git if anyone is interested in this.

1 likes 1 replies

?

Replies

Jeffrey Hulten 🅅 · Jan 9

That looks awesome. Please do! Also, if you haven't seen it yet, check out LiteLLM proxy. docs.litellm.ai/docs/proxy/d...