Basically it’s a layer to let your LLMs plug I to tools.

They generally run on your machine (I use docker to sandbox them) and may or may not cash out to useful APIs

One example is I just wrote one to connect to my national weather services RSS feed, so my LLMs can get and summarize the weather for me in the morning.

Works well with Gemma 3n