It doesn't use LLMs but a neural network for intent classification, based on supervised learning.

This is way less resource-wasting.

@drwho the network architecture itself is using a transformer (the same thing LLMs use) but only one layer (look for keywords/pronouns and the relations to other keywords).

I was able to ditch torch in the runtime so it is pure c++ and straightforward to run in the browser as a wasm module. What's still there is pytorch used for generating the model.