I suspect that a large amount of #AI Inference will migrate to local hardware, AKA "edge". This Kickstarter project is offering offline #GPT120b inference.

https://tiiny.ai/

Current price is around $USD 1,400 but that is likely to fall rapidly.

I can imagine adding this as a companion to #moodlebox, which is #Moodle on the #RaspberryPi once the price drops enough.

Alex Ziskind demonstrates it on this Youtube video.

https://www.youtube.com/watch?v=RkzCAaIV_cQ

#LLM #EdTech