SEPIA Open Assistant

102 Followers
153 Following
153 Posts

Highly customizable, #opensource, self-hosted, extendable, personal, intelligent #voice assistant. #Java server + #DIY cross-platform HTML client #SmartHome #SpeechRecognition #Robots #RaspberryPi

More info: https://sepia-framework.github.io

Posts written by Florian (creator, human, https://fosstodon.org/@bytemind )

Homepagehttps://sepia-framework.github.io

I could watch these 2 #robots playing soccer all day long 🤖⚽️🤖😄:
https://youtu.be/KRm17Pc2nZc

Deepmind OP3 Soccer Team:
https://sites.google.com/view/op3-soccer

OP3 soccer behaviors

YouTube
Next round 😁🤖💬: #Alpaca (Stanford's fine tuned #LLaMA 7B) running on Orange Pi 5 8GB (#ARM RK3588S SBC) via llama.cpp. Real time video from load to finish (no cherry-picking) - Albert Einstein and Yoda's thoughts 😄 - #reallyopenai #ChatGPT
Results can be quite funny of the 7B model 🤣🧙‍♂️🤷‍♂️ "The chancellor of Germany is ...". Btw effects of the 4-bit quantization is unknown so far.
Meta's 7B #LLaMA large language model running with ~2 tokens/s as quantized 4-bit version on #OrangePi 5 8GB RAM (#ARM RK3588S SoC) via llama.cpp by Georgi Gerganov 🚀😲🤩
I predict a future where we treat pre-trained #AI / #ML models for various tasks (image, language, speech, etc.) like invaluable, ancient artifacts that work like #magic 🧙‍♂️✨️🤖

A good write-up by @minimaxir about the recently released ChatGPT API and the impact on basically any app that has (will create) a need for AI text-generation 🙃

https://minimaxir.com/2023/03/new-chatgpt-overlord/

ChatGPT's API is So Good and Cheap, It Makes Most Text Generating AI Obsolete | Max Woolf's Blog

Including OpenAI's other text generating AI!

Max Woolf's Blog
#ChatGPT for #Robotics - Microsoft implements a high-level API to control robots, then let's ChatGPT write code based on a task description like "warm up my lunch" 🙂🤖 - no magic, basically prompt engineering 😉. Article: https://www.microsoft.com/en-us/research/group/autonomous-systems-group-robotics/articles/chatgpt-for-robotics/ - Video: https://youtu.be/NYd0QcZcS6Q
ChatGPT for Robotics

We use ChatGPT to allow a user to intuitively control multiple robots such as drones, robot arms, home assistant robots using only language.

Microsoft Research
If you have a system with Mary-TTS support (like SEPIA client + server 😉) you might be interested in the @coqui_ai #TTS Docker images I've built (x86, Arm64): https://hub.docker.com/r/sepia/coqui-tts 🤖💬 They use an extended server with compatible API (PR pending) for the active voice 🙂.
There are a lot of high-quality voices available and some are even (barely) fast enough to run on #RaspberryPi (check glow-TTS for example).
Docker

I've tested various ports of #OpenAI #Whisper speech recognition to see how fast it can be on #ARM SBCs like #RaspberryPi 4 and #OrangePi 5: https://github.com/fquirin/speech-recognition-experiments - Spoiler: it can be very fast 😁🚀
GitHub - fquirin/speech-recognition-experiments: Experiments to test different speech recognition systems for SEPIA Framework

Experiments to test different speech recognition systems for SEPIA Framework - GitHub - fquirin/speech-recognition-experiments: Experiments to test different speech recognition systems for SEPIA Fr...

GitHub
Something to think about when you have a #CPU with big-little architecture (performance and efficiency cores): DON'T use all cores for parallel processing or you might wait for the slowest ones! 😉 Just accelerated my #TTS #Torch script 4 times by reducing threads from 8 to 4 🙃