coolbutuseless

A demo using {carelesswhisper} to verbally create and run {dplyr} commands.

This is a toy example, but you could hook {carelesswhisper} up to an LLM (e.g. llama.cpp via {rllama}) and potentially have something a bit more general purpose.

#RStats #SaturdayCoding

https://github.com/coolbutuseless/carelesswhisper

GitHub - coolbutuseless/carelesswhisper: Automatic speech recognition in R using whisper.cpp

Automatic speech recognition in R using whisper.cpp - coolbutuseless/carelesswhisper

GitHub
Jun 9, 2023 at 11:00pmWeb
Show threadcoolbutuselessJun 9, 2023

This is a huge manual hack done in 10 minutes. Don't expect miracles. Also I'm sorry for the potato image quality.

Code here:
https://gist.github.com/coolbutuseless/d24cc225c473e12be8af0a065dcbc977

#RStats #SaturdayCoding

run dplyr commands verbally

run dplyr commands verbally. GitHub Gist: instantly share code, notes, and snippets.

Gist
Show threadWolfgang ViechtbauerJun 10, 2023
@coolbutuseless Reminds me of this epic talk/demo: https://youtu.be/8SkdfdXWYaI
Using Python to Code by Voice

YouTube
Show threadDanJun 10, 2023
@coolbutuseless 😂 'empty cars'
Show threadcoolbutuselessJun 10, 2023
@Dan and three alternatives for 'wt' as I don't think whisper.cpp is always the best with the Australian accent :)
Show threadMichael McCarthyJun 9, 2023
@coolbutuseless You’re going to turn us all into Scotty with this one 😬 https://youtu.be/QpWhugUmV5U
Great Moments in Star Trek History - Hello, Computer

YouTube
Show threadAndree Valle CamposJun 10, 2023
@coolbutuseless I'm imagine using it for live coding events or trainings, although wondering if it would be less error-prone than myself hehe
Show threadclimbertobbyJun 10, 2023
@coolbutuseless Computer: zoom and enhance!