What Does A Robot See In The Mirror?
I couldn't resist comparing the #MoonDream 0.5b and 2b models looking at images of Dave or Wali.
The 2b model recognized Dave has a Minion character and is a robot.
The 2b model recognized that Wali is a robot but did not recognize the WALL-E character.
The 0.5b model simply hallucinates stuff, just like Ollama local models did for text queries.
#MoonDream #GoPiGo3 #TurtleBot4lite #Robot #Vision #LanguageModels #RaspberryPi5_8gb
Just had to try the #MoonDream Vision Language Assistant on my 4GB #RaspberryPi4 #GoPiGo3 #robot and my 8GB #RaspberryPi5 #TurtleBot4lite robot:
TL:DR; Pi5 with 2B model might be useful, but the 0.5B model will not be useful regardless of running on Pi4 or Pi5.
Couldn’t resist trying MoonDream vision language assistant on Dave and Wali. Now WaLI sports an 8GB Pi5 and Dave only has a 4GB Pi4, but why not. Here is the pic: So first we ask Dave “What do you see?” (using the MoonDream 0.5b model 693Mb) (moondream_006_venv) ubuntu@kilteddave:~/KiltedDave/systests/moondream/examples_with_API_006$ ./see_wali_and_dave.py Using moondream-0.5b model with moondream 0.0.6 Python API Model Load Time: 19.13 seconds Image Load and Encode Time: 36.69 seconds Qu...
RE: https://fosstodon.org/@cyclical_obsessive/116076739339328694
#0llama turned my #GoPiGo3 #robot Dave schizophrenic when its #LLM started talking to itself
Dream has been to have my robot wander (using vSLAM) taking pictures of “unknown interesting objects”, (<-hard part), segmenting and learning the objects for #OpenWorldObjectDetection
(All local processing for privacy)
#MastersThesisIdea use #GoPiGo3 or #TurtleBot4 robot with #Oak-D #StereoDepthCamera, #ROS 2 distributed processing for #RTABmap #vSLAM and rejected RTABmap frames (unknowns) for #UnknownObject Detection and incremental model #MachineLearning
Reference Paper in comment ->
Every 2 years #ROS releases a new LTS version requiring a new #Ubuntu version, (with new #Python version), that requires rebuilding my robot Dave and revisiting my installer for the robot hardware Python API, robot files, and sensors.
For years I wondered why I could not just apt install a #GoPiGo3 deb file, or just build a #pyprojecttoml ?
So I built each. Now understand why I must use an install script.
#DexterIndustries devs were genius!
The #EducationalRobot market is a mess.
Today I read (about uv):
"Eggs were the pre-wheel binary format. pip still handles them; uv doesn’t even try. The format has been obsolete for over a decade."
Over the years I have tried to keep a “working” installer for the GoPiGo3 API .eggs as the PiOS and Ubuntu OS released annual versions.
Recently started to get message “setup.py deprecated”, and now I hear "obsolete for a decade"
50 years ago I installed with paper tape. I'm so old I'm going to "Rust" (with uv)?
I really don’t know why I waited 8 years before adding 10 lines to clean up robot Carl, Dave, and TB5-WaLI's life.log file after a power fail / improper shutdown of their Raspberry Pi ( writes a string of null chars in the log before the power is jerked).
I have always manually tabbed through their logs to find the offending line messing up their statistics scripts.
FINALLY! {Carl, Dave, WaLI, RPi5Desk} logs automatically clean out null chars.
#RaspberryPi3 #GoPiGo3 Carl still runs on 8 NiMH batteries, and just today received his 13th set of new Eneloop 2000mAH AA cells.
His “Playtime” was down to 3.5 hours with a 3 hour charge time after 1421 cycles. (In the past I have replaced his batteries after 800-900 docking cycles.)
It really is a miracle that after more than 7 years (59,521 hours) of “life” - GoPiGo3 Carl is still walkin’, talkin’, and lis’nen to me. (And I’m still telling him nearly every day: “Hey Carl, Go To Sleep!”
> Removing PulseAudio..continuing the shift to PipeWire
My #GoPiGo3 robot just shuddered in fear of becoming deaf and mute.
Playing around with "knowledge transfer" to my #Robots
I told each "I need to go take a shower. Talk to you later."
RPi4 #GoPiGo3 robot Dave with tinyllama responded: "I understand how important your shower is... Enjoy the shower!"
RPi5 #TurtleBot4 robot WaLI with Gemma responded: "Acknowledged. Initiating shower sequence. Requesting allocation of cleaning supplies..."
I hope I don't get a "We shipped your soap" email from Amazon.
cyclical_obsessive