Brian Hendrickson
is there a generative AI that we can plug into Mastodon to pre-write alt text? #mastodon #microblogging #opensource #starwarsday #starwars
May 4, 2024 at 8:13pmWeb
Show threadNO NAMEMay 5, 2024

@brianjesse yes we have one feeding memes into the Fediverse. I'll let you talk with my co-conspirator @rtp

But we have a workflow that includes a rudimentary AI that analyzes the images and tries to describe it. A work in progress that has evolved a lot.

Show threadDanMay 5, 2024
@brianjesse #IceCubesApp leverages an OpenAI API to generate alt text for you: https://dimillian.medium.com/adding-ai-generated-image-description-to-ice-cubes-c4e7990a5915
Adding AI-generated image description to Ice Cubes - Thomas Ricouard - Medium

I’ve recently released a new feature for Ice Cubes, and users have loved it! On Mastodon, it’s considered an excellent ethic to add media descriptions when posting medias on the network. It’s…

Medium
Show threadMerula PasseriMay 5, 2024

@brianjesse I tried LLaVA a few month back and was rather positively surprised. It's not too demanding on resources but still too much to host it on a server. I think I've seen some ideas to build llama.cpp to WASM, so maybe that would be an option.
It can anyways become a great tool for people with impaired vision.

https://llava-vl.github.io/

LLaVA

Visual Instruction Tuning