The enshittification of AI has lead to the choice of AI used by VLC to be groaned at. I even saw a post cross my feed of someone looking for a replacement for VLC.

VLC is working on on-device realtime captioning. This has nothing to do with generating images or video using AI. This has nothing to do with LLMs.

(edit: There's claims VLC is using a local LLM. It will use whisper.cpp, and not be using OpenAI's models. I don't know which models they will be using. I cannot find any reference to VLC using a LLM.)

While it would be preferred to use human generated captions for better accuracy, this is not always possible. This means a lot of video media is inaccessible to those with hearing impairment.

What VLC is doing is something that will contribute to accessibility in a big way.

AI transcription is still not perfect. It has its problems. But this is one of those things that we should be hoping to advance.

I'm not looking to replace humans in creating captions. I think we're very far from ever being able to do this correctly without humans. But as I said, there's a ton of video content that simply do not have captions available, human generated or not.

So long as they're not trying to manipulate the transcription using GenAI means, this is the wrong one to demonize.

#AI #Transcription #VLC #HearingImpaired #Deaf #Accessibility

@bedast I would also add I find it quite helpful to start with a set of automatically generated captions, and then correct them. I don't do this often, but it saves me loads of time in a part-time job.

Is this a bit like people being annoyed at Mozilla using AI for on-device browser translation, even though that's very useful? I'm not sure if that's generative, but I'd guess not.

@howisyourdog @bedast I groan every time I see unsuprevised automated captions or machine translation. They're simply not ready for prime time.

I know some Deaf people find them useful, so I understand the push to integrate them. But this should not be bundled with VLC; it should be an optional plugin, if it isn't already.

@grvsmth @bedast it's certainly a tricky one. I would go further and say people with hearing loss, particularly those who can't lip read (me), find them more than just useful.

Their accuracy is definitely a problem to be solved, so having it as a plugin is a good compromise as long as people know that. On the other hand it's VLC, so you're getting a pretty amazing piece of software for free, and this is coming from a good place, not trying to inflate stock price with a fad.

Certainly not something to rely on if you're producing videos professionally, but I can also see e.g. a solo YouTuber won't have time to transcribe all their videos.

@howisyourdog @grvsmth @bedast I see people say stuff like this all the time and I just don’t get it. Transcribing a video doesn’t take very long compared to filming/editing it in the first place. And if your video is scripted? Most of the work is already done. Solo youtubers absolutely have the time to do this, especially bc it leads to higher engagement for their vids, and should be teased mercilessly if they don’t.

@sidereal

Sure that "merciless" bullying of creators to reach your goals is the correct way towards a "stronger, kinder world"?