Every once in a while I like to test ChatGPT's knowledge. You know, just to see how well it's keeping up with updates in the field and how correct and trustworthy its information is. (Spoiler: it's not.)

Despite sounding extremely confident and like it "knows" what it's saying, it turns out it doesn't. (Shocking, I know!)

The latest example I tried is I asked it how you can provide alternative text for CSS generated images...

It told me that that's not possible and that's one of the limitations of CSS images.

I gave it a hint and asked it specifically about providing alternative text for CSS images added using the `content` property. (At this point I thought it would just search the web and find my latest blog post about the topic and use it to answer my question.)

Once again it confidently said that it's not possible to provide alternative text for CSS images. ๐Ÿ˜ƒ

It said adding decorative images in CSS is fine (without alt text) and recommended using HTML instead. This is only partially true.

So there you have it. If you're wanting to learn *proper* HTML, CSS, and accessibility, prefer learning from a human. AI is not going to teach you all you need to know.

Not one AI tool is more valuable than you acquiring knowledge and learning how to use it.

Not to mention that AI isn't following the latest discussions happening in the field, nor is it keeping up with the latest updates and additions to the specs. You'll only be able to get this kind of insight from people like you who _are_ following and staying on top of things on a daily basis.

Thank you for coming to my TED talk. ๐Ÿ˜ƒ

@SaraSoueidan thoughts on rubber ducking with a local-only LLM, as an intentional exercise in "can you spot the bullshit"?

@SaraSoueidan The data ChatGPT is using is mostly over a year old. And I donโ€™t think there is a lot of searching the web between these knowledge sessions, but I could be wrong.

Edit: sent too early.

https://github.com/HaoooWang/llm-knowledge-cutoff-dates

GitHub - HaoooWang/llm-knowledge-cutoff-dates: This repository contains a summary of knowledge cut-off dates for various large language models (LLMs), such as GPT, Claude, Gemini, Llama, and more.

This repository contains a summary of knowledge cut-off dates for various large language models (LLMs), such as GPT, Claude, Gemini, Llama, and more. - GitHub - HaoooWang/llm-knowledge-cutoff-date...

GitHub
@yatil All the more reason why LLMs are bad at keeping up with a fast paced field like ours.
@SaraSoueidan @yatil LLMs can rot. Iโ€™d be happy if at least syntax highlighters could keep up with CSS