When learning to use unfamiliar software, the experience often boils down to: I am here, what do I do now?

Ideally you can share your screen with someone who has walked that path. But if you can't, LLMs may be able to synthesize what others have learned. We typically use words to search that body of hard-won knowledge. Searching with images of screens can be a powerful complementary mode.

https://thenewstack.io/what-chatgpt-and-claude-can-see-on-your-screen/

#LLM #ScreenReading #SoftwareOnboarding

What ChatGPT and Claude Can See on Your Screen

The ability to show not tell in LLMs is a gamechanger for developers. Showing an LLM an image can help you learn how to use software.

The New Stack