A few notes on AI and blind gaming:
Last night, I tried a few games with TalkBack's AI. I believe it's using one of the smaller models. Anyway, I played Mortal Kombat, Shaolin Monks, and Fire Emblem, Awakening. Both ended in failure for different reasons. Mortal Kombat ended because I couldn't orient my character to move to the passageway that the AI said was either to my left or right. I did, however, manage to get the first item and defeat a few enemies. It was a lot more button mashing than I hoped for, though. In games, I really like to know what's going on, which I feel isn't what many blind video gamers are after.

With Fire Emblem, Awakening, I wasn’t able to finish the tutorial in 30 minutes because I had know idea why one character was always in battles and the other one was seemingly wandering around an empty place. I mean, I know there are blind people who have been playing games since they were like 9 months old and who can beat any Pokemon game without access scripts, but I just ain't one of them. Granted, Mk Shaolin Monks was a test to me, to see if AI can help me know where to go in these types of 3D games. I really didn't anticipate archways and hallways and such. So that will probably take a larger, thinking model with realtime screen access. I should try Gemini Live again at some point and see if it's improved any. Last time I tried it couldn't even give me controller inputs and Mk Deadly Alliance moves correctly.

#gaming #blind #accessibility #android