Metal 4 has some really cool looking new features, but pretty much every time I've tried to use one I've gotten either vague errors or kernel panics.
| Website | https://www.finnvoorhees.com |
| GitHub | https://www.github.com/finnvoor |
Finn Voorhees
@finnvoorhees
- 1.6K Followers
- 134 Following
- 729 Posts
A microcontroller plugged into the iPad acts as both a MIDI receiver and HID mouse, and an agent running in an iOS app sends signals to the microcontroller to control the cursor. A broadcast extension also streams video to the app so the agent knows what it's looking at.
Okay this is *crazy*
An agent running entirely on iPad* that can control any app
even managed to make it work in the EU, something OpenAI can't even comprehend
you can just copy things
(computer use in pi)
@kylebshr @stroughtonsmith if you have a few seconds to spare and only need it to be correct sometimes
@schwa damn they took all of GitHub down, they really don’t want you using pi
@mathijskadijk ha, looks very similar 😅
I mainly made this since it seemed like there weren't any apps that supported framing videos, and wanted to experiment with keyframe zoom/transform animations. Looks like there's a few people working on this though, e.g. https://matte.app/
@schwa they've employed some advanced security practices but after lots of hard work and reverse engineering we've cracked the code https://gist.github.com/finnvoor/25ca1758cbb358eb7c716976ce85861c
