Finn Voorhees

@finnvoorhees
1.6K Followers
134 Following
729 Posts
Metal 4 has some really cool looking new features, but pretty much every time I've tried to use one I've gotten either vague errors or kernel panics.
A microcontroller plugged into the iPad acts as both a MIDI receiver and HID mouse, and an agent running in an iOS app sends signals to the microcontroller to control the cursor. A broadcast extension also streams video to the app so the agent knows what it's looking at.

Okay this is *crazy*

An agent running entirely on iPad* that can control any app

even managed to make it work in the EU, something OpenAI can't even comprehend

you can just copy things

(computer use in pi)

@kylebshr @stroughtonsmith if you have a few seconds to spare and only need it to be correct sometimes
@schwa damn they took all of GitHub down, they really don’t want you using pi

@mathijskadijk ha, looks very similar 😅

I mainly made this since it seemed like there weren't any apps that supported framing videos, and wanted to experiment with keyframe zoom/transform animations. Looks like there's a few people working on this though, e.g. https://matte.app/

Matte — Polished App Demos in Minutes

Record the iOS simulator, live devices, or any app window. Add backgrounds, device frames, edit and export—all in one native macOS app.

Matte
@schwa they've employed some advanced security practices but after lots of hard work and reverse engineering we've cracked the code https://gist.github.com/finnvoor/25ca1758cbb358eb7c716976ce85861c
anthropic-subscription-fix

anthropic-subscription-fix. GitHub Gist: instantly share code, notes, and snippets.

Gist