SSE sucks for transporting LLM tokens

SSE sucks I’m just going to cut to the chase here. SSE as a transport mechanism for LLM tokens is naff. It’s not that it can’t work, obviously it can, because people are using it and SDKs are built around it. But it’s not a great fit for the problem space. The basic SSE flow goes something like this: Client makes an HTTP POST request to the server with a prompt Server responds with a 200 OK and keeps the connection open Server streams tokens back to the client as they are generated, using the SSE format Client processes the tokens as they arrive on the long-lived HTTP connection Sure the approach has some benefits, like simplicity and compatibility with existing HTTP infrastructure. But it still sucks.

iPhone 17 vs. iPhone 16: Which Is the Right Choice for You?

The iPhone 17 brings improvements to the camera, display and battery. But is it worth the upgrade?

Jon M. Chu Says AI Couldn’t Have Made One of Wicked’s Best Moments

The Wicked: For Good director says being able to improvise on set allows for the kind of moments that are hard for machines to make.

Everyone in Seattle Hates AI — Jonathon Ready

A post about everyone in Seattle hating AI.

Best VPN for Mac for 2025: Improve Your Privacy for Web Browsing, Streaming and Gaming

Keep your web browsing activity hidden, mask your torrenting activity and unblock geo-protected streaming content with the best VPNs for Mac.

deepseek-ai/DeepSeek-Math-V2 · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Why Strong Consistency? - Marc's Blog