Streaming audio to OpenAI in your browser is cool… until you deal with PCM16.

The browser gives you Float32 audio. The API expects PCM16 at 24kHz.

That means:

Float32 → clamp → Int16 → base64 → send to realtime api

If you don’t handle the conversion properly, you’ll hear it right away — crackling, silence, or wrong pitch.

Wrote a quick guide on how to do it correctly: https://l.zfir.dev/6rbGCiN

#PCM16 #WebAudioAPI #OpenAI #OpenAIRealtime #JavaScript

#TIL from building a web audio player (for the mixes):

#Safari's #opus support is still quirky. With a #webm container, playback works but AnalyserNodes won't receive anything to compute frequency data with. With #ogg, `getByteFrequencyData()` works, but the audio element calculates the wrong duration, prob. b/c it always assumes CBR. Also if you build the audio pipeline before the first user interaction in Safari, nothing will get routed to the speakers

But still, the #WebAudioAPI is awesome!

I just released the alpha of Web Audio Studio.

It's a browser-based tool for writing real Web Audio API code and visualizing the runtime graph it produces. You can inspect connections, follow signal flow, and insert analysers to see what's happening between nodes.

Everything runs locally in the browser. No signup. Desktop-only for now.

Would love feedback from anyone working with #WebAudio or #DSP.

https://webaudio.studio

#webaudio #webaudioapi #dsp #webdev #creativecoding

Dittytoy transforme votre navigateur en studio de musique qui se code

https://fed.brid.gy/r/https://korben.info/dittytoy-live-coding-musique-navigateur.html

Last installment of my "make a Game Boy emulator" series. I cover audio, memory, and timing this time! https://www.youtube.com/watch?v=Be5v8E21pEQ

One neat consequence of this video is that it got me to actually start learning about #GameBoy audio so I might have a "how game boy audio works" video some day. It also got me to learn about the #WebaudioApi to make the demo waveforms/visualizations

📝 New blog post: "The Web Audio API: A Cautionary Tale of Ambitious Design and Practical Limitations"

https://rye.dev/blog/web-audio-api-design-philosophy-and-reality/

#WebAudioAPI #webstandards #JavaScript #WebAssembly #APIdesign

Variable duty cycle square waves with the Web Audio API

https://www.danblack.co/blog/variable-duty-cycle-square-wave

#HackerNews #VariableDutyCycle #WebAudioAPI #SquareWaves #AudioProgramming #TechInnovation