I’d like to discuss the current situation with LLM prompting standards; how we got into this mess; and how to live with it now:
https://open.substack.com/pub/altsoph/p/whats-wrong-with-chat-templates-format
What's Wrong with Chat-Templates Format for LLM
This is going to be a long read (I rarely write these), but I believe it's a useful and interesting one with some non-trivial twists along the way. Chat-templates are broken, and I'll explain why.
Aleksey Tikhonov