Jevko for Large Language Models

https://xtao.org/blog/jevko4llm.html

I’ve been learning about LLMs a bit. After watching a recent video about LLM tokenization by Andrej Karpathy a thought appeared in my mind.

Namely: I think it might be promising to investigate Jevko-based formats as an efficient (cheap in terms of tokens) alternative to JSON/YAML/etc. for interacting with LLMs in a structured way...

#AI #LLM #Jevko #JSON #YAML #efficient #tokens #tokenization #structured

Jevko for Large Language Models