@reboot @SnowDerg @eevee essentially both concepts smushed together in a stateful manner as a single model, at least in terms of external behaviour.

the actual architecture isn't the same as those individual components but that's a separate conversation.

@reboot @SnowDerg @eevee I'm probably not the right person to talk about it in deep detail since the gory innards of LLMs and autoregressive models aren't my wheelhouse. Someone did post a good article on LLMs the other day but I can't spot it.

I'd recommend searching online for an explainer but unfortunately every single one I found on the first page of Google was a bust due to gushingly anthropomorphising the model in a way that falsely implied an ability to develop understanding.

@reboot @SnowDerg @eevee LLM = large language model

I find it important to not use the term "understanding" in this context because the model is *not* understanding anything. It can *mimic* understanding through correlative processes, for sure, but the distinction is important.

@reboot @gsuberland @SnowDerg @eevee Yep, it can also be quite easily tricked into doing anything, you just have to hijack the flow of the conversation and "hypnotize" it.

The important thing is, it doesn't have any internal distinction between its own words and what you say besides the context being given to it (probably some header/prefix, which is also how it knows the time lol), so you can quite literally put words in its mouth.