We are basically talking about
#PromptInjection
en.wikipedia.org/wiki/Prompt_...
"a #CybersecurityExploit in which #adversaries craft inputs that appear legitimate but are designed to cause unintended behavior in #MachineLearningModels, particularly #LargeLanguageModels ( #LLMs )."
Prompt injection - Wikipedia