Graham Sutherland / Polynomialfun trick: if someone gives a hosted LLM a skill that lets it fetch web pages (directly, not through some third party scraper service) and it's hosted on AWS, you can often trick it into fetching data from the AWS instance metadata server (IMDS) at 169.254.169.254 / [fd00:ec2::254]. the higher end models tend to refuse if you give the IP, but you can just spin up a domain with A/AAAA records pointing at that IP and request that instead. if IMDSv1 isn't disabled you can get secrets out of it.
penguin42
Dickon Hood@penguin42 @gsuberland I would be very surprised if it didn't. All input into these things is to orient the model into the 'right' place in the vector space to predict the next tokens to output, so if you can engineer a fetch to an endpoint you control you have won.