Peak energy production would be a good time to train the damn llms instead of building natural gas power plant I guess.
Given the price of RAM and graphics cards, it is obvious that running LLM is at least somewhat limited by the amount of hardware available. So having that hardware sitting idle, except when there is too much solar power, is obviously not economically viable.
Power and grid infrastructure is a limitation that can exceed hardware availability. Musk has a datacenter with 20-something methane gas generators running throughout the day to power his mini-me sycophantic AI, Grok.