I think the most tragic aspect of deploying "AI" in teaching and learning situations is how much it pushes people into a situation of learned helplessness. This constant feeling of not knowing how to do a thing of being incapable of actually doing work on one's tasks is mentally so harmful. How do people under those conditions gain confidence in their abilities? Like ever?
In the context of education specifically, it also just shows a complete disregard for understanding and knowledge having value in and of themselves. If if someone believes that "AI" is a good method for achieving correct results, that shouldn't be _enough_ to warrant using it in education.