Unpopular opinion and I expect there will be a lot of pushback on it, but what's a good (polite) debate if not enlightening?

Do you know how your washing machine works? (If yes, keep quiet for those who don't.)
If the answer's no, you do know one thing though I suspect. You know that you trust it to wash your clothes because well, that's what it's designed to do.
If you're not a mechanic and yet you drive, you trust that when you do all the right things and push the right buttons, your vehicle is going to move forward and get you to places. If something breaks, do you attempt to tinker with it and fix it? Maybe, but more likely you go to someone who does know.
What's my point then?
AI coding. Humans made a thing that allows non-programmers to have an idea. They can write that idea in great detail and from there, have something returned that they should of course test thoroughly and if they like it, maybe they share it.
The washing machine is similar but not the same. If you put in your powder/detergent and the right colour of clothes and tell it to start, you let it do it's thing. It washes your clothes and hopefully when you're wearing them at an important meeting, they don't suddenly fall apart, because someone beta-tested that machine ahead of you getting it, and made sure that it didn't rip the seems of your clothes silently, deadly, badly.
AI programs need to be tested the same as your expensive machine, probably many aren't. That is a problem, but the underlying idea of AI code itself being dismissed out-of-hand seems an odd one, at least to me.
Maybe because there's more scope for badness, maybe because you only ever hear the results of all the bad things going on. Like Amazon reviews, the majority of what you see are people unhappy with the product. For every unhappy person there's probably a thousand that just get on with it.
Same for AI badness. For every bad experience, there's probably a few hundred situations where someone made a thing, it just works, nobody cares but you'll never know.
Basically I feel that we maybe need to take a step back, review our hate, our personal biases a tiny bit and stop crapping all over people for doing things a different way that isn't *your* way.
Before automatic washing machines we had manual ones that took a lot more effort, and before that, people washing by-hand. They probably felt exactly the same. The cycle (if you'll pardon the pun) repeats throughout the centuries and will continue to do so, likely forever.
New thing comes along, people hate it, old way was better.
New way becomes old way, new thing comes along, people hate it, old way was better.

Shout at me as you wish.
PS. Wasn't written with aI.

@Onj The analergy is a little flawed because you're comparing an end user to a developer. If I create a washing machine and have no idea how it works and give it to people and things break and I then have no idea how to fix them, that's on me. Any end user using any program may not know how it's going to work, but they can go to the manufacturer, outline their problems and hopefully get fixes, work-arounds or bug fixes.
@JustinMac84 You can go back to your coding agent and outline the problems and if done right, get fixes too. Not always, and not always well, but that's what testing's for isn't it?
@Onj So you receive a support ticket, negotiate with your user, while simultaneously submitting a support ticket to your AI of choice and negotiating with that. If you can't duplicate the problem the user is having, what would you do? You wouldn't know how to advise them and would have to pass on every piece of possibly incorrect, possibly unsafe advice the model gave you and await feedback from the user. Exponentially grow that problem for every bug
@JustinMac84 Yep, but if there were such a thing as fiver for coding instead of music, same thing would apply there. Humans could be just as devious, make something that looks good and works on the outside, steals your crypto on the inside. Not nice.
@Onj I don't understand the point. There is Fiver for coding. You can commission people to produce software for you. Thing is, human-coded software, the culpability can be traced back. Imagine my shock, my horror, my outrage, when you told me the software I had my model produce for you introduced vulnerabilities! However did that happen? there's no way for you to prove that I didn't do it on purpose or that the model didn't mess up.
@JustinMac84 Sure, but I think you're doing what most people do right now, absolute, absolute worse-case scenario. I don't know why people do this honestly, other than if it scores points, but OK, point made. It could be terrible. It could be catastrophic but... What if it just isn't? What if it simply does the job it's intended to do?

@Onj would you still pass on the magic 8-ball solution?

I'm sorry you feel that these arguments are an attempt to point score. They are not. In fact, your post is very topical. there is an article, just today, doing the rounds about Amazon having a high level meeting about a spate of outages affecting its business due to AI coding. A trillion dollar company is suffering because of this.

@JustinMac84 And that's on them. If those higherups are too stupid to properly test, that is a they problem. I can only speak for myself but I spend hours, sometimes days after getting a thing made, testing to the very best of my ability and I always ask my, as you put it, 'stochastic parrot' to write out a document detailing all steps.
I'm even more than happy to share the chats I have with it, I hide nothing.
I'm not doing this seriously, more for fun and that's it.
I'm just so tired of the massive amount of negativity around a thing. If one lives life like that, I pity them. I can't do it.
There's more to life than hate, than sadness, than negative vibes.
@JustinMac84 You're not even wrong, because clearly you've done all the reading, read all the bad press, and it vindicates your own bias about it (which goes back to my post in itself) and that's absolutely your choice to make. I'm not going to change your mind. I just think it's sad that before we can enjoy a new technology, we have to crap all over it first. It happens in all sectors when a new thing comes on the scene.
@Onj Opposing tech for the sake of opposing tech is stupid. I would hesitate before describing a breadth of profound and, most importantly, substantiated concerns as negativity and hate though. I would argue that charging wrecklessly into the adoption of a technology, without considering all the ramifications is equally foolish. For me it's not about black and white no-one should use this stuff, it's about how the stuff is used.

@JustinMac84 Of course it is. If I made a thing, didn't even give it a single test and threw it out there and it killed someone's machine, that is terribly irresponsible. You haven't come up with a single good usecase so far though, your entire response to the thread has been:
Amazon screwed up, you could screw up, people are screwing up. your brand would suck if...

That's putting problems and limits right at the door before you even step out of the house.
Me, I can't live that way. I think trying a thing and seeing if all it does is suck, is better than not knowing at all.
Taking other people's word for it, and again *only* seeing the bad in a thing, well it speaks for itself.