The notion of a broken clock being sometimes right is based on a gross misunderstanding of what information is.

A clock that always shows the same time is never right, even in the moments of the day when the time happens to be what it shows, because you don't gain any information about what time it is by looking at the clock.

This reasoning also applies to chatbots. If you can't tell whether what you have been given is useful information unless you alreay know the information, then you haven't been given useful information.

This confusion is also what cold reading is based on, btw. Falling for a chatbot is literally the same type of mistake as falling for a psychic telling you that somebody you used to know who had a vowel in their name died.
@riley But in my infinite knowledge, I can also add that they died on a day of the week ending with "y"!!!111
@Uilebheist The German version is, they died on a masculine day. (German has one day of the week that does not end in -g, der Mittwoch, but all days of the week are masculine.)