I was researching a science topic once using bing chat. It gave me absolutely invalid references that didn’t even include anything similar to what I was searching for. When I pointed that out, bing apologized and then gave me the same references 🤷