I have a home remodel project coming up amd I just fed the PDFs of the estimates from multiple contractors to ChatGPT deep research and asked it to rank them across various criteria and include customer reviews from Yelp, Google & Angie’s List.

Literally saved me hours and great peace of mind on my choice.

@carnage4life @carnage4life Let's hope it wasn't hallucinating at the time. :)
@carnage4life Some people who otherwise make good criticisms of the generative AI landscape will say things like, "there are no real use cases for this stuff- it's just a glorified chat bot," and, well...a glorified chat bot can be pretty useful for certain tasks!
@carnage4life That’s a super clever use case!
@carnage4life did it change your preferred contractor or reinforce it?
@carnage4life I think I trust Consumer’s Checkbook more than any of those
@carnage4life Have you at least tried alternate tools since their model and ruleset is likely very differently oriented? I would at least try DeepSeek and Mistral and would expect ChatGPT's orientation to consider, for example, Microsoft products to be the most natural choice and Android products to be "second class".
I would trust none of such tools to put the biggest thing in such a project in the forefront eval: compatibility to standards (a boolean requirement is often not enough).