I was able to use an extended conversation with an AI https://chatgpt.com/share/68ded9b1-37dc-800e-b04c-97095c70eb29 to help answer a MathOverflow question https://mathoverflow.net/questions/501066/is-the-least-common-multiple-sequence-textlcm1-2-dots-n-a-subset-of-t/501125#501125 . I had already conducted a theoretical analysis suggesting that the answer to this question was negative, but needed some numerical parameters verifying certain inequalities in order to conclusively build a counterexample. Initially I sought to ask AI to supply Python code to search for a counterexample that I could run and adjust myself, but found that the run time was infeasible and the initial choice of parameters would have made the search doomed to failure anyway. I then switched strategies and instead engaged in a step by step conversation with the AI where it would perform heuristic calculations to locate feasible choices of parameters. Eventually, the AI was able to produce parameters which I could then verify separately (admittedly using Python code supplied by the same AI, but this was a simple 29-line program that I could visually inspect to do what was asked, and also provided numerical values in line with previous heuristic predictions).

Here, the AI tool use was a significant time saver - doing the same task unassisted would likely have required multiple hours of manual code and debugging (the AI was able to use the provided context to spot several mathematical mistakes in my requests, and fix them before generating code). Indeed I would have been very unlikely to even attempt this numerical search without AI assistance (and would have sought a theoretical asymptotic analysis instead).

ChatGPT - Conjecture disproving strategy

A conversational AI system that listens, learns, and challenges

ChatGPT
@tao ChatGPT is a great way to unlearn any subject & unteach yourself to think about problems!
@jackemled @tao And, if you are an expert in the topic of discussion, a potential way to save a few hours of your time to use for other things! (For this example, teaching people how to better use ChatGPT.)
@drScott @tao No, just teach them to use a search engine & fact check. It takes less time & is more reliable for them & for you. Better for the environment & cheaper for them as well. Boolean searches & fuzzy searches have existed for decades. Google has both available for free.

@jackemled We all get to choose how to spend those saved few hours =)

(I don't understand what your 'no' is refuting, my best guess is that it refers to my description of what Tao did with his few hours saved.)

@drScott The "no" was to "teach them to use a LLM". It takes much longer to learn how to use one of those & they never give reliable results no matter how "good" you are at it. It's like gambling; you feel like you're getting better at it, but the chances of a good outcome never actually change.

For boolean searches, you do get better at it; you learn how to filter out unwanted search results. For example, you might search how to program a videogame AI -"chatgpt" -"llm" ~"java" ~"python" to find a guide on making a decision tree or something for a videogame character, in Java or Python, without results being polluted by SEO LLM slop. Google even has a search builder tool so you don't need to learn this in order to make good use of it too.

@drScott We do all get to choose how we spend the time we save with our tools, but in my experience (and literally everyone else's, even people that thought it helped at first), LLMs waste more time than they save. Sure, there's a 1% chance it gives you exactly what you need immediately, but the 99% of the time it makes you pull the slot machine lever again vastly outweighs that.