> Terence Tao (2026) lists many goals of mathematics beyond problem solving. These include developing new theories and techniques, understanding the world, sustaining a community, training the next generation of mathematicians, contributing to cumulative knowledge, and creating works of aesthetic value. Of course, these have been positively correlated with genuine solutions.

> If, instead, mathematicians treat AI as a technology for advancing its long-standing and centrally human purposes, the technology may come to contribute to an accelerated flourishing and enrichment of the discipline.

For the longest time, people who conducted research (not just math) ranked and measured their peers (albeit quasi-subjectively) by 1.) their ability to solve difficult problems, 2.) the cleverness of their solutions, and 3.) the clarity of their explanations.

With the advent of these models, we're understandably worried because #1 and maybe #2 may be gone (maybe even #3).

Are researchers going to shift the ranking/measuring of their peers over to ... "so-and-so is a world-class explainer of AI proofs"?

If you go around telling people, "no no no. You don't understand. The important part of our intellectual work is now going to be <something that was never weighted highly>", well, then it feels like you're handing me a participation trophy and telling me I came in 1st place.

I have no idea how the next 5 years will shake out, but I think that's why there's a lot of anxiety at the moment.

If we (as a species) can genetically modify embryos to make our offspring more athletic, more intelligent, more <whatever>, is that human-RSI?

That's not a gotcha question.

I'm just genuinely curious if that would meet the definition of RSI.

> We already knew we had to do that. But the people in charge of the economy don't wanna.

I've often heard it said that <big corporations> often use consulting firms to recommend unpopular decisions they were already planning to make, thereby offloading the culpability to the consulting firm.

Maybe the LLMs are going to be the ultimate "consulting firm" for our societal issues.

I say this mostly tongue-in-cheek, but we're already offloading a lot of lower-level responsibilities (e.g., "write my email") onto these AIs.

> <big corporations> often use consulting firms

Large organizations also offload decision making when they don't have a clue, and simply want to point to some action taken. The answer doesn't even matter, they just don't want to be responsible for something, or waste their own time making something (that other stakeholders care about) a real priority.

People downplay the value of consultants, but they have many uses!

As a biologist whose PhD research was on the genetics of microbial pathogens, I am far more concerned than the author.

I think he trots out a lot of straw-man arguments (e.g., teenager making the weapon, "super"virus, etc.).

Those scenarios are purposely far-fetched so that he can ridicule them and thereby leave the impression that all the AI/bioweapon concerns are similarly far-fetched.

He spends a lot of "tokens" discussing AI-generated viruses. But bioweapons can be much simpler than a virus--they can be small molecules that inactivate essential molecular targets in humans. This is something that was discussed at length when I was in grad school and it wasn't dismissed as hyperbolic hokum.

So, is AI going to develop a supervirus? Probably not. But it doesn't need to.

Instead, I speculate that AI can "help" in making bioweapons ...

a. more potent

b. less detectable

c. easier to disseminate

You still need humans in the lab to run the experiments, but I think it's foolish to dismiss the worries about AI in such a condescending way.

"they can be small molecules that inactivate essential molecular targets in humans" - aka a poison. I mean we deal with the reality of poisons plenty fine right? This isn't x-risk stuff.

I was an experimental synbio person for decades, and I did plenty of microbial pathogen work. I've also worked on frontier LLMs for the last decade. All of this stuff is gated by experimental effort, not AI!

> All of this stuff is gated by experimental effort, not AI!

My post said you still needed to run the experiments, but if you think AI can't help to improve bioweapons compared to humans alone, I disagree.

Are they straw men if they are specific scenarios presented by widely read commentators? A straw man is when you misrepresent somebody's position to knock it down.

But if Noah Smith wrote about a scenario where 90% of the population is killed by a virus created by some teenagers with an AI... it isn't a straw man to attack that scenario.

Not to discredit your opinion here, but will just point out I am also a PhD biochemist who has worked on viruses, so hopefully our credentials cancel. :)

> no LLM in the world can make them go faster

You mean the microbes have to double n-times (to get sufficient numbers of microbes) before tests can be run on them.

But maybe the LLMs figure out a way to run those tests on microbes that have only doubled 0.1(n-times).

You could then think of the LLMs as being a more honest version of Elizabeth Holmes.

If I remember correctly, the procedure was to prepare a food sample, put it in a temperature-controlled environment for 24 hours, and next day see if something grew there or not. If it did, the food was contaminated.

You could try shortening the time to 6 or 12 hours, but then

1) if something grew then the food was contaminated, but if it didn't, how can you be sure it is good or you just didn't wait enough? You would get a lot of false negatives.

2) the lab followed a normal 8 hours a day schedule, so nobody would be there to analize the results. You would not gain anything.

bioweapons are probably easier.

Killing each other is relatively straightforward. Keeping people alive (e.g., curing cancers) is considerably more difficult.

I imagine that AI augments both our destructive and constructive powers.

> And without mathematicians to ask the right questions

Here, I disagree. What makes you think the AI won't be able to ask the right questions without prompting?

> and able to appreciate the results, why would AI driven research continue?

Here, I think I agree. At some level, there has to be a human in the process that must understand / interpret the results.

I gotta say, however, that I'm not certain about my agreement. I'm worried that I'm missing something where the human can be excised from the process entirely.

> Here, I disagree. What makes you think the AI won't be able to ask the right questions without prompting?

But why would they ask the right questions without prompting? The LLMs have no intrinsic goal to research math problems, it would just be very costly to run queries without a reason to run them... arguably a human in that loop would be a mathematician, but then we do need them after all.

> But why would they ask the right questions without prompting?

What if the models are good enough (maybe even now?) so that all you have to say is "come up with a list of interesting problems overlooked by humans in <insert math discipline>. Then work on those proofs."

I don't think that's so far fetched. Especially given the news today about NS.

I think we know enough about reinforcement learning to tell that it won’t be able to entirely replace human mathematicians. All of the techniques used by these AI firms are well-studied.

> we should be putting this in the water supply...

Talked to a physician last year who said the entire planet should be on GLP-1s.

I worked at a pharmaceutical start-up years ago.

* one of our medicinal chemists had studied nights to become a patent agent (this isn't the bad part).

* he landed a pretty nice job at an IP firm with a considerable raise in his salary.

* we were _in the middle of his farewell party_ when the IT guy told the CEO that during the previous few days the chemist had printed our company's entire library of novel chemical structures and their associated biological activity data.

* in the moment, i had no idea what was happening, but i've never seen someone go from looking happy to absolutely miserable at their own farewell party.

* i do remember that my boss later said she wanted him frog-marched out of the building in handcuffs.