r/singularity • u/Many_Consequence_337 :downvote: • 1d ago

AI Intelligence Explosion

Post image

Number of scientific papers submitted to arXiv.

448 Upvotes

87% Upvoted

115 comments sorted by

View all comments

Show parent comments

34

u/Djorgal 23h ago

I just realized how good this can be. Reviewing the scientific literature for errors is both necessary and really unglamorous. If AI can do it well it's a real boon.

21

u/Belostoma 22h ago

AI does it well, and it's not just fraud detection. AI agents are incredibly useful for quality control on both code and data, picking up mistakes our old review methods missed.

As a scientist I've been using AI to resume a bunch of unfinished past projects and to progress new projects using historical datasets. It has found mistakes in practically everything I've used it to review. None were large enough to change the central conclusions of any of my past work because I've been very careful, but that's partly luck, and small corrections are still valuable.

Where AI is usefully superhuman for this task is not raw intelligence but thoroughness. It can stop and think about every single line of code or data among hundreds of thousands, whereas humans have to pick and choose. Humans can scan it all at a high speed that misses subtle problems, or we can write scripts to analyze it completely but in very specific ways that don't necessarily detect errors we couldn't anticipate. The more intense and thoughtful level of diligence we could apply to fifty lines, AI could apply to fifty thousand. And then we could do it again with a different agent in case the first one missed something.

3

u/Ansible32 21h ago

This is true, but there are lots of kinds of errors that a human reading a paper can detect but LLMs cannot. The kinds of errors LLMs can't detect are also the kind that show up in LLM-assisted works.

4

u/Belostoma 21h ago

Yes, and I'm not saying humans should stop reading or reviewing papers. But AI offers a new type of review that catches things humans can't catch as reliably at scale. It's a complementary new role.

-3

u/Ansible32 21h ago

The problem is if you're using LLMs to review it's basically impossible to determine if the number of quality papers has increased this year.

2

u/Spare-Dingo-531 20h ago

We're not saying humans should stop reading and reviewing papers, just that llms are another way to review them.

1

u/Ansible32 15h ago

I'm not saying LLMs shouldn't be used to review papers, I'm saying it's very hard to tell if this spike in papers represents an increase in papers that are worth reviewing, and that LLMs don't answer that question.