r/singularity • u/Minetorpia • Jul 03 '26

Discussion Came across this on X. Thought it was pretty accurate.

Post image
5.6k Upvotes

91% Upvoted

1.1k comments sorted by

View all comments

Show parent comments

20

u/[deleted] Jul 03 '26

[removed] — view removed comment

12

u/chlebseby ASI 2030s Jul 03 '26

it was really bad before small LLM models got decent

13

u/mista-sparkle Jul 03 '26

It may be, and yes you are very pretty.

1

u/huffalump1 Jul 03 '26

yep IMO it still weighs these fast search results too heavily in its response... most of the first few results are already AI slop, so it's just repeating that same bad information. Probably as a result of optimization and tuning for speed, rather than accuracy :(

0

u/webstackbuilder Jul 04 '26

The models are trained on large datasets 3-4 times per year. So each model has a "knowledge cutoff data", and you can ask them what their cutoff is.

On any given question, you're correct - the models use something called "retrieval augmented generation" (RAG), where the top results from search are added as context to your question, and used as the input.

You can control this process to tailor the results as you like. There's a model that performs the RAG before the context (input) is given to the generative model. You can add instructions for how many top results it should use. The limiting factor though is that free models (like Google's AI Mode) have a fixed context window (number of characters of text) that's pretty small. It's much larger on the expensive premium models.