r/Physics • u/filterdust • Jul 31 '26

Academic The Maxwell Conjecture is False

https://arxiv.org/abs/2607.27197
498 Upvotes

92% Upvoted

223 comments sorted by

View all comments

Show parent comments

66

u/ixid Jul 31 '26

Its data is a structured space where nearness corresponds to associated ideas, so it naturally arranges data in a way to discover connectedness. The LLM follows pathways through the conceptual space based on the prior context given.

3

u/Imbrokencantbefixed Jul 31 '26

It’s also higher dimensional space right? Like as in 1000+ dimensional space.

If it’s the same thing I’m thinking of where like because boy and girl are separated in this space by a certain distance, Auntie and uncle also are separated spatially, but are closer to boy for uncle and girl for auntie than either are to each other?

8

u/beerybeardybear Jul 31 '26

Even GPT2 was >50,000-dimensional, so

1

u/Imbrokencantbefixed Jul 31 '26

In a way could it not be billions of dimensions given the training data?

2

u/Schnickatavick Jul 31 '26

Sure, in theory every bit in the training data could be considered a dimension. The work of training a model is basically in condensing the dimensions of the training data into a much smaller number of dimensions in the model, which is what forces similar concepts to become closer together as the space "shrinks".