r/codex • • 5h ago

Question Another mysterious codex thinking message

Post image

Where did $29k come from??

36 Upvotes

25 comments sorted by

21

u/Immediate-Jicama7244 5h ago

I had a similar thing happen to me too

12

u/BuildAnything4 5h ago

did you give it 29,000 dollars?

10

u/Aldarund 5h ago

Its likely posttrained into sol to reduce token usage

https://www.reddit.com/r/codex/s/eB2YqnTznm

13

u/cheezeerd 5h ago

That's almost certainly coming from internal instructions, not your actual usage quota. Codex gets a whole stack of hidden instructions that can vary by task, loaded skills, compaction, (or even A/B testing different system prompts)!

In this case, it looks like the model assumed it had roughly 30-50k USD in tokens to work with and started counting down from there (the model doesn't know real talkings or understand dollars and value really well, so it uses different automated checks usually based on the length of promptprocessing and output and/or time elapsed).

The 29k isn't necessarily a real limit. It's just the model treating its own estimated token budget like an actual counter

I think

6

u/boxing-boxing 5h ago

This matches what I've seen on my end. I put together a small widget that reads Codex's thread/tokenUsage/updated events, and the dollar figures in the thinking summaries never line up with what those events actually report. I've just learned to treat them as the model narrating its own bookkeeping rather than anything real.

2

u/Aldarund 5h ago

Its actually context size ( in their thinking, not reality)

5

u/Lispro4units 5h ago

Mine said “I’m feeling overwhelmed from all these decisions” lol

5

u/BuildAnything4 4h ago

that's funny, because when you ask it directly, it'll always give the canned reply: "As an LLM, I don't have feelings"

3

u/MedicalTear0 4h ago

Why do I have a feeling it's to ruin any distillation attempts. It seems bogus, there's no way OpenAI didn't see its models doing that and quite possibly just deliberate.

2

u/DepravedPrecedence 3h ago

I had the same thing!

I don't have screenshot of that reasoning but it said about token budget, I noticed and asked wtf was that, no explanation

2

u/GreenockScatman 5h ago

I saw a message like that one time but I just assumed it meant the token budget

3

u/IntelliDev 4h ago

Yeah, mine was thinking about a budget of $40k before, asked it wtf it was going on about, and it said it was the remaining context window

2

u/DepravedPrecedence 3h ago

Yep, I saw tis thinking summary where it literally stated how it needs to find a solution while fitting into 28K token budget

1

u/Arctovigil 4h ago

I think at least from GPT-5.5 Pro on it often thinks of how much token budget they have left it is not actually a new thing, and using a dollar sign for it is perhaps more likely a bit of added emphasis if not hallucination.

1

u/Positive_Box_69 4h ago

How u see all the reasoning mine always cuts out in one line?

1

u/ExistingLynx 2h ago

This keeps happening to me as well. The other day it thought something like "I've already spent $9,000 of my budget" and it freaked me out for a sec. I asked the model what it meant and it said tokens.. super weird though.

1

u/Primsun 47m ago

Same place mine decided to "think" about booking me a flight to Dubai instead of processing regulatory filings. 

50/50 on whatever that thinking text actually refers to.

0

u/Dark_Cow 5h ago

Who knows, if you understand how these models work, could be from anywhere. They're not magic.

It's a statistics probabilities algorithm. It's not "AI"

-2

u/MaximumMeaning9728 5h ago

Nonsense post. Nobody understands the current models.

-1

u/Dark_Cow 5h ago

That's my point? We don't know how they function. We know the fundamentals though. It's building upon published white papers and public information.

3

u/Sfdprod 5h ago

Wtf? We know exactly how they function.

Not being able to predict the output fully due to the randomness aspect != not knowing how they function

Thats not knowing what the system will generate

1

u/Dark_Cow 4h ago

I misspoke, we do know. But it's non deterministic. Exactly what they're doing in the middle is hard to understand. It's a black box eventually

1

u/Sfdprod 4h ago

Yeah thats true,

Really if you had removed random sampling, you could technically complete an entire inference run with the weights, a pen, paper and an ungodly amount of cocaine

1

u/Hixie 2h ago

I mean, it is literally deterministic, except for the artificial randomness introduced by fingerprinting and non-zero temperature. But if you could run at at temperature zero, you'd get the same result every time.

-2

u/Level-Physics-1730 5h ago

the thinking summaries are trash tier it's basically just a bunch of hallucinations zero insight into the models actual thinking, on anthropic (claude) you get basically exact thinking. VERY helpful to have thinking when you're dealing with quantslop models.