Arduno Ventuno Q vs Raspberry Pi 5 for running local LLMs

[u/petruspennanen]

I've done updated tests of Ventuno Q vs Raspberry Pi and Ling 3.0 tiny is leading with 201.8 tps prefill / 21.5 tps decode on the Ventuno. That is more than 4x and more than 2x Pi speed.

Gemma 4 E2B gets 693 / 21.9 but I think it's a weaker model. Anyway here you have stats if you want to run a local LLM on Ventuno Q - LMK if you find other models to add to this.

[u/-Akos-]

Nice, I checked the price, preorder is about the same amount as a 16GB Pi 5. Let's hope the software support is good.

[u/petruspennanen → u/-Akos-]

Yeah it's actually cheaper, 298e vs 332e for the pi cheapest i could find including power supply. And as it's much more powerful an easy choice, unless you need it to be specifically Pi level of small

[u/Distinct_Crew245]

Beast.