I was going to call BS
As the early text implied that it's not been possible to run models locally until now. The differentiating feature looks like it's that their solution supports distributed systems and so is scalable.
They mention the huge amount of power consumed by data centres - I'd like to know if multiple end-user clusters is actually more energy efficient.
(
tarka_dall Like normal dall, only a bit more spicy, Fri 9 Jan 2026, 7:01,
Reply)
I can't see any possible scenario where lots of small local clusters are more energy efficient than a large data centre.
These servers are massively power hungry, but also massively efficient. They need to be. A 1% increase in efficiency across an entire datacentre is a fucking enormous increase in compute/decrease in energy consumption. The stakes are far higher than making a local node 1% more efficient.
(, Fri 9 Jan 2026, 7:11, Reply)
That's as I suspected
So promoting their product based on the fact it avoids power-hungry data centres is rather misleading.
I can see that there are use cases where it would be justified but why muddy the water with BS?
(
tarka_dall Like normal dall, only a bit more spicy, Fri 9 Jan 2026, 16:52,
Reply)