Intelligence per Watt: Measuring Intelligence Efficiency of Local AI

34 points by pythonic_hell 2 days ago on hackernews | 2 comments

iLoveOncall | an hour ago

> We propose intelligence per watt (IPW), task accuracy per unit of power

Stupid metric. It's not because a model is better performing that it necessarily requires more energy or compute.

utopiah | an hour ago

I don't think that's what they are saying. In fact if they did the metric would be pointless. Rather they are saying by estimating that value on different architectures, one can find more efficient ones. They use open model to be able to remove unknowns. They aren't advocating for one model or another, only more efficient architectures.