I’ve assumed the memory shortage is more than just an unfortunate byproduct. To the extent that LLMs have any use, its a threat to the datacenter model if people realize they can be run well enough locally. Hearing stories of datacenters hoarding hardware they can’t use yet make me think they want extra time for people to get used to the norm of subscribing to a service. I’d love for a reporter to ask Sam Altman if he’d be happy to see consumers get access to cheaper ram again.
I’ve assumed the memory shortage is more than just an unfortunate byproduct. To the extent that LLMs have any use, its a threat to the datacenter model if people realize they can be run well enough locally. Hearing stories of datacenters hoarding hardware they can’t use yet make me think they want extra time for people to get used to the norm of subscribing to a service. I’d love for a reporter to ask Sam Altman if he’d be happy to see consumers get access to cheaper ram again.