Hacker Newsnew | past | comments | ask | show | jobs | submit | mghackerlady's commentslogin

I'd imagine cooling? I could be wrong but a lot of the cost is there and putting what's effectively a megawatt scale electric heater certainly isn't going to make that any cheaper

I know nothing about the inner workings of a large scale AI datacenter but I'd imagine the power and cooling requirements are more specialised than your average datacenter that mostly has to handle transmitting large amounts of data over the internet (not that that isn't computationally expensive, I just imagine LLMs (especially at the current scale of their deployment) are much more demanding)

> I'd imagine the power and cooling requirements are more specialised than your average datacenter

But are they actually doing things differently than the high compute parts of the hyperscaled datacenters? Are there radical new ways of distributing heat in the datacenter that only makes sense at that level of energy usage per square foot? Is AI energy use that much higher per square foot of other high-compute parts of datacenters, or is it just that its now something like 90% of the floor plan versus maybe only 50-60%?

> handle transmitting large amounts of data over the internet

I certainly can't speak for all datacenters, and I've never been in a hyperscaler datacenter. But of all the datacenters I've spent time in, the space for the outside network connectivity was rather small compared to the rest of the space for storage and compute. Think a few small office suites dedicated to outside networks coming in and connecting to the clients in the datacenter compared to a medium to large sized warehouse full of compute and storage.


There's "high compute", and then there's proper HPC. AI these days is way more on the HPC end of the scale. The GPUs are doing computations using 2-bit and 4-bit numbers and not 64-bit, but everything else is going to be comparable.

they'll get one when the openbsd maintainers become millionaires

unless you're talking about doom 3 (which I can't really speak on), doom is from the 90s and was shareware

unless you run it on an OpenBSD system, in which case you can

probably because I don't have a guitar

I wish microsoft would have been forced to make the entire windows API an ISO standard if they wanted OOXML to be one so bad

please no. no js in anyone's inbox. please. (I do think attaching a gif to the email is a good idea though ;) )

I've got a little icon on my desktop bar that gives me a random bash.org quote. God I miss that place

the way we're headed (and largely already are) "turning off and disconnecting" will be a privilege of the rich and dream of the stubborn

Indeed. “Privilege of the rich” could be the subtitle for the biography of America. Perhaps founded on the basis of rights for all men, but always denying or chipping away at those rights for the classes of labor.

I’m always cheering for the farmers who are taking on John Deere for the right to repair.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: