Google is in a different position to others in that they're the only frontier lab with a cloud infra business. It obviously makes sense to sell GPUs on cloud infra as people want to rent them. In that respect Google buys a ton of GPUs to rent out.
What's unclear to me is how much Google uses GPUs for their own stuff. Yes Gemini runs on GPUs now, so that Google can sell Gemini on-prem boxes (recent release announced last week), but is any training or inference for Gemini really happening on GPUs? This is unclear to me. I'd have guessed not given that I thought TPUs were much cheaper to operate, but maybe I'm wrong.
Caveat, I work at Google, but not on anything to do with this. I'm only going on what's in the press for this stuff.
It mentions that Gemini can run on eight NVIDIA GPUs, but not which GPU and which Gemini model. Either way, this puts an upper bound of 288 * 8 = 2304 GB on the size of the Gemini model, which as far as I know has been a secret until now.
I have most likely outdated info, I left Google Research 4y ago. Back then, available TPU instances were plenty and GPU scarce. Nobody wanted to mess with an immature crashing compiler and very steep performance cliffs (performance was excellent only if you stayed within the guardrails, and being outside was supported and not even resulting in a warning - as it was so common in code).
But I believe most of it has changed for the better for TPUs.
they all hope to make lot of money of of it.
meshcore has a marketing team spamming reddit all day and a mao to make you believe people use it right now. then you connect to yhe mesh and you're utterly alone there. at least meshtastic has real users lol.
so if China has the data good, us has the data bad, got it lol.
us actually has laws around this and they arent sharing very much with thr us gov today. china shares 100% as required by law. and neither care much about "how long do i cook eggs for", but they do care about code generation a lot.
From an espionage perspective your own government is the safest. But from a civil rights perspective your own government is your most immediate threat. China isn't going to arrest me for my opinions on Netanyahu, my own government could
And the US government has repeatedly shown that it is very interested in collecting all the data available, just like China. In China this is simply done in the open while the US has a veneer of protection for citizens. But where the data collection is forbidden by law they either ignore the law or ask another five eyes member to do the spying and share the results. Both are well documented
> China isn't going to arrest me for my opinions on Netanyahu, my own government could
I don't know whether you really believe this or it was an off the cuff remark. China is not going to tell you why they plan to arrest you. China is not a benevolent dictatorship.
The actual offense isn't important, nor is whether they arrest me or just kick in my door and look through my stuff. What matters is that if I'm not in China I don't have to particularly care what Chinese officials think about me. My local police can kick in my door, Chinese police can't. At least as long as I stay out of China
As a matter of fact, there's been multiple reports of the Chinese doing informal, heavy "policing" of their own citizens abroad. Even if you aren't Chinese or linked to China yourself, this does affect the strength of that particular argument.
> so if China has the data good, us has the data bad
It's not that, it's about relative risk to your own life. Asking questions about "DEI" for example is much more likely to have adverse effects on your life if you ask Grok or an OpenAI chatbot, though still not that likely.
I know it's the norm to criticize the admin, but I don't think its what they're saying. I think they're saying "they know of the vulns they leave in and only fix them after it's been exploited by their states".
Not that any consumer router is super nice and safe, honestly, you're better off making your own these days.
reply