I mean they did execute a wealthy banker a couple years ago. So I think the mercantile class occupies a different place in society there than in America
One thing I will give to them is the MSVC ecosystem. (Something something developers)
No doubt it’s starting to show its age but it’s like watching a lion die. Win32 amenities just being automatically available is quite sick and I wish there was something similar for Linux.
It’s like windows devs and users live in alternate realities, I’m sure a lot of cool things can happen if they bring some of that dev love over to their UX.
I'm not disagreeing that humans 200,000 years ago were approximately anatomically equivalent to humans today; I'm disagreeing that they would be just as intelligent without today's language, technology, or knowledge. I don't think you can define or measure intelligence in a way that ignores those things.
Eh I don’t think it’s something we can ever discount. Some cavewoman could’ve daydreamed the entire theory of general relativity in her own private language while weaving a basket and we would never know because she never felt the need to talk about it. On the other hand there are people today who will emit novels of profound nothingness.
Technology and language is sort of like speaking in this sense, it’s evidence of mind but it’s not mind. And the absence of evidence is not the evidence of absence and all that
It honestly seems a little control freakish to think this way. People leave companies and that’s a good thing, they explore the industry and generally become more capable. If you leave on good terms there’s nothing holding back a renewed relationship, now with the added benefit of new perspectives; maybe meeting at conferences or working on a project. My gut is telling me these companies don’t part on good terms with their employees.
The reason LLMs fail today is because there’s no meaning inherent to the tokens they produce other than the one captured by cooccurrence within text. Efforts like these are necessary because so much of “general intelligence” is convention defined by embodied human experience, for example arrows implying directionality and even directionality itself.
I’d like a source for that. College graduates are no longer at an employment advantage compared to their uneducated peers. The average age of a new hire increased by 2 years over the past 4 years.
Young people in the west have definitely seen declining salaries, if only by virtue of the fact that they’re not being offered at all.
Money and power don’t usually make you smarter, in fact they usually make you dumber. You can have every anti social belief and the intentions of the antichrist, but if you’re smart and run your system well everyone will still benefit.
AI actually has some optimizations unique to the field. You can in fact optimize a model to make it work; not a lot of other disciplines put as much emphasis on this as AI
Yes, in "runtime optimization" the model is just a computation graph so we can use a lot of well known tricks from compilation like dead code elimination and co..
For inference assorted categories may include vectorization, register allocation, scheduling, lock elision, better algos, changing complexity, better data structures, profile guided specialization, layout/alignment changes, compression, quantization/mixed precision, fused kernels (goes beyond inlining), low rank adapters, sparsity, speculative decoding, parallel/multi token decoding, better sampling, prefill/decode separation, analog computation (why not) etc etc.
There is more to it, mentioned 4 categories are not the only ones, they are not even broad categories.
If somebody likes broad categories here is good one: "1s and 0s" and you can compute anything you want, there you go – single category for everything. Is it meaningful? Not really.
reply