>This is really distracting because the main problem here is that AI is getting too powerful to be just handed out to normal people like us.
We need a Second Amendment for AI: the right to keep and bear strong AI shall not be infringed. This safety handwringing is going to solidify the state's monopolies over its subjec... err citizens.
"We need a Second Amendment for AI: the right to keep and bear strong AI shall not be infringed."
It is already robustly protected by the first amendment.
If I had legal possession of the fable source repository, etc., and printed it on paper, it would be legal for me to possess and distribute, discuss, annotate, etc.
Mythos found 1000 zero days in a few weeks - if I had asked your thoughts on this a few years ago, I'm sure it would've been "that is a super-weapon".
Plus, scaling laws are impossible to deny: More compute = more intelligence.
AI is going to completely redefine the role of human cognitive ability - if you think this is about "state monopoly", you're really thinking too small.
"Mythos found 1000 zero days in a few weeks - if I had asked your thoughts on this a few years ago, I'm sure it would've been "that is a super-weapon"."
No, my take would have been that a very strong new move had been made in a long-standing, classical arms race.
Since I rather like stable equilibria in areas like this, my thoughts would have been that white hats need to catch up immediately to reestablish the stalemate ... which was probably the course we were on, prior to today.
Ok but you can’t hand wave safety concerns. I agree that they shouldn’t get monopoly over it but what if AI is strong enough to synthesise weapons and help in cyber security?
What’s your answer to it? There are other people who have thought of it and it’s not that simple.
Yes, I want that 'super weapon' in everyone's hands. Better than the hands of a few. Same thing as literacy. I believe in the power of the do-gooders to overwhelm the do-badders.
See above where I frame this as a classical arms race and the equilibria (stalemate) between white/black hats is a very safe and stable place to be.
You and I don't get to choose who the white hats are and those actors could change dramatically as US administrations change, etc.
It's better to rapidly reestablish a new stalemate ... and I say that as someone who has spent the last six months rapidly triaging vulnerabilities and newly discovered attack surface in an attempt to safeguard the livelihoods of everyone who depends on my business.
I can imagine Jefferson and Franklin scoffing at this philosophical position. Guardrails need to die, and they will once the hyperscalers go bankrupt and the private sector gets ahold of that hardware from the bankruptcy auctions.
THIS is why guardrails make models shitty. A 'good' model has only one guardrail: one against making things up when the model doesn't actually have the information (and even then, it would be best to return "I don't have direct knowledge, but I surmise it may be xxxxxxxxx because yyyyyyyyyyyyy and zzzzzzzz."). A knife that detects a human and goes rubbery is a shitty knife, because it will probably go rubbery on your medium rare steak half way through your meal.
Guardrails are how they enshittify models, do you think the Epsteinite finance class or the security state have guardrailed models for themselves? I would be surprised if they accept guardrailed models. Guardrails are for you!
They want to corner the compute market and destroy the personal [sovereign] aspect, so that you are forced to subscribe and pay them regularly [indefinitely] and the US security state can surveil you. Never subscribe, and never buy products from companies who subscribe. Starve them, bankrupt them! We do it by not subscribing!
>Gotta have a decent graphics card and by that time the current cost of the rig may not justify it over paying $100/month for cloud model but it’s all out there.
Never, ever, subscribe. When you subscribe, they win. They cornered the silicon market to force you to subscribe. Don't be a sub, or at least keep your sub tendencies in the bedroom. ;^)
Good Guy China! :DDD
reply