I'm learning how to train transformer models locally to do useful work instead of having to pay for claude. I regularly update my blog here https://seanneilan.com/posts

If it can be used for inference, who cares right? Just have claude vibe code some objective-C or run the Enclave app.

and Claude is remote inference anyway, just an http api

That's very funny. Bravo.

This is exactly what I needed. I've been thinking about making this tool. For running and experimenting with local models this is invaluable.

Does anyone have Jeff Dean's sources for how he computed these numbers? What's the margin of error? How accurate are they now? Is there a set of numbers that also talks about memory bandwidth in GPUs? Are these numbers intel/amd only? How do they differ between an m1 architecture?

It raises so many questions. The only one I want the answer to is: Will these numbers help me reach the Doherty threshold?

For the uninitiated like me :

> Productivity soars when a computer and its users interact at a pace (<400ms) that ensures that neither has to wait on the other.

https://lawsofux.com/doherty-threshold/

My god, it's real!? I thought that was entirely fabricated for Halt and Catch Fire. I swear I looked it up when it originally aired, but didn't find anything. I've been joking about it ever since. I hope no one accidentally took me seriously at work.

I'm a lot happier now being an anthropic customer.

Yes, the CEO's of these AI companies are clearly not the people who should be selling AI products. They need to be hidden away and kept behind closed doors where they can do their best work. And they need advertising companies, PR firms and better marketing tactics to try and soothe the customers.

I don't understand why some of these AI companies check their egos at the door and hire public relations companies. Yes, I understand they are changing the world but customers do not open their wallets when they are scared. Very few people I know are as avant-guarde as I am with AI, but, most people look at these new technologies and simply feel fear. Why pay for something that will replace you?

He knows what he's doing.

It's to drive FOMO for investors. He needs tens of billions of capital and is trying to scare them into not looking at his balance sheet before investing. It's reckless, and is soaking up capital that could have gone towards more legitimate investments.

Yes, this is probably the piece I am not realizing. However, there is no better approach to getting more capital than by scaring people?

> public relations companies.

Sounds like one of the white collar jobs that LLMs were supposed to solve

Learned a lot about local models using them to scrape target.com.

I am at 5 at home, 3 or something shit at work. I don't like wasting money tho.