I've done the opposite, moving multiple tightly coupled repos into a single monorepo. Saves the step of the llm realizing there's a bigger context, finding the repo, then also scanning/searching it. Especially for fixes that are simply one line each in two repos.
I'm a fan of the monorepo in general, even before LLMs. If using git it leverages git's best feature IMO, the commit as a snapshot of the entire repo. I've worked on so many projects where tightly coupled things are split across repos because it's thought of as a best practice, and it just makes it more difficult to figure out what code you are running.
I think the industry has already agreed to give this product category to Apple. Everyone needs a phone, but only specific types of users need a tablet. Apple's tablet is Good Enough for everyone, and they last forever. The o.g. iPad Air we bought in Nov 2020 is still chugging along and we use it... basically only to watch movies on airplane rides etc. And I am primarily a linux/android user, but this is the one Apple device I "use".
If/when it finally dies (we're on year 6) we'll just buy another one, I guess. The biggest risk for our single household tablet is Apple drops support for it. We have no plans to upgrade it ever, so long as netflix and youtube keep working on it.
Apple's tablets are great, but I think we're just pretty close to the limit for these entertainment devices.
I have a now 7(!) year old Tab S5e that I use to consume media, and it's 5.5mm thick, with 10 hours of battery, a 1600x2560 super AMOLED, and quad firing speakers.
Nothing on the market makes me feel I need an upgrade over what was a $400 mid range tablet, because I have an incredible media experience on all my streaming apps.
I still use my iPad mini 2 I bought in 2014 to read books. The only problem with it is that reading books is one of the very few things I can do with it these days as Safari is no longer capable of rendering most websites, most apps are not supported, and generally iOS 12 ate most of the memory device has. So yeah, it's my bookreader still, but nothing more.
I don't know whether to consider the fact that you find a device lasting 6 years an impressive feat as testament to how crappy devices, especially mobile ones, have been for the past decade, or how used everyone is to abandon perfectly good devices just because "it's X years old".
In my case I use my 8.4" tablet to watch free to air TV with a TVHeadend client for Android (no idea if there is one for iOS.) I run a couple of YouTube alternative apps that Google would love to kill. Firefox. Not much else. It's handy as a portable TV set.
The only Apple product I still have is a 2010 ipad 1. Only use it as a clock, violin tuner, and workout timer, but am amazed it's still going like an old volkswagen.
Original gangsta, which has come to mean “original” with a tint of “I respect it”
They’re either using loosely, as in “my first iPad Air purchased”, or tightly, as in "the original iPad Air release", which was in 2013 but could be purchased used, presumably.
It's been around long enough to have gained cromulence, I think.
I started using "OG" ~16 years ago to disambiguate the Motorola Droid that I had (which was the first Android phone available from Verizon) from the Droid 2, 3, and 4 that came later.
"OG Motorola Droid" has specificity, while "Motorola Droid 1" is something that never existed.
Yeah but 10 years late to be described as the original. That said, my parents got rid of their actual OG iPad only 2-3 years ago (did not hold a charge for a long time, finally decided it was time to get one that did).
I had an iPad that Appled forced into obsolecence. I had to throw a perfectly ok piece of hardware on the trash because it was madr unusable by the manufacturer. It's the main reason I despise Apple, including its hardware.
I replaced it with a Samsung A7. It's even better than the iPad as I could sideload a manga reader that syncs with Komga, amazing stuff to read manga.
Yes, I was wondering about this. Old iPads running iPad OS 15 received updates last month. So even an iPad Air 2 from 2014 could receive updates in 2026.
The big issue with old iPads though is that apps drop support for older iPad OS versions. Usually their older versions do keep working, though.
thats pessimistic. do the calc assuming Cloud provider X changes your nondetermistic output every Y Months by Z probability and increases prices by 10% every 6 months.
slow and steady is worth exponentials. keep slopppping it my boid.
Qwen 3.6 27B, and other dense models, as opposed to MoE models do NOT scale well. Like I said in my original post, for 27B usage specifically, I'd take a dGPU with 32GB of VRAM over Strix Halo. I also don't usually benchmark out to 200k, my typical depths are 0, 16k, 32k, 64k, 128k. That said, with Qwen 3.5 122B A10B, I am still getting 70 tok/s PP speed and 20 tok/s TG speed at 128k depth, and with Nemotron 3 Super 120B A10B, 160 tok/s PP speed and 16 tok/s TG speed at 128k depth. With smaller MoE models, I did bench Qwen 3.6 35B A3B at 214 tok/s PP at 128k and 34.5 tok/s TG at 131k.
Because dense models degrade so severely, I rarely bench them past 32k-64k, however, I did find a Gemma4 31B bench I did - down to 22 tok/s PP speed and 6 tok/s TG speed at 128k.
Nemotron models specifically, because of their Mamba2 hybrid SSM architecture, scale exceptionally well, and I have benchmarks for 200k, 300k, 400k, 500k, and 600k for Nemotron 3 Super. I will use depth: PP512/TG128 for simplicity.
Thanks this is very helpful for planning out localLLM buy. Sounds like we are still at least 1 generation out (DDR6 500-700GB/s memory) from getting to that magic ~25-30TG/s. Nemotron 3 Super architecture sounds promising.
Medusa Halo is on my wishlist, but I'm hearing late 2027 :(
M5 Ultra may be a better near-term option, expected in June. Supposedly ~1.2 TB/s unified memory, unsure of whether Apple will revive the 512 GB SKU or limit to 256 GB, but the new Neural Engine in every GPU core should help dramatically. These were always compute limted rather than bandwidth limited, even in M3 Ultra era.
The big cost of course being that you're locked into Apple silicon and Apple's walled garden. You can still use MacOS without creating an Apple account... for now...
At least Apple Silicon holds resale value remarkably well.
Second hand smoke is a large (almost overwhelming) factor in SIDS. Also for people who don't smoke, it smells f--king disgusting. Nobody wants to deal with that in their life.
United has already cut flights by 5%, the article says KLM is cutting ~1% of their flights, both citing fuel shortages. If giant companies on opposite sides of the Atlantic, are saying this is an issue, it's probably worth taking their word for it
KLM is citing fuel price, not shortage. They’re cutting under utilized flights which they cannot perform profitably at current prices. They’ve explicitly said it’s not because of a shortage.
A shortage can also be physical. The fuel you already bought (and possibly paid for) cannot be delivered. Maybe the actual delivery is the issue. Maybe a government confiscated it for other uses. Or maybe the fuel doesn't exist at all, because the refinery didn't have the oil to produce it.
10 minutes a day of extreme power usage is probably fine for people asking for directions to the store, setting calendar reminders, timers, checking for important emails etc. AI on your phone will be incredibly useful but power usage doesn't matter when total usage is less than 15 minutes per day. I don't think the average person expects to vibe code on the phone for 8 hours a day.
10 minutes a day or 15 minutes a day is what the inference workload is like on fairly small models. Once you start streaming in weights from SSD, things slow down quite a bit and become quite power hungry.
Harbor freight sells three tiers of many of their more popular tools and they're not shy about it. Most of their signage says "ok/better/best" and they're very transparent about what you're buying. I can buy a $9 angle grinder and on the same shelf I an also buy a $85 angle grinder, with the "better" model running ~$25-40. Harbor Freight used to have exclusively cheap junk but their "better" tier stuff is more than adequate for home DIYers
It probably helps that the founder is still the owner. Once that guy or his son dies (he's getting up there) it would not suprise me if the brand spirals into decay.
Hottest day of the year in the US varies by 3 months from California to Texas, which is only about half the width of the country. I would imagine the region you're in has a different hottest day of the year from say Kashmir or your neighbor Sri Lanka.
I don't know whether to call it a corner case or not, but I was pretty easily able to find this one (based on my own experience – the peak temperature in the East Bay has always felt very late in the year): https://weatherspark.com/compare/y/541~3268/Comparison-of-th...
reply