Probably purged some C2 entries too.
The actual blog post on this is more interesting.
Cloudflare’s blog posts are always more interesting. They have a really good postmortem process.
Thats wild. The last part about using the savings for their cache, did they mean the CDN type stuff or was that something related to the 1.1.1.1 stuff?
Either way their plans to use the new excess for the cache will further make things faster for everyone.
thank you for sharing this. very cool read
That logo looks like an ass crack.
You should probably see a doctor about that.
Looks like a cloud and a lens flare to me.
One silver lining about the component restraints, hopefully it drives people to start creating efficient software again. Actually optimizing what you’re doing to save on RAM rather than a gig per tab in Chrome.
Doubtful. Google doesn’t give a shit if you have 8 gigs or 64 gigs, they’ll keep shoving more functionality into Chrome and force the W3 specs that nobody asked for. Some of the worst offending websites when it comes to performance also want you to use their mobile apps anyway (think reddit, facebook).
Anyway, there’s a saying that I heard as a backend dev at a company using Java and Spring: RAM is cheap, devs are expensive. RAM going up 5x hasn’t REALLY changed that… Unless you’re at Cloudflare’s scale, where a small change amounts for 100 TB total across a bunch of servers on multiple continents, which would’ve been expensive even before the prices went up. But in their case, that’s across a bunch of machines so it won’t necessarily mean a big enough decrease in RAM usage per server to spec less RAM on future servers. Rather, they have a bit of extra RAM to play with.
Chrome treats itself as the OS and in some cases they are right do so, but there is an actual OS already running behind it that can’t give up things just because chrome thinks they can do it better. It would break other things.
Chrome is inefficient because there’s no universal agreement on what it should actually be responsible for. So it just does everything.
Oh wow, now that’s some powerful wishful thinking!
Sure, who knows, it could happen!
“Claude, make this software more efficient.”
“Claude, analyze this software’s memory usage to see if there’s anything that could be trimmed without a major rewrite”
“Yes, I can drop truncate the DB for reduction in RAM and memory usage.”
“I went ahead and did it.”
Considering some engineers I’ve met that might actually be helpful, at least in the short term, who knows what long term issues AI code will create
Wish that was the case for a lot of new video games instead of relying on DLSS or FSR to cover up their poor optimisation
Picture the level of quality and performance we could have if we had both traditional optimization AND upscaling optimization AND frame gen optimization.
Cause holy fuck the number of times I’ve seen fsr/dlss slaped onto a game and no effort put into making it perform well.
Cause there IS work you can do to make fsr/dlss actually look good and perform better.
What makes you think nobody does traditional optimization anymore? UE5 is so hard to get to run well, you do need to do all kinds of shit to make a game run well. I suspect most of the games you’ve noticed not running very well, are UE5 games.
Do you know of any games where this is the case? I would love to see a case study where an optimized game benefits from DLSS/FSR in a way that makes it get ridiculous amounts of FPS.
I’m in a community making open source firmware for the Centauri Carbon 3d printer. The thing has 128MB of of RAM. The smarter people in the community worked some magic getting Klipper working on these things, and we’re still fighting to shave off a couple more MB in average use to get things working smoother.
Fellow OpenCentauri member 🤝
Hell yeah! I’m Ember in the server
Talk to the folks running Linux on sn esp32! That’s some shrinking
A Lemmy community? Mjnd sharing the addy?
Discord server, sorry
Discord’s stranglehold is an oof given it’s basically the opposite of private and 100% scrapes data. Even had bots invisible on servers caught scraping once or twice
Farts. Well. Have fun, then! You can have my fun, too lol
Seems to me like everything is instead becoming even more bloated with AI stuff. A Google chat tab uses 2 GIGABYTES on my work computer.
Yes!
stupid RAM price benefit: reduce bloat
AI IS THE GREATEST THING TO HAPPEN TO MANKIND (ignore literally everything else)
I never even thought about this before, but what kind of hardware is a root level DNS server like 1.1.1.1 or quad 8 run on? Are they all roughly the same, or do they take different approaches to the load?
In a previous role at an Internet provider, I was the network engineer in charge of the Anycast DNS cache servers. The company made it some sort of point of pride to buy the cheapest hardware possible. I guess that is the beauty of anycast, failure recovery is pretty much automatic.
Anyways, the servers were dead cheap, single power supply, single SSD. They ran BSD, but my system engineer and I wanted to convert them to Linux, so we ran a proof of concept for switching. We ran performance tests against the same server hardware with BSD and with Ubuntu, I think we saw loss on the BSD server at 325k QPS and Ubuntu made it closer to 500k QPS. Oh, we had like 16 of these caches and our peak load network wide across all of them was something like 36k QPS.
It was a pretty cool setup. If I am remembering correctly we used unbound, ExaBGP, IPTables, and a health check script that would trigger the advertisements to our core network. Although we really wanted to switch to Linux (or rather away from BSD), we were primarily driven by the fact that Cisco IOS-XR does not support DNS query IP SLA tests, which we used previously to trigger the route advertisements.
Cool. What is the file size of the DNS database being quarried with each request anyway? My knee jerk assumption is that it’s like a petabyte, but the longer I think about it, the smaller it gets.
I actually don’t remember, I was mainly focused on the BGP configurations and data collection for presenting to our leadership. I think unbound allowed you to configure the cache size. Our servers were just cache servers, so if they did not have a record the server would just recurse the request.
Bit of a nitpick, but these providers are not running root servers. They’re just recursive caching servers, probably running unbound.
If you want to find out root servers - dig for
.- that’s a dot. A full stop. That’s the root. Those can then answer where to find your .coms, .nets, etc. Those, in turn, handle the domain you rent; so on and so forth.Look up how Cloudflare does anycast BGP. They have servers in data centers everywhere and leverage the fact that they can all be 1.1.1.1 so people’s queries only hit the physically closest server, it’s pretty cool
Most probably off-the-shelf hardware, but with software optimized out the wazoo. Like, reading directly from SSDs instead of using a filesystem. Or more likely using an in-memory database like Redis, perhaps with custom additions.
I knew a guy who went on to work for CloudFlare. Back at that job, he made a write-only static-file storage in Node.js, dumping the contents into a giant file bypassing the filesystem and its metadata overhead. That’s the kind of optimization you want — pretty similar to what database engines like MySQL/PostgreSQL do (iirc one of them does in fact support using a plain disk partition for the database).
Back in early-mid 2010s I’ve read an article on Pornhub’s architecture. They ran Redis behind Haproxy load balancers. An in-memory database, behind load balancers. Some people say that it’s normal, but I’ve never had conditions calling for such a thing instead of sharding harder.
Dang. They do it all in one Pizza box. I figured it would be a whole rack per unit.
I’m actually surprised that they use some beefy servers. Like, Google famously use shitty and cheap commonplace hardware, but in large numbers, so it’s easy to replace when it croaks.
40 bytes are saved, exactly this amount.
40 bytes, per record. 533 bytes per entry. 3-4 GB total savings on an instance.
I think you missed what I was doing, count the characters
oh! lol
