New hardware

[Swede]

Thanks to the donors I didn't have to put up all the money for a new server myself. :thanks:

We're now on 20 cores instead of 4 so you should notice a quicker response. I'll be monitoring the load closely for some time to make sure we can cope with the AI-bot-storms that roams-the-earth.

/Swede

Some stats from this month:
http://leffster.se/forum0526.png

[Z2697]

Do we have backup(s)?

[Selur]

Nice! Thanks for the info!

Do we have backup(s)?
Real man, don't need backups,.... but real man cry sometimes. ;)

Cu Selur

[Columbo]

I would be shocked and amazed if Swede did not do backups.

[Swede]

I've been around for to long to not have backups...
The schedule is that every week the database is archived to a NAS, RAID-5, and there are 2 months worth of backups saved. Since that NAS is physically at my place it gets synced to another NAS, RAID-1, somewhere else.

So, the only thing not backed up is myself...

/Swede

[microchip8]

20 cores? Can't be AMD as they don't have 20 core CPUs. Must be either Intel or ARM? I'm guessing Intel, yes?

[Swede]

20x 12th Gen Intel(R) Core(TM) i7-12700T (and yes, for all you die-hards out there, it's 20 threads not cores, but hey, who's counting?) :o
And at least they're all ours, no shared HW at my place!

[hajj_3]

which model was the old cpu?

[Swede]

Intel Core i5-7400T

[microchip8]

Intel Core i5-7400T

Ha! I have the same one in my NAS, but without the T. It's a Kaby Lake generation (improved Skylake)

[Z2697]

I have the same one (w/o T) in my old laptop :)
The laptop is a pile of components now but the CPU should be functional... in theory.

[rwill]

New user record today, 86k. The spiders scale with the resources available...

[huhn]

where did you get the ram from? so i'm the only one that has gone AMD for consumer grade mainboards with ECC(not reg)?

[Z2697]

New user record today, 86k. The spiders scale with the resources available...

We need Anubis :)

[Swede]

Kind of fun sitting here, listening to the servers humming quietly at "Currently Active Users: 71850" :cool:

[Columbo]

Just curious, do you just allow anything to come in and request stuff? No anti-bot/scraper mitigation?

[Swede]

Well, I do IP-ban some networks, mainly Alibaba and the likes, but other than that I just take what the throw at me. The problem with all the anti-something is that there will always be false positives, legit bots and users. And there is the (small) annoyance with all these 'Wait while we decides if you are worthy'-pages.
I also don't like the aproach that some of those anti-scrapers have, like Cloudflare, as they might listen in on your 'https-secure' traffic.

Besides, I guess with all this traffic, ~4-5 mil hits / day, it will cost me some money.

[Z2697]

Perhaps, only anti-bot the "Guest" visitors?

[clsid]

Perhaps adjust cache-control and expire headers based on user-agent or ip-range? So spiders update less often.

[Z2697]

Perhaps adjust cache-control and expire headers based on user-agent or ip-range? So spiders update less often.

"AI" spiders break rules (e.g. robot.txt). I don't think this will help.

[huhn]

Well, I do IP-ban some networks, mainly Alibaba and the likes, but other than that I just take what the throw at me. The problem with all the anti-something is that there will always be false positives, legit bots and users. And there is the (small) annoyance with all these 'Wait while we decides if you are worthy'-pages.
I also don't like the aproach that some of those anti-scrapers have, like Cloudflare, as they might listen in on your 'https-secure' traffic.

Besides, I guess with all this traffic, ~4-5 mil hits / day, it will cost me some money.

where does the cost come from no flat rates?

[Swede]

Gah, sometimes the universe seems to be against you! This blackout had nothing to do with bots or new servers or anything. It was a major breakdown of my providers backbone here in my part of the world.
Hopefully all new IPs and so forth will update shortly.