Error 2020: Too Slow

Status
Not open for further replies.
Null said:
That looks good. What I'm probably going to do is RAID6 a 256GiB SSD and then RAID6 4TiB HDD, so I'm going to need 8 SATA slots. I'd also like more logical cores.

I'm very tempted to get two new servers, actually. One strictly for PHP and then an AMD Threadripper for reverse-proxying, and offer to reverse-proxy any contentious sites that'd like to have me handling their email complaints.
Click to expand...

Speaking from significant experience running databases on arrays, be a little careful since 6 will significantly limit your writing performance.

Of course, going SSD will make up for that a bit...
 
Broadwing said:
Speaking from significant experience running databases on arrays, be a little careful since 6 will significantly limit your writing performance.
Click to expand...
As I said, the database is on its own SSD hardware already. It got way too big for just the one.

xr95 said:
You should just get a epyc processor, should be enough for 50 cycles
Click to expand...
How would 64x2.0GHz be faster than 8x4.1GHz or something? Would imagine faster/fewer is better for PHP. Like I said, maybe an epyc for an NGINX reverse-proxy shared with sites like ED.
 
Null said:
That looks good. What I'm probably going to do is RAID6 a 256GiB SSD and then RAID6 4TiB HDD, so I'm going to need 8 SATA slots. I'd also like more logical cores.

I'm very tempted to get two new servers, actually. One strictly for PHP and then an AMD Threadripper for reverse-proxying, and offer to reverse-proxy any contentious sites that'd like to have me handling their email complaints.
Click to expand...
Are there any blade servers that use Threadripper? It's more of a prosumer product.
 
Cosmos said:
I’d love to see another merch run! You should bring back some of the old stuff, too, I remember there being really cool designs I wasn’t able to buy at the time.
Click to expand...
I'm still mad I missed the void tbh
 
So I have this 3d printer I've been playing around with. If you want to, I can help with the fundraiser by providing a small knick knack people can purchase from your merch shop. My ability to fulfill orders would be limited to the capabilities of my printer (as in, how fast I can print).

If I get your permission, @Null, I can design a small kiwi farms model, which you can sell and I can ship via the US (though I would need to be reimbursed for shipping, since that can get expensive).

Something like this

Kiwi Bird found on #Thingiverse https://www.thingiverse.com/thing:2122334

Or maybe a KF logo in 3d. I have discord or I can discuss details in PM. Whichever works. Or ignore this if you aren't interested. I just really like this site and printing filament is pretty damn cheap.

Examples of shit I've made
20200128_100807.jpg20200129_111247.jpg
 
Last edited:
  • Winner
  • Like
  • Semper Fidelis
Reactions: TheTism35, NoFeline, Blackh0le and 12 others
Consenticles said:
So I have this 3d printer I've been playing around with. If you want to, I can help with the fundraiser by providing a small knick knack people can purchase from your merch shop. My ability to fulfill orders would be limited to the capabilities of my printer (as in, how fast I can print).

If I get your permission, @Null, I can design a small kiwi farms model, which you can sell and I can ship via the US (though I would need to be reimbursed for shipping, since that can get expensive).

Something like this

Kiwi Bird found on #Thingiverse https://www.thingiverse.com/thing:2122334

Or maybe a KF logo in 3d. I have discord or I can discuss details in PM. Whichever works. Or ignore this if you aren't interested. I just really like this site and printing filament is pretty damn cheap.
Click to expand...

I would buy the shit out of little KF figures
 
  • Agree
  • Like
Reactions: Sparklepants, CashMoney!, A Weddell Seal and 4 others
Consenticles said:
So I have this 3d printer I've been playing around with. If you want to, I can help with the fundraiser by providing a small knick knack people can purchase from your merch shop. My ability to fulfill orders would be limited to the capabilities of my printer (as in, how fast I can print).

If I get your permission, @Null, I can design a small kiwi farms model, which you can sell and I can ship via the US (though I would need to be reimbursed for shipping, since that can get expensive).

Something like this

Kiwi Bird found on #Thingiverse https://www.thingiverse.com/thing:2122334

Or maybe a KF logo in 3d. I have discord or I can discuss details in PM. Whichever works. Or ignore this if you aren't interested. I just really like this site and printing filament is pretty damn cheap.

Examples of shit I've made
View attachment 1128409View attachment 1128410
Click to expand...

j666 said:
I would buy the shit out of little KF figures
Click to expand...

We can create Dungeon Dice Monsters but the monsters are lolcow figures. Can anyone defeat my 3 Blue/Green-eyed Stripped Dragons?
 
  • Like
Reactions: Knyttet, Book Thievery and j666
Null said:
After talking with someone who knows more than I do about hardware, we've deduced the issue is that:
We store 1.5 TiB of static content on the site. This data is accessed all the time. I tried to save money by buying a big HDD, but this is becoming a problem. As we store so much and it's accessed so often, the one harddrive is bottlenecking the site. As a test, I disabled the Cloudflare's CDN, which automatically caches and serves a lot of static content for us. Doing this instantly threw the disk into 100% utilization and crashed the site. As it stands, we already over-utilize what resources I have and only because I've optimized CF to aggressively cache is the site not already dead. The problem will get worse as the site's archive and the utilization of the archive continues to grow.

4+4x3.4GHz is probably just not good enough for a site this size anymore, at least for the front end. I've been fine tuning things since Chch trying to tard cum the server for everything it's worth and now we're at a limit. I have an entire server dedicated to the backend that is on better hardware with more redundancy, but now I'm going to need to move the front end onto its own hardware. Currently, the KF frontend cohabitates a smaller blade with some other smaller sites.

Also, CrunkLord420 runs the Matrix/Riot and Pleroma instances on Server 4, and that server itself is running out of disk space.

Consider donating via crypto if that's an option for you.

I'm probably going to do a merch run to finance this expansion soon. Will likely try selling stickers since it was highly requested last time. Keep your eyes out for that.
Click to expand...

Just as a suggestion, you could research into Single Layer Cell (SLC) Solid Storage drives.

SLC is "generally used in commercial and industrial applications and embedded systems that require high performance and long-term reliability.
SLC uses a high grade of flash technology that provides good performance and endurance, but the tradeoff is its high price.
SLC flash is typically more than twice the price of MultiLayer Cell (MLC) flash [memory]." (Source)

Getting a 10TiB SLC Drive would not only solve storage issues for many years to come, it would also last for many years (expected lifespan of these drives is 20-30 years under moderate load).

It's the most expensive solution, but will have the least headache (in theory). But you sail this boat, so you determine a Final Solution for The Error 2020 Question.
 
  • Like
Reactions: Sparklepants and one_time_user
Shirts, mugs, stickers, figurines, maybe even a canvas tote? I will buy if any of these pop up. ❤️
 
I can't wait for more T-shirt designs. Take my money!
 
Status
Not open for further replies.
Back