Error 2020: Too Slow

Status
Not open for further replies.
A bit over kill but what about something like this?
Screenshot_20200202-200839.pngScreenshot_20200202-200850.pngScreenshot_20200202-200845.png
 
Last edited by a moderator:
  • Like
  • Thunk-Provoking
Reactions: karz, Marvin and PonelessBizza
Null said:
After talking with someone who knows more than I do about hardware, we've deduced the issue is that:
We store 1.5 TiB of static content on the site. This data is accessed all the time. I tried to save money by buying a big HDD, but this is becoming a problem. As we store so much and it's accessed so often, the one harddrive is bottlenecking the site. As a test, I disabled the Cloudflare's CDN, which automatically caches and serves a lot of static content for us. Doing this instantly threw the disk into 100% utilization and crashed the site. As it stands, we already over-utilize what resources I have and only because I've optimized CF to aggressively cache is the site not already dead. The problem will get worse as the site's archive and the utilization of the archive continues to grow.

4+4x3.4GHz is probably just not good enough for a site this size anymore, at least for the front end. I've been fine tuning things since Chch trying to tard cum the server for everything it's worth and now we're at a limit. I have an entire server dedicated to the backend that is on better hardware with more redundancy, but now I'm going to need to move the front end onto its own hardware. Currently, the KF frontend cohabitates a smaller blade with some other smaller sites.

Also, CrunkLord420 runs the Matrix/Riot and Pleroma instances on Server 4, and that server itself is running out of disk space.

Consider donating via crypto if that's an option for you.

I'm probably going to do a merch run to finance this expansion soon. Will likely try selling stickers since it was highly requested last time. Keep your eyes out for that.
Click to expand...

I've pledged $10 a month on MATI.com. All that I ask is you bring back 2:3 ratio avatars, and I'll stay subscribed forever.
 
  • Like
Reactions: spiritofamermaid, Marvin, BoJack Horseman and 3 others
Null said:
After talking with someone who knows more than I do about hardware, we've deduced the issue is that:
We store 1.5 TiB of static content on the site. This data is accessed all the time. I tried to save money by buying a big HDD, but this is becoming a problem. As we store so much and it's accessed so often, the one harddrive is bottlenecking the site. As a test, I disabled the Cloudflare's CDN, which automatically caches and serves a lot of static content for us. Doing this instantly threw the disk into 100% utilization and crashed the site. As it stands, we already over-utilize what resources I have and only because I've optimized CF to aggressively cache is the site not already dead. The problem will get worse as the site's archive and the utilization of the archive continues to grow.

4+4x3.4GHz is probably just not good enough for a site this size anymore, at least for the front end. I've been fine tuning things since Chch trying to tard cum the server for everything it's worth and now we're at a limit. I have an entire server dedicated to the backend that is on better hardware with more redundancy, but now I'm going to need to move the front end onto its own hardware. Currently, the KF frontend cohabitates a smaller blade with some other smaller sites.

Also, CrunkLord420 runs the Matrix/Riot and Pleroma instances on Server 4, and that server itself is running out of disk space.

Consider donating via crypto if that's an option for you.

I'm probably going to do a merch run to finance this expansion soon. Will likely try selling stickers since it was highly requested last time. Keep your eyes out for that.
Click to expand...
Sent some shex. Keep up the good work mate.
NOMYBITCASH said:
Dude just buy a 4tb SSD

But in all seriousness need a new flare or merch.

I'd buy the fuck out of a mug.
Click to expand...
I, too, would buy the fuck out of some mugs.
 
  • Like
Reactions: Cheesetoast and Marvin
HOMO FOR LIFE said:
*get a better server, fgt*
Click to expand...
Null said:
After talking with someone who knows more than I do about hardware, we've deduced the issue is that:
We store 1.5 TiB of static content on the site. This data is accessed all the time. I tried to save money by buying a big HDD, but this is becoming a problem. As we store so much and it's accessed so often, the one harddrive is bottlenecking the site. As a test, I disabled the Cloudflare's CDN, which automatically caches and serves a lot of static content for us. Doing this instantly threw the disk into 100% utilization and crashed the site. As it stands, we already over-utilize what resources I have and only because I've optimized CF to aggressively cache is the site not already dead. The problem will get worse as the site's archive and the utilization of the archive continues to grow.

4+4x3.4GHz is probably just not good enough for a site this size anymore, at least for the front end. I've been fine tuning things since Chch trying to tard cum the server for everything it's worth and now we're at a limit. I have an entire server dedicated to the backend that is on better hardware with more redundancy, but now I'm going to need to move the front end onto its own hardware. Currently, the KF frontend cohabitates a smaller blade with some other smaller sites.

Also, CrunkLord420 runs the Matrix/Riot and Pleroma instances on Server 4, and that server itself is running out of disk space.

Consider donating via crypto if that's an option for you.

I'm probably going to do a merch run to finance this expansion soon. Will likely try selling stickers since it was highly requested last time. Keep your eyes out for that.
Click to expand...


I am not saying I was right but.


I was right.
 
  • Like
  • Winner
  • Thunk-Provoking
Reactions: Knyttet, polonium, DanteAlighieri and 14 others
Null said:
I'm probably going to do a merch run to finance this expansion soon. Will likely try selling stickers since it was highly requested last time. Keep your eyes out for that.
Click to expand...
Merch run. Heard that. If you don't mind disclosing how much are we needing to pool together in order to get the hardware?
 
  • Like
Reactions: PonelessBizza
Since it hasn't been posted on this thread yet, I'm going to shill for Brave and point out that it makes it incredibly convenient to acquire BAT and then funnel them to Null. Getting enough BAT to send him $5 or $6 a month takes almost no effort.

I especially like it when charities advertise, so that you get the very particular pleasure of taking the Rainforest Foundation's money and giving it to a weirdo who makes fun of fat people.
 
  • Like
  • Winner
  • Agree
Reactions: Operator of the Wired, Elaine Benes, the_real_debbil and 26 others
Spawn said:
A bit over kill but what about something like this?
Click to expand...
Server hardware running older Xeons are pretty widely available for pennies by comparison.

Something like a Dell Poweredge Rx20 which run two E-5 Sandy Bridge sockets or
HP servers like the Proliant DL series 3xx from generations 6-8 are also dirt cheap running the same sockets.
Might require a bit more of scrounging for parts but the market is supersaturated with those things.
 
  • Agree
  • Informative
Reactions: NoFeline, Failure_Personified and Leibowitz
@Null too bad you can't find a place to make stickers or whatnot that would let you do an additional sticker (or whatnot) and you could charge $25 for it so people who don't do the currency you take could get you straight up profit money.
 
Status
Not open for further replies.
Back