Postmortem 2024-12-01 death by destiny

  • 🐕 I am attempting to get the site runnning as fast as possible. If you are experiencing slow page load times, please report it.
Don Yagon said:
So why not clean up this table once in a while? Delete all read notifications older than, say, a week, and unread that's older than N months. I recall there's been some peroformance issues on KF Pleroma instance that were also solved by cleaning up notifications table, so it'll make sense to do here as well.
Click to expand...
If you or someone you love has had their reaction notifications confiscated by Null, you may be entitled to compensation.

In all seriousness, I would happily trade nuking reactions over a certain age for restoring (recent) alerts, as they're a good proxy for which threads are seeing lots of activity and worth revisiting.
 
  • Agree
  • Like
Reactions: Billy Bong, Gog & Magog, L'Orange and 3 others
Last edited:
  • Winner
  • Informative
Reactions: Markass the Worst and JohnnyG
Don Yagon said:
So why not clean up this table once in a while? Delete all read notifications older than, say, a week, and unread that's older than N months. I recall there's been some peroformance issues on KF Pleroma instance that were also solved by cleaning up notifications table, so it'll make sense to do here as well.
Click to expand...
FWIW the fediverse thing was a bug in underlying Pleroma backend, that triggered when someone had thousands of unread notifications. Josh hit that problem after a few weeks of kiwifarms.cc being up. Metokur hit the same problem within 24 hours of joining Poast. Pleroma was updated to fix that a few years back.

Purging KF sticker notifications older than a week makes sense, in fact it probably warrants a weekly batch job. But from how Null has described Xenforo's database design, I wonder if it would allow this to happen while the site is live. Doing a mass delete while others are still adding stickers might lock the table up. KF is one of the few sites I know that doesn't have regularly scheduled downtime, however it may become necessary if it needs to have frequent data cleanup.
 
  • Informative
  • Like
  • Thunk-Provoking
Reactions: Markass the Worst, Breadquanda., Toji Suzuhara and 4 others
Null said:
The Kiwi Farms's raw backup file is over 60GiB of pure text
Click to expand...
Wikipedia, which has been autistically documenting everything more studious than Chris-Chan since 2001, has a compressed filesize of its entire database of articles of roughly 24.05GB.
How do you feel knowing that autistic gossip for about 11 years has produced enough pure text to approximate 2.6 Wikipedias?
 
  • Feels
  • Informative
  • DRINK!
Reactions: Markass the Worst, Essay2414778, Breadquanda. and 10 others
Jump said:
He was all ready to chill out, enjoy is trip.

Now he is in the airport in Newark NJ.
Sitting on the floor next to the only working power outlet with his laptop USB tethered to his cellphone which is connected to the kebab shop wifi trying to restore 80gigs of negrate stickers through 7 proxies. Seething as he watches them close the gate to his connecting flight as the progress bar ticks past 3% on his upload.
>client_loop: send disconnect: Broken pipe
Reconnects.. again. 1% done...
Click to expand...
In the before-times I did an Oracle DB install this way. Only about 3 proxies. Had to connect to a jump box with SSH port forward to vnc server there. Then from the jump box to the DB server with X11 forwarding.

I don't miss Oracle at all.


Also, I find it funny that Null deliberately selects airlines with Starlink. Then finds out that Shaniqua and Elon know which flight he's on and slow down his Internet so he feels loved.
 
  • Like
  • Informative
Reactions: FuckedOffToff, Breadquanda., Toji Suzuhara and 4 others
I'm trying to hold back on rating posts, but it's kind of programmed into all our brains. Is there a way to keep highlights for threads if ratings expire, and maybe remove our blown up ratings when we check ourselves?
We need to keep rating posts. We're trained that way, but is there a way to let them expire and keep the highlights in threads?
 
  • Autistic
Reactions: code123
Billy Bong said:
I'm trying to hold back on rating posts, but it's kind of programmed into all our brains. Is there a way to keep highlights for threads if ratings expire, and maybe remove our blown up ratings when we check ourselves?
We need to keep rating posts. We're trained that way, but is there a way to let them expire and keep the highlights in threads?
Click to expand...
I don't know Xenforo. But I thought it was the alerts, not the stickers themselves. The alerts are the little bell icon in the upper right which used to tell you when there was a new sticker on your post, and a new post in a thread, and a reply to your post. Removing the stickers from alerts happened a while back, but all the old ones are still there if you look back in your history. But then again, Xenforo is shit so maybe there's a link there that makes cleaning up alerts clean up actual stickers as well.
 
  • Like
  • Informative
Reactions: Billy Bong and code123
davids877 said:
I don't know Xenforo. But I thought it was the alerts, not the stickers themselves. The alerts are the little bell icon in the upper right which used to tell you when there was a new sticker on your post, and a new post in a thread, and a reply to your post. Removing the stickers from alerts happened a while back, but all the old ones are still there if you look back in your history. But then again, Xenforo is shit so maybe there's a link there that makes cleaning up alerts clean up actual stickers as well.
Click to expand...
yea i would think the table "xf_user_alerts" probably just has alert history in it and hopefully could be pruned to only have like 6 months or less of history.

also i really like virtualization with shared storage in my own datacenter. probably not much of an option without spending a bunch on rack space at a colo. but its nice to just slide vms between storage servers or compute so you can work on stuff without causing any downtime. and backup restores can be super quick as well. but there is a performance hit over bare metal.
 
@kiwifarms
#389
02:11 PM, 01 Dec 2024
I have completely run out of time. We're waiting on 200 MILLION+ rows of xf_user_alerts importing over 8 fucking hours. All of this shit is just "Dipshit faggot retard rated your post autistic" over and over and over again for 10 years.

There will be 2 continuous days of downtime. I will not have a chance to finish the repair today.
Click to expand...

@Null If it wouldn't break XenForo just delete all sticker alerts that are over a month old or something. There's no reason to be storing decade old sticker alerts, not even the stickerfags will care, but it would cut down on size and restore time significantly. I would tolerate downtime to do this if necessary.
 
  • Agree
  • Like
Reactions: Markass the Worst, repentance, "Controlled Demolition" and 1 other person
You must log in or register to reply here.
Back