Data Hoarders Thread - The Scriptatorium of the Modern Age

  • 🐕 I am attempting to get the site runnning as fast as possible. If you are experiencing slow page load times, please report it.
Verdun_Salient

Verdun_Salient

True & Honest Fan
kiwifarms.net
Joined
Apr 21, 2024
I was looking around and realized we do not have a dedicated data hoarders thread. I seek to rectify this problem.

Starting off, I am trying to get myself in the discipline of archiving things I see, but have been having trouble with that.
I also wonder how one would go about preserving the contents of a website
 
  • Like
  • Feels
Reactions: Xev, Flabba Wabba Jabba, Salaryman and 3 others
There's a whole thread dedicated to archival tools.
 
I use archive in a box and a couple of selfmade scripts which takes the url from my firefox history file and archives every url ive been on for that session
 
Where do you guys source your storage media? I've gotten some strange replies when I mention I'm a regular consumer of the Facebook Marketplace HDD haul...
But at 4$/TB, it cannot be beat.
going 3 years without a single failed disk too out of 26.

Want to upgrade to SSDs slowly. I've got empty bays, I just need to know where to get the drives for them.
 
  • Winner
Reactions: soup peddler
Verdun_Salient said:
Starting off, I am trying to get myself in the discipline of archiving things I see, but have been having trouble with that.
I also wonder how one would go about preserving the contents of a website
Click to expand...
When archiving is talked about here it's for preserving thread information.
Is this thread meant to be about that, or about datahoarding in general unrelated to the Farms?
 
seri0us said:
Like what?
Click to expand...

Probably what you're thinking.
"I got 2 from craigslist and they both broke when I really needed them!"
"The failure rate is much higher"
and my favorite
"You don't get any warranty with those!"
 
I have about 72tb usable right now. 11tb free across 5 16tb drives. I got some used ones mainly. I had an issue with WD drives. But nothing unrecoverable.

General Emílio Médici said:
My real dream is getting my hands on LTO drives and tapes and building a massive backup using those, but that is honestly showing off.
Click to expand...
I'd like to get a LTO drive too. Mainly for cold storage. Drives are still cheaper for that sadly.
 
  • Like
Reactions: Shroom King
I've said it before and I'll say it again: LTO drives are utter folly unless you're an actual enterprise with an actual budget and a full-time staff to keep you trotting along on the planned-obsolescence treadmill. Hope your cold-storage bunker contains multiple backup copies of the (expensive, specialized) hardware too.

If "The Big One" does hit, you'll probably always be able to find something in working condition that can read an optical disc, SATA, or even IDE drive. But tape? Forget about it. Things are better than they were - you probably don't need to preserve an entire computer workstation, hardware and software, in amber along with your tapes anymore - but it's just not a cold-storage solution. Tape is for migrating data from Facegoog Datacenter 2020 to Facegoog Datacenter 2025.
 
  • Like
  • Informative
Reactions: Mr. Hedgehog, Shroom King, Roland TB-303 and 1 other person
Kosher Dill said:
LTO drives are utter folly
Click to expand...
It's the consoom mindset of having the shiny rare thing driving the talk about this stuff (i think Linus Cuck Tips had an tape adventure too), not usablity or benefits over just buying more fb marketplace hdds for redundancy.

That being said i have an hp microserver (bought used) full of some kind of hdd (bought used) storing any digital music and book i ever bought / downloaded. I also have a bunch of books and cds, but true datahorders dont like physical media as its a visual indicator for how much media they have and will never use.
 
Milles d'Allemagne said:
It's the consoom mindset of having the shiny rare thing driving the talk about this stuff (i think Linus Cuck Tips had an tape adventure too)
Click to expand...
I think it's more the desire to LARP as "one of the big boys" and do it like the pros, regardless of whether the pros' use case resembles yours.
See also how many online privacy advocates happen to be deep-cover freedom fighters making dead drops to the shadowy Resistance Leader.
 
Kosher Dill said:
I've said it before and I'll say it again: LTO drives are utter folly unless you're an actual enterprise with an actual budget and a full-time staff to keep you trotting along on the planned-obsolescence treadmill. Hope your cold-storage bunker contains multiple backup copies of the (expensive, specialized) hardware too.

If "The Big One" does hit, you'll probably always be able to find something in working condition that can read an optical disc, SATA, or even IDE drive. But tape? Forget about it. Things are better than they were - you probably don't need to preserve an entire computer workstation, hardware and software, in amber along with your tapes anymore - but it's just not a cold-storage solution. Tape is for migrating data from Facegoog Datacenter 2020 to Facegoog Datacenter 2025.
Click to expand...

Mmm. Most of it does seem to align towards more business related usecases than the lower end consumer point of things. Which is a pity, seeing that if properly developed, I could see a small niche for tape stuff being made in the future. If I am reading the specs of it right across the various videos and articles I have researched, tape has a far greater ability to archive more en mass with regards to its physical footprint than either SSDs or traditional mechanical hardrives that were suppose to replace it.

Granted, the read/write speeds are slower by default. But having access to that much data storage per dollar, at a compact form factor and decent price, plus having it in quantities that easy to replace if something goes wrong and being relatively easy to repair? That'd be a dream. Especially considering how porous and ephemeral media and information of all sorts has become in the modern day, and only continues to grow worse with no signs of getting better.

Stuff like M-Discs are a thing, but they aren't exactly practical for storing a lot of stuff en mass. You aren't putting all your eggs in one basket, which is a pro, but it looks like a damn hassle to get all the stuff I already have on to them. And considering mine is fairly small when compared to other data hoarders... Well, there's no easy solutions.

I for my part managed to get at least one of the three prerequisites of backups on at least, but finding other mediums and actual places that I trust to store it are another matter. Best I have been able to do is get a desktop backup on an encrypted 4tb hard drive, along with some chosen ancillary media backpack that I can use to "bugout" in case things turn to shit. It isn't an ideal solution, but it's the best I have got available to me.
 
  • Autistic
Reactions: Roland TB-303
Brabbit Narp said:
if properly developed, I could see a small niche for tape stuff being made in the future. If I am reading the specs of it right across the various videos and articles I have researched, tape has a far greater ability to archive more en mass with regards to its physical footprint than either SSDs or traditional mechanical hardrives that were suppose to replace it.
Click to expand...
It's true that by some measures tape is cheaper per gigabyte, denser, etc. But let's be real here, even the hoardiest individual data hoarders aren't physically running out of space or bankrupting themselves. They're just hobbyist nerds who have a closet full of HDs or perhaps a dedicated rack in a room they turned into their homelab.
 
You must log in or register to reply here.
Back