Data Hoarders Thread - The Scriptatorium of the Modern Age

  • 🐕 I am attempting to get the site runnning as fast as possible. If you are experiencing slow page load times, please report it.
Also curious how people organize their shit. I have a hard enough time keeping the folder names of clean for 800 GB of music
Sonarr for anime and tv, radarr for movies, lidarr for music, and reader for books. There's something called the TrASH guides that let you configure best practices, then the arrs will organize everything you import into them.
 
Just found a fun link with BIG files for all you hoardy fellers https://academictorrents. com/browse.php
archive in a box
what does that actually do? the website is light on explanation and heavy on buzzwords
why they hoard
i dont like losing access to things, or having my access gated in some way, particularly by ads. i really do not like media streaming, i always knew the ads were coming and prepared accordingly. i am a big fan of owning my media and having digital backups for the physicals.
and how if at all you expect the hoard to be useful.
a signifigant portion of it is educational material. i want my children and their children and so on to at least have the option to read a book or watch a video on a subject they are interested in without being dependent on the person who made it continuing to provide the data online. or heavan forbid if something happened to me having the same resources at their disposal that i used to learn reading, writing, and arithmetic, as well as good history, philosophy, theology, science, etc.
 
Just found a fun link with BIG files for all you hoardy fellers https://academictorrents. com/browse.php

what does that actually do? the website is light on explanation and heavy on buzzwords

i dont like losing access to things, or having my access gated in some way, particularly by ads. i really do not like media streaming, i always knew the ads were coming and prepared accordingly. i am a big fan of owning my media and having digital backups for the physicals.

a signifigant portion of it is educational material. i want my children and their children and so on to at least have the option to read a book or watch a video on a subject they are interested in without being dependent on the person who made it continuing to provide the data online. or heavan forbid if something happened to me having the same resources at their disposal that i used to learn reading, writing, and arithmetic, as well as good history, philosophy, theology, science, etc.
This sounds awesome thanks, I like this dudes philosophy.
 
How would one scan books to upload? I got a bunch of manuals I wish to scan

Two ways:

1. Cut the spine and feed each page through a scanner. The book will be damaged, but the pages will look clean in the scan.

2. Press each page down on the scanner. The book won't be damaged, but the pages won't look as clean in the scan.

I recommend #1 if you're going all in on digital.
 
There are scanners with one edge right up against the edge of the unit for book scanning, some libraries have them. Might be worth seeing if any around you do.
 
There are scanners with one edge right up against the edge of the unit for book scanning, some libraries have them. Might be worth seeing if any around you do.
The main downside of this is you're still scanning pages one by one. If you've got a 100 page book maybe you've got time for that. If you want to digitize your shelf, taking your books to Kinko's to get the spines cut and running them through a document feed scanner.

Depending on how picky you are, you can knock out a thousand page this way in a day, or you can get sidetracked by the pages not being straight enough, or if debris on the glass is causing lines you just need to re-scan everything to get rid of, or if you want to crop your pages manually instead of letting the scanner do it etc.
 
And your justification for using HDDs is avoiding bitrot, not the difference in cost?
I thought that was obvious already, but yeah, they're way cheaper and that's why I use them.
But are SSDs good for long term storage? I can't say myself since I've never used one for that. If they're always powered then bitrot isn't an issue.
 
But are SSDs good for long term storage?
Yes, just put a checksum-verifying file system like ZFS on some (do this with HDDs too of course)

SSDs also have quite the speed increase that even enterprise 15K RPM HDDs can't compete with
 
Do you use SSDs or HDDs? I myself only use HDDs because SSDs can lose data if they're not powered for some time.
[citation needed]

On a more serious note, I have flash media (such as USB flash drives and SD cards) that has sat unused for years before accessing them again, and I've not had any problems retrieving data. I can't see SSDs behaving differently from other flash media, unless there's something special about SSDs that I'm missing.

That being said, if an SSD (or any other flash media) does shit the bed, all the data is usually gone. At least with spinning rust, you have a fighting chance of recovering some or all data.

For what it's worth, I still use HDDs for most of my long term storage needs due to the cost per GB, and the fact that if I only want to access something a few times a year, a few extra seconds spent accessing the file(s) I want won't kill me.
 
  • Like
Reactions: Local Fed
On a more serious note, I have flash media (such as USB flash drives and SD cards) that has sat unused for years before accessing them again, and I've not had any problems retrieving data. I can't see SSDs behaving differently from other flash media, unless there's something special about SSDs that I'm missing.
I believe it's that a SSD [when unpowered] is only guaranteed to perfectly retain data for a year. After that the occasional bit will flip, which may or may not be an important bit
 
Last edited:
  • Thunk-Provoking
Reactions: Local Fed
I believe it's that a SSD is only gaurenteed to perfectly retain data for a year. After that the occasional bit will flip, which may or may not be an important bit
If so, how come Samsung offers up to 10 years warranty on its SSDs? (A)

Granted, I'm aware that SSDs are only good for a certain number of total bytes written (usually hundreds if not thousands of TB). However someone using an SSD for long term storage and retrieval won't come anywhere close to hitting this limit.
 
  • Dumb
Reactions: Betonhaus
If so, how come Samsung offers up to 10 years warranty on its SSDs? (A)

Granted, I'm aware that SSDs are only good for a certain number of total bytes written (usually hundreds if not thousands of TB). However someone using an SSD for long term storage and retrieval won't come anywhere close to hitting this limit.
*when unpowered. If it's plugged in and used there will be no bitrot until the ssd is EOL
 
  • Thunk-Provoking
Reactions: Pee Cola
M-Disc is sadly long gone from what I have read. The company was sold for parts and anything sold as "M-Disc" by Verbatim is just a rebranded Bluray and does not use the special medium designed for indefinite storage used by the originals.

I think it would be nice to have a tape drive for cold storage--the price is impossible to beat once you break even on the drive, and the drives are fairly reasonably priced now, especially if you are willing to buy an older LTO generation (I think all the way back to LTO 3 or 4 is still supported by manufacturers, and Linux can run just about any LTO drive). Of course, the downsides are big: speed is a big issue, as is proper labeling and storage, and yes it will be very difficult to find something to read your tapes if your PC is lost and you have no working backup. But you could use offsite tape archives as a backup to the backup to the backup if you are willing to invest the money.
 
Back