DSP's Hard Drive Hoard - How many drives does Dark need?

[big ups liquid richard]

Speaking of storage hardrives, does anyone know how reliable are they over time? I remember saving some images in one, and after a long time without accessing them, I finally looked at the images, and some of them were half glitched out.

i recently found my only one, last used in 2012. It works perfectly fine. lot of good memories, too. i want to go back...

 

[Kermit the Frog]

Phil put all of his old videos on hard drives because he claims if his YouTube channel is deleted or he ever moves to another platform that's like YouTube, he'll upload them all so none of his content vanishes from the internet. The problem? Phil didn't label any of the hard drives and they're just rotting away in a box somewhere. Wouldn't be surprised if they're all dead. Someone about 6 months ago asked Phil to reupload some old videos that were deleted, and he went on a pissbaby rant about how he can't because he doesn't have the time and nothing is labelled anyway. Here's what I wrote about it at the time, which I think has held up well.

Phil would sooner throw all those hard drives in the garbage than reupload the videos should anything happen to his channel. They're as good as gone and anybody asking him to reupload specific videos when he doesn't even have the hard drives labelled is wasting their time. I honestly think he backed up all of his videos because he found out other content creators did the same thing and he wanted to feel like he was being responsible like a mature human, but of course he half-assed it and doesn't know what videos are on what hard drive, which completely misses the point of backing up your videos. A man so proud of his 50k videos he couldn't be bothered to care about any of them. What a legacy. Brilliant.

It's part of an overall theme of Phil wanting to be more "professional" but not putting in any of the actual effort required to be professional. Claims to be a professional streamer, hasn't updated his setup or even downloaded the drivers for his software in 5 years. People have made suggestions that would benefit him greatly, and he absolutely refuses to listen. He hasn't realized that it's this shitty mentality that's made him more irrelevant over the years.

 

[Pargon]

Phil put all of his old videos on hard drives because he claims if his YouTube channel is deleted or he ever moves to another platform that's like YouTube, he'll upload them all so none of his content vanishes from the internet. The problem? Phil didn't label any of the hard drives and they're just rotting away in a box somewhere. Wouldn't be surprised if they're all dead. Someone about 6 months ago asked Phil to reupload some old videos that were deleted, and he went on a pissbaby rant about how he can't because he doesn't have the time and nothing is labelled anyway. Here's what I wrote about it at the time, which I think has held up well.

It's part of an overall theme of Phil wanting to be more "professional" but not putting in any of the actual effort required to be professional. Claims to be a professional streamer, hasn't updated his setup or even downloaded the drivers for his software in 5 years. People have made suggestions that would benefit him greatly, and he absolutely refuses to listen. He hasn't realized that it's this shitty mentality that's made him more irrelevant over the years.

It's quite telling how resistant Phil is to the idea of doing a thing that requires sitting on his ass staring at a screen when he's busy all day, every day (except for his autistic grocery days) sitting on his ass staring at a screen. He could even be doing this during his streams or as part of his breaks. Fuck, he can be doing it during his precious Lay-Around Time, just throw the gin in the box with his hard drives and his laptop, lug it downstairs, push Kat's bedding on the couch over and put on Netflix while he catalogues.

This man absolutely cannot be using his brain whatsoever when he's done with """work""" for the day. No wonder he has to pay his bills on his day off - that's the day he sets aside for Real Adult Responsibilities. There's absolutely no way he can do it any other time because that's the time he saves for autonomic biological processes and literally nothing else.

 

[That Hedonist Nerd]

Weird. If only someone made software that would allow you to organize all of your media across multiple drives, devices, computers. If only. Sucks no one has ever invented archival data storage software, and that if they had there's no way tons of the same available as open source. Dave will never be able to upload those videos now.

 

[HerrKlicks]

The problem with Dave's 'storage library' also is that he bought relatively inexpensive hard drives more aimed to be a means to move data from one machine to another or be a companion drive for a laptop.

AFAIR they are the ones that are bus powered so at least there wouldn't be any chances of the pig blowing out stuff by plugging a wrong power adapter into it but those 'mobile' drives are far from enterprise grade gear and it's safe to say that between the dust, the move and the overall quality of those drives most of the data is gone - if they even still work at all.

Just my two colored puzzle pieces on hdd autism

 

[Synth]

Weird. If only someone made software that would allow you to organize all of your media across multiple drives, devices, computers. If only. Sucks no one has ever invented archival data storage software, and that if they had there's no way tons of the same available as open source. Dave will never be able to upload those videos now.

Everyone knows the only way to actually store information is by magnetic tape on those huge spools, d00d. He's gotta sell all his statues so he can clear out the Storage Nook© to make room for the reels!

 

[mollymawk]

Is there not some way to use software to pull the file sizes from each video on DSPGaming (55,338 videos) and the other channels to determine the collecive amount of storage space needed? I always use NewPipe and Videoder for Android to download the videos before viewing them, and they automatically display the file size information for each video. On a personal level, I would like to see if it's within the realm of possibility to re-upload all of DSP's videos onto a mirror channel(s).

For example, DSP's first run playing Minecraft in 2015 (29 videos) is a total of 21.4GB. His muliplayer session of Minecraft in 2015 (7 videos) is 4.62GB. FYI, all of DSP's Minecraft videos are uploaded to this mirror channel on YouTube here.

 

[Comma]

Is there not some way to use software to pull the file sizes from each video on DSPGaming (55,338 videos) and the other channels to determine the collecive amount of storage space needed? I always use NewPipe and Videoder for Android to download the videos before viewing them, and they automatically display the file size information for each video. On a personal level, I would like to see if it's within the realm of possibility to re-upload all of DSP's videos onto a mirror channel(s).

For example, DSP's first run playing Minecraft in 2015 (29 videos) is a total of 21.4GB. His muliplayer session of Minecraft in 2015 (7 videos) is 4.62GB. FYI, all of DSP's Minecraft videos are uploaded to this mirror channel on YouTube here.

View attachment 768925

If you want to calculate the "real" storage space needed, keep in mind that the actual file size on disk/storage usually is (much) bigger than the file size you get when downloading a video from Youtube due to the heavy compression Youtube applies.

For example: a 1080p30 video I uploaded to Youtube recently has an actual file size of about 430 MB, but when I download it in the same quality, the file size is about 140 MB. Another, much simpler and shorter, video has an actual file size of 2.10 MB, but shrinks to 1.20 MB when downloaded.

When I take a random 720p60 DSP video ("Call of Duty: Black Ops 4 Blackout MP: May 22, 2019 pt2"), its downloaded size is 1.3 GB. A random 1080p30 DSP video ("Team Sonic Racing Adventure Mode playthrough pt2 - 1st Customizations and New Arrivals") of pretty much the same duration is 1.8 GB. My estimate would be that the first video is between 4-5 GB in actual size and the second video probably 6-7 GB, but that's just a guess.

 

[EddyB43]

Since I'm not archiving as I watch DSP these days, these are just recollections - but I recall DSP saying in the last 6-12 months that he no longer buys HDDs to archive his videos. Hell, sometime before that he whined about his current archive external HDD failing when he tried to put more videos on it.

As from my quote, in the YouTube streaming days he always did 1080p60 9000Kbps H.264 video, plus a small amount extra for audio (probably 128Kbps AAC). With his stream archives on YouTube, those should be the same full size since YouTube doesn't transcode the source stream... BUT his uploaded videos after the fact would've been transcoded and are unlikely to match.

Nowadays DSP does 720p60 or 1080p30 6000Kbps H.264 video to hit the raised Twitch limit... which curiously enough is the same bitrate that got him warned for 1080p60 and he freaked out and quit back in November 2014. "ALERT: Changes To Live Streaming, Please Watch Immediately" on November 11th, 2014, ~1:54 in he confirms "up to 6000Kbit" is fine for 1080p60. Also at 04:55 he theorizes 9000Kbps. Not embedded because this is on DSPGaming so be prepared with an adblocker etc.: https://youtu.be/1_OAbvaBAGo?t=105

 

[Wurstbrot]

Is there not some way to use software to pull the file sizes from each video on DSPGaming (55,338 videos) and the other channels to determine the collecive amount of storage space needed? I always use NewPipe and Videoder for Android to download the videos before viewing them, and they automatically display the file size information for each video. On a personal level, I would like to see if it's within the realm of possibility to re-upload all of DSP's videos onto a mirror channel(s).

I already did a calculation based on statistics and healthy assumptions. Lotor quoted that on page 1, but do me a favor and ignore that as I spotted quite a body of flesh eating mistakes. Anyway, there I did the math on how long Phil needs to upload his own videos within his own scheduled time, when he had around 50.700 videos in quantities of whole universe simulations per day. I'll update and correct this fucker and fit it to your question:

Aaaand this is the story all about how I waste my evening just now.

Spoiler: FILE SIZE

For a proper calculation and comparison let's check which type of file ASPgaming uses.
I did some work beforehand and eyeballed his current average video length to 1 hour. So I pick his rape-tastic verbal flatulence of RAGE 2 (part 3) as it's 100% properly processed by the system, and it's perfectly set to 1h, 00min and 10 secs anyway. We also ignore the newer videos as the processing often needs a Snickers while staying on 720p for quite a while. My handy download software whispers in agony:

That's useful. Let me tell you in advance, @Comma is right: The downloadable file is smaller than the original file, as Youtube converts it into a more fitting and better variation for itself (latter assumed). After a fresh RAW upload of a 995 MB mp4 file (720p) we get a reduction of around HALF for every lesser step of quality. However, those uploads had no sound and only 30 FPS, while ASSgaming uses 60 FPS.

So this could mean his 1.5 GB file has a size of around 3 GB? Could perfectly be. I just try to roughly reproduce his file and come up with a comparable file, as I spin the camera in circles to compensate for the complete lack of ego shooters in my life and fail MISERABLY to fit his quality product. So let's ignore that and use the combined work of a thousand men and women! This video file size calculator. Took me a while to find a good one which uses mp4. After smashing in my own 720p video I can confirm it's quite accurate and the quality of my video was SHIT. Thanks internet. For this I assume Phil uses a more proper setup than me, because his videos look quite smooth.

So we punch in the data of REEEEEge 2 and get:

Spoiler

Which surprisingly roughly adds up to my own extrapolation of the supposedly garbage video. I spare you the details, I got 2.22 GB.

So this means the 1080p Youtube file with 1.5 GB had a strength of about 2.6 GB and was compressed by roughly 60%.
So this set of data tells us the reduction:

1080p ~ 60%
720p ~ 45% <--- Probably the file you want to mirror as a dirty mentally ill detractor (don't do it)
480p ~ 30%
360p ~ 15%
240p ~ Why even bother

Can you spot the pattern? Apparently each step changes by around 15%. Sounds good to me, so we use that.
Means, his average source file these days should have a body of 2.5 GB.

Spoiler: Disclaimer

TAKE EVERYTHING WITH A GRAIN OF SALT.

The bitrate is very important for this estimation, so I could just talk directly from my butt. A professional would probably cry in pain when he sees my attempt to understand how stuff influences the file size. I'm only able to slowly crawl forward and check every estimation at least twice. Also, as the author wrote: A fixed bitrate is quite in align with streaming, so I try to not change this setting up too much, I use those ~5000 kbps because it's roughly in align with my own physical experiment.

Also, a Youtube upload would probably fix the most horrible video setup with way too big file sizes. Just take this as an approximation based on an available set of data

Spoiler: Upload Speed & Daily Content

I did quite some mistakes with Phil's upload speed and nobody noticed. Shame on YOU. Yes, YOU. You nearly killed me!

Anyway, previously I wrote the Youtube upload speed is limited to 10 MB/s. Either something with my internet changed or Youtube changed. My upload speed equals roughly 85 MB/s now (I spare you my experiment today), which is quite the difference. So I would assume there is no limit to the speed in the current era.

Another mistake was the confusion of MBPS (Megabits per sec) and MB/S (Megabyte per sec) which led to a completely wrong calculation.
So let's start with Phil's choice of internet. Because he deserves only the best and is a serious full time streamer, he probably purchased the Gigabit Pro package or something around that line, which has an up-speed of 2000 Mbps. Thanks to the handy Google calculator for literally any unit invented by mankind, we get a barking body of 250 MB/s. However his socket is garbage, but I will give him the benefit of the doubt and assume this only delays the connection while playing online, or drops frames and inputs.

Another mistake was made, thanks @Comma. New estimation with his amplified socket (so it works kinda properly) and the actual right data.
Upload speed reduced to 5 mbps (equals 0,625 MB/s which is absolute garbage and could explain why he's awake until 3am?).

This mistake made my previous calculation look like it came from a mentally disabled DSP fan. Luckily I'm just mentally disabled.

The Daily KHANTENT

Now we need to estimate the size of his daily files, which should be quite easy if his daily KWALITY quantity never changed. Even so he spared humanity with his system abusing uploads, the amount stays the same, does it? Let's time machine back and filter his uploads from oldest to newest and do the real difficult part: Scroll through that swamp until we reach an era for accurate measurement. No need to scroll for too long, 8 years ago was a complete mess of uploads, but still tenthousands of views; he probably made enough money to buy a second house.

What a beautiful portrait of 10 to 15 minute videos (to be fair, there was a limit in the dark ages when King Richard III ruled the lands). This scene shows September 6, 2010. For this day alone he uploaded 20 videos. Previously I calculated 12 minutes average, which still seems to hold truth. His camera was a 720p type (with the quality of 240p) until he switched to capture card by his very very very own will.
The wise internet tells us he roughly did that in mid 2014 (with 1080p and 60 FPS, thanks).

We need that information to compare the old output with the current output.
Let's headbutt the numbers in for a 12 minute video with garbage bitrate. We enter the realm of 275 MB per video.

My small mistake of including 10 seconds has no influence.
Continue in the next paragraph.

Spoiler: Total File Size + RESULT

The following ignores all videos on his other or old channel (we only deal with DSPgayming) and treats every video the same. Of course, this means we won't deal with the WHOLE 10 year legacy body, keep that in mind.

Unfortunately I can't find a single website which lists the daily uploads or at least when Phil stopped his video spam. HOWEVER, memory serves well. This happened when his channel was banned due to his spam of videos and he had to evade to the vlogging channel. Specifically from this point on forward, only 10 months ago in Juli 2018. Now we have everything we need. Need some proof he still abused the system during that time?

All those Silent Hill videos on Juli 19.

I. YOUNG GARBAGE CAMERA PHIL WITH SPAM UPLOAD:
April 17, 2010 - Juli 11, 2014 =
20 videos/day x 275 MB = 5500 MB/day.
Total length per day: 240 minutes = 4 hours.

II. NEW QUALITY PHIL WITH CAPTURE CARD BUT STILL SPAM UPLOAD:
Juli 11, 2014 - Juli 20, 2018
20 videos/day x 500 MB = 10.000 MB/day (calculated beforehand)
Total length per day: 4 hours.

III. NEW KHUALITY PHIL WITH CAPTURE CARD AND 1 HOUR UPLOAD:
Juli 20, 2018 - May 24, 2019
6 videos/day x 2600 MB = 15.600 MB/day.
Total length per day: 6 hours.

I'll ignore the inconsistent prestreams because we roughly estimate anyway. My Microsoft Excel says those are 3324 days (A bit above 9 years).
I'll also ignore his free days as I calculate it in a way which makes them lack any influence on the final results.

Currently Fail Burnhell makes us sick with a total of 55.361 videos, so headache inducing 5000 more than in the previous calculation.
Those should be sprayed over his legacy, like a good accident when the camera is on (the whole time!), in this way:

I. Young Phil: 1546 days = 129 months = ~ 4 years = 46,51 %
= 25.748 videos = 7.080,7 GB = 7,08 TB

II. Capture Card, Spam: 1470 days = 123 months = ~4 years = 44,22 %
= 24.483 videos = 12.241,5 GB = 12,24 TB

III. Capture Card, 1 hour: 308 days = 26 months = ~ 0,8 years = 9,27 % (YES, it's this recent)
= 5.130 videos = 13.338 GB = 13,34 TB

So our beloved piglet snorted us a body of 32,66 TB so far.
We keep that number in mind to calculate the number of harddrives he needs to store them all.

We can reduce this number on Youtube, based on our previous completely 100% scientific logical mature human thinking:
I. Young Phil: 7.080,7 x 0,45 = 3.186 GB = 3,18 TB
II. Old Phil: 12.241,5 x 0,60 = 7.345 GB = 7.35 TB
III. Slightly older Phil: 13.338 x 0,60 = 8002 GB = 8,00 TB

So his legacy of a gout infested body on Youtube should be around 18.534 GB or 18.53 TB.
This is the amount you would need to download for an evil illegal mirror channel.

You can calculate for yourself how long you would take to upload it again (Phil or any of his fans with the attention span of a goldfish: Nobody wants to reupload DSGarbage), this is just a fun mind game of "what if".

Spoiler: How many harddrives?

Well, I'm literally not happy you ask.
As @PieceofShet correctly stated in my first calculation, HDDs weren't those monsters they are today. It took a while to find a somewhat reliable source and timeframe for Phil's prefered HDDs, but here we are (Source 1) (Source 2).

The left graph uses GB, the right one TB.
We only lag 2010, but we can eyeball the specific capacity during that timeframe and assume 500 GB.

I. Young Energetic Positive Phil: The first 4 years.
Estimated 500 GB to 937 GB. So in average around 720 GB.
He had to buy 10 HDDs.

II. Depressed Phil: The next 4 years.
937 GB to 2200 GB. So in average 1570 GB.
He had to buy 8 HDDs.

III. Still depressed but married Phil: 1 Year.
2200 GB to 2500 GB. In average 2350 GB.
He had to buy 6 HDDs.

So if he always bought harddrives like a lunatic, which he has not but we just assume, he should be in posession of AT LEAST 24 HDDs.
Could be way more as I don't really trust my low numbers.

Spoiler: What if Phil reuploads everything?

So what if Phil reuploads everything right now, if we consider his daily stressful errand of moving his body? I take my first calculation and stick to the number as it still fits today, with the only difference his upload speed. I calculated he gets 6 hours / day to upload his virtual furuncles or else he dies of stress. The new upload speed is 250 MB/s, 0,625 MB/s provided it will stay stable (insert horse joke) and Youtube has no upper cap, still granted because I'm SUCH a nice guy. But he has to hoise 32.660 GB.
I will ignore multi-uploads as it lowers his speed anyway.

Just as an example and the whole reason I assume he's awake until 3am or later: He babysits his videos.
When he has to upload 15.600 MB/day then with 0,625 MB/s he would need 7 hours.

In short, he would need for his entire library of 32.660.000 MB astounding 14.515 hours ( = 604,8 days = 1,657 years).
But he has only 6 hours a day, means with his current internet he uploads for 6,6 years until completion (provided he also uses his FREE DAYS WITH KHET).

 

[Comma]

Nice post, and I almost feel bad for shitting on your calculations with this, which of course isn't my intention, but I don't get the part about his upload speed:

So let's start with Phil's choice of internet. Because he deserves only the best and is a serious full time streamer, he probably purchased the Gigabit Pro package or something around that line, which has an up-speed of 2000 Mbps. Thanks to the handy Google calculator for literally any unit invented by mankind, we get a barking body of 250 MB/s. However his socket is garbage, but I will give him the benefit of the doubt and assume this only delays the connection while playing online, or drops frames and inputs.

I don't think DSP has fiberglass available at his location, which is the only way he'd be able to get an upload speed of 2000 Mb/s. I think I've heard him talk about his internet (download) speed at some point, and it being around 150-200 Mb/s. Next to that I'm 100% sure he's on a cable connection: he has talked about having a coaxial amplifier, as mentioned by @FallGout some days ago:

A while ago both of his lines went out and he said the issue was the coax amplifier got unplugged, so the signal coming into his house is so low that it needs to be amplified to even function, thats why his internet is so shit. For the most part the speeds will be fine but I would bet his ping sucks and his line has really bad jitter.

That would mean his upload speed is most likely only a around tenth of his download speed, or maybe a bit more because it's a business package.

This also checks out when I use website you linked to check what packages are available, using DSP's zipcode. Btw, the link you gave shows that you used a zipcode from what looks to be a random place in Philadelphia (17505). I get why you used that state, but it also shows that the website has a built-in check to show the maximum available bandwith within a zipcode area.

17505:


DSP's zipcode:


So that would be 150 Mb/s tops. And according to the list below that, the matching upload speed would be 5 Mb/s, though, again, could be higher due to getting a slightly different/better deal or something like that. Maybe you got bamboozled by the list below the section in the screenshots, but those are simply all internet-only packages they have to offer, but that doesn't mean it's available everyhwere.

Also, the fact he owns not one, but two seperate subscriptions, tells me it simply can't be fiberglass. If you have a 1 or 2 Gigabit symmetrical connection, there's no way you'll need two seperate lines to guarantee speed and stability for streaming to Twitch. Not saying that DSP does things logically, but I think even he would know that.

So yeah, in conclusion: I'd say we're looking at an upload speed of 5 to 30 Mb/s (Megabit, just to be clear).

 

[Wurstbrot]

This also checks out when I use website you linked to check what packages are available, using DSP's zipcode. Btw, the link you gave shows that you used a zipcode from what looks to be a random place in Philadelphia (17505). I get why you used that state, but it also shows that the website has a built-in check to show the maximum available bandwith within a zipcode area.

But all Phils reside in Philadelpha, dood.

Yeah thanks, I just blindly copied the link from the old post. I fixed it up, thanks man.
You also gave me an idea. If those calculations are correct (big if), and if you are correct (smaller if), then he would need around 7 hours a day (could even be 8 hours) to upload his entire work of the day. Could be one of the reasons he is still conscious 2am when he should be unconscious, besides the usual excuses? Because his internet is garbage despite the fact he claims it's way better than in the old condo?