Xenomorphs Are Cute
kiwifarms.net
- Joined
- Dec 1, 2019
Oh good, the echo-chamber is now an even bigger echo-chamber.
Archival Tools - How to archive anything.
- Thread starter Null
- Start date
- Joined
- Apr 19, 2023
yt-dlp doesn't seem to work, I tried to download multiple video, and it just says "sign in to confirm you're not a bot."
Anyone else see the same error?
Anyone else see the same error?
- Joined
- Dec 6, 2020
Didn't test it in any way, but in the meantime you may want to try Cobalt as an alternative.
- Joined
- Jun 24, 2019
You can see my thread here: https://kiwifarms.st/threads/how-to...ver-tor-as-of-2024-08-15.198160/post-19225840 for a fix but it's quite involved.
- Joined
- Dec 17, 2022
I've got that occasionally in the last few days with yt-dlp. Just change the VPN to a different location or try again in a while. If you're using a VPN that has SOCKS5 proxy (like Mullvad), you can use proxychains-ng to switch the IP address automatically when downloading a list of videos, but thats another topic for another day.
edit: To get started, here's a list of all the current Mullvad US based SOCKS5 proxies:
Code:
## mullvad proxychains config
## country code: us
## updated: 2024-09-02 02:51:06
random_chain
chain_len = 1
quiet_mode
proxy_dns
remote_dns_subnet 224
tcp_read_time_out 15000
tcp_connect_time_out 8000
[ProxyList]
socks5 10.124.0.1 1080
socks5 10.124.0.3 1080
socks5 10.124.0.10 1080
socks5 10.124.0.12 1080
socks5 10.124.0.14 1080
socks5 10.124.0.16 1080
socks5 10.124.0.18 1080
socks5 10.124.0.22 1080
socks5 10.124.0.23 1080
socks5 10.124.0.24 1080
socks5 10.124.0.26 1080
socks5 10.124.0.27 1080
socks5 10.124.0.29 1080
socks5 10.124.0.31 1080
socks5 10.124.0.32 1080
socks5 10.124.0.38 1080
socks5 10.124.0.43 1080
socks5 10.124.0.44 1080
socks5 10.124.0.46 1080
socks5 10.124.0.52 1080
socks5 10.124.0.57 1080
socks5 10.124.0.58 1080
socks5 10.124.0.69 1080
socks5 10.124.0.70 1080
socks5 10.124.0.72 1080
socks5 10.124.0.75 1080
socks5 10.124.0.76 1080
socks5 10.124.0.78 1080
socks5 10.124.0.82 1080
socks5 10.124.0.83 1080
socks5 10.124.0.85 1080
socks5 10.124.0.86 1080
socks5 10.124.0.87 1080
socks5 10.124.0.88 1080
socks5 10.124.0.89 1080
socks5 10.124.0.90 1080
socks5 10.124.0.96 1080
socks5 10.124.0.97 1080
socks5 10.124.0.98 1080
socks5 10.124.0.101 1080
socks5 10.124.0.103 1080
socks5 10.124.0.104 1080
socks5 10.124.0.115 1080
socks5 10.124.0.126 1080
socks5 10.124.0.127 1080
socks5 10.124.0.128 1080
socks5 10.124.0.129 1080
socks5 10.124.0.130 1080
socks5 10.124.0.131 1080
socks5 10.124.0.132 1080
socks5 10.124.0.133 1080
socks5 10.124.0.134 1080
socks5 10.124.0.135 1080
socks5 10.124.0.137 1080
socks5 10.124.0.142 1080
socks5 10.124.0.143 1080
socks5 10.124.0.144 1080
socks5 10.124.0.145 1080
socks5 10.124.0.146 1080
socks5 10.124.0.147 1080
socks5 10.124.0.148 1080
socks5 10.124.0.149 1080
socks5 10.124.0.150 1080
socks5 10.124.0.151 1080
socks5 10.124.0.153 1080
socks5 10.124.0.157 1080
socks5 10.124.0.158 1080
socks5 10.124.0.162 1080
socks5 10.124.0.163 1080
socks5 10.124.0.164 1080
socks5 10.124.0.165 1080
socks5 10.124.0.167 1080
socks5 10.124.0.168 1080
socks5 10.124.0.169 1080
socks5 10.124.0.170 1080
socks5 10.124.0.175 1080
socks5 10.124.0.176 1080
socks5 10.124.0.177 1080
socks5 10.124.0.180 1080
socks5 10.124.0.181 1080
socks5 10.124.0.182 1080
socks5 10.124.0.184 1080
socks5 10.124.0.187 1080
socks5 10.124.0.188 1080
socks5 10.124.0.197 1080
socks5 10.124.0.207 1080
socks5 10.124.0.208 1080
socks5 10.124.0.209 1080
socks5 10.124.0.210 1080
socks5 10.124.0.213 1080
socks5 10.124.0.235 1080
socks5 10.124.0.236 1080
socks5 10.124.0.250 1080
socks5 10.124.0.251 1080
socks5 10.124.1.6 1080
socks5 10.124.1.7 1080
socks5 10.124.1.8 1080
socks5 10.124.1.9 1080
socks5 10.124.1.10 1080
socks5 10.124.1.11 1080
socks5 10.124.1.12 1080
socks5 10.124.1.14 1080
socks5 10.124.1.15 1080
socks5 10.124.1.29 1080
socks5 10.124.1.36 1080
socks5 10.124.1.37 1080
socks5 10.124.1.38 1080
socks5 10.124.1.39 1080
socks5 10.124.1.40 1080
socks5 10.124.1.41 1080
socks5 10.124.1.42 1080
socks5 10.124.1.43 1080
socks5 10.124.1.44 1080
socks5 10.124.1.45 1080
socks5 10.124.1.46 1080
socks5 10.124.1.47 1080
socks5 10.124.1.48 1080
socks5 10.124.1.49 1080
socks5 10.124.1.50 1080
socks5 10.124.1.51 1080
socks5 10.124.1.52 1080
socks5 10.124.1.153 1080
socks5 10.124.1.154 1080
socks5 10.124.1.155 1080
socks5 10.124.1.156 1080
socks5 10.124.1.157 1080
socks5 10.124.1.158 1080
socks5 10.124.1.159 1080
socks5 10.124.1.160 1080
socks5 10.124.1.161 1080
socks5 10.124.1.162 1080
socks5 10.124.1.174 1080
socks5 10.124.1.176 1080
socks5 10.124.1.182 1080
socks5 10.124.1.186 1080
socks5 10.124.1.187 1080
socks5 10.124.1.188 1080
socks5 10.124.1.189 1080
socks5 10.124.1.190 1080
socks5 10.124.1.191 1080
socks5 10.124.1.192 1080
socks5 10.124.1.193 1080
socks5 10.124.1.194 1080
socks5 10.124.1.195 1080
socks5 10.124.1.196 1080
socks5 10.124.1.197 1080
socks5 10.124.1.198 1080
socks5 10.124.1.199 1080
socks5 10.124.1.200 1080
socks5 10.124.1.201 1080
socks5 10.124.1.202 1080
socks5 10.124.1.203 1080
socks5 10.124.1.204 1080
socks5 10.124.1.205 1080
socks5 10.124.1.209 1080
socks5 10.124.1.210 1080
socks5 10.124.1.211 1080
socks5 10.124.1.224 1080
socks5 10.124.1.225 1080
socks5 10.124.1.226 1080
socks5 10.124.1.227 1080
socks5 10.124.1.228 1080
socks5 10.124.1.229 1080
socks5 10.124.1.230 1080
socks5 10.124.1.231 1080
socks5 10.124.1.232 1080
socks5 10.124.1.233 1080
socks5 10.124.1.234 1080
socks5 10.124.2.22 1080
socks5 10.124.2.23 1080
socks5 10.124.2.24 1080
socks5 10.124.2.29 1080
socks5 10.124.2.30 1080https://api.mullvad.net/www/relays/wireguard/
Or you can manipulate the results from here:
https://github.com/maximko/mullvad-socks-list
After you've got proxychains-ng installed, use it like this:
proxychains4 -q -f /path/to/your.conf <command>So if we've got a list of videos to download:
cat listofurls.txt | xargs -rn 1 proxychains4 -q -f /path/to/your.conf yt-dlpYou can verify that it's changing IP addresses with each run of proxychains by using this command a few times:
proxychains4 -q -f /path/to/your.conf curl https://am.i.mullvad.net/ipedit2: You can also use proxychains for TOR connections. I think the default configs at /etc/ and $HOME/.proxychains/ use TOR out of the box if you run it without the -f flag.
Last edited:
- Joined
- Feb 21, 2023
Is it just me or is archive.ph slow as shit? Ghostarchive is almost instant in comparison.
Psychonaut
kiwifarms.net
- Joined
- Mar 26, 2024
Does anyone know some good archival tools that use an .onion URL? I sometimes use Tor on Kiwi Farms so having shit archived while using Tor will be very helpful.
No its not just you, I'm having some issues as well.
- Joined
- Dec 17, 2022
archive.today can archive .onion addresses and you can also reach it by TOR:
http://archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd.onion
Psychonaut
kiwifarms.net
- Joined
- Mar 26, 2024
Why was there no .onion available button whenever I accessed the website? Thanks btw.
- Joined
- Dec 17, 2022
That has something to do with how the admin of a site sets up the apache/nginx server on their end to advertise it iirc.
Psychonaut
kiwifarms.net
- Joined
- Mar 26, 2024
I'm not sure if this is the right place to talk about it. But does anyone have an Archive of a YouTuber named Guwi talking about Kiwi Farms? I remember seeing that video back when it was available & I wanted to watch it again only for it to be deleted. Here is what is YouTube Profile Looks like.
- Joined
- Mar 13, 2022
This video? It wasn't deleted just unlisted.
Psychonaut
kiwifarms.net
- Joined
- Mar 26, 2024
Thank you. Here is a re-post on the forum in case people can't find the video. Good video in my opinion.
Kiwi Farms: Where the Old Internet Dies
By: Guwi
San Dobel
kiwifarms.net
- Joined
- Aug 14, 2024
- Highlight
- #674
I know this is an old thread, but I thought I'd reply with some newer archival tools that I use a lot.
https://cobalt.tools/ - While this is more so meant to just be a media downloader, the video you download could also become an archival of the video if the original link gets taken down. There are also other instances for this in case the official instance which I just linked doesn't work at https://instances.hyper.lol/instances/.
https://preservetube.com/ - Already been mentioned and used before on this site, but with this site I helped archive the Weird Al - Albuquerque MV by RWappin.
https://ghostarchive.org/ - Archives webpages and videos, PreserveTube alternative in case the servers are down, or if the damn thing just refused to archive.
https://www.waybackyt.download/ - I don't use this website a lot. While it's just a website of a trick you can use to download deleted or unavailable videos with the Wayback Machine, I prefer the manual trick itself. It's still useful for archiving videos, though. The manual trick in question is https://web.archive.org/web/2oe_/http://wayback-fakeurl.archive.org/yt/<video id>. I'd suggest using this if PreserveTube or Ghost Archive's versions of the video were low quality.
https://fileditch.com/, https://catbox.moe/ and other Pomf clones alike - I've uploaded some deleted videos there, including that one where 24 Frames of Nick rants about the tribute at the end of the Sponge on the Run movie (what a jerk). Use FileDitch if the video is too big for Catbox.
Besides the potential necroposting, I hope this helped.
https://cobalt.tools/ - While this is more so meant to just be a media downloader, the video you download could also become an archival of the video if the original link gets taken down. There are also other instances for this in case the official instance which I just linked doesn't work at https://instances.hyper.lol/instances/.
https://preservetube.com/ - Already been mentioned and used before on this site, but with this site I helped archive the Weird Al - Albuquerque MV by RWappin.
https://ghostarchive.org/ - Archives webpages and videos, PreserveTube alternative in case the servers are down, or if the damn thing just refused to archive.
https://www.waybackyt.download/ - I don't use this website a lot. While it's just a website of a trick you can use to download deleted or unavailable videos with the Wayback Machine, I prefer the manual trick itself. It's still useful for archiving videos, though. The manual trick in question is https://web.archive.org/web/2oe_/http://wayback-fakeurl.archive.org/yt/<video id>. I'd suggest using this if PreserveTube or Ghost Archive's versions of the video were low quality.
https://fileditch.com/, https://catbox.moe/ and other Pomf clones alike - I've uploaded some deleted videos there, including that one where 24 Frames of Nick rants about the tribute at the end of the Sponge on the Run movie (what a jerk). Use FileDitch if the video is too big for Catbox.
Besides the potential necroposting, I hope this helped.
Last edited:
- Joined
- Jun 17, 2024
Does anyone know which YouTube archival sites also preserve the comment section? There is a video I am attempting to archive, where the comments are much more relevant than the video.
- Joined
- Mar 13, 2022
If you archive any Invidious instance like yewtu.be that should work. Caveat: Some videos may not be viewable (notably age restricted ones) and it doesn't grab all comments.
- Joined
- Aug 28, 2019
Is it possible to find a separate page for Disqus comment sections for news articles that can be archived separately? I want to find the page described here if it exists and put that in Archive.today:
- Joined
- Feb 3, 2023
Did you have any luck archiving off spotify? Nothing I've been trying has worked and I'm at the point where I'm considering loading up OBS and just recording each podcast episode like that.
- Joined
- Feb 24, 2019
- Joined
- Dec 12, 2022