Meet the Self-Hosters, Taking Back the Internet One Server at a Time - Tired of Big Tech monopolies, a community of hobbyists is taking their digital lives off the cloud and onto DIY hardware that they control.

  • 🔧 Actively working on site again.

Ahriman

Vivere Militare Est.
kiwifarms.net
Joined
Jan 22, 2018

1631772326392.png


It's no secret that a small handful of enormous companies dominate the internet as we know it. But the internet didn't always have services with a billion users and quasi-monopolistic control over search or shopping. It was once a loose collection of individuals, research labs, and small companies, each making their own home on the burgeoning world wide web.

That world hasn't entirely died out, however. Through a growing movement of dedicated hobbyists known as self-hosters, the dream of a decentralized internet lives on at a time when surveillance, censorship, and increasing scrutiny of Big Tech has created widespread mistrust in large internet platforms.

“Self-hosting” is a practice that pretty much describes itself: running your own internet services, typically on hardware you own and have at home. This contrasts with relying on products from large tech companies, which the user has no direct involvement in. A self-hoster controls it all, from the hardware used to the configuration of the software.

“My first real-world reason for learning WordPress and self-hosting was the startup of a podcast,” KmisterK, a moderator of Reddit's r/selfhosted community, told Motherboard. “I quickly learned the limitations of fake ‘unlimited’ accounts that were being advertised on most shared hosting plans. That research led to more realistic expectations for hosting content that I had more control over, and it just bloomed from there.”

Edward, co-creator of an extensive list of self-hosted software, similarly became interested in self-hosting as a way to escape less-than-ideal circumstances. “I was initially drawn to self-hosting by a slow internet connection and a desire to share media and information with those I lived with," he told Motherboard. “I enjoyed the independence self-hosting provided and the fact that you owned and had control over your own data.”

Once you're wrapped up in it, it's hard to deny the allure of the DIY self-hosted internet. My own self-hosting experiences include having a home server for recording TV and storing media for myself and my roommates, and more recently, leaving Dropbox for a self-hosted, free and open source alternative called Syncthing. While I’ve been happy with Dropbox for many years, I was paying for more than I needed and ran into issues with syncing speed. With a new Raspberry Pi as a central server, I had more control over what synced to different devices, no worries about any storage caps, and of course, faster transfer speeds. All of this is running on my home network: nothing has to be stored on cloud servers run by someone else in who-knows-where.

My experience with Syncthing quickly sent me down the self-hosting rabbit hole. I looked at what else I could host myself, and found simply everything: photo collections (like Google Photos); recipe managers; chat services that you can connect with the popular tools like Discord; read-it-later services for bookmarking; RSS readers; budgeting tools; and so much more. There's also the whole world of alternative social media services, like Mastodon and PixelFed, to replace Twitter, Facebook, and Instagram, which can be self-hosted as a private network or used to join others around the world.

Self-hosting is something I've found fun to learn about and tinker with, even if it is just for myself. Others, like KmisterK, find new opportunities as well. “Eventually, a career path started with it, and from there, being in the community professionally kept me personally interested as a hobby.” Edward also found a connection with his career in IT infrastructure, but still continues self-hosting. “It is nice to be able to play around in a low risk/impact environment,” he said.

1631772453506.png

THE AUTHOR'S RASPBERRY PI HOME SERVER SUPPORTS AUTOMATED DATA BACKUPS, FILE SYNCING, AN AD
BLOCKER, AND MORE.


But beyond enjoyment, self-hosters share important principles that drive the desire to self-host—namely, a distrust of large tech companies, which are known to scoop up all the data they can get their hands on and use it in the name of profit.

Despite new privacy laws like Europe's General Data Protection Regulation (GDPR) and the California Consumer Protection Act (CCPA), the vast majority of Americans still don't trust Big Tech with their privacy. And in recent years, the countless privacy scandals like Cambridge Analytica have driven some tech-savvy folks to take matters into their own hands.

“I think that people are becoming more privacy conscious and while neither these laws, nor self-hosting can currently easily resolve these concerns, I think that they can at least alleviate them,” said Edward.

Some self-hosters see the rising interest in decentralized internet tools as a direct result of Silicon Valley excess. “The growth of self-hosting does not surprise me,” nodiscc, a co-creator and maintainer of the self-hosted tech list, told Motherboard. “People and companies have started realizing the importance of keeping some control over their data and tools, and I think the days of 'everything SaaS [Software as a Service]' are past.”

Another strong motivator comes from large companies simply abandoning popular tools, along with their users. After all, even if you're a paying customer, tech companies offer access to services at their whim. Google, for example, is now infamous for shutting down even seemingly popular products like Reader, leaving users with no say in the matter.

KmisterK succinctly summarized the main reasons people have for self-hosting: curiosity and wanting to learn; privacy concerns; looking for cheaper alternatives; and the “betrayed,” people who “come from platforms like Dropbox or Google Photos or Photobucket or similar, after major outages, major policy changes, sunsetting of services, or other dramatic changes to the platform that they disagree with.” This last one “is probably the majority gateway to self-hosting,” based on recent traffic to r/selfhosted, he says. Look no further than their recent Google Photos megathread and recent guides from self-hosters on the internet. For me, changes in LastPass, even as a paid user, had me looking elsewhere.

nodiscc also noted the different reasons people self-host, saying, “There would be many... technical interest, security/privacy, customization, control over the software, self-reliance, challenge, economical reasons, political/Free software activism.” Looking at the growth of self-hosting over the years, Edward says, “These aren't comprehensive reasons but I expect that privacy-consciousness, hardware availability and more mainstream open-source software have contributed to the growth of self-hosting.”

These are all good reasons why self-hosting is so essential. Self-hosting brings freedom and empowerment to users. You own what you use: you can change it, keep it the same, and have your data in your own hands. Much of this derives from the free (as in freedom to do what you like) nature of self-hosting software. The source code is freely available to use, modify, and share. Even if the original author or group stops supporting something, the code is out there for anyone to pick up and keep alive.

Despite the individualistic nature of self-hosting, there is a vibrant and growing community.

Much of this growth can be seen on Reddit, with r/selfhosted hitting over 136,000 members and continuing to rise, up from 84,000 just a year ago. The discussions involve self-hosting software that spans dozens of categories, from home automation, genealogy, and media streaming to document collaboration and e-commerce. The list maintained by nodiscc and the community has grown so long that its stewards say it needs more curation and better navigation.

The quality of free and easy-to-use self-hosting software has increased too, making the practice increasingly accessible to the less-technically savvy. Add to that the rise of cheap, credit card-sized single-board computers like the Raspberry Pi, which lower the starting costs of creating a home server to as little as $5 or $10. “Between high-available hosting environments, to one-click/one-command deploy options for hundreds of different softwares, the barrier for entry has dramatically been lowered over the years,” said KmisterK.

Of course, even the most dedicated self-hosters admit that it isn't for everyone. Having some computing knowledge is fairly essential when it comes to running your own internet services, and self-hosting “will never truly compete with big-name services that make it exponentially easier," KmisterK said.

But while self-hosters may never number enough to put a serious dent in Big Tech's offerings, there is a clear need and benefit to this alternative space. And I can't think of a better model for the kind of DIY community we can have, when left to our own devices.


Personally, I am all for it.
 
All they could find though were people using mini desktops and raspberry pi clusters?
Checking out that sub, that's what's pretty popular, along with NAS setups and the like.

They have some pretty nice setups going.
1631773457315.png 1631773486714.png 1631773519165.png

My only concern about self-hosting is of course, DDoS protection. I could set up and run a crappy blog from an old laptop inside a wardrobe and use Cloudflare as a WAF, but that'd defeat its purpose.

It's one thing if I want to set up a NAS as a personal crypto/pirate box and no one has access to it but me, but the moment you want to put out some content, it's like walking around the battlefield of Verdun with sandals and a Hawaiian shirt on.
 
Last edited:
The charts all look nice but nearly all of them are useless. The homelab and selfhosted subreddits have an issue with people posting "porn" of interfaces they configured that look "cool" but are functionally useless. Heimdall and graphana are great if you have a use but there is actual work you have to do past all the sexiness. Selfhosting is great, though.
The largest obstacle is learning linux if you want a large range of selfhosted applications.
 
Last edited:
The charts all look nice but nearly all of them are useless. The homelab and selfhosted subreddits have an issue with people posting "porn" of interfaces they configured that look "cool" but are functionally useless. Selfhosting is great, though.
Heimdall and graphana are great if you have a use but there is actual work you have to do past all the sexiness.
Yea, same thing on /r/datahoarder. I'd argue that that's the nature of plebbit.

Either way, I am all for having all your stuff on-prem.
 
Self-hosting is basically going to be a dead end 99% of the time. If you despise Reddit, Facebook. et. al. (and really, you should), you can always use Amazon AWS or a blog to make your own site, provided it's relatively inoffensive and doesn't host pirated content, and there's a big vacuum where Geocities used to be as far as that's concerned. Everything from hosting your vacation pictures from your 2015 New Orleans trip or an autistic database of every railroad crossing and details about said crossings (gates, cantilevers, both, or neither?) can be done through that.

If you want to provide safe harbor for wrongthink or piracy (even for yourself), you're going to be in a world of shit when every payment processor eventually cuts you off or blacklists you. (We all Null has basically done a lot of backend Internet stuff for himself due to insane people and/or paranoia, but few people are going to have the patience or funds for that).

Even if you woke up tomorrow and decided that you wanted to make some sort of new user-created content site, even if it was a good idea in theory ("YouTube...but 2005 YouTube, with normal people making videos 10 minutes or less! No algorithms promoting music or professionally produced bits!") you aren't independently wealthy or well-connected enough to make anything sustainable.
 
My only concern about self-hosting is of course, DDoS protection.
Not just DDOS protection, but also just protection against being hacked. Putting something on the public internet today means having every script kiddie script in existence run against you. I'd be wary of running anything but the simplest, most battle-tested, non-interactive HTTP server.
 
Not just DDOS protection, but also just protection against being hacked. Putting something on the public internet today means having every script kiddie script in existence run against you. I'd be wary of running anything but the simplest, most battle-tested, non-interactive HTTP server.
Precisely. Youtoobers like Network Chuck cover topics like this




The downside is that hardening your shit becomes a second job. I mean Nool here can attest to this... troons with nothing better to do have been hitting the site constantly.
 
Self hosting is an absolute good but the problem is it's unsuitable for normies in its current configuration. My sister is not a linux sysadmin and she shouldn't be.
Which is why "Urbit fixes this" is the only proper answer.
 
Self hosting is an absolute good but the problem is it's unsuitable for normies in its current configuration. My sister is not a linux sysadmin and she shouldn't be.
Which is why "Urbit fixes this" is the only proper answer.
No one (except for paypigs) wants to pay ten dollars to use your small corner of the dark web, populated entirely by paypigs, and lacking in multiple-hop ("onion routing") anonymity, Curtis.

Tor and I2P are free, anonymized as far as IP addresses are concerned, and great places to self-host websites and just about any other service.
 
Self hosting is an absolute good but the problem is it's unsuitable for normies in its current configuration. My sister is not a linux sysadmin and she shouldn't be.
Which is why "Urbit fixes this" is the only proper answer.
I'd argue suggesting Urbit on its own kinda misses the point. Ideally, in fact, you'd use the infrastructure you've already got in place, be it a VPS or a local small server, to also host your Urbit ship on it persistently along with everything else you need.
 
  • Dumb
Reactions: TheSkoomer
who tf am i supposed to talk with on a self hosted social media? lol
Self-hosting is basically going to be a dead end 99% of the time. If you despise Reddit, Facebook. et. al. (and really, you should), you can always use Amazon AWS or a blog to make your own site, provided it's relatively inoffensive and doesn't host pirated content, and there's a big vacuum where Geocities used to be as far as that's concerned. Everything from hosting your vacation pictures from your 2015 New Orleans trip or an autistic database of every railroad crossing and details about said crossings (gates, cantilevers, both, or neither?) can be done through that.

If you want to provide safe harbor for wrongthink or piracy (even for yourself), you're going to be in a world of shit when every payment processor eventually cuts you off or blacklists you. (We all Null has basically done a lot of backend Internet stuff for himself due to insane people and/or paranoia, but few people are going to have the patience or funds for that).

Even if you woke up tomorrow and decided that you wanted to make some sort of new user-created content site, even if it was a good idea in theory ("YouTube...but 2005 YouTube, with normal people making videos 10 minutes or less! No algorithms promoting music or professionally produced bits!") you aren't independently wealthy or well-connected enough to make anything sustainable.
this idiot thinks people want to create 10 min videos in 2021. another lol
 
I'd argue suggesting Urbit on its own kinda misses the point. Ideally, in fact, you'd use the infrastructure you've already got in place, be it a VPS or a local small server, to also host your Urbit ship on it persistently along with everything else you need.
A Raspberry Pi with SSD. It's meant to be stupidly easy to set up. You don't need special hardware or knowledge
who tf am i supposed to talk with on a self hosted social media? lol
ngmi
 
  • Like
Reactions: Wright
Back