Home Server and Self Hosting General - Technological Self-Sufficiency

[moocow]

Shovel as many bitty-boards (Raspberry Pi-style widgets and ODROIDs, etc.) with hard disks as you can cram onto your shelf, network them together, install Ceph on them, and just keep adding nodes and disks as space runs low. Fuck proprietary NAS OS'es and manufacturers.

 

[CoolSixtyNiner]

I want to run my plan by the thread. I am building a home server for a few different purposes:

- AI home lab / sunshine streaming of Steam games to my Steam Deck
- immich / file sharing behind a VPN for me and my girl to use instead of google
- self hosted web stuff (blog, maybe webui for ollama)
- plex for home streaming of my legally obtained media
- dev workstation

I've been doing a ton of research and landed on Proxmox as my hypervisor. I believe I understand high level the steps forward:

- AI home lab / game streaming would necessitate a vm that has my beefy GPU pass through.
- the rest will run on vms or containers

I also have a 1080ti collecting dust, and a hardware KVM that I current use to switch between my workstation and my server. I was thinking of assigning it to my dev environment so I can have an hdmi output to my KVM when I am working from my desktop although I do not know how beneficial that would be.

Does this generally make some sense?

 

[cheersbigears]

I want to run my plan by the thread. I am building a home server for a few different purposes:

- AI home lab / sunshine streaming of Steam games to my Steam Deck
- immich / file sharing behind a VPN for me and my girl to use instead of google
- self hosted web stuff (blog, maybe webui for ollama)
- plex for home streaming of my legally obtained media
- dev workstation

I've been doing a ton of research and landed on Proxmox as my hypervisor. I believe I understand high level the steps forward:

- AI home lab / game streaming would necessitate a vm that has my beefy GPU pass through.
- the rest will run on vms or containers

I also have a 1080ti collecting dust, and a hardware KVM that I current use to switch between my workstation and my server. I was thinking of assigning it to my dev environment so I can have an hdmi output to my KVM when I am working from my desktop although I do not know how beneficial that would be.

Does this generally make some sense?

I've recently (ish) started using Proxmox for similar things and it works very well.
I've got:
- AI VM with ollama & comfyUI
- Media VM with Jellyfin, Radarr, Sonarr, etc.
- VM for misc selfhosted websites & bots
- A few VMs with game servers that I turn on/off as and when they are needed.

I haven't messed around with Sunshine, but it was fairly simple to pass through my GPU to the AI VM, so that'll probably be fine :^)

Also look into how to disable the Proxmox subscription nag popups.


Unrelated - does anyone know of a good Fire TV alternative? I want something that I can watch Jellyfin and YouTube (preferably with ad/sponsor blocks). I got pretty sick of the built-in ads in the Fire TV UI, and all of the effort put in to stop you customising anything.

I have tried using Kodi running on a mini PC, but it crashes when trying to play certain things, and the YouTube plugin seems completely broken.

 

[Jeff Q. Anime]

bloated

Join the church of systemd-nspawn my little chuddy...

there are applications that won't run in a container.

Name them!

security

Cgroups are secure my young chud. I have encountered zero reason to use virtual machines anymore unless you're, you know, trying to run another operating system entirely. Sure, okay, you can't run BSD or Windows in a container. You do need to use a VM for a forbidden router or for gaming or to host active directory or whatever. I assume you mean if something fails in a [VM] it doesn't take down the whole system, but that's the same case for containers... And again, you don't have to use docker, you can use systemd-nspawn, you can use lxc if you're super old. But honestly docker just works. Yeah, it's bloated, a lot of developers who make their container stacks are retards. But I've only got so much time. They do it for free. I use dockge for managing my docker bullshit and systemd-nspawn for everything else.

Shovel as many bitty-boards (Raspberry Pi-style widgets and ODROIDs, etc.) with hard disks as you can cram onto your shelf, network them together, install Ceph on them, and just keep adding nodes and disks as space runs low. Fuck proprietary NAS OS'es and manufacturers.

Absolutely deranged, retarded, and reddit alternative to buying a normal computer with $20 hba cards and running ZFS. The raspberry pi cluster meme truly needs to die.

 

[moocow]

Absolutely deranged, retarded, and reddit alternative to buying a normal computer with $20 hba cards and running ZFS. The raspberry pi cluster meme truly needs to die.

ZFS eats data. It's only a matter of time. A pile of ODROID HC4's hosting Ceph and k8s is much more useful.

ETA: Never trust anyone who advocates any aspect of systemd as a "good" thing to rely upon or make use of.

 

[Jeff Q. Anime]

ZFS eats data. It's only a matter of time.

God's most shit eating retarded gorilla nigger of all time in awe

remember my little chuddies, enterprise usecase software with financial backing always has more long term support and stability than tinkertranny hobbyshit projects made by reactionary retards that hate functional interfaces that Just Work

 

[moocow]

God's most shit eating retarded gorilla nigger of all time in awe

I hate brand zealots so much.

Have a data-munching bug in ZFS that went hidden/undiscovered for 18 months. And here's another one.

Stop being a faggot.

 

[Jeff Q. Anime]

Wow. Something happened, once. Twice, even. That's crazy.

I wonder how many data-integrity bugs go uncaught in other filesystems that do not have users that care so much about data integrity...

I guess we'll never know.

even if you're a niggernerd that wants to avoid zfs (the best filesystem and volume manager on earth) for its extremely minor very edge case faults that 99.99% of users have never run into, the raspberry pi cluster mode of operation is and always has been retarded. just buy a normal computer you freak. ++cost ++complexity ++failure points --performance I just bought a 3d printer guize reddit karma post whoring behavior.

 

[Billow Riley]

ZFS eats data. It's only a matter of time. A pile of ODROID HC4's hosting Ceph and k8s is much more useful.

ETA: Never trust anyone who advocates any aspect of systemd as a "good" thing to rely upon or make use of.

I hate brand zealots so much.

Have a data-munching bug in ZFS that went hidden/undiscovered for 18 months. And here's another one.

Stop being a faggot.

Why'd you wait until you got insulted to share those links? Why not just put them in your first post?

 

[moocow]

Why'd you wait until you got insulted to share those links? Why not just put them in your first post?

To annoy you, personally.

Snark aside, I'd assumed it was common knowledge. It caused rather nasty waves in the ZFS fandom when that all happened.

 

[Sandnigger Mudhut]

How tf do I install Calibre on my server closet? I keep getting the systemctl error "There is no calibre library at: /opt/calibre/your_library" despite there being files in said directory. I've been having this issue for 7 months now.

 

[Free4Ever]

Is there good software for managing a distributed digital archive? I need these features:

• source available
• no stoopid duplication of data a la Git-LFS (git-annex doesn't have this problem)
• checksums
• keeping a versioned index of where copies are & what their storage medium properties are (e.g. stored on RAID-10 ZFS or EXT4; with parity data or not; and so on)
• custom risk-assessment logic (e.g. "if backup A and B are at location A, the risk is correlated N%")
• automatic copying over network + manual with confirmation for sneakernet (... USB stick between two computers in my house I can't bother to network)
• support for plain data and for "deep" data such as Git repos - tracked in some nifty way such that "losing at most N commits worth of unsaved work" can be modeled

... am I overlooking something? This shit is low-key easy to implement or am I missing something?
I don't need gigaplatformsupport because it's just for my own use, I can extend support as needed.

 

[Major Discord]

Is there good software for managing a distributed digital archive? I need these features:

I am a bit confused as to what archive you want to maintain exactly. Are you talking about archiving videos/webpages or what?

 

[Demonslayer1776]

What is the usecase of bloating your setup with purpose built virtual machines in a homelab environment
come to containerland my little chuddies, nobody is going to break cgroups...

You shouldn't in most cases. I'd argue that in most environments where containers may add complications, a VM will too and youd be better off running bare metal (specific hardware setups like gpu passthrough). There are some specific setups where a traditional VM may help, but it's fairly rare, especially in homelabs. The most obvious one I would see is running a Windows server in a VM for a domain controller.

 

[Demonslayer1776]

How tf do I install Calibre on my server closet? I keep getting the systemctl error "There is no calibre library at: /opt/calibre/your_library" despite there being files in said directory. I've been having this issue for 7 months now.

I recall having to create the library in the calibre desktop app and copying it over to the calibre-web server. It's been a while but it was very dumb

 

[Sandnigger Mudhut]

I recall having to create the library in the calibre desktop app and copying it over to the calibre-web server. It's been a while but it was very dumb

Yes. The guide says to use Rsync, but I was getting permission errors, so I just copied the files from my HDD to a non-root accessible directory on the server. I'll try again with Rsync.

 

[SchloppyI.T.Man]

Actually you can keep this thread, just name it the homelabbing thread for shit-flinging niggers

 

[wmaf1488]

Any foolproof way of having a Nextcloud homeserver?

- use the Snap or AIO Docker? I was thinking the Snap is better because you can roll back an update if it breaks something
- best way to access from elsewhere in any browser or device when youre on a normal residential ISP with dynamic DNS? Cloudflare Tunnel seems easy but MITMs you
- how to backup everything in case your server breaks? How to back up user data like files separately from the system/"app"?

 

[DavidS877]

Any foolproof way of having a Nextcloud homeserver?

- use the Snap or AIO Docker? I was thinking the Snap is better because you can roll back an update if it breaks something
- best way to access from elsewhere in any browser or device when youre on a normal residential ISP with dynamic DNS? Cloudflare Tunnel seems easy but MITMs you
- how to backup everything in case your server breaks? How to back up user data like files separately from the system/"app"?

People use snap? Like, by choice?

Anyway. I'm running it in docker/podman with an external MariaDB, backup is just dump DB, backup the volume you present to docker/podman.

I have a bunch of stuff exposed on a dynamic IP. My router updates a DDNS server that lets me have a static name. LetsEncrypt for SSL. Apache(yes, I'm old) proxy forwarding to Nextcloud and some other internal services, all on opaque sub paths to at least cause the logs to fill up slower with attacks.

 

[Quandale Octavius Dingle]

I've got an old 2U dell office machine with:​

CPU: Intel i7 3770 4c/8t​

iGPU: Intel HD 4000​

RAM: 16gb 1600mhz​

NIC: Intel 82579LM​

SSD: 120gb (boot)​

HDD: 12tb, 500gb
OS: Ubuntu 20.04.1 LTS​

Services: SMB, QBitTorrent, JDownloader2​

I've been using it as a 24/7 NAS, SeedBox and filehost downloader for about a year now with the 12tb drive for torrents and the 500gb drive as scratch space for things saved through JDownloader. Which mounts as a CIFS network drive on my main machine so FFMPEG can transcode whatever is on it before saving it to my archival drive.​

I've become comfortable with this setup but I quickly realized that this is way overkill for what I've been doing with it and have been wondering for a while if there are any applications or services that I could run on it. I've considered hosting a Mineclone or Veloran server for online aquaintances to get on together but I don't have a reverse proxy to put my dynamic IP behind.​

I also have an old low power thin client HP Greenwood motherboard with​

CPU: AMD e1-6015​

iGPU: r2 HD 8240​

RAM: 8gb 1333mhz​

NIC: Realtek RTL8106E-CG​

That I used to use as an HTPC booting LibreElec and running Kodi with only 1gb of RAM before we got a new AndroidTV puck to run it off of. It only runs at about 20w but the APU in it is shit for anything that isn't an embedded type of task and the NIC is only 10/100. Plus there's almost 0 expandability, only a mini PCIE 2.0 1x slot and 2 sata ports. So the most I could put on it is a single 3.5" HDD and a single 2.5" SSD with a 15 pin slimline to 22 pin sata adapter and maybe a mini PCIE network card/riser. Plus a case for it all. Which all included would cost more than what the board is worth. But I've also wondered what I could run off of it since I don't like having hardware just sit around doing nothing.​