- Joined
- Nov 25, 2018
Follow along with the video below to see how to install our site as a web app on your home screen.
Note: This feature may not be available in some browsers.
I had 5650's but 5690's are cheap as duck nowWhat are the xeons for
But what is the purposeI had 5650's but 5690's are cheap as duck now
Snappy docker web interfacesBut what is the purpose
How much is your power bill with all that stuff running constantly?View attachment 6125299
My setup from top to bottom-
3x Dell r630s 256GB DDR4 Ea.
1x HP DL360 G9
1x Dell R720 (paper weight)
1x Dell EMC KTN STL3 disk bay
1x Netapp ds 4243 disk bay
I use it to run jellyfin.
How much is your power bill with all that stuff running constantly?
The obvious answer is to make selfhosted AI waifus that will comfort you while you are lonely c:I built a new server for myself that hosts AI capabilities (basically Ollama and Stable Diffusion with OpenWebUI for now) but I realized I have no idea what to actually do with it.
Don't really know how Proxmox wraps shit around but in my experience with hosting sonarr etc. on my regular linux PC Docker compose is what i liked for setting docker side up the most and lazydocker to inspect if shit works or not.how the fuck do I use Docker CLI properly
ZFS is a very special file system that requires a bit more of system resources but is the "industry standard" where it comes to reducing data loss. But its very fucking specific with how it works so you just have to dive deep to see what your system can support.what the fuck is ZFS and how to set it up to not lose any data
If data is important to you storing it in 3 places with one of them being off-site is recommended. If you're just torrenting then who really cares.how should I deal with raw cold backups with ZFS (no remote backups)
You're probably gonna run it in some kind of raid for data redunancy so ideally/for convenience you'd want to have them all be the same size (especially if they are hdd). With ZFS you may also like to have an SSD for cashing.what drives should I buy for a NAS (dedicated/whatever, same models/mixed models, new/refurbs)
It doesn't. Docker on Proxmox means you're setting up either a LXC or a KVM and install Docker in that as if you were to install it on a computer with a bog standard distro. I guess in that regard TrueNAS Scale is better as it has Docker as a part of the main OS and it's control panel, but in case of Proxmox you gotta virtualize it. LazyDocker seems promising though, I wanted to learn Docker CLI to get away with dealing with Portainer which to my understanding isn't just a GUI frontend for Docker and I try to aim for simplicity nowadays, but this looks like it's what I actually wanted.Don't really know how Proxmox wraps shit around
My understanding is that you hook up the drives in a special software RAID array where ZFS handles both the RAID and the file system part. My main worry is not hardware compatibility, but how to adapt to this concept from the standpoint of having a single unencrypted NTFS drive that you just plug in and see the data.But its very fucking specific with how it works so you just have to dive deep to see what your system can support
Yeah wow, 3-2-1 backup rule, buy out warehouses to put additional NAS servers in for redundancy in case your house gets bombed. Yes that's all wonderful advice I already know. Thing is I don't have the resources nor the funds to do a proper 3-2-1 backup that'll be resilient to house fires, so my threat model is limited to hardware failure from excessive use and electric damage, so IMO having two separate copies of the same data in the same place, one being ran in a live environment and the other being only ran for synchronization is enough of a backup in my case.If data is important to you storing it in 3 places with one of them being off-site is recommended
1. The same size concept falls apart with ZFS and my intended method of backup as mentioned previously, it doesn't assign them in the same way RAID 1 would, and I need to know how much space I'll have available before I go out on a shopping spree.You're probably gonna run it in some kind of raid for data redunancy so ideally/for convenience you'd want to have them all be the same size (especially if they are hdd). With ZFS you may also like to have an SSD for cashing.
how the fuck do I use Docker CLI properly
You can't install Docker in an LXC container. If you want to use Docker, you need to use a KVM (correct me if I'm wrong on this, but I couldn't get it working).It doesn't. Docker on Proxmox means you're setting up either a LXC or a KVM and install Docker
what the fuck is ZFS and how to set it up to not lose any data
# Let's setup a spinny hard drive for ZFS with encryption. I'm going to call him bender:
zpool create -o ashift=12 -O compression=lz4 -o feature@encryption=enabled -O encryption=on -O keyformat=passphrase bender /dev/disk/by-partuuid/881343fe-aaaaa-bbbbb-ccccc-62133342576f
# I'm going to use Bender for tv and movies:
zfs create -o mountpoint=/media/tv bender/tv
zfs create -o mountpoint=/media/movies bender/movies
# We have bender now. Say we have another hard drive called fry (same `zpool create` as above). Say I just want to backup my movies to fry. We can use snapshots!
zfs snapshot bender/movies@2024-10-27
zfs send bender/movies@2024-10-27 | zfs recv fry/movies
# oh you want a progress bar?! ship it through pv
zfs send bender/movies@2024-10-27 | pv | zfs recv fry/movies
# but I don't want to send the entire drive each backup! Well use incremental sends!
zfs send -i bender/movies@2022-02-09 bender/movies@2022-09-07 | pv | zfs recv fry/movies
# Okay I'm done with fry. How the hell do I pull him out of my NAS?
zpool export fry
# Now you can safely pull fry. `zpool import` can be used when you put him back in. You might need `zfs load-key fry` if you've rebooted and the encryption key isn't in memeory.
Use a calculator like https://www.raidz-calculator.com/but I don't know how to calculate ZFS eating up however many TB of those drives for it's magic to not overspend or underbuy
Actually, you can. I did just that. Create a Debian 12 LXC container, run Docker installation commands as if it was running on bare metal. It just works. And I assume it's the go-to way of setting up Docker under Proxmox. I just feel like I shouldn't have done it via Portainer, too much bloat/overhead for my needs and there are better, lighter ways to easily manage Docker.You can't install Docker in an LXC container.
I never thought of running Linux on ZFS, it always seemed like something you set up separately from the OS to create a reliable NAS server pool. That's what I want to use it for, but I don't believe wrapping it around in Proxmox would be a good idea so a separate TrueNAS machine would be the way to go.ZFS is pretty damn awesome.
To be fair, I should lay off all the ZFS topics and start with basics like these. How exactly does Proxmox deals with storage? For example, I'd like to set up a Syncthing LXC to have an always online sync anchor in the network, but also have it sync to a bog standard exFAT USB stick, not to the containerized storage that I have no idea how to work on outside of a running container in case of an emergency.what proxmox does
So in short, each RAID-Z level serves double the space of an individual drive? I still wonder if you should go with RAID-Z though, and if basic RAID 1 ZFS would be more than enough for redundancy and data safety. Again, no idea how ZFS works, and it's probably best I leave learning it for later once I get around to building a NAS.Use a calculator like https://www.raidz-calculator.com/
with docker images:Intel Xeon E5-2696 v3 with 18 cores (with hyperthreading)
64gb ram (soon to be 128gb)
Intel Arc A310
Nvidia Quadro k6000
4x 14tb sata drives
500gb NVMe os drive
1tb NVMe working/download drive
Ubuntu Server minimal 24.04
what useful tools would be good to add to it? I'm trying to look into image generation (that may be used for, but won't only be used for, porn) but I have some difficulty understanding all of the different options and how to set it uphomeassistant
readarr
qbittorrent
romm
mkvtoolnix
handbrake
nzbget
romm-db
sonarr
sonarrtv
lidarr
radarr
jellyfin
prowlarr
bazarr
filebrowser
metube
organizr
yacht
npm
nextcloud-aio-mastercontainer (plus sub-containers)
watchtower
That's uh pretty gross bro. Pretty sure there's a gooning forum out there for you somewhere.that may be used for, but won't only be used for, porn