Home Server and Self Hosting General - Technological Self-Sufficiency

  • Want to keep track of this thread?
    Accounts can bookmark posts, watch threads for updates, and jump back to where you stopped reading.
    Create account
geckogoy said:
Most memory errors happen in transmission now anyways, so at a minimum you'd want DDR5 before ECC since DDR5 actually ECCs the info as its moving between the CPU and the memory (ddr4 does not)
Click to expand...
And good luck finding ddr5 ECC at a sane price
 
lizardwizard said:
And good luck finding ddr5 ECC at a sane price
Click to expand...
Wow, it really has gone insane.
In August I got 64GB 6400MHz for $420.
Now the same pair is $770.

That's just nuts.

Admittedly the non-ECC is running $450-500, which is also insane.
 
putinschwarzenegger said:
This site is pretty interesting. I tested it with a test message to email thingy, and my cell provider doesnt currently have their DMARC policy set up, although email to cellular message is decently uncommon i would assume.
Click to expand...
That will cause them issues with mailbox providers like Outlook as they now require a DMARC policy (even if it's p=none) for high volume senders.
 
I converted my old gaming PC into a home server running Ubuntu Server 24.04. Enabled Ubuntu Pro, and now I've got several things running through Docker Compose.

On one docker-compose.yml
- Jellyfin (primary)
= Radarr
- sonarr
- qBitTorrent
- Gluetun

On another docker-compose.myl
- FreshRSS

Why the hell did I struggle so much with standalone Docker containers? I should've just taken the plunge into Docker Compose stuff back when I was daily driving Linux Mint on this thing. Shit's comfy asf. Next stop... WireGuard so I can view my Jellyfin crap on mobile data.

EDIT: WIREGUARD WORKS. HALLE FUCKING LLUJAH
 
Last edited:
I'm considering buying a Mac Studio with the M4 Max and 128gb of ram for local llm shit. Help me.

For the price, its the best cheap option for local llm stuff out there. Way cheaper than the PC side.

Dread First said:
I converted my old gaming PC into a home server running Ubuntu Server 24.04. Enabled Ubuntu Pro, and now I've got several things running through Docker Compose.
Click to expand...
couldn't you have just used portainer?
 
tehpope said:
couldn't you have just used portainer?
Click to expand...

Technically, I did have options like Proxmox, Unraid, Portainer, and so on available to me. I opted for Ubuntu Server over any of the former because I'm only spinning up docker-compose stuff through SSH. I dunno, the former three kinda just feel like overkill for what I'm doing at my general skill level.
 
tehpope said:
I'm considering buying a Mac Studio with the M4 Max and 128gb of ram for local llm shit. Help me.
Click to expand...
Metal is good. Paying Apple too much money for it is not, plus your friends will see it and wonder if you like to take it up the ass by random people on Grindr.

For half the price, try a Ryzen Strix Halo platform. ROCm support is getting better but still isn’t 100% on par with CUDA, LLMs should be fine though. Take a look at Framework Desktop before you decide, chances are it’ll do everything you want at half the price of a Mac Studio.
 
Post Reply said:
It's a great value if you can snag it for $400 from Microcenter.
Click to expand...
Are you on crack?

Seething Troon Collector said:
Metal is good. Paying Apple too much money for it is not, plus your friends will see it and wonder if you like to take it up the ass by random people on Grindr.

For half the price, try a Ryzen Strix Halo platform. ROCm support is getting better but still isn’t 100% on par with CUDA, LLMs should be fine though. Take a look at Framework Desktop before you decide, chances are it’ll do everything you want at half the price of a Mac Studio.
Click to expand...
The loadout of the strix halo pc from framework came out to like $2500 ish before taxes. The mac studio is like $4100 before taxes. Looking into it, the amd soc is good, even better in some aspects to the mac studio. but there's a lot of tinkering you have to do. The Mac Studio just works.

its a tinkerer platform vs an appliance. I've tried getting ROCm working with my 6750 xt. Had a bunch of issues getting just whisper working. I know it can just work, but its possible for shit to just up and break. I'd like to have my family use it too. so i'll pay a bit extra to have rock solid stability and it to just work.

Compared to getting 128gb of vram on pc with dedicated gpus, the mac studio is still a fucking steal.

I do appreciate your comment Seething. The Mac Studio is gonna spend its life hiding in a closet. Regardless, I don't have irl friends.
 
tehpope said:
I've tried getting ROCm working with my 6750 xt. Had a bunch of issues getting just whisper working. I know it can just work, but its possible for shit to just up and break. I'd like to have my family use it too. so i'll pay a bit extra to have rock solid stability and it to just work.
Click to expand...
No I totally agree. It's great if you're willing to accept the trade-offs it's great. ComfyUI works great, but realistically there are a lot of gaps in pytorch for ROCm. It'll get better for sure, but if you're wanting something that 'just works' today, then the Mac Studio works, but for the money, a DGX Spark may serve you better since it's going to be 100% compatible since CUDA. The downside is that the memory bandwidth is lacking, so you're trading speed for reliability at the same price point.


tehpope said:
Compared to getting 128gb of vram on pc with dedicated gpus, the mac studio is still a fucking steal.
Click to expand...
I used to hate on unified memory. This is one of the moments where I have to eat my words. The ability to give the CPU and GPU a shared memory pool with insane memory bandwidth really shines when it comes to inference and light training/fine-tuning even if you can't upgrade it later.

Either way. If it's just going to be a headless appliance that you want to work 'right now' without too many headaches, then either the Mac Studio or DGX Spark is what you want. If you want speed, then go for Apple. Hopefully AMD catches up, it'll introduce a serious competitor to the market since Apple isn't really competing for datacenter spend.
 
Looks like the AI plague affecting DRAM and SSDs has hit HDDs also. Aside of price increases, availability is also an issue. I've been looking at WD 12TB NAS drives for which Amazon UK is now citing three to seven months for dispatch and is limiting customers to ordering just one. Amazon UK limiting orders to one drive only seems to be a general thing with NAS/Enterprise drives which would seem to make purchasing for their typical use (a RAID array) rather challenging!

Just glad I don't need to make an early purchase (or any purchase for that matter).
 
DavidS877 said:
Most AM5 CPUs do real ECC so it's just the MB. Presumably you can troll through the CPUs at AMD's website and see which cheaper ones also support ECC.
For instance the Ryzen 5 7600,7400 and 7400f says it supports ECC. Obviously you'll need to decide on a GPU for the non-iGPU models or something like an ASRock Server board with IPMI and on-board VGA if you'll just be using it as a server. Rumor is all the ASRock AM5 boards (Server and Consumer) all do ECC.
Click to expand...
That's not true. AM5 Asrock patched out ECC reporting (and possibly) ECC on some boards iirc. There's also the commercial only ECC ITX ARM board (honeycomb-lx2) if you're a masochist but it sips power (and has an x8 slot!) compared to the x86 ones.

AM4:
Gigabyte (Single bit ECC/ No verbose)
Asus (dual/single bit on higher end amd verbose log)
Asrock (ECC, dual/single on all except the X300, no halt on dual bit?)
MSI (No)
Biostar (Single bit correction and truncated log)
ECS (KYS)

AM5 (I don't have a AM5 board so double check):
Gigabyte (Partial)
Asus (Partial)
Asrock (Yes, but removed after some patches)
MSI (No)
Biostar (???)
ECS (KYS)

On AM4 there is a softlock issue with cpus in the 1000,2000, 3000 series in idle. So the cheapest non-retarded setup would be a 5350GE (PRO) APU with AM4.
 
Milkshake Sniffer said:
Looks like the AI plague affecting DRAM and SSDs has hit HDDs also. Aside of price increases, availability is also an issue. I've been looking at WD 12TB NAS drives for which Amazon UK is now citing three to seven months for dispatch and is limiting customers to ordering just one. Amazon UK limiting orders to one drive only seems to be a general thing with NAS/Enterprise drives which would seem to make purchasing for their typical use (a RAID array) rather challenging!

Just glad I don't need to make an early purchase (or any purchase for that matter).
Click to expand...
Seagate drives are getting pricy, but there's no purchase limit on them at the moment. I'm debating whether to pull the trigger now or risk the price changes later.
 
teriyakiburns said:
Seagate drives are getting pricy, but there's no purchase limit on them at the moment. I'm debating whether to pull the trigger now or risk the price changes later.
Click to expand...
They just released 32tb IronWolf and seem to have been working pretty hard to get rid of their Desktop Expansion stock. Similarly B&H, Best Buy, etc are out of stock on a number of models. I'm (probably irrationally) thinking that they're going to be shipping some new stock soon and that it'll be best to wait for their 32tb,30tb Desktop Expansions to come out from non-spec 32tb Ironwolf stock and shuck those.
 
And here I am thinking about a small array of 4tb drives...

Also, for future reference, if you're moving an older computer into a 4u rack case, make sure the heatsink is less than 150mm tall. I'm just glad I checked before I moved everything over and tried to close up, because that would have been very annoying.
 
The biggest problem with 32TB, besides the slightly elevated price, would seem to be that the time to read the entire drive is about 1.5 days. Which means your rebuild time on drive failure is several days.
Maybe I'll just wait for that cheap solid state storage... any day now...
 
You must log in or register to reply here.
Back
Top Bottom