Help with Best Practices and Getting Started with Proxmox and ZFS

I’m new to Proxmox and a newer Linux user. After listening to 10-15 Self-Hosted Podcasts, I’m interested in learning more about ZFS and testing it out on the home lab server. I’ve yet to install anything on the server, but I have been installing updates and configuring it for pve-no-subscription.

The server is a Dell r720xd, with x2 E5-2695v2, ~48 GB of RAM, and x4 8 TB drives in a hardware Raid 5 for ~24TB of storage.


Current storage setup.

I have several questions:

What are the next steps to start utilizing ZFS on the server?

What are some resources to learn more about ZFS?

Can I install VMs on a ZFS disk or is it recommended to install them on a LVM?

Do you have any other resources, like Proxmox VE Helper-Scripts | Scripts for Streamlining Your Homelab with Proxmox VE to get started?

Hello @SolidBaseIT .
ZFS does not like HW Raid controlled disks. Disable RAID and switch to pass through/JBOD/HBA mode if your RAID controller supports it.
If it does not, you can find cheap HBA adapters that fits your HW.
(Someone ask something similar on FreeNAS forum: FreeNAS on Bare metal Dell R720XD (H310 MINI) or ESXi VM? | TrueNAS Community)

I’d recommend experiment/exercise(/break things?) with ZFS before installing VMs.
For example install on RAIDZ-1 then add disks to make it a RAIDZ-10.

I use both ZFS and LVM but recommend ZFS for most tasks.

Regarding articles/resources I’m obliged :slight_smile: to direct you to this article: ZFS 101—Understanding ZFS storage and performance | Ars Technica

Google directed me to:

HTH,
Have a great journey!

2 Likes

THIS. Every article says that so it surely should be taken serious.

Disable RAID and switch to pass through/JBOD/HBA mode if your RAID controller supports it.

I’m afraid the controller does not have the mode, but possibly could be flashed to HBA mode.
You should find out your exact model and google, try to find someone who already did it, it can get messy. There are guides (one randomly picked from the web).

I think on 720xd you cannot easily change the HBA as it is connected via propritary cables to the back plane for the HDD hot swap enclosures. Maybe you can remove it and send to a specialist for flashing.

(Someone ask something similar on FreeNAS forum: FreeNAS on Bare metal Dell R720XD (H310 MINI) or ESXi VM? | TrueNAS Community)

One seem to share my concerns by proposing to replace the whole machine by one already flashed from ebay. Maybe write to server specialist who offers one on ebay and ask if you can send your HBA for flashing for a fair price?

I’d recommend experiment/exercise(/break things?) with ZFS before installing VMs.

yes, I’d do the same. Maybe make small partitions or have a different root disk (such as ZFS root on SSD) and try options and run benchmarks, practice replacment of “simulated faulty” disks and so.

I use both ZFS and LVM but recommend ZFS for most tasks.

Ahh interesting!
I know swap should be much better configured on LVM mirrors but not on ZFS.
For my learning, what examples also are better with LVM?

1 Like