I just got done building a new FreeNAS to replace my older one. The purpose was to have more cores and RAM to help with Plex transcoding, be able to run more bhyve virtual machines, and have some more storage space available with the possibility to add even more. I am slowly but surely converting all my media (mostly H264) into H265/HEVC to optimize the space the files take, which really pegs the CPU. My Xeon was starting to struggle with a high number of transcodes at the same time in addition to my VMs and everything else going on. Side note, can't wait for the 3900X or even better the 16c/32t for AM4 that is coming out which will go in my personal desktop so it just flies through the transcoding from H264 to HEVC. 2700X is okay but when you're converting tons of files any time saved would be better.
Specs on the server are:
SuperMicro SuperChassis 933T-R760B
- a 3U rack mount server case with 15 hot swappable SATA and triple redundant 760W power supply. Plenty of airflow.
Asrock X370 Taichi
- I had this before I upgraded to my Asus C7H. It's got an amazing VRM, 12k capacitors, supports ECC RAM, POST code readout, and 10 SATA ports. Currently I have all 10 SATA occupied, but if I add more drives I will need to get something like the LSI 9207-8i which is no problem. I had to remove the big white shroud going across the left side of the motherboard to fit the fans from the case in. It was very easy to do and was just held in place by screws on the back
AMD Ryzen 1700
- 8c/16t perfect for my needs
Stock cooler from the 2700X
-, slightly better than the 1700 cooler and I had it kicking around since I have a Scythe Mugen 5 on my 2700X
4 x 16GB (64GB) Crucial CT16G4WFD8266
- all 4 sticks run fine at the rated 2666MHz C19 and are supported in ECC mode by the Asrock board. ECC is essential for my environment
Visiontek 5450 1GB
- installed in the bottom PCIe slot since I'll use the X8/X16 slots for 10GbE or HBA for additional storage down the road. This has no fan which is nice, and was basically only used for the initial installation of FreeNAS and in the future if I ever need to make BIOS changes. Everything I do is either SSH or FreeNAS webGUI
10 x Toshiba X300 5TB HDDs
- they are configured in a ZFS RAIDZ3 so I have redundancy that 3 drives can fail with a usable storage of about 35TB. With lz4 compression enabled, I should be able to store a little bit more than that. They're cheap, they're fast and noisy so I hope I don't need to replace them too often for failures. I have one extra sitting around (already verified all drives were good with long SMART tests) in case of failure.
2 x 32GB Silicon Power Ultima U02 Flash Drives- used in a mirror for the operating system. I stocked up on these when they were I think $6 or $7 for a 2 pack, so I'll be ready to replace them if they die. FreeNAS works fine off a flash drive, and the large storage allows me to keep many previous versions of FreeNAS if I ever upgrade and need to rollback.
UPDATE: Samsung PM961 128GB MLC M.2 NVME SSD for boot drive
- FreeNAS no longer boots and loads into RAM like previous versions so flash drives are no longer recommended. I got a good deal on Amazon on this so moved over to it.
OS: FreeNAS 11.2-U4.1
- FreeBSD is rock solid, and openZFS is one of the best filesystems. In addition to the various jails (all manually configured jails, no FreeNAS plugins here) I have for things like Plex, Tautulli, Transmission torrent, etc... I also run a few bhyve VMs with Ubuntu 18 server, (PiHole DNS) Ubuntu 16 server (Unifi controller) and more to come. FreeNAS serves up some SMB / NFS shares for various machines on my network. I use netdata to monitor statistics. I automate short SMART testing, long SMART testing, and ZFS scrubs and get email reports to monitor server health.
Pictures of the inside of the server and the back can be found here: https://imgur.com/a/NYrlmp8
I didn't take pictures of the front, but it looks like this (except 10 of the HDD lights are constantly blinking depending on what's going on lol): https://www.memory4less.com/images/p...T-R760B-lg.jpg
Any feedback or questions are welcome!