Overclock.net - An Overclocking Community - Reply to Topic
Thread: Ok... So who needs a 50-66TB server?? Reply to Thread
Title:
Message:

Register Now

In order to be able to post messages on the Overclock.net - An Overclocking Community forums, you must first register.
Please enter your desired user name, your email address and other required details in the form below.
User Name:
If you do not want to register, fill this field only and the name will be used as user name for your post.
Password
Please enter a password for your user account. Note that passwords are case-sensitive.
Password:
Confirm Password:
Email Address
Please enter a valid email address for yourself.
Email Address:

Log-in


  Additional Options
Miscellaneous Options

  Topic Review (Newest First)
05-09-2020 06:13 PM
fg2chase
Quote: Originally Posted by BuzzLighter View Post
OP, as I understand, you know a lot about this stuff. I want to open an online shop and it seems that it would require a hell lot of free space. I don't have a permanent IT specialist in my team, so I asked one of my friends, who claims to be an IT specialist and he told me that I need an instant dedicated server for this purpose. Even told me where to find one. And now I'm collecting information. As I understood by this friend of mine, I need something like 70TB of a free space. Is it only possible to get it only if I buy/rent dedicated server?
This depends on what you are doing in your business, What did he say you needed 70TB of space for? Fault tolerance? I need some more information in order to give you an educated response.

What is your business doing? I just deployed a small poweredge server with 10TB of space for a small attorneys office, they are only using 700GB of word documents and such....
05-09-2020 06:11 PM
fg2chase
Quote: Originally Posted by parityboy View Post
A couple of questions:

1) How did you make the jump to 92TB? I see 3TB drives in that screenshot and previously your max capacity was 66TB. Did you replace them with 4TB drives?

2) Considering you have a P2000 for your transcoding needs, what tangible benefits does the 3800X bring? Once the GPU hits a certain load, can Plex fallback to the CPU for subsequent transcodes?
I am now sitting at over 120TB, I have replaced 1/2 of the 3TB drives with 8TB ones and will continue to do so as the storage needs rise.

The plan now is to max out the board to a 3950X, I am still noticing a lot of CPU and GPU usage when I am both hosting movies and TV and recording live TV from my cable provider as well. A 3950X will be the last CPU I put in there for the life cycle of the system. I suspect I will start a new server around 2028 or so if the last server I had is any indication. That one existed from 2008-2018 and was using an AMD 1090T if I recall correctly.
05-09-2020 06:07 PM
fg2chase
Quote: Originally Posted by EniGma1987 View Post
Have you noticed data corruption in your storage pool? I never had issues on my plex server before when it was single drives for everything. I converted to storage pools recently and have had 4 or 5 issues where whole folders have become inaccessible with file system errors and need to run an error check to fix it. I had this issue on the plex server and my own personal computer with my new game drive in a pool. Plex server runs Server 2019 Datacenter edition, my own PC runs WIn 10 X64 v2004. So kinda weird. Just wondering if you noticed similar issues when using storage spaces pool?
I have not noticed any corruption at all actually, and some of this data goes back to 2008 when I was using windows home server V1 which was 'known' for corruption. Storage spaces has come a long way since then and is now baked into Windows Server 2019.
04-29-2020 08:28 AM
BuzzLighter OP, as I understand, you know a lot about this stuff. I want to open an online shop and it seems that it would require a hell lot of free space. I don't have a permanent IT specialist in my team, so I asked one of my friends, who claims to be an IT specialist and he told me that I need an instant dedicated server for this purpose. Even told me where to find one. And now I'm collecting information. As I understood by this friend of mine, I need something like 70TB of a free space. Is it only possible to get it only if I buy/rent dedicated server?
02-06-2020 11:24 AM
parityboy
Quote: Originally Posted by fg2chase View Post
I have made a few upgrades. It physically looks the same but it has grown to over 92TB and it now has a Ryzen 3800X/quadro P2000
A couple of questions:

1) How did you make the jump to 92TB? I see 3TB drives in that screenshot and previously your max capacity was 66TB. Did you replace them with 4TB drives?

2) Considering you have a P2000 for your transcoding needs, what tangible benefits does the 3800X bring? Once the GPU hits a certain load, can Plex fallback to the CPU for subsequent transcodes?
02-04-2020 03:32 PM
EniGma1987
Quote: Originally Posted by fg2chase View Post
I have made a few upgrades. It physically looks the same but it has grown to over 92TB and it now has a Ryzen 3800X/quadro P2000
Have you noticed data corruption in your storage pool? I never had issues on my plex server before when it was single drives for everything. I converted to storage pools recently and have had 4 or 5 issues where whole folders have become inaccessible with file system errors and need to run an error check to fix it. I had this issue on the plex server and my own personal computer with my new game drive in a pool. Plex server runs Server 2019 Datacenter edition, my own PC runs WIn 10 X64 v2004. So kinda weird. Just wondering if you noticed similar issues when using storage spaces pool?
02-04-2020 12:07 PM
fg2chase
fg2chase

I have made a few upgrades. It physically looks the same but it has grown to over 92TB and it now has a Ryzen 3800X/quadro P2000
02-03-2020 03:11 PM
parityboy @thread

Quick update: while perusing the 'net I've discovered that QuickSync isn't fully supported by the open source driver in the Linux kernel and that the proprietary Intel driver requires a patched build of ffmpeg to work. The options are VA-API (assuming I can get the iGPU to pass through) or a better CPU (I'm leaning towards the latter) but apparently some boards will not boot without a GPU active and the Ryzen 1700 I was considering (currently in my workstation) doesn't have one.

"More research is needed" (tm),
01-23-2020 05:06 AM
parityboy
Quote: Originally Posted by fg2chase View Post
Hey man, I just saw this. I forgot all about this site... I don't monitor CPU usage really but I do know that the Quadro P2000 does most of the heavy lifting when it comes to transcoding so the CPU usage usually remains pretty low.
Thanks for that. I tried passing though my iGPU last night but it appears I need to create a fresh virtual machine with UEFI support, so that's been queued for a later date. In further testing, adding a second transcoded stream with all 6 vCPUs active pushes the usage back up to around 99% load. For the moment it's only me using the media server so it's not an issue, but if I were to support other users (i.e. family members) I'd need a lot more horsepower.

For the moment I'm limited to a single mITX host and the single PCIe slot on the motherboard is taken with a storage controller, so an add-in GPU is a no-go. Furthermore, if I were to upgrade the CPU to something I could still cool in such a small space, I'm probably limited to 65W TDP, which means something like a Ryzen 2700 which of course doesn't have an iGPU and would also mean a motherboard replacement. Of course, I could wait until AMD release their 8C16T Navi-based APU (which I think is inevitable).

And yeah, no surprise you forgot about OCN. This place is quieter than a church on Tuesday....where did everyone go? Reddit?
01-22-2020 05:05 PM
fg2chase
Quote: Originally Posted by parityboy View Post
@fg2chase

I have a whitebox server running Proxmox VE 6.0; the hardware is an mITX board with an i5-8400 (6C6T) and 16GB RAM. I have Serviio running in an Ubuntu 18.04 LTS VM with 2GB of system memory. With 2 vCPUs, transcoding a single HD stream (Serviio uses ffmpeg) to medium quality has the CPUs pegged at nigh-on 100% load. 4 vCPUs averages 95% load and Increasing to 6 vCPUs has the CPUs at around 80% load.

I re-read this thread and couldn't find this: what CPU load are you seeing on average? Did you ever test with a single stream as a reference point?
Hey man, I just saw this. I forgot all about this site... I don't monitor CPU usage really but I do know that the Quadro P2000 does most of the heavy lifting when it comes to transcoding so the CPU usage usually remains pretty low.
This thread has more than 10 replies. Click here to review the whole thread.

Posting Rules  
You may post new threads
You may post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off