Overclock.net › Forums › Components › Hard Drives & Storage › Storage solution for small video production company.
New Posts  All Forums:Forum Nav:

Storage solution for small video production company.

post #1 of 9
Thread Starter 
I run a small video production, we shoot with p2, soon maybe with the sony f3. We do all the editing in house with two mac pros (not trying to start a mac vs pc debate). We currently store all footage on a few pre-built raid 5s and quite a few gtech 1tb g safes. I'm soon beginning to realize how much money is being wasted with these pre-made systems and wanted to try to do something new.

My main question is what would be the best solution in your opinion for editing and video storage, should I build a server? or just buy a huge raid enclosure for 24 drives?. Money is not really a problem as long as its not too ridiculous. I apologize if this is in the wrong category.
    
CPUMotherboardGraphicsRAM
i5 2500k gigabyte z68xp-ud4 evga gtx560 ti sc g.skill ripjaws x 8gb 
Hard DriveOSPowerCase
kingston 64gb ssd, 2x seagate 500gb w7 + osx + arch linux corsair tx650 v2 corsair 600t se 
  hide details  
Reply
    
CPUMotherboardGraphicsRAM
i5 2500k gigabyte z68xp-ud4 evga gtx560 ti sc g.skill ripjaws x 8gb 
Hard DriveOSPowerCase
kingston 64gb ssd, 2x seagate 500gb w7 + osx + arch linux corsair tx650 v2 corsair 600t se 
  hide details  
Reply
post #2 of 9
Depending on what you need, I may move the thread to the server section for you.


What's the workflow? Do you guys share files over the network? Work on files remotely? Have a control system to allow only one editor at a time?

Is performance an issue?

How much storage are you looking for?

Do you have a backup process? (RAID is NOT a form of back-up, it is a form of redundency.)
Edited by DuckieHo - 7/27/11 at 1:41pm
Once again...
(13 items)
 
  
CPUMotherboardGraphicsRAM
i7 920 [4.28GHz, HT] Asus P6T + Broadcom NetXtreme II VisionTek HD5850 [900/1200] + Galaxy GT240 2x4GB G.Skill Ripjaw X [1632 MHz] 
Hard DriveOSMonitorKeyboard
Intel X25-M 160GB + 3xRAID0 500GB 7200.12 Window 7 Pro 64 Acer H243H + Samsung 226BW XARMOR-U9BL  
PowerCaseMouseMouse Pad
Antec Truepower New 750W Li Lian PC-V2100 [10x120mm fans] Logitech G9 X-Trac Pro 
  hide details  
Reply
Once again...
(13 items)
 
  
CPUMotherboardGraphicsRAM
i7 920 [4.28GHz, HT] Asus P6T + Broadcom NetXtreme II VisionTek HD5850 [900/1200] + Galaxy GT240 2x4GB G.Skill Ripjaw X [1632 MHz] 
Hard DriveOSMonitorKeyboard
Intel X25-M 160GB + 3xRAID0 500GB 7200.12 Window 7 Pro 64 Acer H243H + Samsung 226BW XARMOR-U9BL  
PowerCaseMouseMouse Pad
Antec Truepower New 750W Li Lian PC-V2100 [10x120mm fans] Logitech G9 X-Trac Pro 
  hide details  
Reply
post #3 of 9
Thread Starter 
Thanks for the really fast reply.

Most of the time there is only one editor working at a time, sometimes two.

There isn't that much sharing between the two computers, but it'd be nice to have an ftp client of some sort for our website so clients can view edits there instead of downloading files from yousendit, which is what we use now. I don't have much if not any server knowledge or experience.

Performance isn't an issue for dumping large files, but I would like the relatively fast speed for editing.

Around 12tb's minimum and expandability would be a really big plus.

Most of our data is backup'ed on g safes and various external hard drives. I was also looking at something like this http://www.wiebetech.com/products/RTX220-QJ.php strictly for back up. Just pop in bare drives, back up, and store drive in static free case on a shelf. Any ideas on this?
    
CPUMotherboardGraphicsRAM
i5 2500k gigabyte z68xp-ud4 evga gtx560 ti sc g.skill ripjaws x 8gb 
Hard DriveOSPowerCase
kingston 64gb ssd, 2x seagate 500gb w7 + osx + arch linux corsair tx650 v2 corsair 600t se 
  hide details  
Reply
    
CPUMotherboardGraphicsRAM
i5 2500k gigabyte z68xp-ud4 evga gtx560 ti sc g.skill ripjaws x 8gb 
Hard DriveOSPowerCase
kingston 64gb ssd, 2x seagate 500gb w7 + osx + arch linux corsair tx650 v2 corsair 600t se 
  hide details  
Reply
post #4 of 9
Quote:
Originally Posted by lvpd742;14369326 
Thanks for the really fast reply.

Most of the time there is only one editor working at a time, sometimes two.

There isn't that much sharing between the two computers, but it'd be nice to have an ftp client of some sort for our website so clients can view edits there instead of downloading files from yousendit, which is what we use now. I don't have much if not any server knowledge or experience.

Performance isn't an issue for dumping large files, but I would like the relatively fast speed for editing.

Around 12tb's minimum and expandability would be a really big plus.

Most of our data is backup'ed on g safes and various external hard drives. I was also looking at something like this http://www.wiebetech.com/products/RTX220-QJ.php strictly for back up. Just pop in bare drives, back up, and store drive in static free case on a shelf. Any ideas on this?
How are the two workstations connected to the storage? 1Gb network I assume? Do you guys transfer files locally, work on them, and then upload again? Or do you work directly from the server?

I would not allow your clients to directly access your internal file server. If anything, create a seperate server that that Internet access. Manually transfer files to that server for review. You never want to exposure your primary server to the outside world like that.

What is your budget like? Designing storage solutions is a bit of an art... how much protection is needed?

If you want to do it right.... You can build two servers for around $200-300 each (excluding disks). Have one server as your primary.... and have the other one perform nightly/weekly incremental backups. Each server will be running either RAID5 or RAID6.
Once again...
(13 items)
 
  
CPUMotherboardGraphicsRAM
i7 920 [4.28GHz, HT] Asus P6T + Broadcom NetXtreme II VisionTek HD5850 [900/1200] + Galaxy GT240 2x4GB G.Skill Ripjaw X [1632 MHz] 
Hard DriveOSMonitorKeyboard
Intel X25-M 160GB + 3xRAID0 500GB 7200.12 Window 7 Pro 64 Acer H243H + Samsung 226BW XARMOR-U9BL  
PowerCaseMouseMouse Pad
Antec Truepower New 750W Li Lian PC-V2100 [10x120mm fans] Logitech G9 X-Trac Pro 
  hide details  
Reply
Once again...
(13 items)
 
  
CPUMotherboardGraphicsRAM
i7 920 [4.28GHz, HT] Asus P6T + Broadcom NetXtreme II VisionTek HD5850 [900/1200] + Galaxy GT240 2x4GB G.Skill Ripjaw X [1632 MHz] 
Hard DriveOSMonitorKeyboard
Intel X25-M 160GB + 3xRAID0 500GB 7200.12 Window 7 Pro 64 Acer H243H + Samsung 226BW XARMOR-U9BL  
PowerCaseMouseMouse Pad
Antec Truepower New 750W Li Lian PC-V2100 [10x120mm fans] Logitech G9 X-Trac Pro 
  hide details  
Reply
post #5 of 9
Actually with that many drives, unRAID might be better
Once again...
(13 items)
 
  
CPUMotherboardGraphicsRAM
i7 920 [4.28GHz, HT] Asus P6T + Broadcom NetXtreme II VisionTek HD5850 [900/1200] + Galaxy GT240 2x4GB G.Skill Ripjaw X [1632 MHz] 
Hard DriveOSMonitorKeyboard
Intel X25-M 160GB + 3xRAID0 500GB 7200.12 Window 7 Pro 64 Acer H243H + Samsung 226BW XARMOR-U9BL  
PowerCaseMouseMouse Pad
Antec Truepower New 750W Li Lian PC-V2100 [10x120mm fans] Logitech G9 X-Trac Pro 
  hide details  
Reply
Once again...
(13 items)
 
  
CPUMotherboardGraphicsRAM
i7 920 [4.28GHz, HT] Asus P6T + Broadcom NetXtreme II VisionTek HD5850 [900/1200] + Galaxy GT240 2x4GB G.Skill Ripjaw X [1632 MHz] 
Hard DriveOSMonitorKeyboard
Intel X25-M 160GB + 3xRAID0 500GB 7200.12 Window 7 Pro 64 Acer H243H + Samsung 226BW XARMOR-U9BL  
PowerCaseMouseMouse Pad
Antec Truepower New 750W Li Lian PC-V2100 [10x120mm fans] Logitech G9 X-Trac Pro 
  hide details  
Reply
post #6 of 9
Quote:
Originally Posted by DuckieHo;14369792 
How are the two workstations connected to the storage? 1Gb network I assume? Do you guys transfer files locally, work on them, and then upload again? Or do you work directly from the server?

I would not allow your clients to directly access your internal file server. If anything, create a seperate server that that Internet access. Manually transfer files to that server for review. You never want to exposure your primary server to the outside world like that.

What is your budget like? Designing storage solutions is a bit of an art... how much protection is needed?

If you want to do it right.... You can build two servers for around $200-300 each (excluding disks). Have one server as your primary.... and have the other one perform nightly/weekly incremental backups. Each server will be running either RAID5 or RAID6.
I agree with this line of thought.

Once you need huge amounts of space (24TB+), building your own fileserver and backup fileserver is the way to go.

Duckie - were you thinking Perc 6/i cards for the RAID controllers, or did you have other cards in mind? I love how powerful Perc 6 cards are for their price.
     
CPUMotherboardGraphicsRAM
FX-8350 @ 4.6ghz 1.425v Sabertooth 990FX Zotac GTX 1070 Amp! 32GB (4x8GB) Kingston Fury 1866mhz CL10 1T 1.5v 
Hard DriveHard DriveHard DriveHard Drive
Hitachi 2TB - HDS723020BLA64 Crucial M500 960GB - CT960M500SSD1 WD 4TB Black - WD4001FAEX WD 4TB Black - WD4001FAEX 
Hard DriveHard DriveHard DriveHard Drive
Seagate 2TB - ST2000DM001 WD 640GB Black - WD6401AALS Seagate 6TB - ST6000DM001 Micron M500 - MTFDDAK480MAV 
Optical DriveOptical DriveOptical DriveOptical Drive
Pioneer DVR-115DBK Samsung SH-S243D/BEBE LG GH22NS90 Lite-On EBAU108 External DVD 
CoolingCoolingCoolingOS
Noctua NH-D15 Fractal Design 140mm Fan - FD-FAN-140 Fractal Design 120mm Fan - FD-FAN-120 Windows 7 
OSMonitorMonitorKeyboard
Ubuntu 14.04 LTS Samsung 2343BWX 23" (2048x1152) BenQ GW2765HT 27" IPS LCD Monitor (2560x1440) Genius Keyboard KB-G235 PA 
PowerCaseMouseMouse Pad
Seasonic Platinum 1000w PSU - SS-1000XP Fractal Design Define R5 Steelseries Rival 6500 dcpi Mousepad + Desk 
AudioAudioOtherOther
Onboard Realtek® ALC 892 Cyber Acoustics CA-2992 2.0 Speakers Razer Krait 1600 DPI nGear G-C1601 Card Reader 
OtherOther
Pisen Card Reader Gigabyte M7 Thor 
CPUMotherboardGraphicsRAM
VIA Eden C7 1200mhz Jetway J7F4K1G2ES-LF VIA Onboard 512MB PC2-4200 
Hard DriveOptical DriveCoolingOS
A-Data FlashDrive None Fanless Linux 
MonitorKeyboardPowerCase
Headless None 65w Power Brick Antec ISK300-65 
MouseAudio
None Onboard VIA 
CPUMotherboardGraphicsRAM
Barton XP-M 2400+ FJQ4C Asus A7N8X-E Deluxe 256MB BFG 7800GS OC 2x512MB Samsung PC3200 
Hard DriveOSMonitorKeyboard
Raptor 74GB/Seagate 120GB Windows 2000 Pro 60hz 17" CRT Brandless PS2 Keyboard 
PowerMouse
Antec Neo HE 550w Logitech G5 
  hide details  
Reply
     
CPUMotherboardGraphicsRAM
FX-8350 @ 4.6ghz 1.425v Sabertooth 990FX Zotac GTX 1070 Amp! 32GB (4x8GB) Kingston Fury 1866mhz CL10 1T 1.5v 
Hard DriveHard DriveHard DriveHard Drive
Hitachi 2TB - HDS723020BLA64 Crucial M500 960GB - CT960M500SSD1 WD 4TB Black - WD4001FAEX WD 4TB Black - WD4001FAEX 
Hard DriveHard DriveHard DriveHard Drive
Seagate 2TB - ST2000DM001 WD 640GB Black - WD6401AALS Seagate 6TB - ST6000DM001 Micron M500 - MTFDDAK480MAV 
Optical DriveOptical DriveOptical DriveOptical Drive
Pioneer DVR-115DBK Samsung SH-S243D/BEBE LG GH22NS90 Lite-On EBAU108 External DVD 
CoolingCoolingCoolingOS
Noctua NH-D15 Fractal Design 140mm Fan - FD-FAN-140 Fractal Design 120mm Fan - FD-FAN-120 Windows 7 
OSMonitorMonitorKeyboard
Ubuntu 14.04 LTS Samsung 2343BWX 23" (2048x1152) BenQ GW2765HT 27" IPS LCD Monitor (2560x1440) Genius Keyboard KB-G235 PA 
PowerCaseMouseMouse Pad
Seasonic Platinum 1000w PSU - SS-1000XP Fractal Design Define R5 Steelseries Rival 6500 dcpi Mousepad + Desk 
AudioAudioOtherOther
Onboard Realtek® ALC 892 Cyber Acoustics CA-2992 2.0 Speakers Razer Krait 1600 DPI nGear G-C1601 Card Reader 
OtherOther
Pisen Card Reader Gigabyte M7 Thor 
CPUMotherboardGraphicsRAM
VIA Eden C7 1200mhz Jetway J7F4K1G2ES-LF VIA Onboard 512MB PC2-4200 
Hard DriveOptical DriveCoolingOS
A-Data FlashDrive None Fanless Linux 
MonitorKeyboardPowerCase
Headless None 65w Power Brick Antec ISK300-65 
MouseAudio
None Onboard VIA 
CPUMotherboardGraphicsRAM
Barton XP-M 2400+ FJQ4C Asus A7N8X-E Deluxe 256MB BFG 7800GS OC 2x512MB Samsung PC3200 
Hard DriveOSMonitorKeyboard
Raptor 74GB/Seagate 120GB Windows 2000 Pro 60hz 17" CRT Brandless PS2 Keyboard 
PowerMouse
Antec Neo HE 550w Logitech G5 
  hide details  
Reply
post #7 of 9
Thread Starter 
The drives are connected to one computer at a time via fw800 or sata. Most of the drives are connected to the main, more powerful system. I don't really know what would be the easiest and fastest way of storing data and I'm completely open to changing my workflow.

Having two servers seems like a good idea, and I also have an old g4, could this be used as the server connected to the internet by any chance?

Protection in terms of openness to the internet is not really an issue, I don't see why anyone would want our video.

Money isn't really an issue as long as its cost efficient and will improve our workflow and make storage and backups easier and simpler.
    
CPUMotherboardGraphicsRAM
i5 2500k gigabyte z68xp-ud4 evga gtx560 ti sc g.skill ripjaws x 8gb 
Hard DriveOSPowerCase
kingston 64gb ssd, 2x seagate 500gb w7 + osx + arch linux corsair tx650 v2 corsair 600t se 
  hide details  
Reply
    
CPUMotherboardGraphicsRAM
i5 2500k gigabyte z68xp-ud4 evga gtx560 ti sc g.skill ripjaws x 8gb 
Hard DriveOSPowerCase
kingston 64gb ssd, 2x seagate 500gb w7 + osx + arch linux corsair tx650 v2 corsair 600t se 
  hide details  
Reply
post #8 of 9
Quote:
Originally Posted by lvpd742;14369988 
The drives are connected to one computer at a time via fw800 or sata. Most of the drives are connected to the main, more powerful system. I don't really know what would be the easiest and fastest way of storing data and I'm completely open to changing my workflow.

Having two servers seems like a good idea, and I also have an old g4, could this be used as the server connected to the internet by any chance?

Protection in terms of openness to the internet is not really an issue, I don't see why anyone would want our video.

Money isn't really an issue as long as its cost efficient and will improve our workflow and make storage and backups easier and simpler.

Yes, the P4 can be a web/FTP server. The risk is if someone accesses your internal files... something that you never want to risk.

What do you with older files? Is there usually 1TB or less of data that you work day-to-day and then just save the rest for long term? I am still trying to understand how your business works before recommending.
Once again...
(13 items)
 
  
CPUMotherboardGraphicsRAM
i7 920 [4.28GHz, HT] Asus P6T + Broadcom NetXtreme II VisionTek HD5850 [900/1200] + Galaxy GT240 2x4GB G.Skill Ripjaw X [1632 MHz] 
Hard DriveOSMonitorKeyboard
Intel X25-M 160GB + 3xRAID0 500GB 7200.12 Window 7 Pro 64 Acer H243H + Samsung 226BW XARMOR-U9BL  
PowerCaseMouseMouse Pad
Antec Truepower New 750W Li Lian PC-V2100 [10x120mm fans] Logitech G9 X-Trac Pro 
  hide details  
Reply
Once again...
(13 items)
 
  
CPUMotherboardGraphicsRAM
i7 920 [4.28GHz, HT] Asus P6T + Broadcom NetXtreme II VisionTek HD5850 [900/1200] + Galaxy GT240 2x4GB G.Skill Ripjaw X [1632 MHz] 
Hard DriveOSMonitorKeyboard
Intel X25-M 160GB + 3xRAID0 500GB 7200.12 Window 7 Pro 64 Acer H243H + Samsung 226BW XARMOR-U9BL  
PowerCaseMouseMouse Pad
Antec Truepower New 750W Li Lian PC-V2100 [10x120mm fans] Logitech G9 X-Trac Pro 
  hide details  
Reply
post #9 of 9
Thread Starter 
Quote:
Originally Posted by DuckieHo;14375282 
Yes, the P4 can be a web/FTP server. The risk is if someone accesses your internal files... something that you never want to risk.

What do you with older files? Is there usually 1TB or less of data that you work day-to-day and then just save the rest for long term? I am still trying to understand how your business works before recommending.

I meant an old apple G4, but it probably won't work out because its really old.

We usually keep finished project files backed up twice, once on a raid 5, and once on either a gsafe or a regular external hard drive.

Day-to-day we are usually working on 2 to 3 videos, max 4. Each total project could be anywhere from 100gb to 500gb, sometimes even more. Usually there is probably 1tb or less of data being used but it can go over that.
    
CPUMotherboardGraphicsRAM
i5 2500k gigabyte z68xp-ud4 evga gtx560 ti sc g.skill ripjaws x 8gb 
Hard DriveOSPowerCase
kingston 64gb ssd, 2x seagate 500gb w7 + osx + arch linux corsair tx650 v2 corsair 600t se 
  hide details  
Reply
    
CPUMotherboardGraphicsRAM
i5 2500k gigabyte z68xp-ud4 evga gtx560 ti sc g.skill ripjaws x 8gb 
Hard DriveOSPowerCase
kingston 64gb ssd, 2x seagate 500gb w7 + osx + arch linux corsair tx650 v2 corsair 600t se 
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Hard Drives & Storage
Overclock.net › Forums › Components › Hard Drives & Storage › Storage solution for small video production company.