Best way to configure all drives for video/photo editing

t0rri

Distinguished
Oct 10, 2008
30
0
18,530
Hi guys,
I have a new PC with different drives:
Samsung Pro 950 M2 512GB for OS, applications and some games.
Sandisk EXtreme SSD 1 TB Sata3
OCZ vertex 4 SSD 256GB Sata 3
Seagate 6TB 7200RPM.

my questions is what is the best way to configure the cache disk, export directory, source files directory etc for heavy image and video editing with Photoshop CC, Lightroom, Premiere, and Davinci Resolve.

Using heavy Raw video from the black magic cinama camera and 50mb RAW stills Images.
I would really appreciate your help!!! :)
 
Solution
If you did a fresh install of Windows 10, I'm surprised the applications will run at all. I've never tried changing the system drive (is that what you mean by "that drive"?).

Applications are all over the place in terms of how they handle drive letters, some go off of environment variables, some use relative paths, some will save the hard coded drive letter. That's no single answer for you there. And I've actually never tried a "fresh" O/S install leaving the applications in place on the system drive, only upgrades. Perhaps someone else can suggest.

I'll offer my opinion - when ever I do a new build (and often just if I need an O/S upgrade) I wipe everything and rebuild and reload, for a chance to do a thorough cleanup. I think...

LinwoodFerguson

Reputable
Aug 19, 2016
59
0
4,660
I've done a tiny amount of video (Blackmagic Resolve) and a ton of Lightroom. One problem you have is that there are competing issues, notably I'd want redundant raid for images, but that's slower.

For video and Resolve, a huge issue is GPU(s); it heavily depends on them for rendering, especially with a lot of nodes in the color grades. It will likely be a limiting factor more than the disks, though they come right behind.

Let me answer Lightroom first as I'm more confident there. The Preview Cache, ACR cache, and your scratch and temp should be on either a single non-raid SSD, or a Raid-0 SSD. When there is a disk bottleneck, they are usually it (especially during interactive use as opposed to big exports). The preview cache has to be moved with a soft-link, as by default LR will only put it next to the catalog (which IMO should be on a raid-1 for safety). The actual image files do not matter a lot for LR, though for Photoshop if you are writing back large TIF's, having them on faster disks helps a lot. I kept all my images on slow spinning disks for years, and just changed to SSD, and frankly can't see a difference in that respect but most editing is in LR (which doesn't write big TIFF's normally). Putting the catalog file itself in faster disk does help quite a bit in some operations, though not develop (which is where most people feel LR is slow).

For most things single core speed is the biggest bottleneck for Lightroom, not disks.

My biggest concern in the above is that you have no apparent setup for any raid protection for your data. If that's OK with you, great. Just think about it.

With no raid at all, the fastest thing is the M.2 card, so I'd put your caches (Resolve, Photoshop ACR, Photoshop temp, LR cache) there as well as OS. Then just spread the rest of the load as widely as you can, observe which disks are busy and consider relocating things as you observe how they vary with your own workload. Static images (raw files not being actively changed) on the spinning disks, though you might move big video files to fast disk while you are editing them.
 

t0rri

Distinguished
Oct 10, 2008
30
0
18,530
Great thanks!
I will use 8core 4gh cpu
And gtx 1080 so that's why I want to set up the drives in the most efficient way.

So I will install all the apps on the faster m2 drive (os).
Set the cache and archive directories to the same drive.

Source files will be on the 1tb sata 3 ssd.
And the export will be on another 256gb ssd sata 3.

is that right?

 

LinwoodFerguson

Reputable
Aug 19, 2016
59
0
4,660
Sounds reasonable if you have space. Raw video is really large (and compressed works badly in Resolve and probably most editors).

I think the real answer will come from use -- monitor when you have wait times (e.g. deep queues) on a drive and if consistent, move stuff off. A lot of times the answer is really counter-intuitive, you never know what developers are doing under the covers. It's one thing that is so frustrating with Lightroom, it won't benefit from lots of cores; they do a lousy job of using parallelism. So the big honking X99 systems actually run slower than the faster Z170 ones.

Oh... I'd try with HyperThreading off as well. I did some benchmarks on Lightroom and found it was faster off than on. Now Resolve... might be the reverse, never tried it. Photoshop my guess (guess!) is that it's a wash. But it is definitely not always helpful.
 

t0rri

Distinguished
Oct 10, 2008
30
0
18,530



I must say I didn't understand what you meant with HD and 23/64k sizes?
can you please elaborate?
I will use 6tb hd for storage, and move the relevant video/images files to an ssd other than the OS when working on a project.

The chace and temp folders won't run faster on the OS drive? (it is M2, about 3Xtimes the speed than the other regular sata ssds I have).

 
When you format a HD, you have the option to specify the CLUSTER SIZE, most people, not knowing what this is for, just take the default, which used to be (silly) 512 bytes, and I think it's now up to 1K with modern OS. The CLUSTER SIZE tells the OS to never break up a file below this size. This is the smallest size the OS will break up your files for storage. If your HD drive is mostly used for large files, it makes no sense to leave the OS to break up your large files into (relatively) small chunks. This is called fragmentation, the more your files are fragmented, the slowest is for the app to retrieve all the pieces, reason why some people go mental running defrag all the time.

There is a downside to increase your cluster size , is if you have lots of small files on the drive, say you format it for 64K cluster size, so even if a file takes a few bytes, the space it will take on the disc, is the minimum, 64kB. Todays though, most files tend to large, relatively anyway, compare when this was invented, call it legacy defaults.
 

LinwoodFerguson

Reputable
Aug 19, 2016
59
0
4,660
Large drives may be different, but I just formatted a 4TB drive, and a 1TB drive, under Windows 10, and it set to 4096. Your point is a good one, just offering a data point. Also, if you are using raid it's useful to have your cluster size be evenly divisible into your stripe chunk size (or a multiple of).

As to system vs another drive for scratch/temp - only by some experimentation will you know if the added speed of the M.2 will offset the fact that the O/S drive is often busy doing other things. My educated guess is that for photo and video editing, the O/S will be mostly quiet, and you get more bang for your buck with its speed than you lose from lack of isolation. But experiment. The nice thing about caches and temp type areas is you can just delete and move them fairly easily to test.

 

t0rri

Distinguished
Oct 10, 2008
30
0
18,530
Thanks for the info guys!

I have one more question,
When finished installing win 10 on a new ssd (along with cpu motherboard and gpu upgrade) all the drivers letters had changed (old os drive from c to f etc)

Is it possible to change the letters back to the way they were before on my old win 7?


That way I will save tons of times installing some applications and also configuration of root .
As example all my foobar2000 playlist is not working.

This will be a huge time saver.
 

LinwoodFerguson

Reputable
Aug 19, 2016
59
0
4,660
Sure. Go to Computer Management, look for Storage, then Disk Management. In there you will see the drives on the left and their volumes to the right. Volumes have the drive letters in windows. Find the one you want to change, and right click on it, and "change drive letters and paths".

It is worth noting if you have already installed software using a drive changing its letter from that when you installed the software may break things.
 

t0rri

Distinguished
Oct 10, 2008
30
0
18,530
I'ts me the OP...
so if I change it back to the letter it was before can I use the applications and games on that drive without reinstalling?
I have upgraded the cpu-mobo-ram-gpu and installed a fresh win10.
so will i be able to start the applications from that drive if I change it to the same letter it was before?
will it fix my playlist in foobar 2000?

I didn't installed any software on any of that drives except the new win 10 os drive.
 

LinwoodFerguson

Reputable
Aug 19, 2016
59
0
4,660
If you did a fresh install of Windows 10, I'm surprised the applications will run at all. I've never tried changing the system drive (is that what you mean by "that drive"?).

Applications are all over the place in terms of how they handle drive letters, some go off of environment variables, some use relative paths, some will save the hard coded drive letter. That's no single answer for you there. And I've actually never tried a "fresh" O/S install leaving the applications in place on the system drive, only upgrades. Perhaps someone else can suggest.

I'll offer my opinion - when ever I do a new build (and often just if I need an O/S upgrade) I wipe everything and rebuild and reload, for a chance to do a thorough cleanup. I think over time that brings a lot of stability. But it takes a lot of time, and you needed to prepare (e.g. having all the media, a safe place to stage the data, etc.).
 
Solution