I'm working on creating a Digital Cinema Package for use with some professional projectors.
The creation involves having each frame of video as a single JPEG2000 file. This is then muxed into an MXF stream and compiled into a DCP package.
The issue I'm having at the moment is terrible slowdowns using NTFS on my server. I've already checked the volume's free space and fragmentation, and they're not that bad. Yet copying / moving files is horrendously slow - around one 1MB file per second.
I reckon it's due to having all the files in a single directory. Unfortunately, I can't really split it up because the muxer needs all the files in one directory which composes a video stream.
So what options can you suggest?
- Would symbolic links work? I've never tried this in Windows / NTFS and have limited experience using ext3/4
- Should I switch to another file system? If so, which one supports 200,000+ files in one directory and is usable on Windows and is free? I would use StorNext and it would work but it's hardly an option with the hardware I have (no SAN, metadata controllers, etc).