More Power! Shotcut on a Xeon system?

To borrow a line from Tim Allen…

We have a video system based on a Roland VR-50HD mixer. Here is a MediaInfo example of its output when using Roland’s Video Capture for VR software :

General
Complete name                            : H:\Videos\2017 06 01 1080P.mp4
Format                                   : MPEG-4
Format profile                           : Base Media / Version 2
Codec ID                                 : mp42 (mp41/isom)
File size                                : 7.18 GiB
Duration                                 : 1 h 5 min
Overall bit rate mode                    : Constant
Overall bit rate                         : 15.7 Mb/s
Encoded date                             : UTC 2017-06-01 23:26:10
Tagged date                              : UTC 2017-06-01 23:26:10

Video
ID                                       : 1
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : Main@L4.2
Format settings, CABAC                   : Yes
Format settings, ReFrames                : 2 frames
Codec ID                                 : avc1
Codec ID/Info                            : Advanced Video Coding
Duration                                 : 1 h 5 min
Source duration                          : 1 h 5 min
Bit rate mode                            : Constant
Bit rate                                 : 15.5 Mb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 29.970 (29970/1000) FPS
Original frame rate                      : 29.970 (30000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.250
Stream size                              : 7.09 GiB (99%)
Source stream size                       : 7.09 GiB (99%)
Encoded date                             : UTC 2017-06-01 23:26:10
Tagged date                              : UTC 2017-06-01 23:26:10
mdhd_Duration                            : 3922685

Audio
ID                                       : 2
Format                                   : AAC
Format/Info                              : Advanced Audio Codec
Format profile                           : LC
Codec ID                                 : 40
Duration                                 : 1 h 5 min
Source duration                          : 1 h 5 min
Bit rate mode                            : Constant
Bit rate                                 : 176 kb/s
Nominal bit rate                         : 192 kb/s
Channel(s)                               : 2 channels
Channel positions                        : Front: L R
Sampling rate                            : 48.0 kHz
Frame rate                               : 46.875 FPS (1024 spf)
Compression mode                         : Lossy
Stream size                              : 82.2 MiB (1%)
Source stream size                       : 82.2 MiB (1%)
Encoded date                             : UTC 2017-06-01 23:26:10
Tagged date                              : UTC 2017-06-01 23:26:10
mdhd_Duration                            : 3922696

I have been editing with Shotcut. Nothing fancy, cuts here and there. I may have an additional video track or two to “fix in post” my recording goofs by compositing in a PNG here or there. Or to composite in Powerpoint slides in PinP fashion.

I have been exporting with H.264 (libx264). Keeping the original resolution and aspect ratio. Best settings for Deinterlacer and Interpolation. Constant Bitrate for libx264 (to match the source). GOP of 12 and B Frames of 2. No Dual pass. vpre=medium, preset=medium, movflags=+faststart.

Export times on a Quad Core i5 (4460 I think) with 8GB of memory have been 1.5X to 2X the edited video time.

I am trying to speed this up. During export all i5 cores are saturated until the very end when the edit is written to disk. I started with Codec Bitrate at 16M and vminrate=16M to match the source, but have since reduced both to 8M since DVDs max out at 8M to save some time.

So thinking of more cores/threads especially since Ryzen has come out (8/16).

Then someone suggested something I did not think of, a surplus dual Xeon system.

An example is based on two Xeon E5-2680s. If I am reading the specs correctly, total of 16 cores and 32 threads. 8x the current Core i5 thread count. Windows 10 Pro.

I have never been able to go above a thread count of 4 using Shotcut (Core i5s only). Will Shotcut/qmelt exploit/max out both processors and all 32 threads? I don’t expect an 8x reduction in export time, parallel processing doesn’t work like that. Is there some other bottleneck I should be aware of once there are lots of threads?

How does memory usage increase during export with more threads? I am not familiar with qmelt memory usage. The proposed Xeon system would have 64GB. That would be 2GB per thread. I don’t want to be memory constrained once there are lots of threads.

The system will be dedicated to recording the VR-50HD video with Video Capture with VR, editing the video with Shotcut and authoring DVDs with DVDStyler.

it depends on the xeon, if its older than the i5 etc, shotcut will use all cores on x264/x265 encoding
my Ryzen 1700X with its 8-cores and 16-threads encodes pretty fast

also the storage system can be a bottleneck but not in your case

FYI i5 4460 is a 4 core 4 thread part aka not that fast

also you can check my benchmark results

a friend tested his 4590S

FYI yeah xeons seems to be pretty good compared to your current one
https://browser.primatelabs.com/v4/cpu/compare/3006239?baseline=2990548

here is ryzen 1700X vs xeon
https://browser.primatelabs.com/v4/cpu/compare/3007528?baseline=2990548

and also what is the price of that xeon system?

What is being proposed by someone who looked into this is a Z620 HP Workstation.

With a Quadro K2000. (Shotcut won’t use that for export, but will future-proof the system.)

256GB SSD boot drive. And 2 x 3TB drives. With the original video and two edited versions I can generate close to 24GB of video a week. I fill up the existing 1TB quickly and have to offload the videos to free up space every so often.

Price is around $1,400 on eBay store PC Server & Parts.

I have been googling around investigating various hardware platforms for a system.

But I am getting so confused trying to identify hardware that can get the most bang for the buck from Shotcut/qmelt/libx264.

I am using an H.264 Export preset with the libx264 Codec.

But I read in one place that “x264 isn’t exactly great at utilizing a lot of threads and usually not able to use a second CPU at all” and “Also /lib-x264 doesn’t really support more then 16-threads for encoding,

But I then read in another place “Oh, yes x264 parallelizes quite well on multicore CPUs. I [sic] scales nearly linearly up to at least 8 cores, and decently even beyond 32.

The first set of quotes was from 2017 while the last quote was from 2015!

I absolutely do not want to have big bucks spent on a system that will not be fully exploited. Where the extra sockets/cores/threads go to waste.

Since there has been no guidance from the Shotcut community about more than 16 libx264 threads, we decided to play it safe and go with the new Dell Inspiron 5675 Gaming Desktop.

Ryzen 7 1700X to get 16 threads
Memory maxed out at 32GB (Only 2 DIMM slots, grrr)
AMD Radeon RX 580. OpenGL 4.5 should help improve the editing process.
Windows 10 Pro