Something similar to this has been implemented for the 26.4 release. The cover art image is specified as an image file in a new “Metadata” tab in the export settings. I chose not to use “select a frame” because the image might not even be from the video. Or, in the case of mp3 export, there is no video at all.