How far are we away from having an artificial intelligence cut and edit our videos according to our description?

What do you think? Or even better, by recognizing the content of the videos and have them cut accordingly. So all you need to do is just record a lot of footage and have a general idea what the final result should be. And then you have shotcut edit it all and preview the result for you to click render.

Personally, I hope never to see that in my lifetime.

2 Likes

I’ve used GoPro’s automatic movie from clips which technically uses some AI and it did a decent job for a short reel because any part of the original footage would have worked synced to a groovy beat.

But right now I would not use it for something like a 10 minute travel vlog where there are very specific sights that need to be kept and very boring set-up stuff which absolutely needs to be cut.

I think in maybe 5-10 years AI will advance enough so it knows what is boring or interesting, have a structure in mind so it will properly match different shots of the same building or have a proper intro for that setting etc, but it would still be “someone” else doing its vision instead of your own.
Probably most people would accept that and move on.

The only question remaining is how much would that AI processing cost as I doubt the internal data/weights would be freely accesible.

Well, I mean, whatever is boring and what is good could just be derived from your existing movies. So let’s say you let AI look over your shoulder when you cut videos, it realizes a certain style and then you can just give it new footage and then it creates a new edit. So basically it’s not about learning from other people, it’s learning from your own footage. So you create a LoRA, if you will, or you retrain it and then it is just your own editor and it replicates your style. And if you want to do something new, you have to retrain it on something new and then it cuts new videos based on your personal handwriting.

Provided you see editing as a chore that is.

I would never buy a dishwasher because I enjoy washing my dishes. Just like I would never want a self-driving car, because I love driving my car.