Is Transcoding to .MKV The Only Way To Keep Best Quality and To Be Able to Apply Time Remap Filter?

  1. That is normal.
  2. Choose the “better” option, which is sometimes called a visually lossless if not mathematically.
  3. It is not only MP4 files. The Time Remap lets you go in reverse, and when the video is compressed with B type frames the performance and reliability is too poor.
  4. No, only ones with B frames. You do not need to fully understand video compression and B frames to understand and accept this condition, but you can search the web to learn more about compression in general.

See also the docs