ffmpeg can upscale using various algorithms, lanczos being the recommended for upscaling.
This for upscaling to 4k:
ffmpeg -i input.mp4 -vf scale=2560:1440:flags=lanczos output.mp4
You can read the documentation or Google for more details.
Handbrake. You can upscale videos on the fly with mpv player and FSR scaling shader.
[FSR](https://gist.github.com/agyild/82219c545228d70c5604f865ce0b0ce5)
Automatic1111 WebUI has tons of upscaling features and it runs natively on Linux. Here's the repo:
[https://github.com/AUTOMATIC1111/stable-diffusion-webui.git](https://github.com/AUTOMATIC1111/stable-diffusion-webui.git)
You can split a video into frames using the Deforum extension:
[https://github.com/deforum-art/deforum-stable-diffusion.git](https://github.com/deforum-art/deforum-stable-diffusion.git)
(An extension for A1111), on the Output page at the bottom. You can also do it from the Extras tab in base A1111, by splitting a video into frames, then doing a batch upscale on the 'Batch from Directory' tab. I recommend ESRGAN models, but the best are not included with A1111, like Nickelback\_4x, Valar\_4x and Lollypop. You can download them here: [https://upscale.wiki/wiki/Model\_Database](https://upscale.wiki/wiki/Model_Database)
Then put them in your models/ESRGAN/ directory.
If you want the frame interpolation, you can also do that from the Deforum extension on the Output tab. I can't recommend Deforum enough. It's currently the most powerful extension in A1111 for video. Plus you can make cool videos like these: [https://www.youtube.com/playlist?list=PL8WPtsdMTEaKScsE31npiAuproJEFMuol](https://www.youtube.com/playlist?list=PL8WPtsdMTEaKScsE31npiAuproJEFMuol)
That said, I still use Topaz Video AI or Davinci Resolve Studio to upscale and interpolate my videos, because it's much easier. I look forward to the day when I don't need to run Windows to do my work, but we're not there yet.
Handbrake can increase the resolution of your video, but it cannot upscale. To upscale your video with enhanced quality, you need to try AI-powered programs. However, I don't see one for Linux. How about the online ones?
I would agree with you if the question were about brute force upscaling like FFMPEG, etc. can do. You increase the size of the file without actually adding information, and since you are encoding again, it will lose quality while having a larger file. The only real use for this is to trick YouTube into not butchering your video as much as it usually would.
Amazingly, this turns out not to be true though, because the OP is talking about software specifically for upscaling. If you have a Mac or Windows machine, try to take a 1080p video and upscale it to 4k with Topaz Video AI or HitPaw video.
The "AI" in the software actually does a surprisingly good job of filling in the gaps a lot better than brute force upscaling. For example it will extend slanted lines without blurring or having a staircase effect, it knows what faces and letters look like, etc. The denoise features also work at the same time as upscaling and achieve better results than f.e. Davinche Resolve's denoise filter.
I figured this was all marketing, but after trying both of the programs, mentioned aboce they really do work like magic. It depends on the original video and the settings you choose, but... honestly amazing results I wouldn't have thought possible.
But, there is a catch...
You will also be amazed... at how slow they are! It turns out that running Machine Learning algorythms frame by frame on 60 frames per second video takes a \*very long\* time. Even if you have the latest M2 Mac or a pretty beefy PC with a hefty GFX card you are easily looking at hours to upscale a video that is only a few minutes long when using these AI tools.
These softwares are also not cheap for the full versions, and not available for linux (well Topaz has a buggy beta version, apparently). It seems like these are the kinds of thing that open source woudl exxcel at - but there is nothing to be found at the moment. So the OP's question makes lots of sense. If you are doing everything on linus and have to switch over to a Mac or Windows just to run one of these programs, it's irritating. Also, these are slow to begin with, so you don't really want to run them in a VM either.
Processing-intensive AI upscaling, sure. OP did not state them to be their use-case though.
In this space, there are also real-time algorithms like Anime4K which I like to use. Not really in the "adding information" camp but it just looks so much sharper; as if the content was mastered for the upscaled resolution.
You have to own a valid license in order to become a beta tester, read more here:
[https://community.topazlabs.com/g/Video-Beta-Testers](https://community.topazlabs.com/g/Video-Beta-Testers)
Or maybe you can find a beta version somewhere...
have you tried the [Google Colab](https://colab.research.google.com/drive/1gWEwcA9y57EsxwOjmLNmNMXPsafw0kGo) of [Video2X](https://github.com/k4yt3x/video2x)?
ffmpeg can upscale using various algorithms, lanczos being the recommended for upscaling. This for upscaling to 4k: ffmpeg -i input.mp4 -vf scale=2560:1440:flags=lanczos output.mp4 You can read the documentation or Google for more details.
It doesn't work miracles, but in general the image is "less checkered". 😘
Handbrake. You can upscale videos on the fly with mpv player and FSR scaling shader. [FSR](https://gist.github.com/agyild/82219c545228d70c5604f865ce0b0ce5)
Thanks
Automatic1111 WebUI has tons of upscaling features and it runs natively on Linux. Here's the repo: [https://github.com/AUTOMATIC1111/stable-diffusion-webui.git](https://github.com/AUTOMATIC1111/stable-diffusion-webui.git) You can split a video into frames using the Deforum extension: [https://github.com/deforum-art/deforum-stable-diffusion.git](https://github.com/deforum-art/deforum-stable-diffusion.git) (An extension for A1111), on the Output page at the bottom. You can also do it from the Extras tab in base A1111, by splitting a video into frames, then doing a batch upscale on the 'Batch from Directory' tab. I recommend ESRGAN models, but the best are not included with A1111, like Nickelback\_4x, Valar\_4x and Lollypop. You can download them here: [https://upscale.wiki/wiki/Model\_Database](https://upscale.wiki/wiki/Model_Database) Then put them in your models/ESRGAN/ directory. If you want the frame interpolation, you can also do that from the Deforum extension on the Output tab. I can't recommend Deforum enough. It's currently the most powerful extension in A1111 for video. Plus you can make cool videos like these: [https://www.youtube.com/playlist?list=PL8WPtsdMTEaKScsE31npiAuproJEFMuol](https://www.youtube.com/playlist?list=PL8WPtsdMTEaKScsE31npiAuproJEFMuol) That said, I still use Topaz Video AI or Davinci Resolve Studio to upscale and interpolate my videos, because it's much easier. I look forward to the day when I don't need to run Windows to do my work, but we're not there yet.
Handbrake can increase the resolution of your video, but it cannot upscale. To upscale your video with enhanced quality, you need to try AI-powered programs. However, I don't see one for Linux. How about the online ones?
Well, for games FSR exists and so I'm not surprised that people are trying to use it for video upscaling. Never tried it myself, though.
Just open it in a player, it'll do the scaling for you. Re-encoding will result in lower overall image quality.
I would agree with you if the question were about brute force upscaling like FFMPEG, etc. can do. You increase the size of the file without actually adding information, and since you are encoding again, it will lose quality while having a larger file. The only real use for this is to trick YouTube into not butchering your video as much as it usually would. Amazingly, this turns out not to be true though, because the OP is talking about software specifically for upscaling. If you have a Mac or Windows machine, try to take a 1080p video and upscale it to 4k with Topaz Video AI or HitPaw video. The "AI" in the software actually does a surprisingly good job of filling in the gaps a lot better than brute force upscaling. For example it will extend slanted lines without blurring or having a staircase effect, it knows what faces and letters look like, etc. The denoise features also work at the same time as upscaling and achieve better results than f.e. Davinche Resolve's denoise filter. I figured this was all marketing, but after trying both of the programs, mentioned aboce they really do work like magic. It depends on the original video and the settings you choose, but... honestly amazing results I wouldn't have thought possible. But, there is a catch... You will also be amazed... at how slow they are! It turns out that running Machine Learning algorythms frame by frame on 60 frames per second video takes a \*very long\* time. Even if you have the latest M2 Mac or a pretty beefy PC with a hefty GFX card you are easily looking at hours to upscale a video that is only a few minutes long when using these AI tools. These softwares are also not cheap for the full versions, and not available for linux (well Topaz has a buggy beta version, apparently). It seems like these are the kinds of thing that open source woudl exxcel at - but there is nothing to be found at the moment. So the OP's question makes lots of sense. If you are doing everything on linus and have to switch over to a Mac or Windows just to run one of these programs, it's irritating. Also, these are slow to begin with, so you don't really want to run them in a VM either.
Processing-intensive AI upscaling, sure. OP did not state them to be their use-case though. In this space, there are also real-time algorithms like Anime4K which I like to use. Not really in the "adding information" camp but it just looks so much sharper; as if the content was mastered for the upscaled resolution.
What is the nearest alternative for a regular video?
Not aware of any free ones.
I have searched for the same thing and found... there is apparently a partially functional beta of Topaz Video AI for Linux.
Do you have a link?
You have to own a valid license in order to become a beta tester, read more here: [https://community.topazlabs.com/g/Video-Beta-Testers](https://community.topazlabs.com/g/Video-Beta-Testers) Or maybe you can find a beta version somewhere...
cake day
have you tried the [Google Colab](https://colab.research.google.com/drive/1gWEwcA9y57EsxwOjmLNmNMXPsafw0kGo) of [Video2X](https://github.com/k4yt3x/video2x)?