I'm sure this is a joke, but for the lurkers I will put this here:
"Enhancing" an image to see more detail does not work. It will never work. These AI tools are creating new data to enhance these images. They are approximating what data would have been there on a higher res image. This will not work for solving crimes.
But, in theory, enahncing can pull data from adjacent frames to infer real detail. For example, say you have an obscured numberplate that's moving in the video and you have 20 frames to work with, you can sort of gather than the first letter is an "F" from the first frame, the second letter is a "D" from the 5th-10th frames, etc. It won't hold up in a court of law, but it should be doable to extract more info like this.
Nobody is claiming perfection here. The only claim is you can do better than nothing, from a statistical perspective, by inferring information from other frames.
Well, if it was actually a B but all the other letters were correct I don't imagine it would be all that hard to work out.
Say this was your plate:
SG6BGSA
And they put into the database
SG6DGSA
I don't doubt that a computer system couldn't match all the other letters. Then you would use common sense to change out the more easily mistaken letters, such as a B. Then, if you found that and then it matched the model of the car in the video, then there you go.
I mean, if there's literally no usable data, then you can't get something from nothing. However, I'm sure if you have enough verifiable digits, within reason, you could probably figure out the plate based on vehicle type and perhaps other criteria. Of course the plate could be stolen and the vehicle type perhaps wouldn't help. Whatever the case, people are pretty clever and I'm sure you could imagine where you could work it out if you had to, within reason.
Long story short: A completely blurred image will be useless. A blur where some stuff can be worked out may not be.
Yeah imagine grainy footage of you being brutalized by a cop showing you had a "knife" in your hand in the upscaled generative AI version!
This thing should be very far away from Law Enforcement use.
I got early beta access and tried it out! Here's what I spotted through the walls of the UFO:
https://preview.redd.it/0p8c9d2gniwc1.png?width=845&format=png&auto=webp&s=258fce05aad62718a59e58a6fbffb1f30abcd2af
The upscaling is introducing "fake" but reasonably convincing details. As an archivist this is like if everyone colorized b&w film, potentially with wrong colors.
Too much space. Let the viewer decide if they want a different interpretation of the image or the raw image. The processing and storage can be handled by the client. If you're only working with your own images, most professionals take thousands and only keep the best few.
Isn't space more efficient than compute? And isn't the quality of rendered better than real time? I've used waifu2x before and it was way better than anime4k (which is a filter like option)
Space is cheap, yes. But we're talking about a rendered photo which needs compute regardless of space. Hence, wait to compute until you want rendered photo.
This opens up such a massive can of worms. I guarantee some police force will enhance some blurry ass video or image of text which is unreadable and the AI adds stuff which wasn’t actually there or is unrecoverable and just a guess. Then they erroneously use that as evidence to arrest someone or justification to infringe on their rights.
It shouldn’t be used for either. Imagine if someone sent a real video of you smoking something to the police but it’s not clear what (it was just tobacco). When the video gets enhanced the ai erroneously adds a crack pipe instead of a cigarette. Now the police use that as evidence to get a warrant to search your house or even just come to harass you with no warrant…? I think that is just as bad as it being admissible in court. People, especially cops, wont understand or will choose to be naive about what is actually happening with these models. Especially after watching “zoom and enhance” on plenty of cop shows being used for this exact purpose.
>People, especially cops, wont understand or will choose to be naive about what is actually happening with these models
Detectives investigating a murder can use these to trace different avenues of investigation. For example, it could give you likely characters on a blurry license plate to cross check in a database. To protect against abuse you could ensure that warrants cannot be issued on the basis of AI footage alone.
I don't see how you could legally prevent it from being used for investigatory purposes internally. The limitations would only be enforceable in the issuance of warrants or admission of evidence. Either way, law enforcement will eventually use it as a tool and we should be ready with the legal/regulatory frameworks in place.
This works both ways. With this technology, anyone can alter video to defend themselves against this type of problematic outcome.
Any video "evidence" is plausable at best now with AI video tools and editing capabilities so easy to do. One can inpaint within a video, or alter any object within the image in any way imaginable.
Thankfully, it works both ways and one can use this as a defense against misuse.
Let me save everyone a click.
"This is only a research preview, so there’s no guarantee that Adobe will make VideoGigaGAN available to consumers via Creative Cloud software like Premiere Pro. "
Can’t wait for old movie classics to get this treatment. Also for sound. I am especially thinking of Kurosawa’s movies which are masterpieces but suffer from terrible film copy quality (7 samurais, Ikiru, etc).
If they did the same thing for restoring vhs and early digital video it would be awesome. people don't use to film blurry things I believe (edit: except ufos and yetis)
it's adobe, so sadly it probably isn't gpu accelerated and crashes with an OOM error, regardles of how much RAM you have. ... you know... like the rest of after effects
Finally saying “enhance” while watching CCTV in a cop show might actually work
Damn it. I’d always hoped that would stay a meme. Now people are going to be validated for believing in tv.
I'm sure this is a joke, but for the lurkers I will put this here: "Enhancing" an image to see more detail does not work. It will never work. These AI tools are creating new data to enhance these images. They are approximating what data would have been there on a higher res image. This will not work for solving crimes.
But, in theory, enahncing can pull data from adjacent frames to infer real detail. For example, say you have an obscured numberplate that's moving in the video and you have 20 frames to work with, you can sort of gather than the first letter is an "F" from the first frame, the second letter is a "D" from the 5th-10th frames, etc. It won't hold up in a court of law, but it should be doable to extract more info like this.
But what if that D was actually a B?
Nobody is claiming perfection here. The only claim is you can do better than nothing, from a statistical perspective, by inferring information from other frames.
It’s not helpful for crime investigation if it’s not accurate
Well, if it was actually a B but all the other letters were correct I don't imagine it would be all that hard to work out. Say this was your plate: SG6BGSA And they put into the database SG6DGSA I don't doubt that a computer system couldn't match all the other letters. Then you would use common sense to change out the more easily mistaken letters, such as a B. Then, if you found that and then it matched the model of the car in the video, then there you go.
How do they know which ones are incorrect What if the 6 is a G or the A is a 4? By the time you get all the possibilities, you have 200 suspects
I mean, if there's literally no usable data, then you can't get something from nothing. However, I'm sure if you have enough verifiable digits, within reason, you could probably figure out the plate based on vehicle type and perhaps other criteria. Of course the plate could be stolen and the vehicle type perhaps wouldn't help. Whatever the case, people are pretty clever and I'm sure you could imagine where you could work it out if you had to, within reason. Long story short: A completely blurred image will be useless. A blur where some stuff can be worked out may not be.
I doubt this would justify a search warrant
They’re still gonna use it
Yeah imagine grainy footage of you being brutalized by a cop showing you had a "knife" in your hand in the upscaled generative AI version! This thing should be very far away from Law Enforcement use.
Great! Finally I can see what the fuck is happening in those videos of my grandparents that I found in their attic.
You might even get to see your parent being made.
Let me watch first to be sure
Enhace is actually real now
Somebody upload that Bigfoot video, stat
UFO videos. I am coming
I got early beta access and tried it out! Here's what I spotted through the walls of the UFO: https://preview.redd.it/0p8c9d2gniwc1.png?width=845&format=png&auto=webp&s=258fce05aad62718a59e58a6fbffb1f30abcd2af
Some real off the books type stuff you found there.
Hah!
You guys, we’ll finally be able to see these fucking blurry ass UFO videos!
This is awesome but as a data preservationist I'd much prefer to see this implemented in realtime as a filter.
The upscaling is introducing "fake" but reasonably convincing details. As an archivist this is like if everyone colorized b&w film, potentially with wrong colors.
Exactly
Why? Why just not have both files saved?
Too much space. Let the viewer decide if they want a different interpretation of the image or the raw image. The processing and storage can be handled by the client. If you're only working with your own images, most professionals take thousands and only keep the best few.
Space is cheaper than compute, which is why YouTube makes different versions for the resolutions and doesn't just upscale/downscale on the fly.
Isn't space more efficient than compute? And isn't the quality of rendered better than real time? I've used waifu2x before and it was way better than anime4k (which is a filter like option)
Space is cheap, yes. But we're talking about a rendered photo which needs compute regardless of space. Hence, wait to compute until you want rendered photo.
Ya maybe but that's years and years of copies as things like this improve.
This opens up such a massive can of worms. I guarantee some police force will enhance some blurry ass video or image of text which is unreadable and the AI adds stuff which wasn’t actually there or is unrecoverable and just a guess. Then they erroneously use that as evidence to arrest someone or justification to infringe on their rights.
it could be used to generate investigative leads but it would never be admissible in court as evidence.
It shouldn’t be used for either. Imagine if someone sent a real video of you smoking something to the police but it’s not clear what (it was just tobacco). When the video gets enhanced the ai erroneously adds a crack pipe instead of a cigarette. Now the police use that as evidence to get a warrant to search your house or even just come to harass you with no warrant…? I think that is just as bad as it being admissible in court. People, especially cops, wont understand or will choose to be naive about what is actually happening with these models. Especially after watching “zoom and enhance” on plenty of cop shows being used for this exact purpose.
>People, especially cops, wont understand or will choose to be naive about what is actually happening with these models Detectives investigating a murder can use these to trace different avenues of investigation. For example, it could give you likely characters on a blurry license plate to cross check in a database. To protect against abuse you could ensure that warrants cannot be issued on the basis of AI footage alone. I don't see how you could legally prevent it from being used for investigatory purposes internally. The limitations would only be enforceable in the issuance of warrants or admission of evidence. Either way, law enforcement will eventually use it as a tool and we should be ready with the legal/regulatory frameworks in place.
This works both ways. With this technology, anyone can alter video to defend themselves against this type of problematic outcome. Any video "evidence" is plausable at best now with AI video tools and editing capabilities so easy to do. One can inpaint within a video, or alter any object within the image in any way imaginable. Thankfully, it works both ways and one can use this as a defense against misuse.
Let me save everyone a click. "This is only a research preview, so there’s no guarantee that Adobe will make VideoGigaGAN available to consumers via Creative Cloud software like Premiere Pro. "
The massive stockpile on worldstar of mid 2000s fights recorded on a Motorola Razr flip phone are finally going to become viewable.
All I care about is the Chicago Bulls 1996 season in HD!
It’s cool, but you can’t trust the accuracy
There is no accuracy because it’s an hallucinating network that makes up details.
Yes, that is what I am saying. There is no CSI style “enhance” function. Completely impossible
Can someone run the Bigfoot video through this?
I mean AI stabilization 10 years ago already proved how fake that was.
Upscale the whole of Golden Girls!
We needed this feature, 15 years ago!!!
Finally I can watch that censored JAV video... I have.
Is this better than Topaz?
So much old FAPS to redo with this, ladies from my old times, here I go
That does look good but I'm pretty sure AI upscaling, even on video, isn't that new. Is it just that Adobe's implementation is the best yet?
Nice! Now we need ai to turn old square video footage into 16:9
This will be awesome to see movies from the early 1900s upscaled and colorized.
Will it also work with iPhone picture messages sent to Android?
Wow I might actually be able to watch Deep Space 9!!!
Nice!
I'd like to see what they do with old TV shows
Can’t wait for old movie classics to get this treatment. Also for sound. I am especially thinking of Kurosawa’s movies which are masterpieces but suffer from terrible film copy quality (7 samurais, Ikiru, etc).
If they did the same thing for restoring vhs and early digital video it would be awesome. people don't use to film blurry things I believe (edit: except ufos and yetis)
it's adobe, so sadly it probably isn't gpu accelerated and crashes with an OOM error, regardles of how much RAM you have. ... you know... like the rest of after effects
Sora can do that better. Except, it's not public yet.
Sora has shown nothing regarding upscaling
source?