I don't think it's intentional. This behavior is a straightforward consequence of training something on pairs of "real" and "degraded" images. It learns what images look like and does the best it can. Philosophically, replacing the moon with a better moon is no different than any other computational photography technique that uses world knowledge, like reducing red eye from flash by detecting faces, or enhancing blurry text using knowledge of the alphabet.
The problem is philosophical - people are upset by certain types of enhancement error, but not others, and they can't even articulate the difference to themselves, let alone to an AI.
> people are upset by certain types of enhancement error, but not others, and they can't even articulate the difference to themselves
People are upset by enhancement errors that produce an image that is meaningfully different from the "true image". Replacing the sun with the moon or replacing the letters with different letters (e.g. https://www.dkriesel.com/en/blog/2013/0802_xerox-workcentres... ).
The philosophical problem here is that you can't get at the true image, you can only imagine ideas like "what the human originally taking the photo saw with their naked eye".
What constitutes a "meaningful" difference? If you replace flash-induced red eyes with a more plausible (yet inaccurate) eye color, people are perfectly happy with that, even though the camera indeed saw red photons. They're not happy if you run the exact same algorithm on a photo of someone with genuinely red eyes. It's not always about the "true photons" - the cause of the red eye is relevant, and so is the intent of taking the photo.
"what the human originally taking the photo saw with their naked eye" is a tempting standard, but a misleading one - there might not be a human eye near the camera at all, and at any rate there certainly isn't one co-located with the focal point. And shall we have cameras that render only a few degrees of high resolution color, and have a large-ish blind spot? It's what the human eye sees.
nobody forces you to keep AI Camera switched on, I disable it as one of the first things when opening camera on Xiaomi phone first time, just swipe up from top and tap on AI Camera and you are done, I don't speak French so would be really interested how was their Xiaomi phone set, but I would bet my money they had AI Camera (and possible also Super Moon) enabled
There was a post on HN a few months ago showing the stages of post-processing on a photo of a Christmas tree in a room - the original photo was unrecognisable.
I would find the link, but I’m balancing my phone on my knee while trying to eat dinner and pretend I’m not playing with my phone while eating dinner…
I am wondering if the AI enhancement should be opt-in rather than the default and saving the original as well. Even if you want AI enhancement, future models are likely to be better.
With the rise of AI-generated content I would actually love a camera with no post-processing by default and a watermarking system that proves the picture is authentic. I can see Apple going that way eventually.
Well, they do their best, they don't do any userspace post-processing. They can't really help whatever the firmware in the camera and/or the camera driver are already doing.
It's not really possible to have zero processing of an image. At some point you have to interpret the sensor data and turn it in to a JPEG. The line people decide an image is "processed" is pretty subjective though. It's somewhere between the camera deciding what the white balance / exposure is, and AI replacing the sun with a moon.
Any file format or data structure you can display on the screen is processed. The whole point is the debate around phone processing is not as clear cut as photos being processed vs unprocessed.
The layperson also doesn't really consider the result of their smartphone app to be "processed", until they get slapped in the face with it. The layperson's intuition isn't reliable.
The layperson doesn’t have any idea what they are talking about so it’s hard to pull a coherent statement out of it.
People claim they want unprocessed photos but it’s not clear what they even mean by that. I think we can rule things like ai replacing the sun with a moon as obviously too far, but most phones like the iPhone aren’t AI generating or filtering things.
Someone manually selecting an exposure, white balance, and tint in Lightroom isn’t any less real than letting the camera do that automatically because the camera doesn’t know which values are real either.
The line I draw is at semantic editing. Manipulating images based on abstract geometric or statistical features like edges or color histograms is acceptable. Attempting to guess what those features mean is not. Traditional sharpening, color balance correction, focus stacking, lens distortion correction, etc. is fine. Red eye removal, skin tone correction, traditional dodging and burning, replacing a detected moon with a higher resolution photo, etc. is not. Unlabeled semantic editing is dishonest. AI image processing does not distinguish between geometric and semantic features, so it's always unacceptable, even for simple tasks like sharpening.
The one exception I make is cropping, because photographers have always had the ability to choose where to point the camera. Cropping based on meaning is not dishonest because it's inherent in the process of photography.
That doesn't seem like a very sharp line (hah). "Abstract geometrical or statistical features like edges" have semantic meaning. An "edge" is just an area of the image with a high derivative, but as soon as you use that information to process it in some way, you are making some implicit assumption about what this statistical feature means - the boundary of an object, a discontinuity in depth, etc.
There is no dividing line between syntax and semantics - semantics is just syntax scaled. Godel proved it, LLMs exploit it.
If I run an unsharp mask filter I'm not making any decision about what individual edges mean. I might look at the result and decide to apply more or less sharpening, but that's still not "semantic editing", because the edit itself only sees derivatives.
This is a feature a lot of companies are looking in to right now. It's less about reducing processing and more about proving something is real and not AI generated. The iphone processing doesn't straight up generate things that aren't real.
It's also something I've been looking into. I've completely broken Google's implementation and I can sign any file as if it were real, more details will be public in the coming weeks.
Signatures are nice, but the contents of the image still matter. Any signs of manipulation should still be treated with suspicion, even if they're "legitimate" edits. The best way to avoid such signs is to have the bare minimum processing.
This is also my opinion. However, I still think it's worth raising the bar for plausible fakes. Minimising processing is another way to raise that bar (or at least, lower the floor). It's also not something you can do by default, because consumers demand image processing.
Every dedicated camera is like this, more so if you shoot in raw.
There's also a lot of confusion around the processing here. The iPhone is mostly just taking multiple pictures and stacking them on top of each other to make up for the poor performance of the small hardware, denoising, and then applying a mask to subjects to lift shadows and adjust skin tones. This is the same kind of edit a photographer would do in Lightroom. It's not straight up AI generating content in the image.
Sadly Android phones are willing to pull cheap tricks to show better numbers or look better in some comparative youtube video so they pull this stuff.
Leica and Sony offer this as “Content Credentials” and anti-forgery digital signatures done on camera. It’s also been standard for many years for digital cameras used in criminal evidence procedures, Olympus tough series IIRC.
Me I just switched back to film. It’s about a buck a picture but I like the results I get, I’d rather have 30 photos than 300 to look through anyway.
Telling if a photo or a video is "true" is the same as telling if the written text is "true". You can not tell it by analyzing characters / words in a text, or pixels in a video.
You should analyze the subject who is providing that text / video and decide for yourself, whether you trust that subject or not.
E.g. "Elon Musk is 10 feet tall" - are you reading it on an anonymous X account or on a Business Insider social account? An attached photo of Elon Musk being 10 feet tall does not make a difference.
The year is 2036, when dialed up to maximum space saving, the latest generation of smart phones now turn camera pictures to a textual description and later when you want to view them, re-generate them on the fly using a text2image model. Not that "saving space" really means something, the phones refuse to unlock if they don't have an internet connection and store all your data on multiple cloud servers anyway (one for each five eye country).
That one monarch is not a person or organization of people. It's an aggregation of all the loosely connected ones, competing on some things, coordinated on others, but you, the end user are never the beneficiary. That, my old school human friend, is the one commandment no one challenges. With all those players locked into a Nash equilibrium, no one can do anything about this, while all humans complain that things are not the way they should be.
The constitutional monarchies respect each others' land ownership and colonies, but in terms of actual power the British Crown dwarfs everything, especially if one correctly recognizes the USA as their vassal state.
Outside of this there are few strongmen-led states of non-royal blood, of which China is the most important one.
And then there is Switzerland, which is part of the democratically-pacified buffer zone around Liechtenstein ;)
Let's hope the people at the top don't become too crazy.
This is conspiracy theory territory. The USA is not a vassal state of the crown in any way at all.
I just note that one of the few people to face fallout from the Epstein scandal is Prince Andrew, because he's not inside the US unaccountability protection field.
It’s a legit possibility that “FaceTime” in the future will be super low bandwidth because the phones on each end do local animations of a deepfaked/skinned model to match live capture rather than transmit high resolution video.
This is actually how FaceTime works on the Apple Vision Pro. Though that’s because your face is covered by a giant headset.
We can already compress video massively, enough to video call on crappy mobile connections without much care. I can’t imagine network connections would get worse in the future so it wouldn’t seem like there would be a need to compress further.
pretty sure even Xiaomi can do it, just disable stupid AI Camera and/or Super Moon, one of the first things I disable in camera on all Xiaomi phones (wife and me both have Xiaomi 13t and 13 respectively), don't forget also to disable Beautify (switch to Original) for selfie camera and don't remember what is the default selfie mirroring setting, this is very common issue with all brands they are not displaying real sides in selfie photos (real right hand becomes in photo left hand)
I still struggle with the idea that the chinese olympics had both CGI fireworks and real firework footage mixed together.
I cant fathom how this was a "if they know it doesnt matter at all" situation.
A complete acceptance of real / fake, who cares its about stuff looking great.
I mean I can be told it but I cant understand why you would waste millions on real works just to have fake ones, why not just go all fake? If its a half way house then does no one care what is real?
IE on linkedin somany AI videos with thousands of comments and likes and I become lost on ... do most poeple just not care if its real or not? I dont think they do at all. Am I mad to care?
Its very easy to say well everyone uses filters and they are not real. And its true! But somewhere and I have no idea where, there seems tobe a line for me where I say no, thats not cricket, you cant just replace part of an image with a template of something else. I have no idea tho any thoughts appreciated.
From what I have seen, the attitude towards AI in China is entirely different. The population largely believes it's a positive technology that will help improve their lives. While in America there is a seething hatred towards AI where people believe the benefits will all go to the billionaires while they are put out of a job.
If you look at the way Chinese AI companies act compared to American ones, it's easy to see how people feel this way.
The crucial difference: in China, if a billionare might become more powerful than the government, they get disappeared and re-educated: https://www.bbc.com/news/technology-56448688
Jack Ma is as scummy as the American tech elite, The whole 996 work schedule was from his companies. It's honestly good for society that people like him get reined in.
And it's not like they sent him to some north korean death camp. He's still one of the richest people in China, he just failed to deregulate the finance industry.
> Jack Ma is as scummy as the American tech elite, The whole 996 work schedule was from his companies.
doubt that, 996 has long tradition in China (even in Huawei, at least for young interns), heck even their schools were pretty much 996 up recently and most small businesses operate more like 997 closing only once a year for Chinese new year
1. people losing income/jobs because of AI see it differently, you can even find videos of regular chinese talking about their daily life and how they see AI
2.it helps AI content in China needs to be marked, so pretty much every Chinese ad now contains AI mark, which become quite pointless since AI is used absolutely everywhere
3. but yeah, people can see it more positively since technology is more regulated and less used for milking customers
Perhaps they needed some real fireworks for those there in person, and to be able to claim that there really was a fireworks show, but wanted to amp it up for those viewing the event virtually (most of the world).
> I mean I can be told it but I cant understand why you would waste millions on real works just to have fake ones, why not just go all fake? If its a half way house then does no one care what is real?
I work with VFX and try to always have something real in the shot. Explosions and the like are easier to expand but quite difficult to just add to empty shot. Fireworks are a bit easier but there is interplay with the environment which is hard to fake.
All these films where they announce ”we did it for real with practical effects” usually mean that it’s a mix and match between practical and computer generated effects. It can look better than either on their own.
Also I guess they had audience there so you need something for them as well.
IMO this is old man yelling at clouds mindset, which is fine, but losing battle. Asia went HAM on face filters day one and never turned it off, aesthetics > reality, and that mindet always existed in west but gaining mindshare in new gens. It's just produced art/content at the end of the day, I would say even before if you're not editing raw you're not trying, but now editing is included.
Interestingly, one of their AI filters is actually called "Super Moon":
4.14.3 Camera Image Optimization
The camera image optimization AI algorithm is mainly used in the following camera features: Super Moon, AI Camera, Document Mode, Front Portrait Mode with Background Blurring, and Beautify.
i would not underestimate the tomfoolery Xiaomi is doing to give the impression their phone can take a zoomed in photo of the moon. It's pretty tasteless in my opinion
I got some amazing photos through a set of eclipse viewing glasses on my Vivo x300 pro. If I'd been a bit more organized and set up a stand and taped the glasses onto the phone I think I could have taken a video of the whole thing in incredible quality. But I just held the glasses in front of the lens and it worked.
What I found though was that I had to use the pro mode (which I use for basically everything anyway, to avoid exactly the kind of issues this article is talking about).
I did try on normal photo mode and I think what was happening was that as soon as I covered one lens with the glasses it switched to another.
swiftcoder | 9 hours ago
thehamkercat | 8 hours ago
https://www.theverge.com/2023/3/13/23637401/samsung-fake-moo...
swiftcoder | 8 hours ago
dTal | 7 hours ago
The problem is philosophical - people are upset by certain types of enhancement error, but not others, and they can't even articulate the difference to themselves, let alone to an AI.
pjc50 | 7 hours ago
People are upset by enhancement errors that produce an image that is meaningfully different from the "true image". Replacing the sun with the moon or replacing the letters with different letters (e.g. https://www.dkriesel.com/en/blog/2013/0802_xerox-workcentres... ).
The philosophical problem here is that you can't get at the true image, you can only imagine ideas like "what the human originally taking the photo saw with their naked eye".
dTal | 7 hours ago
"what the human originally taking the photo saw with their naked eye" is a tempting standard, but a misleading one - there might not be a human eye near the camera at all, and at any rate there certainly isn't one co-located with the focal point. And shall we have cameras that render only a few degrees of high resolution color, and have a large-ish blind spot? It's what the human eye sees.
mcphage | 5 hours ago
Well, replacing the sun with the moon constitutes a meaningful difference. Let’s start there and work our way down.
fragmede | 8 hours ago
inigyou | 8 hours ago
mugiseyebrows | 8 hours ago
Markoff | 4 hours ago
IvanK_net | 9 hours ago
BlackRabbit1 | 9 hours ago
It's fascinating to see how much post-processing gets done.
PlunderBunny | 9 hours ago
I would find the link, but I’m balancing my phone on my knee while trying to eat dinner and pretend I’m not playing with my phone while eating dinner…
yoavm | 9 hours ago
Retr0id | 8 hours ago
Alexander-Barth | 9 hours ago
Zealotux | 9 hours ago
hutattedonmyarm | 9 hours ago
swiftcoder | 8 hours ago
Gigachad | 8 hours ago
austinthetaco | 8 hours ago
Gigachad | 8 hours ago
austinthetaco | 7 hours ago
Gigachad | 7 hours ago
austinthetaco | 6 hours ago
dTal | 5 hours ago
Gigachad | 5 hours ago
People claim they want unprocessed photos but it’s not clear what they even mean by that. I think we can rule things like ai replacing the sun with a moon as obviously too far, but most phones like the iPhone aren’t AI generating or filtering things.
Someone manually selecting an exposure, white balance, and tint in Lightroom isn’t any less real than letting the camera do that automatically because the camera doesn’t know which values are real either.
mrob | 7 hours ago
The one exception I make is cropping, because photographers have always had the ability to choose where to point the camera. Cropping based on meaning is not dishonest because it's inherent in the process of photography.
dTal | 5 hours ago
There is no dividing line between syntax and semantics - semantics is just syntax scaled. Godel proved it, LLMs exploit it.
mrob | 5 hours ago
amelius | 8 hours ago
Gigachad | 8 hours ago
Retr0id | 8 hours ago
Gigachad | 8 hours ago
Retr0id | 8 hours ago
Signatures are nice, but the contents of the image still matter. Any signs of manipulation should still be treated with suspicion, even if they're "legitimate" edits. The best way to avoid such signs is to have the bare minimum processing.
Gigachad | 8 hours ago
Retr0id | 8 hours ago
Gigachad | 8 hours ago
There's also a lot of confusion around the processing here. The iPhone is mostly just taking multiple pictures and stacking them on top of each other to make up for the poor performance of the small hardware, denoising, and then applying a mask to subjects to lift shadows and adjust skin tones. This is the same kind of edit a photographer would do in Lightroom. It's not straight up AI generating content in the image.
Sadly Android phones are willing to pull cheap tricks to show better numbers or look better in some comparative youtube video so they pull this stuff.
jazzyjackson | 8 hours ago
Me I just switched back to film. It’s about a buck a picture but I like the results I get, I’d rather have 30 photos than 300 to look through anyway.
dTal | 8 hours ago
amelius | 6 hours ago
epihelix | 8 hours ago
Alternatively, buy a mirrorless or DSLR with some decent lenses.
IvanK_net | 7 hours ago
You should analyze the subject who is providing that text / video and decide for yourself, whether you trust that subject or not.
E.g. "Elon Musk is 10 feet tall" - are you reading it on an anonymous X account or on a Business Insider social account? An attached photo of Elon Musk being 10 feet tall does not make a difference.
thih9 | an hour ago
I can’t.
Historically Apple is a late adopter of the mainstream. And they implement it as default, with little to no customization options.
Not to mention that iPhone cameras already perform heavy photo post-processing.
st_goliath | 9 hours ago
inigyou | 8 hours ago
xnickb | 8 hours ago
bflesch | 8 hours ago
aljgz | 7 hours ago
bflesch | 5 hours ago
Outside of this there are few strongmen-led states of non-royal blood, of which China is the most important one.
And then there is Switzerland, which is part of the democratically-pacified buffer zone around Liechtenstein ;)
Let's hope the people at the top don't become too crazy.
pjc50 | 4 hours ago
I just note that one of the few people to face fallout from the Epstein scandal is Prince Andrew, because he's not inside the US unaccountability protection field.
BLanen | 4 hours ago
danillonunes | an hour ago
whycome | 6 hours ago
Gigachad | 5 hours ago
We can already compress video massively, enough to video call on crappy mobile connections without much care. I can’t imagine network connections would get worse in the future so it wouldn’t seem like there would be a need to compress further.
Markoff | 5 hours ago
ionwake | 9 hours ago
I cant fathom how this was a "if they know it doesnt matter at all" situation.
A complete acceptance of real / fake, who cares its about stuff looking great.
I mean I can be told it but I cant understand why you would waste millions on real works just to have fake ones, why not just go all fake? If its a half way house then does no one care what is real?
IE on linkedin somany AI videos with thousands of comments and likes and I become lost on ... do most poeple just not care if its real or not? I dont think they do at all. Am I mad to care?
Its very easy to say well everyone uses filters and they are not real. And its true! But somewhere and I have no idea where, there seems tobe a line for me where I say no, thats not cricket, you cant just replace part of an image with a template of something else. I have no idea tho any thoughts appreciated.
xattt | 9 hours ago
Gigachad | 8 hours ago
If you look at the way Chinese AI companies act compared to American ones, it's easy to see how people feel this way.
pjc50 | 7 hours ago
Gigachad | 7 hours ago
And it's not like they sent him to some north korean death camp. He's still one of the richest people in China, he just failed to deregulate the finance industry.
Markoff | 5 hours ago
doubt that, 996 has long tradition in China (even in Huawei, at least for young interns), heck even their schools were pretty much 996 up recently and most small businesses operate more like 997 closing only once a year for Chinese new year
Markoff | 5 hours ago
1. people losing income/jobs because of AI see it differently, you can even find videos of regular chinese talking about their daily life and how they see AI
programmer's view - has to make food delivery to make money https://www.youtube.com/watch?v=eJZFUEQebbI
this one is more about regular life than about AI https://www.youtube.com/watch?v=Ba_iwcFmxE8
2.it helps AI content in China needs to be marked, so pretty much every Chinese ad now contains AI mark, which become quite pointless since AI is used absolutely everywhere
3. but yeah, people can see it more positively since technology is more regulated and less used for milking customers
Smoosh | 8 hours ago
Perhaps they needed some real fireworks for those there in person, and to be able to claim that there really was a fireworks show, but wanted to amp it up for those viewing the event virtually (most of the world).
plastic3169 | 7 hours ago
I work with VFX and try to always have something real in the shot. Explosions and the like are easier to expand but quite difficult to just add to empty shot. Fireworks are a bit easier but there is interplay with the environment which is hard to fake.
All these films where they announce ”we did it for real with practical effects” usually mean that it’s a mix and match between practical and computer generated effects. It can look better than either on their own.
Also I guess they had audience there so you need something for them as well.
Markoff | 5 hours ago
enhanced with fake for rest of the world
I don't like it either
profstasiak | an hour ago
maxglute | 15 minutes ago
Alexander-Barth | 8 hours ago
4.14.3 Camera Image Optimization
The camera image optimization AI algorithm is mainly used in the following camera features: Super Moon, AI Camera, Document Mode, Front Portrait Mode with Background Blurring, and Beautify.
https://trust.mi.com/docs/miui-privacy-white-paper-global/4/...
Taniwha | 8 hours ago
yokoprime | 8 hours ago
esperent | 8 hours ago
What I found though was that I had to use the pro mode (which I use for basically everything anyway, to avoid exactly the kind of issues this article is talking about).
I did try on normal photo mode and I think what was happening was that as soon as I covered one lens with the glasses it switched to another.
mugiseyebrows | 8 hours ago
kleiba2 | 8 hours ago
ndsipa_pomu | 5 hours ago