The Crazy Computations Inside Your Smartphone Cameras

  Рет қаралды 341,186

Asianometry

Asianometry

Күн бұрын

Пікірлер: 587
@Asianometry
@Asianometry 2 жыл бұрын
Like and subscribe. Yada yada. Check out other deep dives here: kzbin.info/aero/PLKtxx9TnH76RiptUQ22iDGxNewdxjI6Xh
@pat8988
@pat8988 2 жыл бұрын
I believe that the blurred background of the cup is a normal effect in low light conditions for all cameras. It’s due to the depth of field becoming shorter with a lower (numerical) f-stop.
@gordongecko5412
@gordongecko5412 2 жыл бұрын
The conclusion is a masterpiece ! Thank you !!
@ntabile
@ntabile 2 жыл бұрын
The MEITU image at 9:24 -9:30 is funny!
@myentertainment55
@myentertainment55 2 жыл бұрын
My mom said the same about my voice! Maybe it's some biological explanation here :D Listening to voice of their kids makes mothers very calm and relaxed.
@El.Duder-ino
@El.Duder-ino 2 жыл бұрын
Very good "food for thought" that people rather take unreal, but nice looking photos than the real ones... this give us back the answer that people prefer fake than reality.
@ClockworksOfGL
@ClockworksOfGL 2 жыл бұрын
I’m glad you pointed out something I’ve been saying for years: you’re not seeing what the camera sees, you’re seeing what the phone generates. It’s not a bad thing, because the raw data coming from that sensor is close to unusable. Optical designers can’t overcome the laws of physics.
@mychemicaljojo
@mychemicaljojo 2 жыл бұрын
The video puts it so well! food for thought, man.
@insu_na
@insu_na 2 жыл бұрын
That's not quite true... Many phones nowadays allow the saving of for photos in raw format, which does bypass the image processing pipeline of the phone. Sometimes entirely, sometimes only mostly. Either way the image you get from that is *far* from unusable. Often you can make these raw format photos look leaps and bounds better than the standard processed ones. If you just let the phone to its thing you have 0 control over colours, white balance, denoising, lense correction, etc. The phone just guesstimates some appropriate values and if it guessed wrong, well tough luck. Usually it guesses decently, but it can't beat full manual control. Now obviously none of that matters to the average person just trying to take a photo for Instagram or Facebook or whatever, and most people who want nice and accurate photos will use a DSLR, but sometimes you don't have a DSLR with you but still want to take a good photo. Long winded way of saying: no, raw camera data is very good actually and if you really value quality of the photo over ease of making it then you'll choose the raw data over the processed image
@daniel_960_
@daniel_960_ 2 жыл бұрын
Your brain actually does the same thing. What your eyes see is not what you perceive, the eyes data also gets quite heavily processed.
@MaxoticsTV
@MaxoticsTV 2 жыл бұрын
@@insu_na Let me give short winded retort, no, small sensor raw data will never match larger sensors. It's the physics. Whatever they figure out for them would just be multiplied into larger sensor DR. How many photon-bumped electrons can a cell camera count versus a large sensor camera? You're right, one would always choose RAW over anything else, but the fact remains, RAW "what"?
@insu_na
@insu_na 2 жыл бұрын
@@MaxoticsTV Did you even read what I wrote? Did you see the part where I said that DSLRs make better images? Should you maybe repeat school again?
@doctorscoot
@doctorscoot 2 жыл бұрын
Well, photographers have been altering their images since the beginning. Filters (darken the sky / brighten the sky), tilt-shift large format cameras, toying with exposure and film speed, ‘pushing’ the negatives, dodge and burn, retouch, etc. Now we just get fancy machine learning pocket supercomputers to do it for us.
@acidtears
@acidtears 2 жыл бұрын
The "problem" is the shifting of control over to machines. If everything is done by machines, then what remains human of the image? Producing negatives is an artform and so is (arguably) using Lightroom or Photoshop for digital images. If everything is done automatically by an algorithm, nothing but the scene/subject is unique anymore. Naturally, it becomes easier to take pictures for everyone. And that's a good thing. But just like painting and other expressions of art, photography is a skill to be learned and nurtured over multiple years. Perfection through machines is not the same as perfection through practice.
@doctorscoot
@doctorscoot 2 жыл бұрын
@@acidtears I never said their wasn’t a problem. Just the impulse to ‘fake reality’ has a history, culturally as well as technically. Also, the same type of arguments you’re using here (traditional photography contains the traces of the artist, AI does not), are the same class of arguments used _against_ photography in favour of the traditional “arts” (ie drawing and painting).
@dishwashersafe222
@dishwashersafe222 2 жыл бұрын
@@acidtears Well said!
@frostypurply
@frostypurply 2 жыл бұрын
It’s about real time with software and digital assets
2 жыл бұрын
It's tool, medium. You could argue quite similar for audio over video, books over radio, storytelling over books, Cave paintins over... It's on you, what and how you use it.
@lidarman2
@lidarman2 2 жыл бұрын
This story struck a cord with me since I have been working on this stuff for 20 years. You nailed it. Just like our eyes and brains, the electronic cameras are starting to utilize all the light that is hitting the phone at any given moment. In the past, cameras just take a momentary sample of the light. But human eyes are doing it constantly...we don't have shutters in our eyes. I love where photography has gone and is going.
@neilmcmahon
@neilmcmahon 2 жыл бұрын
Man, I've been watching your videos since I am working on EUV processes and really think each of your videos is like a PhD thesis in visual form. They are so informative in a way that reading isn't. Despite your self-deprecation, I can sense that you are a deep, intelligent individual. Your humour appeals to me. You have a dead-pan delivery that is geek-unique.
@DanafoxyVixen
@DanafoxyVixen 2 жыл бұрын
It needs to be remembered that all the advanced computational processing that happens with smartphones always trickles down in to the bigger DSLR/mirrorless cameras, when also coupled with larger more "optically" superior lenses, full size cameras will always be better. but having said that, modern smartphones are "good enough" for most people
@Mia-ln1zs
@Mia-ln1zs 2 жыл бұрын
You have a point, but there's a hard limit to how "good" an image can be. From a physical perspective. Arguably cameras have already surpassed that point and further manipulation is simply to please the viewer. A DSLR isn't necessarily technically superior, but you may find its rendered image more pleasing.
@cyzcyt
@cyzcyt 2 жыл бұрын
@@Mia-ln1zs err no. The whole point of improving image quality is to improving a more pleasing render. The physics of having a small form factor like a smart phone, will always be technically inferior to a bigger format camera. That's the whole reason why a front camera recorded TikTok video will never look like a properly produced talking head studio recording. Even tho both is just basically the same content as the subject is basically talking to the camera The "hard limit" is still a long ways away. Sure there will be a point where the smartphone's output is good enough to be consumed, but that's hardly a hard limit. Because at that point of time, the bigger camera's output will be still pushing the limits on what's possible. So it's forever a never ending chase
@watchout5508
@watchout5508 2 жыл бұрын
The performance focused chipsets in modern phones will always Trump that of the latest dslrs, sure they don't have the hardware when compared to the more hand held cameras BUT that being said, smartphones are designed from the ground up to be your primary device for almost everything and in that regard the cameras are also advancing rapidly might i add! Now id love an amazing DSLR but when do we most feel like taking pictures? When we plan it, or simply in the moment. Then for the moment having such a powerful camera in our pockets is simply mind blowing! I love the advancment of our little rectangles and cant wait to see where they head! Likely AR glasses...
@robinrai4973
@robinrai4973 2 жыл бұрын
I have yet to see a DSLR or mirrorless camera that does the image stacking smartphone do, I really wish pocket cameras would do it, because stacking alone produces incredible results. If KZbin would allow me to post links I've got a comparison between a modified smartphone with a nearly 1 inch sensor happily keeping up with a Ricoh GR III!
@TheDiner50
@TheDiner50 2 жыл бұрын
@@robinrai4973 There was ones cameras with full out smartphone features like screen and all. Or close to it. What we need are phones that are a bit thicker and even maybe have a camera bump to boot. That basically is a blend of a camera and a smartphone. Like yea maybe the phone is to big to have in your normal pocket. But like it still can be totally a thing one want to carry around. Like keeping the size down from a XL phone and just add extra thickness should totally be still mobile and pocket friendly enough for most people. Handbag and jacket/hoodie pockets are a real thing.
@MaxoticsTV
@MaxoticsTV 2 жыл бұрын
Great job! Most non-photo nuts flub much of it. Many in the comments are confused because you didn't hammer home this--cell phone cameras USE COMPUTER PROCESSING TO MIMIC WHAT YOU'D GET FROM A REAL CAMERA. Yes, I know you said a few different ways. I agree. They do an amazing job! So if you want to take a photo with your iPhone 13 that looks like something you took with a $3,000 camera then you will not be disappointed. But that photo is a computer generated image using very noisy image data from your phone's camera. It's like having a street artist paint a realistic portrait from your polaroid (in my day) Hard-core photographers aren't interested in whether something looks "professional" or not. They are trying to focus on a specific visual truth. You can only get that through exact focus (which is hard to do manually on a phone). Natural optical bokeh (impossible on phones). Then there's exposure. Again, too time consuming on phone. Phones will not replace large cameras because the sensors are too noisy in most light--full stop. You should have covered curved sensor development btw. Also, Foveon technology is worth exploring. It doesn't use filters. I would have said sensors are color blind in your video, but that's quibbling. If you're reading this I LOVE your stuff, pass it on to anyone I know who has an interest. Also, Samsung pretty much left the large camera business even though they developed cutting-edge tech and had a cult following. Definitely worth a video from you!
@MGalaxy
@MGalaxy 2 жыл бұрын
15:54 iPhone 13 Pro has a bigger sensor and lower aperture compared to the regular 13 and most other phones. I bet that's why you can notice more shallow depth of field, not because of AI work. Correct me if I am wrong but I think algorithms do not mess with background blur in regular mode. Nice video btw, good compilation of history! It's very interesting topic that deserves more attention.
@Raja995mh33
@Raja995mh33 2 жыл бұрын
Exactly this. It's just physics doing its work here because of the much bigger sensor and also much bigger aperture - not some software
@michaellundphotography
@michaellundphotography Жыл бұрын
I came here to say this thank you =)
@salamander405
@salamander405 Жыл бұрын
As a professional photographer (who admittedly doesn’t know much about phone cameras) I immediately knew that wasn’t totally correct when he said that. Even my iPhone 8 plus achieves that shallow DOF when taking photos of close subjects with a low f/stop.
@royack
@royack 2 жыл бұрын
In my humble opinion, the bokeh you were talking about with the iPhone 13 pro wasn’t a case of “Portrait mode” leaking into normal photo mode, but a result of the camera sensor size being much larger than previous sensors.
@salamander405
@salamander405 Жыл бұрын
My iPhone 8 plus is very capable of “blurring backgrounds” with a close up subject, especially when the camera app is telling me it’s taking the photo at f/1.8. That’s really just optical physics at work, wide aperture + close subject = less depth of field on non-focused subjects. When he said this I paused the video and quickly snapped a photo of my water bottle close up just to make sure.
@Sam-K
@Sam-K 4 ай бұрын
Sensor size doesn't have much to do with bokeh effect, it's the wide aperture that creates a natural looking depth of field. After all, a full frame DSLR doesn't create a shallower depth of field than an APSC or micro four-thirds with the same aperture lens.
@Sam-K
@Sam-K 4 ай бұрын
@@salamander405 Exactly. The camera on the iPhone 8 is tiny (roughly 17.5 sq-mm), even compared to micro four-third (~250 sq-mm) or one inch cameras (~125 sq-mm), yet it creates natural bokeh effect in close up shots because of F/1.8 aperture.
@masononemine1702
@masononemine1702 2 жыл бұрын
And even with all that, I have grown a particular distaste for the kind of processing smartphone manufacturers do these days, and the thing is, people love that. I guess I am just not like the majority of consumers who never zoom-in to a picture, or ones who complain about over sharpening and what not.
@oceanheadted
@oceanheadted 2 жыл бұрын
The quality of pictures from modern phones is crazy given the size of the hardware, thanks for unpacking some of the features which it relies on.
@dienelt5661
@dienelt5661 2 жыл бұрын
People don’t realize how much the image quality in smartphones is LARGELY due to the high amount of pre and post processing and smart optimizations. The sensors themselves aren’t that “good” especially when compared to classic full size sensors.
@chengong388
@chengong388 2 жыл бұрын
Yea so? Who cares? As long as the photo ends up good what’s your problem?
@dienelt5661
@dienelt5661 2 жыл бұрын
@@chengong388 i didn’t mean it in a bad way, I find it amazing that smartphone can accomplish so much with so little.
@shadowshadow2724
@shadowshadow2724 2 жыл бұрын
@@chengong388 they're somewhat fake photos ?! did you see that feature in Huwawei's smartphone (I guess) when you take a photo of the moon in night the moon looks so good and so real because of AI pre processing
@tomis181
@tomis181 2 жыл бұрын
@@chengong388 I mean sometimes you want to capture reality rather than what a company has decided looks best. Of course you can shoot some sort of RAW in many phones now but still. Or for example sometimes the iPhones portrait mode looks good a first glance but the bokeh looks totally fake when blown up to desktop (I'm sure this will improve with time)
@chengong388
@chengong388 2 жыл бұрын
@@shadowshadow2724 that example is totally different from what we're talking about.
@stephencampbell9384
@stephencampbell9384 2 жыл бұрын
One of the best overview explanations of this field I've seen, good stuff.
@bearlemley
@bearlemley 2 жыл бұрын
The trouble is that the lenses are subpar if you are comparing them to real cameras. You get used to looking at cell phone pictures and they started to look good until you go back a camera with a real lens and suddenly all those that see the photograph are stunned by the detail, the depth and the accuracy.
@tomschmidt381
@tomschmidt381 2 жыл бұрын
As an retired EE it amazes me how much functionality is being packed into such a small package. Until this video I had no idea how computational intensive digital imagining was. I assumed (know what they say) most of the processing cycles were spent on compression to save on storage space.
@yuraretz2379
@yuraretz2379 Жыл бұрын
What I don’t understand is why can’t they make square sensors? That would allow taking landscape photos while holding the phone in more convenient portrait orientation.
@MrKelaher
@MrKelaher 2 жыл бұрын
Really good ! A couple of other fun ones where computation is key: 1. simulating more zoom levels/smooth zoom from multiple fixed levels and parallaxed sensors 2. using these parallaxed sensors to complement depth sensors in deeper fields where dedicated depth sensors fail 3. enhancing low light performance of the "zoomed" sensors by using the wider ones 4. using multiple sensors to calculate "field flow" to correct shake and pan blurs 5. On that note, using multiple sensors in the video domain to simulate filmic effects like focus pull Just so many things one you have a matrix of sensors and a crap load of CPU/GPU ! One annoying marketing thing Apple do - some "exclusive" features of new phones COULD work on earlier ones, and sometimes quietly sneak into subsequent software releases on older phones (Bokeh being a prominent example)
@StoicGore
@StoicGore Жыл бұрын
I finally got a stand alone camera. So glad I don't have to upgrade every year and holding a camara feels so much better than something made for talking.
@JohnEnergy2012
@JohnEnergy2012 2 жыл бұрын
Things get even crazier when you realize the processing is so fast the same tech can be applied to video (4k60fps) as well...
@tomis181
@tomis181 2 жыл бұрын
Good vid. It seems camera sensors themselves haven't improved greatly in the last few years. Or at least not nearly at the pace they were previously. For example, a great low light camera, the Sony A7SII to A7SIII did not see a huge improvement in low light performance despite a five year gap between releases. Maybe I am expecting too high a pace of improvement for digital sensors and they won't ever be able to compete with image intensifier tubes. For dedicated cameras I understand wanting personal control rather than computer control for taking shots but I do hope the big manufactures begin taking more advantage of computational photography in areas where a photographer can't easily improve it by manual controls- low light, star tracking, focus stacking.
@hobbykip
@hobbykip 2 жыл бұрын
Most optimizations are done on speed, pixel decity and the ability to handle special scenes (like requireing HDR). The CMOS technology is near its physics limit als noise is so low and the 'bucket size' of the pixel is difficult to increase (they call this technology deep trench isolation). Anyway, hopefully SPAD technology will better the sensitivity and thus performance.
@tomis181
@tomis181 2 жыл бұрын
@@hobbykip thanks for the insight. I wasn’t sure of the exact tech and what to expect for the future but did notice the “stagnation” of CMOS. Will look up SPAD.
@krzysztof6123
@krzysztof6123 2 жыл бұрын
A7S is primarily video camera
@tomis181
@tomis181 2 жыл бұрын
@@krzysztof6123 I understand that. Everything I said still stands
@acidtears
@acidtears 2 жыл бұрын
I think that low-light mode is pretty much a gimmick. I say this based on photos I've seen, not on personal experience. There is an art in using a digital camera and different lenses to capture as much light as possible. However, at the widest aperture and highest iso, things should stop becoming brighter. If you want to enhance the brightness further you can always go into Photoshop or Lightroom, but the image taken by the camera remains (in my opinion) a far better representation of reality. Low light is difficult to shoot and I do think that certain improvements should be made to the imaging processors. But as it stands, I prefer to shoot "RAW" or even JPEG on my Fuji than artificially blowing up all aspects of my image for the sake of - people wanting it? Light is the most important aspect to photography and for casual users, using a ML algorithm to blow it the fuck up might be the best way to go. For anybody else, time and patience, persistence and determination - those are the key factors to "winning" in low-light and producing great pictures.
@MoritzvonSchweinitz
@MoritzvonSchweinitz 2 жыл бұрын
Please, please, please make an episode about the manufacturing process of all those components! How are this Bayer color filters produced so small, and aligned perfectly? How are zillions I'd super precise micro lenses made? How does optical imagine stabilization work that quickly and precisely?
@MaxoticsTV
@MaxoticsTV 2 жыл бұрын
DITTO!
@gibbogle9486
@gibbogle9486 2 жыл бұрын
I am also interested in the manufacture of the lenses. This is an aspect of the technology that is often overlooked.
@Patrick_B687-3
@Patrick_B687-3 Жыл бұрын
Not that long ago (seemingly) I remember thinking how cool it was to snap a pic with a Motorola Razor. 😂😂
@GatorWinup
@GatorWinup Жыл бұрын
2 cents: depth of field and Bokeh are two different concepts. Your comparison of portrait mode and the blurry background of the drink picture let me know that you are confused. But I am sure some quick online search would clarify them to you.
@Paulkjoss
@Paulkjoss 2 жыл бұрын
What’s crazy is how you keep finding such interesting topics to cover dude 👍🏾
@creepychris420
@creepychris420 2 жыл бұрын
bro you are so good at explaining yourself, you are very listenable - i usually watch the pictures too but i can understand it all without looking usually. ill check out the podcast no worries
@nomore-constipation
@nomore-constipation 2 жыл бұрын
All my photos taken on any digital device seems like a lie now. I abandoned the older way because I thought the future was digital photography. Goes to show you, old school lenses are the only way to get actual pictures from a object or subject.
@shadypark78
@shadypark78 2 жыл бұрын
The camera should take the most accurate photo possible. I'm aware that all engineers see differently, and that there are a lot of variables, but effects should be added after an accurate photo has been taken. I use Light Room and all kinds of other software, but require a raw, accurate, uncompressed photo to start with.
@Erik-rp1hi
@Erik-rp1hi 2 жыл бұрын
Putting a bunch of images together to get the effect of a big lensed DSLR camera works pretty good. Good report.
@michaelludvik2173
@michaelludvik2173 2 жыл бұрын
What about the LiDAR feature on the iPhone 13pro? Agreeed that the computation “improvements” are a bit flawed philosophically but LiDAR is truly new 3d data we have to work with.
@trinidol
@trinidol 2 жыл бұрын
The bokeh blur on the macro photo is optical, not digital... When the object is close enough you can have a nice blurred background :)
@xenuburger7924
@xenuburger7924 2 жыл бұрын
Photography means writing with light, which seems intuitive when light is projected onto film. Projecting it onto a CMOS sensor through a matrix of color filters adds complexity most people would rather avoid, so the word remains the same. Thanks for the explanation.
@dominicus9891
@dominicus9891 2 жыл бұрын
15:46 That's actually natural bokeh on the glass there, the same as on a DSLR or mirrorless camera. It only pops up on the glass because it's so close to the camera. You see more and more of it nowadays because of the physically larger, and subsequently more telephoto lenses to match in modern phone cameras.
@PeteC62
@PeteC62 2 жыл бұрын
Yeah, I can get very similar bokeh with the main camera on my Galaxy S22 Ultra (though I'm not super impressed with the quality of the bokeh in the pic in the video, tbh). What's interesting on Android these days (not sure about iOS) is that you can add blur to _any_ photo, not just photos taken in portrait mode (and for that matter, they don't even need to have been taken on the phone's camera!) They do "depth from ML" segmentation on the image, and just apply blur based on the depth at the selected "focus point", and virtual f-stop. The Light L16 could do the same thing, but in that case the depth map was from stereo, not from ML.
@dominicus9891
@dominicus9891 2 жыл бұрын
@@PeteC62 In my opinion, I prefer real bokeh just because I can be guaranteed of the authenticity, there can't be any "error" to it, besides an out of focus shot.
@PeteC62
@PeteC62 2 жыл бұрын
@@dominicus9891 I totally agree. The quality of artificial bokeh depends on so many factors, like the accuracy of the depth map, and the way the blur is applied (low end software will just apply a simple gaussian blur, whereas better software will try to mimic the shape of the aperture blades, at the cost of slower processing). It's fine for making the subject of a portrait stand out from the background, but you're unlikely to get great bokeh balls...
@dominicus9891
@dominicus9891 2 жыл бұрын
@@PeteC62 There'll be a time in the near future where I believe the depth map itself will be doing the brute of the work to mimic the effect, instead of the "edge detection" which is needed now.
@opalyankaBG
@opalyankaBG 2 жыл бұрын
Not sure where you've gotten this definition but a zoom lens doesn't usually take you from a long shot to a close up. Long shots are taken with long lenses (a long focal length), and close ups can be taken with basically any focal length. Zoom means the lens covers multiple focal lengths all in one. Another thing to note is that you can actually use a smartphone camera to get a subject in focus and blur the background - naturally that is, without using any blur/bokeh/portrait modes. However that's only possible with small subjects in close-ups.
@leonmartinville7628
@leonmartinville7628 2 жыл бұрын
Bonsoir, toujours des super vidéos. Quelle synthèse. Vos compétences sont immenses. Bravo
@canalsentir
@canalsentir 2 жыл бұрын
Great video about the technology of cameras and smartphone cameras in particular! We also did one just now with my hand (lol) but in the video you can see how intricately and quickly a Samsung A22 focussed and quickly changes the depth of field all automatically!
@BradleyVanTreese
@BradleyVanTreese 2 жыл бұрын
This was SUCH a good episode, especially the bit of thought philosophy near the end. How often we, as Humans, ask for or prefer something other than reality. I am quite sure this says something profound about our species and the environments we experience.
@jb-xc4oh
@jb-xc4oh 11 ай бұрын
Its the one aspect of digital photography which I really dislike.....its synthetic, a maze of mathematical computation which approximates reality, in other words....fake.
@PhilipLeichauer
@PhilipLeichauer 2 жыл бұрын
Great video. It's a shame smartphones can't operate external flashes and generally lack the easy to control manual mode that DSLR cameras have. So convenient though. Glad to have both.
@mindaugasstankus5943
@mindaugasstankus5943 2 жыл бұрын
Do not surprise if you soon need to pay extra (subscription) for using cameras (software/bios/firmware). Compact cameras with alternative bios/firmware unlock great capabilities (CHDK for canon for e.g.). Same apply to all digital camera, but "dumding down", control/removal of ownership making tech crappier and crappier.
@karanvora2674
@karanvora2674 2 жыл бұрын
Sony phones have excellent pro mode. But I doubt anyone buys Sony phones.
@Kylefassbinderful
@Kylefassbinderful 8 күн бұрын
By the way, your mom is 100% correct I usually fall asleep to one of your videos playing. It's always a video that I've seen before so I'm not ignoring you.
@Muonium1
@Muonium1 2 жыл бұрын
I remember when I first saw a picture from a camera on a flip phone in 2003. It was absolute garbage and I literally laughed at how bad it was. The improvements over the intervening 2 decades - the CCD to CMOS switch, back-illuminated sensors, pixel crosstalk suppression, quantum-dot based sensors - have been incredible. There's still enormous room for improvement yet, only a couple percent of the area of the back of a modern cameraphone is actually collecting photons...
@brodriguez11000
@brodriguez11000 2 жыл бұрын
Deformable lenses.
@gameshot911
@gameshot911 2 жыл бұрын
Dude your videos are so, so good! The graphics you track down are super cool and informative, and the explanations have great flow and are really intuitive. Plus you pick interesting topics! Keep it up!
@krzysztof6123
@krzysztof6123 2 жыл бұрын
Saying that a phone is better than a camera is like saying a moped is better than a car
@PaulFisher
@PaulFisher 2 жыл бұрын
One other way zoom can work in addition to those you covered is with help from computational photography. Because your hand moves a little no matter what, by taking multiple rapid-fire exposures and comparing them, you can infer some more detail by looking at overall motion and fine transitions. This technique has been used on Pixel devices (at least, possibly others) and Google (former employer) calls it “super-res zoom”.
@Scrogan
@Scrogan 2 жыл бұрын
Like traditional noise-based oversampling. When you have an analogue signal going into an ADC with a known noise distribution filling it, you can use that noise to infer bit values beyond the resolution of that ADC.
@NPJGlobal
@NPJGlobal 2 жыл бұрын
That philosophical conclusion doe. Food for thought indeed
@calvinatdrifterstudio8438
@calvinatdrifterstudio8438 2 жыл бұрын
Just compare a raw file from an iphone 13, and a 10 year old Fujifilm xpro1 (200$). You can't get around the physics but you can get better at faking it
@kuantumdot
@kuantumdot 2 жыл бұрын
Very Well done!! I only get a glimpse at the how the image processing is conceived and executed but I can concur with your video here. It’s is astounding to see how amount of thoughts and executions going behind the scene of each selfies
@rorychivers8769
@rorychivers8769 2 жыл бұрын
Imagine all of that engineering, and no one thought to put a sticker on the camera reading "No one gives a shit about your facebook pictures"
@prakadox
@prakadox 2 жыл бұрын
Great video. The quote at the end, cherry on top of the cake!
@smallmoneysalvia
@smallmoneysalvia 2 жыл бұрын
The iphone 13 pro max has a really large aperture on the wide lens, it can generate real bokeh at short distances
@shazmosushi
@shazmosushi 2 жыл бұрын
Really great video. I forgot to watch it during Patreon Early Access. But it's a really nice deep dive!!
@andikappradana
@andikappradana 2 жыл бұрын
When you point the phone at the relatively close object like in the minute 15:48, it's not leaking portrait mode, it's natural bokeh of the camera because iPhone 13 Pro has a bigger sensor and f stop than the previous iPhones
@Knorrkator
@Knorrkator 2 жыл бұрын
The reason why the background is blurred in your picture at 15:45 is not software but because the bigger sensor gets you shallower depth of field
@jb-xc4oh
@jb-xc4oh 11 ай бұрын
Depth of field is determined by the focal length of the lens and its aperture it has nothing to do with sensor size.
@atlantasailor1
@atlantasailor1 Жыл бұрын
This is one of the most brilliant videos on KZbin. Congratulations! Supposing the zoom issue is resolved with the next iphone 15 or Samsung or whatever, one wonders what is left to improve in smartphones? Maybe microscopic images 100X? Who needs a telescope or microscope? Maybe you could have an image at night and zoom into a star in the sky and also into the cells of a leaf in the same image. After the image is saved…
@mimimimeow
@mimimimeow 2 жыл бұрын
Looks like "folded zoom" concept is very similar to those camera optics in the RF-5E recon jet. The light gets folded 90° thrice. Allowing the camera to zoom all the way to 50 nautical miles slant range while still managing to cram 3 different cameras + stabilizing systems in the nose.
@mimimimeow
@mimimimeow 2 жыл бұрын
@27_ECE_Gokul V Slant range is basically the direct line-of-sight range to target (hypothenuse of triangle). We specify "slant" because a plane flies high up.. and not at the same horizontal level to object (like base of triangle). Yes it can clearly see human-sized objects >50NM away despite being all-mechanical and using film. Much of the capability can be attributed to the stabilizer system. Targeting pods today cannot match that due to pylon vibration and pod design. It was the best recon camera the US ever produced until 1990s SYERS 2 came on upgraded U-2s and satellites. Ironically it was never used by the US.. first customers were Malaysia and Saudi Arabia. Malaysia later upgraded to even more capable digital camera.
@henryD9363
@henryD9363 2 жыл бұрын
I have four mirrorless Sony cameras. The last time I use one was about 4 years ago when I got my first pixel phone. My pixel 4 takes better pictures than any Sony I have. By better I mean more usable better color better shadow details they just look better. I don't understand why Sony or Canon, etc, doesn't put the same processing in one of their mirrorless cameras. Their sales are going down down down because practically speaking they're not as good as most people's phone. I refuse to spend 3 to 10 minutes in Lightroom to get a couple of photos looking as good as from my phone. I know there's a huge, actually very small, group of photographers who want raw only and want to spend their lives photo processing. But to heck with them. Watch this video, Sony.
@clothesclothes777
@clothesclothes777 2 жыл бұрын
Doesn’t the a7s series have leading low Light tech? Or am I too far behind now
@x2ul725
@x2ul725 2 жыл бұрын
Been waiting for this one - I appreciate glass more and more because of this channel
@fxsrider
@fxsrider 2 жыл бұрын
I have owned a mid range Canon DSLR for years. Todays smartphone cameras are incredible! The Lidar on the iPhone 12 is on my wish list.
@SpecterJoe
@SpecterJoe 2 жыл бұрын
In the best way possible your mom is right about your videos putting people to sleep, Whenever you post I make sure to watch your videos as a way to wind down at the end of a long day. Thank you
@horrgakx
@horrgakx 2 жыл бұрын
Good video, thanks for posting. But as good as camera phones are, they're no substitute for DSLR / Mirrorless with a decent lens.
@MicrophonicFool
@MicrophonicFool 2 жыл бұрын
Excellent video as usual. As a photographer/video guy, I am more disturbed by the trend of taking a picture of the moon, or Eiffel tower and have it replace my pixels with those of known images. That practice is unacceptable to Art.
@Norsilca
@Norsilca 2 жыл бұрын
Very nice. Now do panoramas! I know they can line up overlapping parts of neighboring images, but I always wondered how much they use accelerometer data to help them guess how far you've moved/tilted between the images.
@mortenthorpe
@mortenthorpe 2 жыл бұрын
Interestingly, all of my photos, taken using dedicated interchangeable lens cameras, are commented on by people quite often, s “that doesn’t look true to the scene”, while it actually is… according to a single image, taken with a limited dynamic range sensor, the processing pipeline behind it and all baked in… Conversely, this is what we consider as “taking a picture”, while what people apparently desire are the results of “making a picture”, enter the smartphones with cameras, no post-editing of single- and multiple- photographs. This begs the question “does the difference described here - taking vs. making - really matter? Most would say NO, while most photographers and enthusiasts hold on to the original single image outlet of a dedicated camera. No matter, the image quality differences re still visible in a way, where I can easily spot images made with a phone, vs. those taken with a camera - conclusively, I’d never take any important image using a phone, too much of a compromise on quality and editing potential…
@daniel_960_
@daniel_960_ 2 жыл бұрын
My 13 pro max camera is really nuts. The pictures are just perfect. All the cameras before were nice upgrades and did a great job, but you'd always find something to complain about. Since the XS the pictures often look quite artificial, the auto HDR didn't always do a great job, uneven exposure taking panoramic photos, video stabilization was often stuttery, iPhone 11 pro only main camera was useful in the dark, the exposure was taking quite long... The iPhone 13 pro is just perfect, no complaints. It's insane how heavy the picture processing is yet it looks very natural and colors and exposure are just on point. Not just the camera, everything is perfect about this phone, before that there always was something missing. Perfect screen (120hz, 1000nit), perfect battery, perfect camera, 5g and 5ghz hotspot, perfect speakers. Only usb-c missing, though lightning is great. My iPads usb-c port doesn't work properly anymore.
@TheMamon66
@TheMamon66 2 жыл бұрын
Interesting analogy in the end for sure...
@twogenders
@twogenders 2 жыл бұрын
That last line is deep.
@justcommenting4981
@justcommenting4981 2 жыл бұрын
I almost never look at the screen while the videos are playing. I had no idea I was missing jokes. Podcast sounds perfect for me.
@Asianometry
@Asianometry 2 жыл бұрын
Visual jokes and gags are my favorites.
@douira
@douira 2 жыл бұрын
If you think about it, our brains also do a lot of computation on the raw signal our eyes provide. Neither our nor the smartphone's vision systems are very faithful to a physical snapshot of the incoming light.
@brodriguez11000
@brodriguez11000 2 жыл бұрын
In the frequency domain and analog to boot.
@jb-xc4oh
@jb-xc4oh 11 ай бұрын
All your sensory functions and your brain are analog systems, not digital. The mathematical manipulation of 1's and 0's is a human invention and doesn't occur in the natural world.
@horrorlostplaces
@horrorlostplaces 2 жыл бұрын
Good photo "editing skills" do not make a good photo, composing and choices are the art to do photos. let me explain this : when we go with the fact that AI does photos that are art then everybody who use a "iphone" would have all photos liked. This is not the case ! Photos who let the viewer think/feel/move are the photos who are on the top lists. even when you are not a "photo pro" a single photo can make you feel "warm, good, happy" or "cold, dark, sad" without knowing the technical side. This feelings you get are the art of the photographer who did the photo. You watch a good photo and try to get your first feeling, then you talk with your inner, why you feel this at this photo ? this start of inner communication of the viewer makes art. a computer must learn to feel before he can compose such photos or paintings, just imitating feelings is not enough. computer photos can be good and nice for a personal memory, to remember something and a feeling you bind with it but it does not touch every viewer that have no personal binding.
@indianajanes1182
@indianajanes1182 2 жыл бұрын
Fantastic in-depth presentation.
@BunToomo
@BunToomo 2 жыл бұрын
I think i recognize the scenery in those nightime shots in 12:24 and 12:30!! I think its in Taipei for the former and Sunset scene in Gaomei wetlands for the latter. Great pics!
@terryshemishere7715
@terryshemishere7715 2 жыл бұрын
Perfecto!!! This is my first time on your channel. Your explanation and overall video was so good that I was forced to liked and subscribed. Thanks man
@navadeep025
@navadeep025 2 жыл бұрын
Great video and compilation of history. I literally was there feeling the revolution, but never explored the tech behind it. Interesting one!
@birdpump
@birdpump 2 жыл бұрын
for all the money people spend upgrading their phone only for the newer camera they could probably buy a really nice mirrorless or DSLR by now
@Sagittarius-A-Star
@Sagittarius-A-Star 2 жыл бұрын
A lot of new information - thumbs up!
@adrianheffernan102
@adrianheffernan102 2 жыл бұрын
I loved how you ended this video very well said and thought provoking, Many camera phones apply skin softening in portrait mode - crazy to think all our memories will have been doctored - it's like something from 1984.
@AdityaChaudhary-oo7pr
@AdityaChaudhary-oo7pr 2 жыл бұрын
your research and documentary are very very informative!! Thank you for making such videos
@sundog486
@sundog486 2 жыл бұрын
Very well explained! I didn't learn much from this particular episode but I've learned a great deal from your others. Thank you.
@donutey
@donutey 2 жыл бұрын
If I lug around my MILC camera with a couple good lenses I almost always get great pics. The only shots I've been asked to print and frame were taken with my camera. But you're lugging around a couple grand of equipment for that experience. I've definitely left it at home because of the weight or worrying about keeping it somewhere while on a trip. It really is amazing how good phone cameras are now, so I don't anguish much over leaving the big camera at home anymore. Ultimately the best camera is the one you have, and 99% of the time that's going to be a phone camera that'll do the job 90% as well.
@PeteC62
@PeteC62 2 жыл бұрын
I totally agree. Based on how my pics were being consumed (95% of the time on people's phones, with the very rare print), and the hassle of schlepping the lenses around, I sold my Sony a7r3 a couple of years ago. I did buy a buy an RX10M4 as a kind of compromise between full frame and a phone, but I rarely ended up using it. On a recent trip to Vietnam, i just took my Samsung S22 Ultra, and I'm perfectly happy with the results (though I'd really miss the 10x optical telephoto if I had an iPhone). (All that said, I just read a review of the Canon R7, and I'm sorely tempted, especially since I still have a lot of EF mount lenses from my pre-Sony days!)
@TheOneG36
@TheOneG36 2 жыл бұрын
very well explained! thank you for that!
@unreliablenarrator6649
@unreliablenarrator6649 2 жыл бұрын
Suggest you deep-dive camera module packaging, the integration of optical mechanical and electronic components and fictions in a miniaturized package is a marvel of miniaturization and more than meets the eye.
@Real_Good_Joe
@Real_Good_Joe 2 жыл бұрын
You missed a bunch of algorithms, but this is the gist of it, nice video
@adramalech5109
@adramalech5109 2 жыл бұрын
dude i was just trying to google how camera sensors actually work and trying to brainstorm how that would be. this was rreally interesting and well made. thanks for a great video! take my like and subscription!
@JulesStoop
@JulesStoop 2 жыл бұрын
@15:47 the new larger sensor of the iPhone’s standard (1x) camera is actually big enough for fully natural bokeh to occur with close-up subjects. This is most likely what you’ve noticed creeping.
@moeinmaleki7859
@moeinmaleki7859 2 жыл бұрын
i have discovered this channel far too late. great video!
@Bethos1247-Arne
@Bethos1247-Arne 2 жыл бұрын
The cup on the table is close enough for the camera to have actual depth of field, because the Iphone 13 Pro main camera sensor is quite large, allowing the phone to use a lens long enough for a somewhat shallow depth of field.
@CompoundingCuriosity
@CompoundingCuriosity 2 жыл бұрын
damn that henry wu quote at the end. Mic drop!
@nerdynephew
@nerdynephew 2 жыл бұрын
I feel like I’m definitely going to enjoy your content more as a podcast
@FranklinBryan
@FranklinBryan 2 жыл бұрын
Love your videos. Is that Halcyon at 15:20 ish?
@SillyNaughty
@SillyNaughty Жыл бұрын
"The insane engineering of..." You and the Real Engineering channel should do a crossover episode!
@Kyuubi840
@Kyuubi840 2 жыл бұрын
Very interesting analysis, thanks for this!
@2365Films
@2365Films 2 жыл бұрын
Well done tutorial - Thank You!
@arnecl9566
@arnecl9566 2 жыл бұрын
Great video again! Love your work
@redshifted8790
@redshifted8790 2 жыл бұрын
This really is an awesome video, thanks for your work!
@TonyLing
@TonyLing 2 жыл бұрын
That is very illuminating. Thanks.
@yash_kambli
@yash_kambli 2 жыл бұрын
Smartphone cameras have come a long way, just 10years before, except some handful devices camera quality was plain pathetic in most of the devices but now their achievement is in front of us. However still i do feel that computational photography can't beat the laws of physics, they are still very profound. AI /ML creates very unrealistic looking images , oversharpen unnecessarily and colour accuracy is gone for a toss. Most frustrating though is loss of depth in the images, they looks flat and washed out which is something nokia lumia 808 was known for
@061Hitachi
@061Hitachi 2 жыл бұрын
Photos from my Nokia N73 and N95 still look absolutely gorgeous.
@TheTarrMan
@TheTarrMan 2 жыл бұрын
I remember going from a Note 5 to a Pixel 5 and being blown away with the night-shot.
@pejvaaksalimi2311
@pejvaaksalimi2311 2 жыл бұрын
Impressive video. and the message at the end was so true. People want to see what they want not what it is. ;)
@unvergebeneid
@unvergebeneid 2 жыл бұрын
The blur in the coffee picture might just have been that you were close to the subject. The closer you are, the more natural blur you get.
@leyasep5919
@leyasep5919 2 жыл бұрын
Yet another excellent report ! thanks !
@henryefry
@henryefry 2 жыл бұрын
To repeat what others have said, I'm a bit of an amateur photographer and a lot of photography is figuring out how to frame the shot just right that it only shows what you want it to. Making careful use of zoom and positioning while out taking photos, then in Lightroom or a lightroom if using film, messing with the raw photo. DSLRs don't have much computing power but computers do. I do the same thing with my photos as the phones do. Adjusting saturation and exposure and toying with denoising to get it just right.
@scott-qk8sm
@scott-qk8sm 2 жыл бұрын
Would like them to add night vision to the iPhone
Why AMD's Chiplets Work
12:53
Asianometry
Рет қаралды 300 М.
Why Fujifilm Survived (& Kodak Didn't)
24:30
Asianometry
Рет қаралды 422 М.
كم بصير عمركم عام ٢٠٢٥😍 #shorts #hasanandnour
00:27
hasan and nour shorts
Рет қаралды 11 МЛН
This Game Is Wild...
00:19
MrBeast
Рет қаралды 186 МЛН
Симбу закрыли дома?! 🔒 #симба #симбочка #арти
00:41
Симбочка Пимпочка
Рет қаралды 5 МЛН
Long Nails 💅🏻 #shorts
00:50
Mr DegrEE
Рет қаралды 16 МЛН
What's going on with smartphone cameras?
8:19
Android Police
Рет қаралды 126 М.
The Fake Chip Scourge
16:05
Asianometry
Рет қаралды 335 М.
The future of computational imaging
35:49
Stanford University School of Engineering
Рет қаралды 1,8 М.
The Birth, Boom and Bust of the Hard Disk Drive
22:02
Asianometry
Рет қаралды 573 М.
Iran's Alarming Water Crisis
19:51
Asianometry
Рет қаралды 532 М.
The Gallium Nitride Revolutions
14:34
Asianometry
Рет қаралды 269 М.
Intel & AMD: The First 30 Years
22:25
Asianometry
Рет қаралды 155 М.
Smartphone Cameras Explained - Technically
18:32
MOBHouse
Рет қаралды 48 М.
Apple‘s Struggle to Survive the IBM PC
31:33
Asianometry
Рет қаралды 269 М.
The Amazing, Humble Silicon Wafer
18:19
Asianometry
Рет қаралды 329 М.
كم بصير عمركم عام ٢٠٢٥😍 #shorts #hasanandnour
00:27
hasan and nour shorts
Рет қаралды 11 МЛН