GSMArena.com GSMArena.com

Tip us

888k

156k
74k
1.1m

RSS

Log in

Login

I forgot my password
Sign up
  • Home
  • News
  • Reviews
  • Videos
  • Featured
  • Phone Finder
  • DealsNew
  • Tools
  • Coverage
  • Contact
ADVERTISEMENTS

Samsung explains how it uses AI to enhance portrait shots on the Galaxy S21 series

  • Post your comment
  • Comments (17)

Peter 03 February 2021

Samsung Android

You keep hearing about AI-powered cameras, but it often sounds like the Wizard of Oz is working behind the curtain. Now Samsung posted a fairly detailed explanation of how the Galaxy S21 series uses AI to create impressive portrait shots.

The selfie camera processing is pretty straightforward. First, the software identifies faces in the image and marks them for further processing (this is called segmentation). Second, detail in hair, eyes and facial features is enhanced. The camera also tweaks the white balance to achieve natural skin tones regardless of the ambient light.

Samsung explains how it uses AI to enhance portrait shots on the Galaxy S21 series

Portrait mode is much more involved. It starts with segmentation so later stages know which parts of the image are humans, which are pets and which are just background. This way the correct processing can be applied where needed. This segmentation map is used to create a rough “seed map”.

Samsung explains how it uses AI to enhance portrait shots on the Galaxy S21 series

Next is the “tri-map”, which is important as it highlights the border between the subject and background. Then the matte map traces fine detail within that border – it keeps hair and facial features from blending into the background. Finally, the depth estimation pass calculates the distance to objects, which will be used to create the shallow depth of field effect.

Samsung explains how it uses AI to enhance portrait shots on the Galaxy S21 series

If you’ve encountered less than perfect portrait modes, you’ll know how often strands of hair and other fine detail is blurred into the background, giving the image a very artificial feel. It’s the accuracy of the matte map that sets Samsung’s portrait shots apart from the rest.

Below is an example tri-map (center image), white for the subject, black for the background and grey for uncertain areas. On the right is the resulting matte map, which refines the subject/background separation.

Samsung explains how it uses AI to enhance portrait shots on the Galaxy S21 series

The phone takes the seed maps to apply image enhancements to the subject and blur the background. Then, it adds the matte map to create a sharp division between subject and background. All these layers are processed and combined into the final image in 3 seconds.

Source

Related articles
  • Samsung Galaxy S21 Ultra 5G review Samsung Galaxy S21 Ultra 5G review
  • Samsung Galaxy S21 5G review Samsung Galaxy S21 5G review
  • Our Samsung Galaxy S21 Ultra camera review video is up Our Samsung Galaxy S21 Ultra camera review video is up
  • Samsung details the ISOCELL HM3 - the 108 MP sensor used in the Galaxy S21 Ultra Samsung details the ISOCELL HM3 - the 108 MP sensor used in the Galaxy S21 Ultra

Reader comments

J
  • Jskinvest
  • k3u
  • 15 Feb 2021

There is a problem with portrait mode selfies. Selfies taken in portrait mode just come out to be regular photos with no blur or any other effect.. It also says looking for face and it never says ready once it finds a face. A reboot fixes it but on...

  • Reply
W
  • WolesBro
  • XTr
  • 14 Feb 2021

Samsung introduced this 'live focus' mode since galaxy note 8 till now. It's really good to know how they improve it so far till s21 series. Especially using the front camera that doesnt have a depth sensor.. thats really tricky part.....

  • Reply
H
  • Hey
  • 63x
  • 09 Feb 2021

As an engineer, it would be a pleasure to make this possible for us all. I just need to get to know the right people willing to get on it.. so with that said, maybe we can have a call sometime then yeah? 🙂

  • Reply
  • Read all comments
  • Post your comment
Total reader comments: 17

ADVERTISEMENTS

Phone finder

  • Samsung
  • Apple
  • Huawei
  • Nokia
  • Sony
  • LG
  • HTC
  • Motorola
  • Lenovo
  • Xiaomi
  • Google
  • Honor
  • Oppo
  • Realme
  • OnePlus
  • vivo
  • Meizu
  • BlackBerry
  • Asus
  • Alcatel
  • ZTE
  • Microsoft
  • Vodafone
  • Energizer
  • Cat
  • Sharp
  • Micromax
  • Infinix
  • Ulefone
  • Tecno
  • BLU
  • Acer
  • Wiko
  • Panasonic
  • verykool
  • Plum

All brands Rumor mill

ADVERTISEMENTS

Top 10 by daily interest

  Device Daily hits  
1.Xiaomi Mi 11 Ultra43,765
2.Xiaomi Redmi Note 10 Pro42,016
3.Xiaomi Poco F332,404
4.Nokia X2031,802
5.Xiaomi Redmi Note 1031,624
6.Xiaomi Poco X3 Pro30,138
7.Samsung Galaxy A7228,054
8.Samsung Galaxy A52 5G26,960
9.Samsung Galaxy A5223,869
10.Samsung Galaxy S21 Ultra 5G20,833
ADVERTISEMENTS

Home News Reviews Compare Coverage Glossary FAQ RSS feed Youtube Facebook Twitter Instagram

© 2000-2021 GSMArena.com Mobile version Android app Contact us Privacy Terms of use Change Ad Consent Do not sell my data