Why does the phone recognize you wearing a mask? Mainly because of it

deep learning-spark global limited

With the advent of the epidemic, the face unlocking function has degraded the noble head. When masks become a must-have item for us to go out on the street, we always have to go through the cumbersome process official recognition failure’-‘input password’ when unlocking the phone. This makes people miss fingerprint recognition. In order to optimize the face unlocking experience, earlier this year foreign entrepreneur Danielle Baskin launched a mask with facial information. The product extracts the user’s facial information and prints it on the outside of the mask. After the user wears the mask, they can piece together a complete face.

▲ It’s actually a bit scary. Picture from: djbaskin However, the unlocking success rate of this product is not yet clear, and there is no large number of sample verifications. So how can people’s face recognition system stop being bothered by masks? Some netizens gradually discovered that as the time of wearing a mask becomes longer and longer, the mobile phone seems to have found “experience” in the face unlocking failures, and gradually can recognize the self wearing the mask successfully. Relying on this idea, some technology bloggers also shared more efficient tutorials, such as repeatedly unlocking while wearing a mask. If the face recognition fails, immediately enter the password. Repeat this action for about 30 minutes, and the phone can recognize the person wearing the mask. By myself.
▲ Successfully unlock the face while wearing a mask. Picture from: Farhad Usmanoff However, in the course of practice, netizens said that the learning’ speed of different models is different. Some people have repeated the above actions for 20 minutes and have succeeded, but some people have repeated them thousands of times, and their mobile phones still cannot recognize themselves wearing a mask. Why does this happen? In fact, the answer relates to the AI ​​learning ability of mobile phones.
▲ Picture from: thenextweb

  Deep learning weapon-NPU

If you have followed the mobile phone conference in the past two years, you must have found that when mobile phone manufacturers introduce SoC chips, they will focus on NPU upgrades. The so-called NPU refers to the neural network processor. In a mobile phone chip, it is generally divided into several functional areas. There are three frequently mentioned at the press conference: one is the CPU that is good at handling complicated tasks and issuing commands, the other is the GPU that is good at graphics processing, and the other is that is good at handling manual labor. NPU for intelligent tasks. Although the NPU’occupies’ area is not as large as the CPU and GPU, its capabilities cannot be ignored. The intelligence of a mobile phone mainly depends on it.

▲ Chips with NPU are often referred to as’AI chips’ bionic chips’. Image from: Lei Xue.net The aforementioned training of mobile phones to recognize themselves wearing masks is mainly due to the NPU’s ability. After the camera captures the face image, the CPU and GPU will preprocess the image in a very short time, then the NPU and GPU will detect and extract features, and finally the CPU, GPU and NPU will jointly complete the face recognition and classification. Thanks to the increasingly powerful computing power, the whole process has been able to achieve the degree of “insensitivity”. The moment we picked up the phone, the above process was completed. The addition of NPU allows mobile phones to recognize you in different states. When you wake up in the morning, even if your face is swollen, your phone knows that this is you. Even after being stung by a wasp, his mouth swollen into sausage’, the phone can still recognize it.
▲ Picture from: Captain Han Drifting So after a certain amount of training, the phone can recognize you without fear of a mask.spark global limited