3D gesture recognition for human-computer interaction to insert wings

With the rapid development of robot technology, robots have been widely used in various fields, such as sweeping robots, waiter robots, chef robots, welcome robots, etc. As a subversive technology, robots are not only technical development, but also capable of Bringing further integration of science and technology.

Since the beginning of human beings, there have been gestures. When speaking, they often use body language to strengthen the content to be expressed. This natural interaction and the combination of GesTIC technology will certainly promote the development of modern human-computer interaction. In view of this, Electronic Consumers' "Robot Technology Special Issue" invites Andreas Guete, Marketing Manager of Human-Machine Interface and Advanced Input Devices Division of Microchip Asia Pacific, to discuss the future direction and development trend of 3D gesture tracking and recognition sensing technology in the robot field.

3D gesture recognition for human-computer interaction to insert wings

Andreas Guete, Marketing Manager for Human Interface and Advanced Input Devices at Microchip Asia Pacific, said that the GesTIC® technology developed by Microchip has only one goal: to provide a cost-effective single-chip solution for 3D gesture recognition, and the MGC3030 and MGC3130 fully achieve this goal.

"Hand-made movements" are called gestures and they are used in a wide range of ways. According to Andreas Guete, Microchip's gesture recognition solution is optimized for detecting these movements and selecting different chips for different applications – integrated gesture recognition is as easy as connecting mechanical buttons without any intervention from the host.

At the same time, the recognizable gestures include many complicated circles in addition to the simple direction of up, down, left and right. Andreas Guete said that integrating such gesture recognition is cheap and easy, and can open up more and wider markets, such as audio systems, home automation and digital screen products. In the future, it is possible to develop the Internet of Things, games, automotive market, etc. .

Overcoming the three major challenges of traditional identification technology

Relative to traditional identification technology, in three major areas, Microchip's gesture recognition solution can be overcome:

First, camera-based gesture recognition solutions are traditional ways of tracking and recognizing gestures. The camera uses light as a sensing element and requires a lens to capture the image. There are five deficiencies in this traditional approach:

1. Perspective. The camera has a certain angle of view. The closer it is, the more it may not see you.

2, lighting conditions. No data is available when there is no light, excessive illumination, and rapid changes to the lighting environment;

3, only get the original data, any camera can image countless. For example, 1 megapixel, 50 fps, 8-bit RGB equals 150 MBps of raw data stream, but does not require raw data, but needs to detect gestures. So you need a hardware calculation unit to do the calculations, you also need to write software or buy the license of off-the-shelf software to detect real gestures. All in all: camera-based gesture recognition is complex and expensive;

4. Through hole and assembly space. To install the lens of the camera, you need to punch holes and the holes need to have a certain depth, which is contrary to our original intention. Moreover, a small amount of dust can make the camera-based system ineffective;

5. Privacy. The camera monitors the user's actions and threatens personal privacy.

Second, although the problem of viewing angle and light can be solved by arranging multiple cameras and artificial light, the cheap and easy to use GesTIC has never been troubled by these problems.

Thirdly, the GesTIC technology was developed with the electric field as the sensing medium, which got rid of the constraints of color and light. It consumes less power and the original data is about 2 kBps - much lower than the data volume of the camera system, which ensures its single-chip gesture processing. Feasibility.

MGC3x30 series highlights the advantages of differentiation

In the sound system, the gesture can realize the fast control of the system, and the soundtrack can be switched easily by waving the hand, and the volume can be adjusted by drawing a circle in the air with a finger. According to Andreas Guete, GestIC does not require a host (all calculations are done by the chip), so it is an excellent gesture solution for embedded devices, and it is the only system on the market that offers automatic wake-up. When there is no interaction, the system will enter a low power state and the system will wake up when it detects a human hand approaching. The advantages are mainly reflected in:

First, the MGC series is not only low-cost but also low-power. It is a unique discrete gesture recognition system. It has many excellent features that may not be particularly noticeable at first. In addition to the self-awake mode and various simple and complex gesture control methods, the most popular consumer is the gesture port function;

Second, the MGC can map gestures to pins so that the MGC3030/3130 can be connected to the host with just a few wires, without the need for a bus;

Third, the MGC SoC is designed to switch to full activation within 1 us—supporting the detection of any gesture at any time with minimal power consumption because the system wakes up only when needed.

When the electric field is close to the system, the system always emits conducted noise, which is a common problem of the capacitive system. In this regard, GestIC also made a breakthrough. According to Andreas Guete, GestIC not only has built-in automatic frequency adoption (AFA), but also introduces a digital noise filtering algorithm to filter noise. AFA sets the operating frequency to be equivalent to the lowest frequency noise, and adaptive digital filtering ensures sensitivity. The signal to noise ratio required to detect gestures. Not only that, all work is done independently by the chip, regardless of the host, GestIC can also cover the entire sensing area, without any blind spots.

See the future layout strategy of touch sensing

Touch sensing has become a must-have feature of many products, and it is accustomed to the convenience brought by smart phones, so I hope other products are just as convenient. To achieve this goal, Andreas Guete said that Microchip will continue to focus on adding more features to single-chip solutions, such as screen surface gesture recognition. Nowadays, everyone likes to delete emails by hand. This gesture is used to identify the operating system. Many embedded devices do not rely on the operating system to run, so they usually do not have such clever interface interaction.

Existing 2D touch sensors and future 2D touch sensors have built-in surface gesture recognition systems. Andreas Guete pointed out that "Pinch and Zoom" will become more popular, not only for mobile phones, but will continue to provide waterproof touch solutions. From waterproof buttons to 2D waterproof touch sensors, practicality is always our focus. In terms of performance, low power consumption and temperature range, Microchip products are outstanding and interested in the automotive market. In the future, we will provide tailor-made products for automotive customers and expand the range of applications for 1D, 2D and 3D products.

Not only that, but CES also demonstrated the latest innovations in GestIC gesture recognition combined with the screen. People have long wanted to be able to manipulate screen content through multi-touch or 3D gestures no more than 20 cm in front of the screen, and today this dream has become a reality. Andreas Guete said that in the future, in addition to relying on GestIC and 3D gesture technology, it can also develop new markets by touchpad, touch screen and buttons. For Microchip user interface solutions and users, CES is just the beginning, a brilliant year is coming. .

Electronic enthusiasts "Robot Technology Special Issue", more quality content, download now

Special issue of robotics

September Weekly deals

September Weekly deals,High Quality September Weekly deals,September Weekly deals Details, CN

ZHONGSHAN G-LIGHTS LIGHTING CO., LTD. , https://www.glightsled.com