One of the major challenges for autonomous driving is the safe transition from autonomous to manual driving. To achieve this goal, the system must have a comprehensive view of the situation inside and outside the vehicle. This requires a holistic model of the driving environment, which includes traffic conditions, other road users' behavior, and the condition of the driver. Only when the information from the surrounding environment is consistent with the information from the inside can driving responsibility be safely transferred. The technology company Continental has now developed a suitable solution that uses an integrated camera system that includes an inward infrared camera and an external camera. This system can monitor the driver's condition, continuously monitor whether the driver is performing driving operations, and the traffic conditions in front of the vehicle.
Self-driving, Continental, self-driving camera
Relevant software continuously evaluates the camera data to show whether the driver is concentrating while driving or is distracted, whether the child is facing the back seat, staring at the smartphone screen, or whether the driver's hand is on the steering wheel or On the back of the head. Georg Binder, head of strategy and planning at Continental's Advanced Driver Assistance Division, said: "With this new camera system, vehicles and drivers can continue to monitor each other's situation. This ultimately helps people build trust in autonomous driving. .The driver can rest assured that the technology will only perform operations according to clear and understandable standards, and will not suddenly hand over driving responsibilities without warning. "
Integrated camera system is a prerequisite for autonomous driving
With its comprehensive camera system portfolio, Continental can provide multiple options for implementing this function according to customer needs. In addition to modular solutions, one can also use off-the-shelf installation space. This road and driver camera are located behind the vehicle's windshield and above the rearview mirror. It is installed in the same position as the existing camera, and its lens is aimed at the road ahead to provide data for advanced driver assistance systems. Cameras play a key role in the implementation of modern driver assistance systems and are an integral part of autonomous driving sensors. The new-generation camera is characterized by excellent night vision characteristics and high image resolution. Its resolution range is from 1 million to 8 million pixels. It also has an aperture of up to 125 degrees, which can detect cross-traffic earlier object. In addition to traditional computer vision processes, it can also match neural networks with available hardware.
This system combines a built-in camera to accurately detect the driver's position, gaze direction, and driver's hand position, so it is considered a prerequisite for autonomous vehicles to get on the road. Because automatic driving can only become a reality if it can switch between "automatic" and "manual" driving modes safely and reliably. The driver must be confident that the vehicle will only transfer responsibility if it is ready to take over driving responsibility.
Built-in monitoring function optimizes restraint system
However, the data from the built-in cameras is not only used to assess whether the vehicle can safely transfer driving functions. It can also adapt passive safety systems such as seat belts and airbags to the current situation with the help of vehicle safety monitoring software. For example, an airbag can adjust its deployment based on what is detected internally to optimize its protection.
An important function of the road and driver camera's internal monitoring system is to evaluate camera data-but not record it. Andreas Forster, the new generation technology manager of the Passive Safety and Sensors Division, said: "The focus is on understanding the vehicle's driving conditions to improve the safety factor for drivers and other road users."
Driver monitoring-part of the future roadmap of the European New Car Safety Assessment (NCAP)
Consumer protection organization European New Car Safety Assessment (NCAP) has adopted topics such as driver monitoring and baby or child monitoring in closed vehicles to improve road safety and be a “zero vision” (no road accidents, deaths or Injured vision). Continental's new camera system minimizes the risk of driver distraction, fatigue, or leaving young children and sleeping babies in the car. It can provide valuable data and take appropriate strategies based on it.
The European NCAP regulations have not yet been finalized. But it is clear that these new regulations must be implemented between 2020 and 2022. By then, Continental's road and driver cameras, which are scheduled for mass production in 2021, are already on the market. By then, the first self-driving cars will likely be on the road. These self-driving cars will be equipped with camera systems that can monitor road and interior conditions. Continental has been able to demonstrate this technology and apply it to new security systems-it is fully in line with the spirit of "zero vision", which is to create a future without traffic accidents for people.