Skip to main content
Home
jump back to top
deen
Contact
  • more THI pages
  • semester dates
  • Moodle
  • PRIMUSS Application portal
  • PRIMUSS student's portal
  • Curriculum
  • Webmail
 logo
  • more THI pages
  • semester dates
  • Moodle
  • PRIMUSS Application portal
  • PRIMUSS student's portal
  • Curriculum
  • Webmail
Contact
deen
Home
  • University
    • General contact and directions
      • THI Main campus, CARISSMA, Research/FORTEC and IAW
      • Location Stauffenbergstraße
      • Location CARISSMA Outdoor Test Facility
      • Location Neuburg/Donau
      • Office and opening hours
    • University Profile
      • Profile and Strategy
      • Facts and Figures
      • Mission Statement
        • Mission Statement
        • Principles of teaching
      • Milestones
      • Prizes and awards
      • Partners and Sponsors
        • Association of friends of the THI
        • Association for international relations
      • Campus
        • Room of Silence
      • University Management
        • Digitalisation
        • Communcation, Marketing, Press
        • Legal department
        • Taxation
        • Strategy and Quality
        • Event Management
        • Service Center Study Affairs
        • Career Service & Student Counselling
        • International Office
        • Women’s Representatives
        • Special functions
      • University Boards and Organisation
        • University Board
        • University Council
        • Senate
        • Students' Council
    • News
      • Press Releases
    • Events
      • ON Campus Festival
      • CONTACT: The career fair
      • Akademische Feier - Graduation ceremony
    • Corona Updates
  • Faculties
    • Faculties
    • Mechanical Engineering
      • News
        • Study Green Energy
      • About us
        • Dean's Office
        • Professors of the Faculty
        • Other Lecturers
        • Research Assistents
      • Degree Programmes Mechanical Engineering
      • Pre-study internship and bridge courses Maths and Physics
      • Areas of Expertise & Research
        • Link to Institute of new Energy-Systems
        • Projects in Aeronautical Engineering
        • Acoustics
        • Materials Science
      • Laboratories
      • International
    • Engineering and Management
      • News
      • Team
        • Dean's Office
        • Professors
        • Retired professors
        • Other Lecturers
        • Research Assistants
        • Organisation
      • degree programmes
      • Projects
      • Laboratories
      • Expertise & Research Fields
        • Analysis of and Advice on Technical Claims
        • Bavarian Foresight Institute
        • Entrepreneurship and Innovation Management
        • Production Engineering
        • Business Process Management
        • Industry 4.0 and Digitalization of Production
        • AI Applications in Innov. Production & Logistics Systems
        • KI-Based Optimization in the Automobile Production
        • Production and Assembly Systems
        • Statistical Modelling and Machine Learning in Engineering
        • Engineering Procurement
      • International Students
    • Electrical Engineering and Information Technology
      • News
        • Ingolstadt International Lecture Series on Electric Mobil
      • Team
        • Dean's Office
        • Professors and Teaching Staff
      • degree programmes
      • Laboratories
    • Computer Science
      • News
      • About us
        • Dean's Office
        • Professors
        • Other Lecturers
        • Research Assistants
      • Degree Programmes
      • Research Professors
      • Laboratories
        • Laboratory Autonomous Vehicles
        • Lab for Embedded Systems
        • Laboratory Aircraft Electronics and Computer Science
        • Laboratory Hexapod test bench
        • Laboratory User Experience Design
        • Laboratory Computer Networks
        • Laboratory Virtual Reality and Simulation
      • Computer Science International
    • Sustainable Infrastructure
      • Dean's Office and Team
      • Degree programmes
    • THI Business School
      • Welcome to THI Business School
        • Our Vision
        • Our Mission
        • Our Core Values
        • Facts and Figures
        • Sustainability
      • Degree Programmes Business School
      • Dual studies
        • Information for students
        • Information for companies
        • Co-operate companies of the THI Business School
      • News
      • Business School International
      • Areas of Expertise
        • Automotive & Mobility
        • Business Informatics & Logistics
        • Finance, Controlling & Taxation
        • Human Resources & Organisation
        • Marketing & Sales
        • Retail & Consumers
        • Stratgey, Technology, Entrepreneurship & Management
        • UN creativity & innovation day
      • Retail Lab
      • About us
        • Dean's Office
        • Professors of the THI Business School
        • Visiting professors
        • Retired professors
        • Honorary Professors
        • Research Assistants
        • Advisory Council
  • Studies
    • Studying at THI
      • Mobility
      • Engineering
      • Business
      • Digitasation
      • Life Sciences
      • Design and Creativity
      • Sustainability, infrastructure and renewable energies
    • Degree programmes
      • Bachelor study courses
      • Master Study Courses
      • Dual Studies
        • Bachelor dual
        • Master dual
        • Dual corporate partners
        • Dual study models at the THI
        • Applying for dual studies
        • Advantages of a dual study progamme
      • Virtual University of Bavaria (vhb)
    • FAQs
      • General Interest
      • Financial matters FAQs
      • Accommodation search FAQs
      • Staying in Germany (legal issues)
      • Arriving and Life in Ingolstadt
      • Study organization FAQs
      • Free time FAQs
      • FAQs Information for Refugees
    • THI Counselling Services
      • Counselling for prospective students
        • prospective bachelor students
        • Information for prospective master students
      • Counselling for students
        • Student Counselling
        • Leave of absence from studies
        • Psychological-psychotherapeutic counselling
        • Social counselling
      • Studying with children and maternity protection
      • Student disability service
    • Application
      • Bachelor Application
      • Master Application
      • Bachelor application from abroad
      • Masterapplication from abroad
      • Masters and Qualified Professionals
      • Admission and Enrollment
      • PRIMUSS student´s portal
    • Financial Assistance
      • Financing options
      • Contributions and fees
      • Re-registration
    • Internships
      • General information about basic internship and practical studies semester
      • Online application for internship
      • Preparing internship documents
      • Pre-study internship
    • Examination
      • Semester dates
      • Crediting of competences
      • Information about the Examination procedure
      • Applications concerning the examination procedure
      • Examination registration and deregistration
      • Announcement of grades
      • Examination bodies
    • Language Center
      • Contact
      • Chinese
      • German
      • English
      • French
      • Portuguese
      • Russian
      • Spanish
      • Intercultural Courses
    • Center of Entrepreneurship
      • [Translate to English:] Unser Angebot
      • Center of Entrepreneuership - News
    • Going abroad
      • Erasmus+ Programme
      • move
      • Study abroad
        • Step 1: Choosing a partner university
        • Step 2: Applying at THI
        • Step 3: Applying at the partner university
        • Step 4: Financial Issues
        • Step 5: Learning Agreement
        • Step 6: After your return
      • Internship
        • Step 1: General Conditions
        • Step 2: Motivation, Goals
        • Step 3: Finding an Internship
        • Step 4: Application
        • Step 5: I Have Found an Internship - Next Steps
        • Step 6: After the Internship
      • Summer Schools
      • Staff mobility
    • International students
      • Exchange Students
      • International Summer School
        • Application and fees
        • Accommodation
        • Social Programme
        • UX Boot Camp – Designing for Accessibility
      • International Degree-Seeking Students
      • International Ph.D. students
      • For Refugees
      • Practical Information for Internationals
    • Career Service for students
    • Campus and student life
      • Student clubs and initiatives at THI
        • consult.IN e. V.
        • Eta-nol e.V.
        • Catholic University Community
        • Neuland Ingolstadt e. V.
        • NEWEXIST - The start-up initiative
        • N.I.C.E. (Network & International Culture Exchange)
        • Our Future e.V.
        • Schanzer Racing Electric e.V.
        • Studentischer Börsenclub Ingolstadt
        • Students' Life
        • think - The student newspaper
        • UNICEF University Group
      • Accommodation
      • Student discounts
      • Public transport, parking and more
      • Buddy Programme
      • Student Projects
  • Research
    • Research at THI
      • Research competencies
        • Materials and Surface Technology
        • Aeronautical Engineering
        • Start-ups
      • Your Career in Research
    • CARISSMA
      • Philosophy
        • Scholarly Advisory Board
        • Research programme
        • Social and Political Relevance
        • Career
        • Vision of CARISSMA
        • Team
      • News & Press
      • C-IAD
        • Safeguarding automated driving functions using mixed-reality
        • Sensor simulation with a focus on weather conditions
        • Safeguarding functions and HW using HIL for automated driving sys
        • Ergonomics and Human Factors
        • Simulation based validation of vehicle safety functions
        • Localization and Exteroceptive Sensors
        • Interventions in the vehicle dynamics for autonomous driving maneuvers
        • Machine Learning for Vehicle Safety Systems
      • C-ISAFE
        • Project ANTON
        • SAVE-ROAD
        • SimuSens
        • arTIco
        • IFAS
        • Environmental perception
        • Test methods for sensor systems
        • Integral safety
        • Interior detection
      • C-ECOS
        • Security in Mobility
        • Car2X communication with the aid of simulation, HIL and real-life
        • Cooperative Intelligent Transport Systems
        • Safe electromobility and accident analysis
      • Laboratories
        • Abuse-attempts
        • Car2X Laboratory
        • Driving Simulator (Hexapod)
        • Drop Tower
        • Hil Laboratory
        • Indoor test facility
        • Outdoor Test Facility
        • Mobile robots
        • Lab for Security in Mobility
        • Battery lab
        • Simulation Laboratory
    • AImotion - AI Mobility Node
      • Research@AImotion
        • Research Projects
        • Topics
      • People@AImotion
      • Career@AImotion
      • About@AImotion
        • Organizational structure of the AI node
        • Professorships in the AI mobility node Ingolstadt / AININ
        • Hightech Agenda Bayern
    • AININ Artificial Intelligence Network
    • Bavarian Foresight Institute
    • ForTraNN – Sustainability Research and Transfer Center
    • Fraunhofer Application Center
    • Institute of Innovative Mobility (IIMo)
      • Research areas
        • Electromobility and Learning Systems
        • Microelectronics Packaging
        • Engines and Powertrains
      • Teaching and research laboratories
      • Jobs and offers for students
    • Institute of new Energy Systems (InES)
      • Field of Research
        • Industrial Energy Systems
        • Energy System Technology
        • Domestic Energy Systems
        • Technology Transfer & International Projects
      • Laboratories
      • Know-How Transfer
      • International Activities
        • Newsletter-Archiv
      • Team InES
      • Career opportunities InES
    • Transfer at THI
      • AWARE - Applied Research with Latin America
      • Mensch in Bewegung
      • SAFIR IP
        • Intensification Phase
        • Set-up Phase
    • Graduate Center
      • doctorate course
        • Legal background
        • Cooperative doctorate process
        • Financing
        • Supervision agreement
        • Completed doctorates
      • Graduate Center Offers
        • Doctorates
        • Students and external interested parties
        • Doctoral Studies
      • Doctorate course cooperation partners
      • Consortial Doctorates
      • Graduate Center News and Events
    • FORTEC
      • Team
      • Networks
      • Further Responsibilities
        • National funding programmes
        • EU-Funding
        • Start-up support
      • Subsidy Controlling
      • Research institutions
      • News
  • Executive Education
    • bachelor in executive education
    • master in executive education
    • THIntegriert
      • THIntegriert mentoring programme
      • Cooperation with companies
    • Integration campus
  • Service
    • Our services for you
    • University Library
      • Online Registration
      • Order Suggestion
      • Funding Application for Open Access Publications at THI
        • Funding Application for Open Access Publications at THI
      • Library Catalog
      • Information Resources
        • Access Requirements
        • Terms of Use and Copyright Provisions
        • Reference Works
        • Databases
        • Databases - EZproxy
        • Bookmark guide
      • Information Literacy
        • Beginners
        • During your studies
        • Thesis
        • Citavi
        • THI staff
        • Services for schools
        • Individual Support
        • Handouts
      • Our Services
        • iPads
        • Locker
      • About us
      • Research and Publication Service
      • Contact
    • IT Service
      • Software
        • Citavi - literature management
        • MATLAB
        • MSDNAA / dreamspark
        • MindManager
        • Office 365 ProPlus
      • User account
        • Guidelines for Use
        • Password hints
        • Student ID card
      • E-mail / exchange
      • Printing
      • VPN
      • WIFI
    • Gender and Diversity
      • Family-friendly University
      • Working with Children
      • Childcare
      • Guideline against discrimination
      • Integration at THI
    • Dual Studies - Information for companies
    • Talent Promotion/Scholarships
      • THI Talent-The support programme for gifted students
        • Programme sequence & content
        • THI Talent Application
        • Portrait Mentors
        • Dates THI Talent
      • Scholarship programmes of the THI
        • Germany Scholarship
        • Oskar-Karl-Forster-Scholarship
      • Award Winners
        • Awards 2018
        • Awards 2019
        • Awards 2020
        • Awards 2021
      • Current tenders & events
      • Databases, Blogs & Useful
      • Unitag
    • Mentoring for female students
      • Registration for study IN program
      • BayernMentoring Courses
    • Alumni
    • Sports
    • Marketplace
    • Merchandising
  • Career
    • Your Career at THI
      • Professors
        • W1 Junior Professorship
        • W2 Professorship
      • Scientific Staff
      • Non-Scientific Staff
      • Apprentices
    • Who we are and what we do
    • Who we are looking for
    • Where we work
  • Campus Neuburg
    • Welcome to Campus Neuburg
    • Study offers in Neuburg
    • Neuburg - city and region
    • semester dates
    • Moodle
    • PRIMUSS Application portal
    • PRIMUSS student's portal
    • Curriculum
    • Webmail
Contact
deen
  1. Home
  2. Research
  3. CARISSMA
  4. C-IAD
  5. Sensor simulation with a focus on weather conditions

Sensor simulation with a focus on weather conditions

The non-reproducibility of the environment and accompanying difficulty in reconstructing scenarios is one of the greatest challenges of endurance testing. Unfavourable weather conditions in particular, such as rain, fog and the position of the sun, can lead to critical sensor effects and to incorrect decisions subsequently being taken by an automated system. The safeguarding of safety systems draws on the aforementioned mixed reality test environment, enabling testing both in real life under reproducible conditions and virtually in simulation environments.
Statistical and dynamic tests can be made at variable rain intensities using an indoor rain unit developed in-house and validated with measurements taken under natural conditions. The use of a test hall for testing purposes ensures stable general conditions. In addition, by employing disturbance models, it is possible to perform purely virtual testing of algorithms to determine weather effects. A considerable increase in a system’s robustness can be effected by conducting tests at an early stage.

Projects

SAFIR - Impuls Project 1, Subproject 3: Sensor systems and sensor models under weather impact

The subproject develops a validation method for sensor models based on the measurement of real weather conditions and a downstream disturbance modelling. Weather conditions (bad weather situations rain, fog, snow, but also low sun position) have a considerable influence on the reliability of the environment sensor system in the vehicle and are systematically investigated within this subproject. For this purpose, real weather data will be measured over a longer period of time in reality, a rain and fog simulator will be set up in the laboratory (each 50m long), and the simulators will be parameterized with real weather values. In this setting, environment sensors in the vehicle (radar, lidar, camera) are exposed to different weather conditions under reproducible conditions, measured data are recorded and transferred into models for the virtual world (simulation). Finally, the models are subjected to a comparative evaluation (validation).

AI-SEE

The automotive industry is facing one of the most demanding challenges in its history: how to make automated travel safe in all conditions. There have been great advances towards automation with new vehicles increasingly equipped with driver assistance systems (ADAS). The biggest barrier now remaining to full automation is driving under poor weather and visibility in safety. The AI-SEE project aims to build a novel, robust sensing system supported by Artifical Intelligence (AI) that will enable automated travel in varied traffic, lighting and weather conditions. It will extend the Operational Design Domain (ODD) of automated vehicles (i.e. the scope of what they can do), taking the technology from SAE level 3 (environmental detection, human override) to level 4 (high driving automation) where vehicles drive themselves with no human interaction in most circumstances.

With advanced and autonomous vehicles entering the market, solving problems linked to lighting and weather conditions such as rain, fog and snow is key to ensuring a safe environment for drivers, passengers and pedestrians. However, to move from level 3 to level 4 requires solutions to four key challenges: (i) mass-production of powerful computing platforms (ii) improved sensing capabilities and lower-cost sensors (iii) necessary technical standards and (iv) infrastructure. AI-SEE is focusing primarily on the second challenge by increasing the environmental and situational awareness of vehicles.

Humans ‘see’ by combining stored memories and sensory input to interpret events and anticipate upcoming      scenarios. Today’s automated vehicles cannot yet provide this inferential thinking, nor communicate in real-time with the environment. For automated vehicles to drive without human intervention, the information content from current sensors needs to be enhanced significantly. But this will create an increasingly large amount of data transmitted at huge data rates which, along with all the additonal sensors, will quickly exceed      the limits of in-vehicle storage space, and vehicle computational and energy resources.

Together, the high number of sensors needed for 360 degree environment perception and situation awareness and the high cost of LiDAR (Light Detection & Ranging) used for measuring distances to objects, represent significant barriers to the wider roll out of automated driving.[1]

Taking technologies to the next level

AI-SEE will address these challenges by combining complex hardware and software development, creating automotive perception systems that go beyond today’s state-of-the-art. Its goal is to introduce reliable, secure, trustable sensors and software by implementing self-diagnosis, adaptation and robustness.

The AI-SEE concept is built on four main blocks:

  1. A 24/365 high resolution adaptive all-weather sensor suite
  2. An AI platform for predictive detection of prevailing environmental conditions including signal enhancement and sensor adaptation
  3. Smart sensor data fusion to create the 24/365 adaptive all-weather robust perception system
  4. A demonstrator and system validation plan, with testing carried out in simulations and in real-world environments in northern Europe

The project will deliver the first high-resolution adaptive multi-sensor suite building on ainnovative novel AI perception-processing scheme for low visibility conditions.

Specifically, AI-SEE will create novel sensor hardware comprising an active polarimetric imager and congruent LIDAR data; a short-wave infrared (SWIR) LIDAR with a novel SPAD receiver architecture; a high resolution 4D MIMO radar and a gated SWIR-camera. To support the novel sensing system and improve localization performance in poor weather, the project will also take high definition (HD) dynamic mapping to a new level. In addition, to handle the multisensory data fusion, an AI platform will be built to advance early signal enhancement for robust perception.

Importantly, the project will develop sensor-near simulation models for all active sensors for artificial generation of synthetic inclement weather datasets. This is expected to revolutionise simulation, with conversion of good weather neural network datasets into inclement weather datasets – thereby saving large amounts of money and time in testing and validating inclement weather sensor performance. Moreover, a large outdoor weather data bank for testing, modelling and validation will also be created. All of which will lead to a paradigm shift in signal enhancement techniques and a competitive advantage for the European automotive industry.

Partnership beyond traditional automotive networks

The AI-SEE fault tolerant environment perception system and its sub-system are highly complex. Bringing them to the market calls for partnership beyond the traditional network of automotive OEMs and Tier 1 suppliers. To tackle the challenges of new hardware, data collection, and AI-supported signal enhancement and simulations, the AI-SEE project includes OEMs; Tier 1, 2 and 3 suppliers; and smaller engineering companies as well as academic and research institutes. Together, these partners not only have the necessary expertise, but also unique testing and development capabilities not found in any one European country alone.

Positioned for rapidly evolving market opportunities

The emergence of AD is transforming the automotive industry, bringing in new players such as online service providers and IT and telecommunication suppliers. However, the market outlook remains unclear. Predictions range from sales of two million L3+ vehicles in 2030 to 63 million in the same time period[1] . Nonetheless, automotive sensor sales are expected to grow at an average rate of 8%, with 14% growth in sales value, up to 2022. Overall, the sensor market was worth USD 11 billion in 2016 and it is expected to reach USD 23 billion by 2022, mainly due to the boom in imaging, radar and LiDAR sensors, which will respectively be worth USD 7.7 billion, USD 6.2 billion and USD 1.4 billion by 2022.[2]

Being fast and focused will be key for success in this rapidly evolving landscape. AI-SEE will contribute by giving Europe a vital first in cutting-edge technologies for environmental perception. It will also allow European companies to compete in the supply of sensors related to adverse weather conditions where US exports are limited by security (defence technology) concerns. Furthermore, it will help Europe maintain its strong position (close to 40%) in the fast-growing LIDAR market, expected to reach USD 2.6 billion by 2030,[3] and to seize opportunities in areas such as automotive night vision systems and automotive radar. In addition, AI-SEE’s results will support standardisation, which is essential for deployment of automated driving systems on a wide scale.

Automotive is one of Europe’s key industries accounting for 6.8% of EU GDP and 13.3 million jobs. Through its outcomes, AI-SEE will help Europe to retain its world-leading strengths in this domain, thereby safeguarding high-value jobs, economic growth and indirectly the social well-being of EU citizens.

 

KEY APPLICATION AREAS

Transport and Smart Mobility

 

ESSENTIAL CAPABILITIES

Safety, Security and Reliability;

PARTNERS

Mercedes-Benz AG

Algolux (Germany) GmbH

Algolux Inc.

ams AG

ANSYS Germany GmbH,

AstaZero AB

AVL List GmbH

Basemark Oy

Brightway Vision Ltd.

    

FIFTY2 Technology GmbH

Ibeo Automotive Systems GmbH

Institut für Halbleitertechnik der Universität Stuttgart

Institut für Lasertechnologien in der Medizin und Meßtechnik an der Universität Ulm

Meluta Oy

Mercedes-Benz AG (Project Lead)

 

OQmented GmbH

Patria Land Oy

 

Robert Bosch GmbH

Technische Hochschule Ingolstadt CARISSMA Institute of Automated Driving       

UNIKIE Oy

 

Veoneer Sweden AB

VTT Technical Research Centre of Finland Ltd

COUNTRIES INVOLVED

Austria

Canada

Finland

Germany

Israel

Sweden

PROJECT LEADERS

Name: Dr. Werner Ritter
Company: Mercedes-Benz AG

KEY PROJECT DATES

Start: 01 June 2021

End: 01 April 2024

 


[1] Prices for individual LiDAR-sensors can reach up to 10 000 €. Garmin, 2019. LIDAR-Lite v3HP a Low-Cost Solution to Autonomous Building-Interior Mapping.

[2] Electronic Specifier (2020). Sensing changes in the automotive sensor market.

[3]  KnowMade (2018).  LiDAR for Automotive Patent Landscape.


Technische Hochschule Ingolstadt
  • Esplanade 10
    85049 Ingolstadt
  • Phone: +49 841 9348-0
  • Mail: info@thi.de

Legal notes

  • Imprint
  • Data protection

Any Questions?

  • FAQs
  • Service Center Study Affairs
  • Counselling for prospective students
  • International Office

General information

  • General contact and directions
  • Office and opening hours
  • Marketplace
  • Website Feedback