Skip to main content
Home
jump back to top
deen
Contact
  • more THI pages
  • semester dates
  • Moodle
  • PRIMUSS Application portal
  • PRIMUSS student's portal
  • Curriculum
  • Webmail
 logo
  • more THI pages
  • semester dates
  • Moodle
  • PRIMUSS Application portal
  • PRIMUSS student's portal
  • Curriculum
  • Webmail
Contact
deen
Home
  • University
    • General contact and directions
      • THI Main campus, CARISSMA, Research/FORTEC and IAW
      • Location Stauffenbergstraße
      • Location CARISSMA Outdoor Test Facility
      • Location Neuburg/Donau
      • Office and opening hours
    • University Profile
      • Profile and Strategy
      • Facts and Figures
      • Mission Statement
        • Mission Statement
        • Principles of teaching
      • Milestones
      • Prizes and awards
      • Partners and Sponsors
        • Association of friends of the THI
        • Association for international relations
      • Campus
        • Room of Silence
      • University Management
        • Digitalisation
        • Communcation, Marketing, Press
        • Legal department
        • Taxation
        • Strategy and Quality
        • Event Management
        • Service Center Study Affairs
        • Career Service & Student Counselling
        • International Office
        • Women’s Representatives
        • Special functions
      • University Boards and Organisation
        • University Board
        • University Council
        • Senate
        • Students' Council
    • News
      • Press Releases
    • Events
      • ON Campus Festival
      • CONTACT: The career fair
      • Akademische Feier - Graduation ceremony
    • Corona Updates
  • Faculties
    • Faculties
    • Mechanical Engineering
      • News
        • Study Green Energy
      • About us
        • Dean's Office
        • Professors of the Faculty
        • Other Lecturers
        • Research Assistents
      • Degree Programmes Mechanical Engineering
      • Pre-study internship and bridge courses Maths and Physics
      • Areas of Expertise & Research
        • Link to Institute of new Energy-Systems
        • Projects in Aeronautical Engineering
        • Acoustics
        • Materials Science
      • Laboratories
      • International
    • Engineering and Management
      • News
      • Team
        • Dean's Office
        • Professors
        • Retired professors
        • Other Lecturers
        • Research Assistants
        • Organisation
      • degree programmes
      • Projects
      • Laboratories
      • Expertise & Research Fields
        • Analysis of and Advice on Technical Claims
        • Bavarian Foresight Institute
        • Entrepreneurship and Innovation Management
        • Production Engineering
        • Business Process Management
        • Industry 4.0 and Digitalization of Production
        • AI Applications in Innov. Production & Logistics Systems
        • KI-Based Optimization in the Automobile Production
        • Production and Assembly Systems
        • Statistical Modelling and Machine Learning in Engineering
        • Engineering Procurement
      • International Students
    • Electrical Engineering and Information Technology
      • News
        • Ingolstadt International Lecture Series on Electric Mobil
      • Team
        • Dean's Office
        • Professors and Teaching Staff
      • degree programmes
      • Laboratories
    • Computer Science
      • News
      • About us
        • Dean's Office
        • Professors
        • Other Lecturers
        • Research Assistants
      • Degree Programmes
      • Research Professors
      • Laboratories
        • Laboratory Autonomous Vehicles
        • Lab for Embedded Systems
        • Laboratory Aircraft Electronics and Computer Science
        • Laboratory Hexapod test bench
        • Laboratory User Experience Design
        • Laboratory Computer Networks
        • Laboratory Virtual Reality and Simulation
      • Computer Science International
    • Sustainable Infrastructure
      • Dean's Office and Team
      • Degree programmes
    • THI Business School
      • Welcome to THI Business School
        • Our Vision
        • Our Mission
        • Our Core Values
        • Facts and Figures
        • Sustainability
      • Degree Programmes Business School
      • Dual studies
        • Information for students
        • Information for companies
        • Co-operate companies of the THI Business School
      • News
      • Business School International
      • Areas of Expertise
        • Automotive & Mobility
        • Business Informatics & Logistics
        • Finance, Controlling & Taxation
        • Human Resources & Organisation
        • Marketing & Sales
        • Retail & Consumers
        • Stratgey, Technology, Entrepreneurship & Management
        • UN creativity & innovation day
      • Retail Lab
      • About us
        • Dean's Office
        • Professors of the THI Business School
        • Visiting professors
        • Retired professors
        • Honorary Professors
        • Research Assistants
        • Advisory Council
  • Studies
    • Studying at THI
      • Mobility
      • Engineering
      • Business
      • Digitasation
      • Life Sciences
      • Design and Creativity
      • Sustainability, infrastructure and renewable energies
    • Degree programmes
      • Bachelor study courses
      • Master Study Courses
      • Dual Studies
        • Bachelor dual
        • Master dual
        • Dual corporate partners
        • Dual study models at the THI
        • Applying for dual studies
        • Advantages of a dual study progamme
      • Virtual University of Bavaria (vhb)
    • FAQs
      • General Interest
      • Financial matters FAQs
      • Accommodation search FAQs
      • Staying in Germany (legal issues)
      • Arriving and Life in Ingolstadt
      • Study organization FAQs
      • Free time FAQs
      • FAQs Information for Refugees
    • THI Counselling Services
      • Counselling for prospective students
        • prospective bachelor students
        • Information for prospective master students
      • Counselling for students
        • Student Counselling
        • Leave of absence from studies
        • Psychological-psychotherapeutic counselling
        • Social counselling
      • Studying with children and maternity protection
      • Student disability service
    • Application
      • Bachelor Application
      • Master Application
      • Bachelor application from abroad
      • Masterapplication from abroad
      • Masters and Qualified Professionals
      • Admission and Enrollment
      • PRIMUSS student´s portal
    • Financial Assistance
      • Financing options
      • Contributions and fees
      • Re-registration
    • Internships
      • General information about basic internship and practical studies semester
      • Online application for internship
      • Preparing internship documents
      • Pre-study internship
    • Examination
      • Semester dates
      • Crediting of competences
      • Information about the Examination procedure
      • Applications concerning the examination procedure
      • Examination registration and deregistration
      • Announcement of grades
      • Examination bodies
    • Language Center
      • Contact
      • Chinese
      • German
      • English
      • French
      • Portuguese
      • Russian
      • Spanish
      • Intercultural Courses
    • Center of Entrepreneurship
      • [Translate to English:] Unser Angebot
      • Center of Entrepreneuership - News
    • Going abroad
      • Erasmus+ Programme
      • move
      • Study abroad
        • Step 1: Choosing a partner university
        • Step 2: Applying at THI
        • Step 3: Applying at the partner university
        • Step 4: Financial Issues
        • Step 5: Learning Agreement
        • Step 6: After your return
      • Internship
        • Step 1: General Conditions
        • Step 2: Motivation, Goals
        • Step 3: Finding an Internship
        • Step 4: Application
        • Step 5: I Have Found an Internship - Next Steps
        • Step 6: After the Internship
      • Summer Schools
      • Staff mobility
    • International students
      • Exchange Students
      • International Summer School
        • Application and fees
        • Accommodation
        • Social Programme
        • UX Boot Camp – Designing for Accessibility
      • International Degree-Seeking Students
      • International Ph.D. students
      • For Refugees
      • Practical Information for Internationals
    • Career Service for students
    • Campus and student life
      • Student clubs and initiatives at THI
        • consult.IN e. V.
        • Eta-nol e.V.
        • Catholic University Community
        • Neuland Ingolstadt e. V.
        • NEWEXIST - The start-up initiative
        • N.I.C.E. (Network & International Culture Exchange)
        • Our Future e.V.
        • Schanzer Racing Electric e.V.
        • Studentischer Börsenclub Ingolstadt
        • Students' Life
        • think - The student newspaper
        • UNICEF University Group
      • Accommodation
      • Student discounts
      • Public transport, parking and more
      • Buddy Programme
      • Student Projects
  • Research
    • Research at THI
      • Research competencies
        • Materials and Surface Technology
        • Aeronautical Engineering
        • Start-ups
      • Your Career in Research
    • CARISSMA
      • Philosophy
        • Scholarly Advisory Board
        • Research programme
        • Social and Political Relevance
        • Career
        • Vision of CARISSMA
        • Team
      • News & Press
      • C-IAD
        • Safeguarding automated driving functions using mixed-reality
        • Sensor simulation with a focus on weather conditions
        • Safeguarding functions and HW using HIL for automated driving sys
        • Ergonomics and Human Factors
        • Simulation based validation of vehicle safety functions
        • Localization and Exteroceptive Sensors
        • Interventions in the vehicle dynamics for autonomous driving maneuvers
        • Machine Learning for Vehicle Safety Systems
      • C-ISAFE
        • Project ANTON
        • SAVE-ROAD
        • SimuSens
        • arTIco
        • IFAS
        • Environmental perception
        • Test methods for sensor systems
        • Integral safety
        • Interior detection
      • C-ECOS
        • Security in Mobility
        • Car2X communication with the aid of simulation, HIL and real-life
        • Cooperative Intelligent Transport Systems
        • Safe electromobility and accident analysis
      • Laboratories
        • Abuse-attempts
        • Car2X Laboratory
        • Driving Simulator (Hexapod)
        • Drop Tower
        • Hil Laboratory
        • Indoor test facility
        • Outdoor Test Facility
        • Mobile robots
        • Lab for Security in Mobility
        • Battery lab
        • Simulation Laboratory
    • AImotion - AI Mobility Node
      • Research@AImotion
        • Research Projects
        • Topics
      • People@AImotion
      • Career@AImotion
      • About@AImotion
        • Organizational structure of the AI node
        • Professorships in the AI mobility node Ingolstadt / AININ
        • Hightech Agenda Bayern
    • AININ Artificial Intelligence Network
    • Bavarian Foresight Institute
    • ForTraNN – Sustainability Research and Transfer Center
    • Fraunhofer Application Center
    • Institute of Innovative Mobility (IIMo)
      • Research areas
        • Electromobility and Learning Systems
        • Microelectronics Packaging
        • Engines and Powertrains
      • Teaching and research laboratories
      • Jobs and offers for students
    • Institute of new Energy Systems (InES)
      • Field of Research
        • Industrial Energy Systems
        • Energy System Technology
        • Domestic Energy Systems
        • Technology Transfer & International Projects
      • Laboratories
      • Know-How Transfer
      • International Activities
        • Newsletter-Archiv
      • Team InES
      • Career opportunities InES
    • Transfer at THI
      • AWARE - Applied Research with Latin America
      • Mensch in Bewegung
      • SAFIR IP
        • Intensification Phase
        • Set-up Phase
    • Graduate Center
      • doctorate course
        • Legal background
        • Cooperative doctorate process
        • Financing
        • Supervision agreement
        • Completed doctorates
      • Graduate Center Offers
        • Doctorates
        • Students and external interested parties
        • Doctoral Studies
      • Doctorate course cooperation partners
      • Consortial Doctorates
      • Graduate Center News and Events
    • FORTEC
      • Team
      • Networks
      • Further Responsibilities
        • National funding programmes
        • EU-Funding
        • Start-up support
      • Subsidy Controlling
      • Research institutions
      • News
  • Executive Education
    • bachelor in executive education
    • master in executive education
    • THIntegriert
      • THIntegriert mentoring programme
      • Cooperation with companies
    • Integration campus
  • Service
    • Our services for you
    • University Library
      • Online Registration
      • Order Suggestion
      • Funding Application for Open Access Publications at THI
        • Funding Application for Open Access Publications at THI
      • Library Catalog
      • Information Resources
        • Access Requirements
        • Terms of Use and Copyright Provisions
        • Reference Works
        • Databases
        • Databases - EZproxy
        • Bookmark guide
      • Information Literacy
        • Beginners
        • During your studies
        • Thesis
        • Citavi
        • THI staff
        • Services for schools
        • Individual Support
        • Handouts
      • Our Services
        • iPads
        • Locker
      • About us
      • Research and Publication Service
      • Contact
    • IT Service
      • Software
        • Citavi - literature management
        • MATLAB
        • MSDNAA / dreamspark
        • MindManager
        • Office 365 ProPlus
      • User account
        • Guidelines for Use
        • Password hints
        • Student ID card
      • E-mail / exchange
      • Printing
      • VPN
      • WIFI
    • Gender and Diversity
      • Family-friendly University
      • Working with Children
      • Childcare
      • Guideline against discrimination
      • Integration at THI
    • Dual Studies - Information for companies
    • Talent Promotion/Scholarships
      • THI Talent-The support programme for gifted students
        • Programme sequence & content
        • THI Talent Application
        • Portrait Mentors
        • Dates THI Talent
      • Scholarship programmes of the THI
        • Germany Scholarship
        • Oskar-Karl-Forster-Scholarship
      • Award Winners
        • Awards 2018
        • Awards 2019
        • Awards 2020
        • Awards 2021
      • Current tenders & events
      • Databases, Blogs & Useful
      • Unitag
    • Mentoring for female students
      • Registration for study IN program
      • BayernMentoring Courses
    • Alumni
    • Sports
    • Marketplace
    • Merchandising
  • Career
    • Your Career at THI
      • Professors
        • W1 Junior Professorship
        • W2 Professorship
      • Scientific Staff
      • Non-Scientific Staff
      • Apprentices
    • Who we are and what we do
    • Who we are looking for
    • Where we work
  • Campus Neuburg
    • Welcome to Campus Neuburg
    • Study offers in Neuburg
    • Neuburg - city and region
    • semester dates
    • Moodle
    • PRIMUSS Application portal
    • PRIMUSS student's portal
    • Curriculum
    • Webmail
Contact
deen
  1. Home
  2. Research
  3. CARISSMA
  4. C-ISAFE
  5. Interior detection

Cabin Monitoring

CARISSMA's passive safety research group shows expertise in the field of human-centred artificial intelligence by combining machine learning expertise with knowledge of human-machine interaction in road safety. Its advanced know-how in the fields of computer vision systems, application of artificial intelligence methods for image processing, driver behaviour and behavioural changes from the interaction with automated functions, as well as anthropometry and biometrics, has enabled the group to collaborate with the industry and other research institutes in the passt years.

Work conducted sofar focused on the areas of pose detection and passenger state assessment.

 

Pose detection

In-Vehicle occupant detection includes not only the determination of the number of passengers, but also their exact positioning and the postures made. This information is important for the recognition of Out-of-Position (OoP) situations and the targeted activation of new, adapted restraint systems, which can protect passengers dependent on their position. It is well known that drivers perform additional tasks (so-called secondary tasks or non-driver tasks) when driving manually. Apart from the fact that these tasks may pose a safety risk (the driver has to divide his attention between driving and other activities), to perform them, drivers move their head, arms and upper body, sometimes leaving the ideal upright position required for optimal protection in the event of an airbag deployment.

With increasing automation of vehicles, drivers will no longer need to continuously monitor the environment. They will have more freedom to interact with other passengers and perform activities. As a result, the number of Out-of-Position situations will increase exponentially, posing a challenge for new adaptive restraint systems. Our work on the detection of passengers, objects and animals inside vehicles (passenger cars and public transport) therefore aims at testing and optimising deep learning convolutional neural network architectures for pose recognition and estimation. The focus lies on the creation of a human body segment graph for the exact positioning of passengers. Especially the distance of the different body segments in relation to a certain point or region in the cabin is of great importance. The research group is also working on accomplishing accurate and robust real-time positioning in different scenarios (different number of passengers, clothing characteristics and movement amplitude).

Passenger State Assessment

The work, which focus on passenger state assessment and fitness to drive, is based on the development and improvement of (mainly non-invasive) techniques for measuring physiological and behavioural parameters, that can help to infer conditions such as drowsiness, distraction or stress. These conditions may prevent the driver from performing the driving task manually or, in the case of a higher degree of automation, may impede adequate vehicle monitoring or take-over control actions. Modern methods of artificial intelligence are applied to sensors data, such as like cameras or radar. These results are then compared with classical evaluation methods (e.g. ECG), which are usually considered gold standards.

Recently, the group created a private database (100 driving hours, 130 TB) which contains naturalistic data from daily commuters and long-distance drivers. This database comprises videos of drivers' faces (from RGB and IR cameras) and the road environment ahead (Dashboard Camera), physiological data (Heart Rate and Respiration Frequency from Smartwatch and ECG) and subjective assessments of stress and drowsiness along all trips. Current work on image processing using this database aims to develop algorithms to assess driver's fitness and alertness state. The realistic nature of the data, resulting of the fact that the journeys have taken place under different external environmental conditions (different light, road layout and traffic changes), allows to test the robustness of the algorithms used.

Contact: Prof. Dr. Alessandro Zimmer; Dr. Marta Pereira Cocron

Contact: Prof. Dr. Alessandro Zimmer, Dr. Marta Pereira Cocron

 

Technische Hochschule Ingolstadt
  • Esplanade 10
    85049 Ingolstadt
  • Phone: +49 841 9348-0
  • Mail: info@thi.de

Legal notes

  • Imprint
  • Data protection

Any Questions?

  • FAQs
  • Service Center Study Affairs
  • Counselling for prospective students
  • International Office

General information

  • General contact and directions
  • Office and opening hours
  • Marketplace
  • Website Feedback