Making critical autonomous AI-based systems safe

Making critical autonomous AI-based systems safe

Objectives

To improve the explainability and traceability of DL components

To provide clear safety patterns for the incremental adoption of DL software in Critical Autonomous AI-based Systems (CAIS)

To integrate the SAFEXPLAIN libraries with an industrial system-testing toolset

To create architectures of DL components with quantifiable and controllable confidence, and that have the ability to identify when predictions should not be released based on applicability’s scope or security concerns

To design, implement, or update selected representative DL software libraries according to safety patterns and safety lifecycle considerations, meeting specific performance requirements on  relevant platforms

Deep Learning (DL) techniques are key for most future advanced
software functions in Critical Autonomous AI-based Systems (CAIS) in
cars, trains and satellites. Hence, those CAIS industries depend on their
ability to design, implement, qualify, and certify DL-based software
products under bounded effort/cost

Case studies

Railway: This case studies the viability of a safety architectural pattern for the completely autonomous operation of trains (Automatic Train Operation, ATO) using intelligent Deep Learning (DL)-based solutions.

Space: This case employs state-of-the-art mission autonomy and artificial intelligence technologies to enable fully autonomous operations during space missions. These technologies are developed through high safety-critical scenarios.

Automotive: This case develops advanced methods and procedures that enable self-driving cars to accurately detect road users, estimate their distance from the vehicle, and predict their trajectories while adhering to both safety and explainability requirements.

Safety patterns for AI-based systems

Safety patterns for AI-based systems

Through the SAFEXPLAIN project, Ikerlan has analyzed strategies and developed specific solutions to implement safety patterns in systems that incorporate AI components. Learn more about the 4 key safety mechanisms used in the reference safety architurecture pattern.

Coming Soon! SAFEXPLAIN technologies converge in an open demo

Coming Soon! SAFEXPLAIN technologies converge in an open demo

As the project enters into its 27th month, releases for most technologies are already available and undergoing the last steps towards completing their integration.To demonstrate the SAFEXPLAIN approach, project partners are working towards creating an open source demo...

Webinar- Putting it together: The SAFEXPLAIN platform and toolsets

Webinar- Putting it together: The SAFEXPLAIN platform and toolsets

The third webinar in the SAFEXPLAIN webinar series will share the novative infrastructure behind the AI-FSM and XAI methodologies. Participants will gain insights into the integration of the proposed solutions and how they are designed to enhance the safety, portability and adaptability of AI systems.

SAFEXPLAIN to Participate in 2025 HiPEAC Conference

SAFEXPLAIN to Participate in 2025 HiPEAC Conference

Join us for two workshops at this year’s HiPEAC conference. Partners IKERLAN and RISE will be participating in workshops: MCS: Mixed Critical Systems – Safe Intelligent CPS and the development cycle WS and the Women@HPC MAR WHPC chapter: Building the diversity continuum in cutting-edge technologies. These workshops will take place during the second day of the workshop.

SAFEXPLAIN @ AI, Data, Robotics Forum

SAFEXPLAIN @ AI, Data, Robotics Forum

SAFEXPLAIN is happy to support the 2024 edition of the AI, Data and Robotics Forum. This two-day event is helping to unite the AI, Data and Robotics (ADR) community to support responsible innovation. The theme of this year's forum is "European Sovereignty in AI, Data...