AI for advanced and collective perception and decision making for CCAM applications (CCAM Partnership)

Topic updates

17 January 2025

17 September 2024

The call for proposals HORIZON-CL5-2024-D6-01 closed on 05/09/2024. 239 proposals were submitted to the call. The breakdown per topic is:

HORIZON-CL5-2024-D6-01-04 (RIA): 30

AI for advanced and collective perception and decision making for CCAM applications (CCAM Partnership)

HORIZON-CL5-2024-D6-01-04

Programme: Horizon Europe Framework Programme (HORIZON)
Call: Safe, Resilient Transport and Smart Mobility services for passengers and goods (HORIZON-CL5-2024-D6-01)
Type of action: HORIZON-RIA HORIZON Research and Innovation Actions
Type of MGA: HORIZON Action Grant Budget-Based [HORIZON-AG]
Deadline model: single-stage
Planned opening date: 07 May 2024
Deadline date: 05 September 2024 17:00:00 Brussels time

ExpectedOutcome:
Project results are expected to contribute to all of the following expected outcomes:

Approaches for resilient collective awareness, which can eventually be used in e.g. complex models of collective behaviour.
Advanced collective awareness, decision making and triggering of actions for CCAM applications, enabled by new concepts and tools built on advancements in Artificial Intelligence (AI), including Hybrid Intelligence (HI).
CCAM solutions evolving from reactive into predictive system state awareness (including driver state and road user diversity), decision making and actuation, enhancing road safety.
Understanding of AI-related ethical issues and user needs, together with capabilities, limitations and potential conflicts of AI based systems for CCAM, including a definition and a measure of human-like control.
Increased user acceptability and societal benefit of CCAM solutions, based on explainable, trustworthy and human-centric AI. Interactions with AI-based vehicles are understandable, human-like and reflect human psychological capabilities.
Scope:
Today’s mobility landscape is rapidly changing, as is seen in the recent boom in the detection of advanced and/or complex urban scenarios that add new challenges to the development of CCAM technologies. These novel scenarios are especially emerging with the establishment of new urban traffic regimes and cultures, such as restricted zones, shared zones, and cycle-streets, which need to be taken into account when designing and developing CCAM solutions.

To integrate and tackle complex traffic scenarios, CCAM technologies will require highly advanced decision-making based on enhanced collective awareness – the stage beyond on-board perception, advancing on e.g. results from projects under CL5-2022-D6-01-05[1] – incorporating information from multiple sources and including interpretation for the aggregation of this information. Developing collective awareness should take into account the state of the vehicle, the driver and the road user environment. It can also involve the tracking of other road users' behaviour and generating predictions on a short horizon, which can be based on the input from advanced behavioural models, e.g. those developed within CL5-2022-D6-01-03[2] projects. The integration of these findings will lead to collective awareness for CCAM.

The use of multiple sources (sensors and sensor fused information, maps, infrastructure, other road users, and localisation systems) and the sharing of the overall situational information and related intentions of the vehicle and that of its direct environment will be an important building block towards collective awareness. Eventually, in future work this can be incorporated in complex, self-organised bottom-up models of collective behaviour based on the change/modelling of individual interactions. Collective awareness should create a larger time window in safety critical situations and generate benefits for the overarching mobility system, which include efficient traffic management and improved traffic flow as it incorporates situation prediction capabilities and environmental benefits (which can eventually include e.g. smart charging strategies).

AI is a key enabler to bring these increasing amounts of information together, with decision-making enabled both at vehicle level (including safety critical decisions) and at a mobility system level. In order to continue to define the role and limits of AI and of emerging new developments within AI, this topic recommends exploring Hybrid Intelligence (HI) as such a new subset of AI. Hybrid Intelligence is the process of developing and mobilising Artificial Intelligence (AI) to expand on human intelligence and expertise, thereby ensuring human-like control of CCAM operations. Applying an HI approach will allow CCAM technologies to integrate human expertise and intentionality into its decision-making in order to generate meaningful and appropriate actions that are aligned with ethical, legal and societal values. This will be essential to foster user acceptability, trust and adoption, especially when appropriate SSH expertise is included.

Proposed R&I actions are expected to address all of the following aspects:

Methods to establish collective awareness of CCAM applications that are resilient to faulty sources, thereby ensuring safe operations. Guidance for failsafe designs should be developed.
Methods to embed an HI approach in the entire action chain towards collective awareness (from basic perception to driving functions) to allow for seamless operation and real-time decision-making while enabling human-like control of CCAM applications by combining system and domain knowledge (of the vehicle and its technologies on one hand and of the transport environment including all the human interactions on the other, thereby understanding of potential risks and capabilities and needs of other road users). Tooling will be required to deliver situational awareness information in a structured way, based on multiple sources and in real-time. In addition, the development and integration of ethical goal functions to support collective awareness should be included. Work is expected to be based on:
At least perception systems, sensor fusion, high-level world models/maps, vehicle positioning information. Guidance on common reference systems for positioning and time for synchronisation should be included in order to secure robustness and traceability.
Relationships between the vehicle and forecasted intentions of other road users (e.g. a pedestrian crossing the street at a zebra crossing), as such including spatial temporal relation of elements in the driving-situation.
This topic requires the effective contribution of SSH disciplines including ethics and the involvement of SSH experts, institutions as well as the inclusion of relevant SSH expertise, in order to produce meaningful and significant effects enhancing the societal impact of the related research activities.

Proposals should monitor and align relevant developments under this topic with on-going discussions regarding EU type vehicle approval rules as well as in the framework of the UNECE.

In order to achieve the expected outcomes, international cooperation is encouraged in particular with Japan and the United States but also with other relevant strategic partners in third countries.

This topic implements the co-programmed European Partnership on ‘Connected, Cooperative and Automated Mobility’ (CCAM). As such, projects resulting from this topic will be expected to report on results to the European Partnership ‘Connected, Cooperative and Automated Mobility’ (CCAM) in support of the monitoring of its KPIs.

Specific Topic Conditions:
Activities are expected to achieve TRL 5 by the end of the project – see General Annex B.

[1] “Artificial Intelligence (AI): Explainable and trustworthy concepts, techniques and models for CCAM”

[2] “Human behavioural model to assess the performance of CCAM solutions compared to human driven vehicles”