Raja Chatila- Sorbonne University
What does it mean to trust AI systems?
The High-Level Expert Group on Artificial In telligence (AI HLEG) appointed by the EU Commission is tasked with elaborating recommendations on ethical, legal and societal issues related to AI and on policy and investments. The group has produced a document released in April 2019 entitled “Ethics Guidelines for Trustworthy Artificial Intelligence”.
Computerized socio-technical systems, based on algorithmic computations and decisions that impact human individuals and society in a way or another, must indeed be trustworthy, and AI systems are no exception. The academic and industrial communities developing software-based systems have produced several techniques to achieve their “dependability” or “resilience”. Software validation and verification techniques, such as error detection and recovery mechanisms, model checking, detection of incorrect or incomplete system knowledge, and resilience to unexpected changes due to environment or system dynamics have been developed for several critical applications such as aviation.
However, as decisions usually devoted to humans are being more and more delegated to machines, sometimes running computational algorithms based on learning techniques, ethical considerations become central. New issues have to be considered technically, in the design process and in the governance of these systems, and properties such as transparency, accountability and explainability take more importance.
Raja Chatila, IEEE Fellow, is Professor of Artificial Intelligence, Robotics and Ethics at Pierre and Marie Curie University in Paris, France. He is director of the SMART Laboratory of Excellence on Human-Machine Interactions and former director of the Institute of Intelligent Systems and Robotics. He contributed in several areas of Artificial Intelligence and autonomous and interactive Robotics along his career. His research interests currently focus on human-robot interaction, machine learning and ethics.
He was President of the IEEE Robotics and Automation Society for the term 2014-2015. He is chair of the IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems, member of the High-Level Expert Group on AI with the European Commission, and member of the Commission on the Ethics of Research on Digital Science and Technology (CERNA) in France.