On Wednesday, Members of the European Parliament approved the Artificial Intelligence Act, which guarantees safety and protection of fundamental rights while simultaneously promoting innovation. The regulation, agreed upon during negotiations with member states in December 2023, was adopted with 523 votes in favor, 46 against, and 49 abstentions. Its aim is to protect human rights, democracy, the rule of law, and environmental sustainability from high-risk artificial intelligence, while also encouraging innovation and ensuring Europe’s role as a leader in this field. The rules for artificial intelligence are established based on its potential risks and level of impact.
The new rules prohibit certain applications of artificial intelligence that threaten citizens’ rights, including systems for biometric categorization based on sensitive characteristics and indiscriminate collection of facial images from the internet or surveillance footage for the creation of recognition databases. It also prohibits emotion recognition in workplaces and schools, social scoring of citizens, predictive policing (when it is based solely on profiling individuals or assessing their characteristics), and artificial intelligence that influences human behavior or exploits individuals’ vulnerabilities.
The use of remote biometric identification systems for criminal prosecution is generally prohibited, except in circumstances that are exhaustively listed and precisely defined. Real-time remote biometric identification may only be used if strict requirements are met, e.g., its use is time- and geographically limited, and a special judicial or administrative authorization has been previously issued for it. Some examples of such circumstances include targeted searches for missing persons or preventing terrorist attacks. Subsequent use of remote biometric identification systems is considered high-risk use and requires judicial authorization related to a criminal offense.
Clear obligations are also foreseen for other high-risk artificial intelligence systems (due to their significant potential to endanger health, safety, fundamental rights, the environment, democracy, and the rule of law). High-risk artificial intelligence is used, among other things, for critical infrastructure, education and training, employment, key private and public services (e.g., healthcare, banking), certain systems within criminal prosecution, migration and border management, justice, and democratic processes (e.g., influencing elections). For such systems, risk assessment and mitigation, record-keeping of use, transparency and accuracy, and human oversight must be ensured. Citizens will have the right to file lawsuits related to artificial intelligence and receive explanations for decisions based on high-risk artificial intelligence systems that affect their rights.
General-purpose artificial intelligence systems and the models they are based on must meet certain transparency criteria, including compliance with EU copyright law and the publication of detailed summaries of the content used for training. More powerful general-purpose artificial intelligence systems that could pose systemic risks will be subject to additional requirements, including model assessment, risk evaluation and mitigation, and incident reporting. Additionally, artificially created or manipulated audio content, photographs, and video content (deepfakes) must be clearly labeled as such.
