Spanish National Police Halts Veripol, Its Flagship AI To Detect False ReportsThe Ministry of Interior stated that it dismissed the system on the grounds that it had been proved being of no validity in judicial proceedings.
Automation on the MoveSystems based on Artificial Intelligence (AI) and automated decision-making (ADM) are increasingly being experimented with and used on migrants, refugees, and travelers. Too often, this is done without adequate democratic discussion or oversight. In addition, their use lacks transparency and justification to those who are subjected to these systems, as a growing body of literature and evidence shows. This needs to change.
Automation on the Move The Automation of Fortress Europe: Behind the Black CurtainThe European Union poured 5 million euros into the development of a border surveillance system called NESTOR. When we tried to look into it, we were presented hundreds of redacted, blacked out pages.
Automation on the Move Automating EU Borders, Broken Checks and BalancesFor over a year, we have been looking into EU-funded border security research projects to assess their methodological approaches and ethical implications. We failed.
Automation on the Move EMERALD – The One That Fell from GraceOnly one proposed border security research project did not meet the EU’s ethical requirements and was rejected, AlgorithmWatch found. What was so unique about this surveillance system?
“All Rise For the Honorable AI”: Algorithmic Management in Polish Electronic CourtsPolish courts are using algorithms to support their decision-making process, e.g. for evaluating cases or issuing resolutions. Some see AI as a game changer, but the lack of a critical assessment and transparency as well as the impact on judges’ independence and fairness are reasons for concern.
Campaign: ADM and People on the Move Borders without AI29,000 people have died in the Mediterranean over the past ten years while trying to reach the EU. You would think that the EU wanted this tragedy to stop and scientists across Europe were working feverishly on making this happen with the latest technology. The opposite is the case: With the help of so-called Artificial Intelligence, the walls are being raised, financed with taxpayers' money.
Campaign: ADM and People on the Move The Automated Fortress Europe: No Place for Human Rights29,000 people have died in the Mediterranean over the past ten years while trying to reach the EU. You would think that the EU wanted this tragedy to stop and scientists across Europe were working feverishly on making this happen with the latest technology. The opposite is the case: With the help of so-called Artificial Intelligence, digital border walls are being raised, financed with taxpayers' money.
Explainer: ADM in the public sector The algorithmic administrationAutomating administration processes promises efficiency. Yet the procedures often put vulnerable people at a disadvantage, as shown by a number of examples throughout Europe. We’ll explain why using automation systems in the domain of public administration can be especially problematic and how risks may be detected at an early stage.
Italy Introduces Entirely Automated Public TendersThe neofascist government led by Brothers of Italy passed a law that encourages public institutions to entirely automate procurements, from the definition of needs to the selection of winning bids. The consequences are uncertain as such systems have yet to be implemented, but small communities will most definitely lose power and opacity will reign.
Stance If the UN wants to help humanity, it should not fall for AI hypeHow should the international governance of AI look like? This is the thorny question the UN Secretary General’s AI Advisory Body tries to address in its first interim report. We have highlighted some concerning aspects of the report in a recent consultation process.
Spanish Inmates Not to Be Automatically Monitored in Fear of AI ActSpanish region Catalonia’s government approved the use of an Artificial Intelligence-based software to monitor inmates and interpret their behavior. Partially funded by the European Union, the system was to be implemented at the Mas d'Enric prison near Tarragona, a city south of Barcelona, and extended to other regional prisons. Ultimately, it wasn't.
Austria’s Social Security Invests Over €50m in AI – Just for Bookkeeping?The company that manages the technical infrastructure of Austria’s health insurance system passed a massive tender for AI services. The plan is shrouded in secrecy, even though the company’s track record urges caution.
Battle in Strasbourg: Civil society fights for safeguards against AI harmsWith negotiations on a Convention on Artificial Intelligence (AI) within the Council of Europe entering a crucial stage, a joint statement by AlgorithmWatch and ten other civil society organizations reminds negotiating states of their mandate : to protect human rights, democracy, and the rule of law. To adhere to this mandate and to counter both narrow state interest and companies’ lobbying, the voice of civil society must be listened to.
The algorithm that blew up Italy’s school system An algorithm was supposed to save time by allocating teachers on short-term contracts to schools automatically. Failures in the code and in the design severely disrupted teachers’ lives.
Joint statement: The EU AI Act must protect people on the moveIn its current form, the AI Act does not adequately address and prevent harms stemming from the use of AI in the migration context. Today, AlgorithmWatch together with 191 organizations and individuals are sending a decisive signal to EU decision-makers: ensure the protection of human rights of people on the move!
Civil society responds to the Council of Europe Treaty on AITogether with other observer civil society organizations in the Committee on AI in the Council of Europe, AlgorithmWatch stresses the importance of that legal framework on AI based on human rights, democracy, and the rule of law that is currently being elaborated in Strasbourg. We urge the EU not to delay this process in light of the negotiations on its own AI Act currently ongoing in Brussels. The two frameworks have a different purpose and should complement rather than copy-paste each other.
EU rules for AI have some distance to goThe AI Act and Directive on AI Liability aim to protect fundamental rights, health and safety, but fall short in the current form. An op-ed, published first at Context.
Our response to the EDPB’s guidelines on facial recognition in law enforcementThe European Data Protection Board has called for input on its recently published guidelines on the use of facial recognition technology in law enforcement. AlgorithmWatch responded.
Submission to the UN report on the right to privacy in the digital ageWhen the right to privacy is violated, it is often the case that other human rights are also negatively impacted. In our submission, we list key areas of concerns on the way automated decision-making systems (ADMs) affect people’s basic rights.
Council of Europe creates rules for Artificial IntelligenceNot only the EU but also the Council of Europe – an international organization based in Strasbourg – is setting rules on Artificial Intelligence (AI). In this explainer on its Convention on AI, we show what this is all about, why it is relevant to you and what the next steps are.
Members of the European Parliament could protect us from biometric surveillance – if they wanted toTogether with Reclaim Your Face and 51 other civil society organizations, AlgorithmWatch calls for a meaningful ban of remote biometric identification systems in public spaces. In an Open Letter to Members of the European Parliament, we urge them to amend the draft AI Act accordingly.
Civil society reacts to EP AI Act draft ReportTogether with civil society partners we analyse in our new joint statement the two main EU parliamentary committees' draft report on the AI Act. In light of our core demands we identify the important steps it takes – and the gaps it still needs to fill so that it protects people and our fundamental rights.
A Milestone in the AI Act negotiationsOn April 21st, the much-awaited IMCO-LIBE draft report on the Artificial Intelligence Act (AI Act), produced by the European Parliament lead negotiators Brando Benifei and Dragoș Tudorache, was finally disclosed – a major milestone in the AI Act negotiations. While we are preparing a detailed analysis in collaboration with our partners, we share below our first take on the draft report.
AlgorithmWatch’s demands for improving the AI ActAs policymakers are busy with shaping the AI Act, AlgorithmWatch has clear demands what should flow into the regulation so that it genuinely protects our fundamental rights.