|
Lehrende/r: Mattia Cerrato
Veranstaltungsart:
Vorlesung/Übung
Anzeige im Stundenplan:
Trustworthy AI
Semesterwochenstunden:
4
Credits:
6,0
Unterrichtssprache:
Englisch
Min. | Max. Teilnehmerzahl:
- | -
Voraussetzungen / Organisatorisches:
Zweiteilige Veranstaltung: Vorlesung (Dienstag) und Tutorium/Diskussion (Donnerstag). Teilnahme an beiden wird empfohlen, ist aber nicht verpflichtend.
Teilnahmevoraussetzungen
- The instructor is only able to teach in English.
- To fully benefit from the class, some background in probability and statistics is advisable. However, programming skills are not strictly necessary.
Anforderungen/
- Final essay on the intersection between Trustworthy AI and the student’s background (e.g. law, philosophy, social sciences…) (6-8 pages)
- Participation in the weekly discussions, or, alternatively, completion of short essays (3-5 pages)
Inhalt:
A full description is available at https://pibborn.github.io/trust-class/
While this course is designed for computer science students, the concepts of fairness, interpretability, and privacy are highly relevant to other disciplines as well, whether law, social sciences, philosophy, or others. We therefore invite interested students from all disciplines to take part and share their perspectives.
Machine Learning models, especially based on neural networks, are now part of our everyday life, being deployed in smartphones and embedded systems. Computer Vision algorithms recognize our pets in the photos we take; Natural Language Processing models are able to fix our grammar and even generate human-passing text.
While the new wave of so-called "deep learning" systems displays impressive performance in various tasks, these models are very hard to understand in various ways. To cite one issue among others, the GPT family of models employs 175 billion learnable parameters. When something goes wrong, it is almost impossible to understand "why" a model has made a particular decision.
The technical optimism and excitement around Machine Learning has also pushed businesses to apply it in situations where it may impact people’s well-being directly, such as loan applications, candidate selection for job offers and evaluating the chance of re-offending for people who commited crimes. Computer vision applications based on neural networks have even been employed to judge beauty contests.
In such contexts, opaque models are particularly problematic as there is a concrete risk for discrimination against certain groups of people. Protected characteristics such as gender and ethnicity might be used in the computation of the final decision, which is problematic on moral grounds and unlawful. The existence of the gender pay gap, for example, shows how there are complex correlations between law-protected attributes (gender) and other, non-sensitive attributes such as a person’s yearly salary.
If models are learning from biased data, it follows that they will learn to output biased decisions; if we are unable to explain those decisions, we are left with very little human control over what ultimately is a software process. On top of being philosophically troubling and unethical, recent legislation might see these methodologies as unlawful. Taking the General Data Protection Regulation in the European Union as an example, transparency and fairness have to be guaranteed to individuals who are subject to automatic decision-making software systems.
During this class, you will learn about the current discussion in the AI and ML literature about how to control AI and ML algorithms so that they are trustworthy. We will be focusing on three characteristics especially:
- Fairness: how can we learn non-discriminating models from biased data?
- Interpretability: how can we make sense of a model’s decisions?
- Privacy: how do we make sure that a model trained with our personal data does not leak our data to third parties?
Zusätzliche Informationen:
Mattia Cerrato: I work as a Post-Doc in the Data Mining group at Johannes Gutenberg-Universität Mainz, under the guidance of Prof. Stefan Kramer. I am a Principal Investigator for the TOP-ML project, which deals with understanding the trade-offs between properties of machine learning algorithms beyond performance. Before that, I was a PhD. student in the Machine Learning Group at University of Torino, my hometown. Prof. Roberto Esposito was my advisor for three years.
My research interests are centered around deep neural networks - I mostly research algorithms to constrain and understand them better. I have published papers about algorithmic fairness, interpretability and connections between them. I care deeply about making sure that AI applications can be beneficial to everyone - or at least not harm anybody.
|
