Identity and Integrity: The Ethical Relevance of Super-Scores

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

von: Christiane Woopen (CERES; University of Cologne)

Digital decision making relies on data and predefined criteria, but lacks when being implemented non-technical parameters like a social environment or basic human values. Christine Woopen, however, disagrees and explains in her talk why these values are fundamental to any (automated) social scoring system.

Inhalt

Mensch-Maschine-Schnittstelle: Wer trifft die Entscheidungen? Kann man noch von einer "Black Box" sprechen? Woopen stellt die These auf, dass Bürger*innen sich verunsichert fühlen, wenn die Entscheidungen in einer "Black Box" gefällt werden, es also keine konkreten menschlichen Ansprechpartner für Bedenken und Probleme und keine verantwortliche, adressierbare Stelle für das Scoring gibt. Ein rein binär anhand vorgegebener Kriterien entscheidender Prozess, der nicht informiert ist durch menschliche Werte und Sensibilitäten, wird als problematisch gesehen. Konsensuale kollektive Werte (Menschenwürde, Freiheit, Gleichbehandlung, Gerechtigkeit/Solidarität, Sicherheit/Stabilität, Daten-/Privatsphärenschutz, Nachhaltigkeit …) müssen grundlegend für alle Systeme sein.

Der Begriff der Black Box wurde jedoch in Frage gestellt: Das Treffen von Entscheidungen setzt Werte voraus, die dem System von Menschen vorgegeben werden, was die Entscheidungen prädeterminiert – und die Auswirkungen der Entscheidungen (zum Beispiel über Mittelvergaben im Sozialwesen) sind dieselben, ob nun ein Mensch oder ein Algorithmus sie trifft.

Unter welchen Bedingungen kann Scoring erlaubt werden? Gibt es eine goldene Regel, ein Prinzip, einen Standard? Ein rein binär anhand vorgegebener Kriterien entscheidender Prozess, der nicht informiert ist durch menschliche Werte und Sensibilitäten, wird als problematisch gesehen. Konsensuale kollektive Werte (Menschenwürde, Freiheit, Gleichbehandlung, Gerechtigkeit/Solidarität, Sicherheit/Stabilität, Daten-/Privatsphärenschutz, Nachhaltigkeit …) müssen grundlegend für alle Systeme sein. Entscheidungen sollten flexibel sein, ohne dabei die Regeln zu umgehen, Ausnahmen sollten möglich sein (Vergleich Klosterleben). Scoring sollte immer nur einen einzelnen Bereich des Lebens betreffen. Es muss einen konkreten, nachvollziehbaren Grund geben, aus dem Scoring in diesem bestimmten Bereich relevant ist. Zudem muss der Zweck ethisch vertretbar sein.

Weitere Informationen

  • Produktion: 11.10.2019

  • Spieldauer: 00:19:04

  • hrsg. von: Bundeszentrale für politische Bildung/bpb

Themen

Creative Commons License

Dieser Text und Medieninhalt sind unter der Creative Commons Lizenz "CC BY-NC-ND 4.0 - Namensnennung - Nicht kommerziell - Keine Bearbeitungen 4.0 International" veröffentlicht. Autor/-in: Christiane Woopen (CERES; University of Cologne) für bpb.de

Sie dürfen den Text unter Nennung der Lizenz CC BY-NC-ND 4.0 und des/der Autors/-in teilen.


Weitere Medien zum Thema

Beyond

Beyond "Digital Big Brother": Five things to understand about China's Social Scoring System

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

In her talk Ohlberg analyses the current state of China's social credit system by neither trivializing nor dramatizing it. In her opinion, the social credit system is "a highly effective tool helping to enforce the Chinese code of law" but... Weiter...

Blacklists and Social Credit Regimes in China

Blacklists and Social Credit Regimes in China

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

The Chinese social credit system CSC represents a new regulatory methodology. Catá Backer´s object in this essay is to encourage fresh thinking among Westerners. In his opinion, China is not only a harbinger of transformations in technology, but... Weiter...

Scoring is not a new phenomena: we can learn from experience how to deal with scoring

Scoring is not a new phenomena: we can learn from experience how to deal with scoring

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Scores are numerical ratings used to predict or steer people’s behavior. These numerical ratings are usually calculated via algorithmic processes based on a broad range of data (see, e. g., AlgorithmWatch 2019). Wagner gives a brief historical... Weiter...

Personal Scoring in the EU: Not quite Black Mirror yet, at least if you‘re rich

Personal Scoring in the EU: Not quite Black Mirror yet, at least if you‘re rich

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

The TV show "Black Mirror" has widely been used to illustrate what a centralized, permanent and public personal scoring system would look like. How likely is the application of such a system in the countries of the European Union? Weiter...

Data Scores as Governance: Mapping and Analysing Changing Practices in the UK

Data Scores as Governance: Mapping and Analysing Changing Practices in the UK

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Governments at all levels use more and more predictive technologies. The Data Justice Lab at Cardiff University investigates where and how local authorities across the UK use data systems. The results of this project are presented by Joanna Redden. Weiter...

Shared responsibilities? The future of scoring in the context of shifting baselines and public science

Shared responsibilities? The future of scoring in the context of shifting baselines and public science

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Digitalization intensifies the correlation between organization and control. A seemingly harmless example of this is self-tracking. People measure themselves in an increasing number of life spheres, supposedly voluntarily, while carrying... Weiter...

On the function and legitimation of scoring

On the function and legitimation of scoring

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Scoring relies on data or methods of classification. With this in mind, does scoring lead to automation of discrimination? Are its creators still capable of keeping track with their decision making processes? Lorena Jaume-Palasí presents her... Weiter...

Ethical Aspects of Algorithms and Scoring in Pedagogical and Social Work Contexts

Ethical Aspects of Algorithms and Scoring in Pedagogical and Social Work Contexts

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Algorithms and scoring play an increasing role in social work as well as in pedagogical contexts. In her talk Nadia Kutscher discusses what it means that social work is being part of practices producing sensitive and score-related data about clients.... Weiter...

Being scored but informed – how to boost people´s risk literacy for public discourse

Being scored but informed – how to boost people´s risk literacy for public discourse

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

I do not need to know how a bus works, for taking the bus!? – Wrong! Algorithm sovereignty actually is about being the object of others’ analyses, or better, about putting control on that. Felix G. Rebitscheck focuses in his talk on the... Weiter...

Scoring practices - consequences for education in democratic societies

Scoring practices - consequences for education in democratic societies

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Data storage and processing have become a politically relevant topic. Media literacy and media education play an important role. Technological education is thus political education. Political education thus requires basic technical knowledge or at... Weiter...

Nach oben © Bundeszentrale für politische Bildung Zur klassischen Website von bpb.de wechseln