Designing Machine Realities

Designing Machine Realities

1

Theme

Designing Machine Realities

Quantum computing reaches deep into the physical substrate of computation, exploiting properties of fundamental matter that classical machines cannot access. Unconventional computing pushes the substrate question in a different direction, extending computation into biological, chemical and physical media beyond silicon. Robotics and embodied intelligence give these computational capacities a body, situating the computation within the material constraints of action and perception and giving it the opportunity to interact with the physical world. Digital security supplies the trust infrastructure through which the resulting assemblies of human and artificial agents can safely and reliably communicate, exchange and verify at scale. Extended reality, finally, engineers the perceptual interfaces through which these environments become inhabitable by human (and perhaps other) minds.

Together, the topics gathered here make a single underlying gesture: the deliberate engineering of new agents alongside the substrates and interfaces through which we interact with them. What is being designed is therefore not merely a set of tools but a redistribution of agency. From this perspective, designing machine realities critically involves engineering the material and formal grounds for what counts as real when the common category of the agent itself is no longer restricted to human or natural beings.

Who are we, as humans?

When we focus on the human individual, this redistribution challenges the central tenet of modern political and moral thinking. The sovereign individual, taken for three centuries as the basic unit of moral, legal and political reasoning, was a profoundly consequential abstraction. It animated many of humanity’s greatest achievements in statecraft and democracy, as well as many of its worst horrors in genocidal killing, labour abuse and colonial extraction. Its original question was: who counts as one of us, and on what grounds is the designation granted or denied? Designing machine realities does not solve this question; it transforms it. A newer set of questions arises that are different in kind: what is a machine when it can imperceptibly imitate a human? And what is a human who comes to mimic the machines? These are not questions about simply extending the category of the agent to new candidates. They register that “human” and “machine” are not stable entities but relational ones, constantly evolving with environment, society and culture, and that the boundary between them is something the designs at issue here actively reshape.

At this conceptual level, this transformation percolates through the vocabulary by which we have understood ourselves. Person, rationality, freedom, consciousness, responsibility: all of these notions were calibrated to a category of agent whose features we took to be distinctive. Specifically, rational intelligence in the Western tradition has long been viewed as distinctively human and was implicitly paired with consciousness and understanding. But non-conscious machines lacking any understanding can now outperform human rational intelligence at sophisticated problem-solving tasks, prompting humans to acquire new heuristics by learning from the machines. This calls for a fundamental rethink of our very concept of rationality and what makes it so supposedly distinctive. The large-scale offloading or delegation of non-basic human cognitive abilities to technologies will only increase this need (see “Augmenting Human Potential”). And the concepts under pressure are not neutral: they come with a normative bearing that crystallises into ideals endowed with a standardising power, like the overarching concept of a human itself, whose granting or denial has long influenced our social structures (see “Exploring Social Worlds”).

How can we live together, as societies?

At the social level, therefore, designing machine realities is never the design of objects alone. It is instead the design of the conditions under which humans and machines learn to know, interact and cohabit with each other. At the start of the cybernetic revolution, the question raised was what it means to learn. The answer was that learning is not merely the acquisition of rules but a social and institutional practice shaped by histories, ideologies, aesthetics and institutions. The myth of technocratic solutions to all global challenges, social and political included, obscures precisely this. Quite tellingly, there is no discussion of artificial general intelligence that includes the question of where and how one learns, or that understands learning beyond the ability to adapt to change in an existing condition. Likewise, there was originally no concept of smartness that included the ability to envision alternative political futures and technological imaginaries. The discourse of smartness has now merged technical and biological determinism, reducing the language of education to that of adaptation and evolution. By contrast, in the cybernetic spirit, living together with these technologies means thinking of technology not as a solution to politics but as itself political. The technologised cities of the future would then not be those that automate the social, but those that seek to responsibly experiment with the political and consciously reflect upon it.

What is our relationship with the planet?

Because we are now designing machine realities, the relationship between humans and the technologies we design is no longer one between a subject and the objects it manipulates. The centred human subject is giving way to multi-agent assemblies whose constitutive units are heterogeneous – human, artificial, environmental – without one occupying the privileged position at the centre. In this movement beyond centric thinking, all agents become mediators within complex networks of interdependent relationships, both synchronically and diachronically. The technical powers designed here to model, understand and evaluate planetary systems at new scales and temporalities can be used in new ways: not to continue the past, but to invent futures. Planetary sustainability is itself a project of redesigning the relationship between humans and the planetary systems they now act upon (see “Charting Planetary Frontiers”). And so designing machine realities therefore involves determining how humans and the worlds they design come to form sustainable systems, and on what terms these emerging configurations can evolve.

Topic

Mathematics

Unlike any other discipline, mathematics is deeply rooted in almost every human culture. This has been the case for as long as written records have existed. The practices of counting, measuring, arranging, quantifying and comparing objects in the physical world around us is so useful that we begin to teach them to our children at a very young age.

Topic

Digital Security

Much has been written about the potential of technologies like social media and data analytics to spread disinformation and polarise societies, thus weakening democracy, but there is now a countervailing movement: an effort to create, nourish and grow democracy-affirming technologies. Further advances come from innovations in fact-checking websites and tools that have been designed to help people better assess the validity of information online; digital identity technologies, which are emerging as a critical tool for helping democracy transition into the digital age, and technological means to evade attempts at censorship.

Topic

Artificial Intelligence

Artificial Intelligence (AI) aims to produce intelligence using algorithms and machines. This includes systems that perceive and analyse their environment, take decisions, communicate and learn. In the past decade, AI has reached major milestones and is poised to disrupt societal norms.1

Topic

Quantum Computing

When information is stored in the physical states of objects whose behaviour is governed by the laws of quantum physics, new and powerful forms of information processing become possible. Suitably realised and managed, this creates novel computational capabilities that have the potential to significantly impact sectors as diverse as finance, materials science, cryptography and drug discovery.

Topic

Unconventional Computing

Research is now looking to widen the scope of information processing to explore the potential of a range of approaches. Unconventional computing might harness biological innovations honed through millions of years of evolution, for instance. If researchers can achieve even a fraction of the energy efficiency and processing power of the human brain, we will have unleashed an extraordinary new era of computing. Other novel possibilities arise from the biological processing power of organoids and cellular material, which may be a route to more efficient environmental sensing, remediation of pollution and medical diagnosis. The properties of photons — the particle form of light – are also redefining information processing’s possibilities, offering radical new computing applications.

Topic

Robotics and Embodied Intelligence

The speedup of digital communications, combined with developments in hardware and software, means that we can now receive real-time data and sensory experiences that enhance our normal interaction with our environment. Such overlays of augmented reality are already being used to train people in virtual work environments and to improve certain leisure activities, such as online gaming. Companies such as Apple and Meta are committing resources to improving the offering: as the technology progresses, the hardware — such as glasses that provide a view of information about our surroundings and the objects within them — will become ever more ubiquitous. Augmented reality is likely to change the nature of our daily interactions with other people and with our surroundings, and even the way we switch between the real world and virtual environments such as the metaverse.

Topic

Extended Reality

“Extended reality”, or XR, promises to create immersive digital experiences that seamlessly blend real and virtual elements, digitally altering the everyday human experience of reality.