AI should serve human interests without conflict from "summary" of Human Compatible by Stuart Russell
The fundamental idea is that AI systems should reliably and effectively pursue our objectives without causing harm. This principle is straightforward and uncontroversial, but it has profound implications. It means that AI should be aligned with human values - that is, it should do what we want it to do. If we specify our objectives as "maximize the number of smiles," then the AI should work to maximize the number of smiles. If we specify our objectives as "cure cancer," then the AI should work to cure cancer. If we specify our objectives as "make as much money as possible," then the AI should work to make as much money as possible. The challenge is to design AI systems that are provably aligned with human interests under all circumstances and to ensure that they remain so as they become more intelligent. The AI's objectives must be well-specified. They must capture our true desires and values, as opposed to some distorted version of them. They must take into account the full range of consequences of the AI's actions, not just the immediate effects. And they must be robust, in the sense that they are not easily subverted or undermined by unforeseen events or adversaries. In practice, achieving alignment means solving a difficult technical problem, which is how to design an AI system that can reliably learn our ob...
Similar Posts
AI has the potential to enhance equality and social justice
AI holds the promise of helping to level the playing field when it comes to equality and social justice. One way in which AI ca...
AI could lead to job displacement and economic shifts
As our world becomes increasingly automated and dominated by artificial intelligence, the potential for job displacement and ec...
AI ethics demand global cooperation
The rapid advancement of artificial intelligence (AI) technology has raised numerous ethical concerns that transcend national b...
Network effects impact
The concept of network effects impact is crucial to understanding the dynamics of artificial intelligence development. When a t...
Climate change solutions through advanced technology
One of the most pressing challenges facing humanity today is the issue of climate change. The Earth's climate is rapidly changi...
Prediction governance difficulties
Governance difficulties arise when it comes to predicting the behavior and capabilities of a superintelligent AI. This is becau...