Will machine intelligence threaten life, liberty and the pursuit of happiness?

This post has nothing to do with the influence of political party machines on current election campaigns.

As some readers will already know, Nick Bostrom’s book, Superintelligence, discusses the challenge presented by the potential for machine brains to surpass human brains in general intelligence. Bostrom does not claim that is imminent, but he suggests it is somewhat likely to happen sometime this century. After AI has surpassed human intelligence, the author fears that an initial superintelligence might soon afterwards obtain a decisive strategic advantage and pose a threat to human life. There have been several good reviews of Superintelligence, including one by Ronald Bailey in Reason.

How could a machine programmed by humans come to threaten human life? Some examples mentioned by Bostrom imply that it would be quite easy for that to occur by accident. For example, a machine that was given the simple objective of maximizing the production of paperclips could seek to acquire an unlimited amount of physical resources and to eliminate potential threats, including humans who are likely to try to prevent it from achieving its goal.

People like Bill Gates and Elon Musk, who could not be viewed as technophobes, argue that the threats posed by superintelligence should be taken seriously. That didn’t stop me asking myself why anyone in their right mind would program a machine to maximize the number of paperclips. Any sensible businessman would ensure that the machine was programmed with a profit-making objective, rather than a production objective. I have to acknowledge, however, that would still leave the problem of ensuring that the superintelligence doesn’t use unethical means to eliminate competitors. 

There is also the problem that some of the people developing AI might be crazy, or antipathetic towards humans. For example, it does not seem beyond the bounds of possibility that a group of extreme Greenies might seek to develop a superintelligence that would pursue the selfless goal of restoring the natural environment to its condition prior to the Anthropocene.

Most of Superintelligence is devoted to a discussion of the difficulty of designing superintelligence so that it would not be a threat to humans. While reading the book I felt that at times I was reading about the problems of designing a god – an enormously powerful entity that would govern our lives. For example, if the AI is given the seemingly innocuous goal of making us all happy it might arrange for us to have electrodes implanted in the pleasure centres of our brains, or perhaps even upload our minds to computers and then administer the digital equivalent of a drug to make us ecstatically happy all the time.

At other times I felt the problems being discussed were more like those which might be involved in establishing the characteristics of a good society. Bostrom seems to favour AI being given a goal such as maximizing our coherent extrapolated volition (CEV). As I understand it the CEV concept implies that if we knew more and thought faster our individual views about the nature of a good society would converge, so that a consensus could be discovered. The author explains that the CEV approach does not require that all ways of life, moral codes, or personal values be blended together into a stew. The CEV dynamic “is only supposed to act when our wishes cohere”.

The CEV concept has some appeal to me because it seems consistent with my own efforts to describe the characteristics of a good society in the most popular post on this blog. However, it does not require superintelligence to identify those characteristics. It would not be difficult to establish through existing survey methods that the vast majority of humans want to live in peace, to have opportunities to live for a happy lives and to have some degree of security to protect against misfortunes. The problem is in ensuring that a superintelligence would interpret such objectives in a manner consistent with individual human flourishing.

The main reservation I have about Superintelligence is that it does not contain much discussion about defence against malevolent AI. As I see it, it is probably worthwhile to undertake collaborative efforts to avoid the accidental development of machine intelligence in ways that might not be benign. But such efforts are not likely to prevent the AI being used unethically by people with nefarious objectives. Our defences against cyber-attack will need to be strengthened to protect against malevolent AI.

We need a Superintelligence dedicated to defending our individual rights. But we should be careful what we wish for! Once upon a time, a few centuries ago, some enlightened people set about establishing forms of government dedicated to protecting life, liberty and the pursuit of happiness. We ended up with warfare/welfare states.

What is the "bourgeois deal" and why should you care?

The ‘bourgeois deal’ is a term used frequently by Deirdre McCloskey in Bourgeois Equality, the third book of her trilogy which aims to show that it is ethical and rhetorical change that has enabled most humans today to be much better off than their forebears. The bourgeois deal refers to societal acceptance of innovations that compete with and displace old ways of doing things in exchange for widespread improvements in living standards.

Big deal? This has been a huge deal. Deirdre argues persuasively that trade-tested betterment associated with the bourgeois deal was responsible for the massive improvement in living standards enjoyed by vast numbers of people that began over 200 years ago and has now spread to most parts of the world (as shown in the accompanying chart prepared by Max Rosser using Angus Maddison’s data).

There are two aspects to the rhetorical-ethical revaluation discussed in Bourgeois Equality:

• A change in prevailing attitudes gave greater respect to people engaged in commercial activities.
• The development of rhetorically open societies – involving freedom of conscience and greater freedom of speech – propelled the French and Scottish Enlightenments, science, experimentation and invention, journalism, the spread of technical knowledge, and the economic and political dignity of ordinary people.

In emphasizing the importance of trade-tested betterment to economic growth, Deirdre McCloskey’s views are consistent with the mainstream view of economists, who, for the last half century at least, have acknowledged the important role of technological progress (and technological catch-up) in the economic growth process. Anyone who persists in espousing alternative explanations such as imperialism, or capital accumulation by itself, might benefit from reading Deirdre’s demolition of such theories.

The author seeks to differentiate her views from those of neo-institutionalists, such as Douglass North, who have sought to explain economic growth as stemming from institutional change i.e. changes in economic incentives associated with changes in the rules of the game in society (social norms as well as constitutions, laws and regulations). She succeeds in dismissing some factors, including property rights, previously emphasized by the neo-institutionalists. Property rights were reasonably secure in England for centuries prior to the industrial revolution. 

Nevertheless, institutional change was necessary to enable intellectual innovation to be protected from the violent responses that had previously been meted out to heretics and innovators who were perceived to constitute a threat to long-established patterns of production, distribution and exchange.

Some components of relevant rhetorical and ethical changes do not fit under the heading institutional change. For example, changes in perceptions of personal identity that enabled some individuals to take on entrepreneurial roles seem to have been closely related to rhetorical change, but probably had little to do with changes in rules or incentives. Similarly, changes in the rules can have an independent economic impact that does not fit easily under the heading of rhetorical and ethical change. For example, political leaders sometimes get ahead of public opinion e.g. in promoting free trade or privatisation of government owned enterprises.

Perhaps we should be lumping rhetorical, ethical and institutional change together. The author cites an example which seems to involve all three elements. The reduced willingness of courts in England to support the restrictiveness of the craft guilds, from the early 17^th century onwards, has been described by Eric Jones as attributable to “the national shift in elite opinion, which the courts partly shared”. In many instances, however, relevant rhetoric has been directed specifically toward changing the rules of the game. Adam Smith’s influential discussion of the appropriate role of government in Wealth of Nations comes to mind.

Hopefully, some of you - those who are still reading - will be wondering why the bourgeois deal is relevant to you. (I wonder whether any of those who stopped reading before this point will read the 650 pages of text in Bourgeois Equality. It seems to be a big ask to get anyone to read even 600 words these days.)

We should all care about the bourgeois deal because we are confronted with choices among a menu of different deals. Deirdre points out that, after 1848, the Bourgeois deal was challenged by the utopian Bolshevik deal and the Bismarckian (or Beveridge) deal.

The Bolshevik deal promised that all the problems associated with nasty concentrations of power in property owned by the bourgeoisie would be resolved by government ownership of the means of production and that the nature of man would change with the arrival of socialism. That deal was taken off the menu in 1989 (everywhere except North Korea) after it became too obvious that it was an extraordinarily bad deal for everyone except Communist party officials.

The Bismarckian deal stemmed from Bismarck’s scheme to steal the thunder from his socialist enemies by introducing a welfare state. Deirdre describes it thus:

“The deal is that the welfare state will substitute for your own and your family’s voluntary provision for old age or unemployment or medical care, and you will come to view the present state as your noble and benevolent lord” (p 604).

The Bismarckian deal lives on, coexisting uneasily with the Bourgeois deal because the high taxes required to support it act as a disincentive to trade-tested betterment. That is my judgement; I imagine Deirdre would agree, but I can’t see where at the moment. Like all good libertarians (the bleeding heart variety) she supports the provision of a welfare safety net directed specifically toward assisting those in need.

In my view we are now confronted with a third deal, which could be described as the doomsday deal, or if you want to personalise it, the Paul Ehrlich deal (after the biologist Paul Ehrlich who, like many other sect leaders who prophesy imminent doom, seems to have managed to maintain the loyalty of many of his followers even though the doom he predicted did not happen). Deidre describes such prophesies as the “eighth pessimism of our times”, rather than a deal. I see the doomsday deal as offering us the hope of being saved from an imaginary environmental doom if only we are prepared to forgo further economic betterment. Those who accept the doomsday deal deny that the bourgeois deal can be compatible with sensible measures to avert environmental disasters.

We should care about the bourgeois deal because it is constantly under threat. As Deidre McCloskey puts it in the table of contents for her book:

“Rhetoric made us, but can readily unmake us”.


Postscript:

Deirdre McCloskey has provided the following comment:

What an intelligent and penetrating discussion!  You clarify for me what I dislike most about neo-institutionalism, namely, that is always, every time, about incentives.  Humans respond to incentives.  I admit it (I am after all an economist).  But other matters than cost and benefit move people, too.  The Anzac men going over the top at Gallipoli cannot be summarized as responding to incentives alone.

I like your supplement to the Bismarckian Deal--Beveridgean!