Irving Wladawsky-Berger

Large Language Models: A Cognitive and Neuroscience Perspective

Over the past few decades, powerful AI systems have matched or surpassed human levels of performance in a number of tasks such as image and speech recognition, skin cancer classification, breast cancer detection, and highly complex games like Go. These AI breakthroughs have been based on increasingly powerful and inexpensive computing technologies, innovative deep learning (DL) algorithms, and huge amounts of data on almost any subject. More recently, the advent of large language models (LLMs) are taking AI to the next level. And, for many technologists like me, LLMs and their associated chatbots have introduced us to the fascinating world of human language and cognition.

I recently learned the difference between form, communicative intent, meaning, and understanding from “Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data,” a 2020 paper by linguistic professors Emiliy Bender and Alexander Koller. These linguistic concepts helped me understand the authors’ argument that “in contrast to some current hype, meaning cannot be learned from form alone. This means that even large language models such as BERT do not learn meaning; they learn some reflection of meaning into the linguistic form which is very useful in applications.”

A few weeks ago, I came across another interesting paper, “Dissociating Language and Thought in Large Language Models: a Cognitive Perspective,” published in January, 2023 by principal authors linguist Kyle Mahowald and cognitive neuroscientist Anna Ivanova and four additional co-authors. The paper nicely explains how the study of human language, cognition and neuroscience sheds light on the potential capabilities of LLMs and chatbots. Let me briefly discuss what I learned.

“Today’s large language models (LLMs) routinely generate coherent, grammatical and seemingly meaningful paragraphs of text,” said the paper’s abstract. “This achievement has led to speculation that these networks are — or will soon become — thinking machines, capable of performing tasks that require abstract knowledge and reasoning. “Here, we review the capabilities of LLMs by considering their performance on two different aspects of language use: formal linguistic competence, which includes knowledge of rules and patterns of a given language, and functional linguistic competence, a host of cognitive abilities required for language understanding and use in the real world.

Driving Value with the Metaverse in the Enterprise

A killer app is an IT application whose value to individuals and companies is relatively simple to explain, its use is fairly intuitive, and the application turns out to be so useful that it can singlehandedly propel the success of a new product or service. Word processing and spreadsheets, for example, were major factors in the widespread adoption of personal computers in the 1980s.

I got interested in 3D immersive environments in the mid-2000s when IBM launched an exploratory initiative on the topic. As part of these efforts, we conducted a number of experiments on Second Life, a platform that allowed its users to develop a variety of virtual world applications. We built a number of workplace applications, including virtual meetings, and online events, and even built a virtual replica of Beijing’s Forbidden City in partnership with the Palace Museum that was opened to the public. But, despite our high expectations, we couldn’t find any compelling enterprise killer apps, and after about three years, the project was dissolved. In the ensuing years, 3D immersive technologies and applications continued to advance, but mostly focused on video-games and related industries.

The past few years have seen a surge of interest in the metaverse and extended reality. “After desktop computing, the consumer internet and the smartphone boom, the consumer-computing industry is past due its Next Big Thing,” wrote The Economist in  “A reality check for the metaverse is coming,” an article in its 2022 year-end issue. “[A]n internet which is still largely flat — based on two-dimensional text, images and video — is ripe for replacement with one that is three-dimensional and immersive.”

Are GPT-3 and ChatGPT Truly Intelligent?

Large language models (LLMs) — e.g., BERT, GPT-3, — and chatbots like ChatGPT, are quite impressive. In the coming years, they will likely lead to a number of transformative tools and applications. They may well herald a coming AI revolution. But, how much closer are they getting us to the kind of general intelligence that, for the foreseeable future, only humans have? How can we best sort out their true significance and value from the accompanying hype? Let me discuss how two different articles addressed these questions.

“The success of the large neural language models on many NLP [Natural Language Processing] tasks is exciting” wrote linguistic professors Emiliy Bender and Alexander Koller in their 2020 paper “Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data.” “This has led to claims, in both academic and popular publications, that such models understand or comprehend natural language or learn its meaning. From our perspective, these are overclaims caused by a misunderstanding of the relationship between linguistic form and meaning.”

In their paper, Bender and Koller explain why LLMs like GPT-3 are likely to become innovative language tools, — kind of like highly advanced spell checkers or word processors, — while dismissing claims that they have the ability to reason and understand the meaning of the language they’re generating. Their explanations are couched in linguistic concepts which they carefully define: form, communicative intent, meaning, and understanding.

Can an AI System Exhibit Commonsense Intelligence?

“One of the fundamental limitations of AI can be characterized as its lack of commonsense intelligence: the ability to reason intuitively about everyday situations and events, which requires rich background knowledge about how the physical and social world works,” wrote University of Washington professor Yejin Choi in “The Curious Case of Commonsense Intelligence,” an essay published in the Spring 2022 issue of Dædalus. “Trivial for humans, acquiring commonsense intelligence has been considered a nearly impossible goal in AI, added Choi.”

What is commonsense intelligence? In a 2020 presentation, Choi defined common sense as “the basic level of practical knowledge and reasoning concerning everyday situations and events that are commonly shared among most people.” Common sense is essential for humans “to live and interact with each other in a reasonable and safe way,” and for an AI system, common sense is essential “to understand humans needs and actions better.” She further explained the difference between intuitive commonsense reasoning and analytical rational reasoning by discussing the pioneering research of Daniel Kahneman, — Princeton Professor Emeritus and recipient of the 2002 Nobel Prize in Economics, — and his long time collaborator Amos Tversky, who died in 1996.

In his excellent 2011 bestseller Thinking, Fast and Slow, Kahneman explained that our mind is composed of two very different systems of thinking, System 1 and System 2.  System 1 is the intuitive, unconscious, fast, and effortless part of the mind. Thoughts come automatically and very quickly to System 1 without us doing anything to make them happen.

Is AI (Finally) Coming of Age?

Artificial intelligence first came to light in the mid-1950s as a promising new academic discipline. AI became one of the most exciting areas in computer sciences over the next two decades. But, after years of unfulfilled promises and hype, a couple of so called AI winters of reduced interest and funding set in that nearly killed the field. AI was successfully reborn in the 1990s with a new statistical paradigm based on analyzing large amounts of data with powerful computers and sophisticated algorithms. Now, six decades after the field was founded, AI seems to be finally coming of age.

“2021 saw the globalization and industrialization of AI intensify, while the ethical and regulatory issues of these technologies multiplied,” said the 2022 AI Index report on the progress of AI, which was released in March of 2022 by Stanford’s Institute for Human-Centered Artificial Intelligence (HAI). “2021 was the year that AI went from an emerging technology to a mature technology - we’re no longer dealing with a speculative part of scientific research, but instead something that has real-world impact, both positive and negative,” wrote Jack Clark, co-chair of the AI Index. Multiple factors led to his conclusion, in particular the advent of foundation models like OpenAI’s GPT-3 and Google’s BERT.

In the past decade, increasingly powerful AI systems have matched or surpassed human levels of performance in a number of specific tasks like image and speech recognition. These task-specific deep learning (DL) systems have generally relied on supervised learning, a training method where the data must be carefully labelled, - e.g., cat, not-cat, - thus requiring a big investment in time and money to produce a model that’s narrowly focused on one task and can’t be easily repurposed.

Foundation models have gotten around these DL limitations based on two recent advances, transfer learning and huge scale. Transfer learning takes the knowledge learned from training a specific task and applies it to different but related tasks, - such as using the training in recognizing cars in images and applying it to recognizing trucks and buses. As a result, foundation models can be adapted to many different tasks with relatively small amounts of fine-tuning.

The Current State of Service Science

On October 17, the National Academy of Engineering (NAE) conducted an online forum on Service Systems Engineering in the Era of Human-Centered AI. “With AI advances poised to drive service system productivity and quality - similar to the way previous generations of technology revolutionized agriculture and manufacturing productivity and quality - it is time to take stock for industry-academic-and-government stakeholders on this important topic,” wrote the NAE in its website.

The agenda included an opening keynote by retired IBM executive Nick Donofrio. It was followed by four panels on various aspects of service systems, and concluded with an open discussion of the way forward. I was a member of the panel on Evolving Engineering Education. In my prepared remarks, I reflected on the current state of service science and related sociotechnical systems. Let me share my remarks, slightly edited for clarity.

Service Science, Management and Engineering (SSME) is an initiative launched in IBM’s Almaden Research Lab in the early 2000s in partnership with a number of universities as an interdisciplinary field of study aimed at applying science, technology and innovation to the service sector of the economy.  The service sector is the largest in most economies around the world. At the time, services already accounted for over 70% of GDP and jobs in advanced economies, as well as an increasing portion of the revenues of many companies, including close to 60% of IBM’s revenues.

The Disruptive Economics of AI

In 2017, I attended a seminar by University of Toronto professor Avi Goldfarb on the economic value of AI. Goldfarb explained that the best way to assess the impact of a potentially transformative technology is to look at how the technology reduces the cost of a widely used function. Computers, for example, have dramatically reduced the cost of digital operations like arithmetic by several orders of magnitude. As a result, we’ve learned to define all kinds of tasks in terms of digital operations, e.g., financial transactions, inventory management, word processing, photography. Similarly, the internet has reduced the cost of communications and the Web has reduced the cost of access to information, which has led to a huge increase in applications based on communications and information, like music and video streaming, and digital media.

Viewed through this lens, AI is essentially a prediction technology, and its economic impact is to reduce the cost and expand the number and variety of applications that rely on predictions. A key finding of Stanford’s 2022 AI Index report was that AI is becoming much more affordable and higher performing, leading to the widespread commercial adoption of AI-based applications. “Since 2018, the cost to train an image classification system has decreased by 63.6%, while training times have improved by 94.4%.,” said the report.

Goldfarb and his U of T colleagues Ajay Agrawal, and Joshua Gans published their research in the 2018 book Prediction Machines: The Simple Economics of Artificial Intelligence. And this week, they just published Power and Prediction: The Disruptive Economics of Artificial Intelligence.

“When we published Prediction Machines in 2018, we thought we had said all we needed to on the economics of AI,” wrote the authors in the Preface of their new book. “We were wrong. We laid out a framework for the economics of AI in that book, which remains useful today. However, the Prediction Machines framework only told part of the story, the point solutions part. In the years since, we discovered that another key part of the AI story had yet to be told, the systems part. We tell that story here.”

The AI Maturity Framework

I recently attended a seminar, The Art of AI Maturity, by Accenture executives Philippe Roussiere and Praveen Tanguturi as part of MIT’s Initiative on the Digital Economy (IDE) lunch seminar series. The seminar was based on their recently published article The Art of AI Maturity: Advancing from Practice to Performance.

“Today, so much of what we take for granted in our daily lives stems from machine learning,” wrote the authors in the article’s executive summary. “Every time you use a wayfinding app to get from point A to point B, use dictation to convert speech to text, or unlock your phone using face ID ... you're relying on AI. And companies across industries are also relying on - and investing in - AI to drive logistics, improve customer service, increase efficiency, empower employees and so much more.”

To determine the true state of AI maturity in the marketplace, Accenture conducted a survey in August and September of 2021 of over 1,600 C-suite executives at nearly 2,000 of the world’s largest companies across 16 industries with headquarters in 15 countries. In addition, they interviewed 25 CEOs, Chief Data Officers and Chief Analytics Officers, as well as a number of Accenture AI experts, and developed over 40 case studies on AI transformation.

The Recent Impact of AI on Jobs and Economies

“Recent developments in Artificial Intelligence (AI) have stoked new fears about large-scale job loss, stemming from its ability to automate a rapidly expanding set of tasks (including non-routine cognitive tasks), and its potential to affect every sector of the economy,” said The impact of Artificial Intelligence on the labour market: What do we know so far?, a recently published report by the Organization for Economic Co-operation and Development (OECD). Founded in 1961 to stimulate economic progress and world trade, the OECD now has 38 member countries around the world.

“Furthermore, there are concerns about employee well-being and the broader work environment, linked to the idea that AI may soon become pervasive in the workplace and threaten and undermine humans’ place in it,” noted the report. “However, AI also has the potential to complement and augment human capabilities, leading to higher productivity, greater demand for human labour and improved job quality.”

A number of recent studies have focused on the impact of AI on the future of work. For example, in the spring of 2018, MIT launched a task force on the Work of the Future to understand whether and how our current period of technological disruption differs from prior industrial epochs. The task force final report, The Work of the Future: Building Better Jobs in an Age of Intelligent Machines, released in November of 2020, concluded that:

 “No compelling historical or contemporary evidence suggests that technological advances are driving us toward a jobless future. On the contrary, we anticipate that in the next two decades, industrialized countries will have more job openings than workers to fill them, and that robotics and automation will play an increasingly crucial role in closing these gaps. Nevertheless, the impact of robotics and automation on workers will not be benign. These technologies, in concert with economic incentives, policy choices, and institutional forces, will alter the set of jobs available and the skills they demand.”

The 2022 State of AI in the Enterprise

“Rapidly transforming, but not fully transformed - this is our overarching conclusion on the market, based on the fourth edition of our State of AI in the Enterprise global survey,” said Becoming an AI-fueled organization, the fourth survey conducted by Deloitte since 2017 to assess the adoption of AI across enterprises. “Very few organizations can claim to be completely AI-fueled, but a significant and growing percentage are starting to display the behaviors that can get them there.”

AI is increasingly viewed by workers as a trusted assistant. “Within just the last 18 months, AI capabilities have advanced considerably, maturing from what was often experienced as a bothersome critic - telling workers what to do or pointing out their mistakes - to more frequently serving as a copilot, independently executing on insights and trends surfaced through the power and speed of cloud- based data hosting and computation.”

These conclusions are similar to those of Stanford’s 2022 AI Index report, which found that AI was becoming more affordable and higher performing, with lower training costs and faster training times across a number of AI tasks including recommendation engines, image classification, object detection, and language processing. This has led to the widespread commercial adoption and increased real-world impact of AI systems.

The Open Source AI and Data Ecosystem

“The availability of enterprise-grade open source software (OSS) is changing how organizations develop, maintain, and deliver products,” wrote Ibrahim Haddad in a recent report, Artificial Intelligence and Data in Open Source. Haddad is VP of Strategic Programs at the Linux Foundation (LF) and Executive Director of the LF AI & Data initiative. “Using and adopting OSS can offer many benefits, including reduced development costs, faster product development, higher code quality standards, and more. The open source methodology offers key and unique benefits to the domains of AI and data, specifically in areas of fairness, robustness, explainability, lineage, availability of data, and governance.”

Earlier this year, Stanford released the 2022 AI Index report, its fifth annual study on the impact and progress of AI. The Stanford report noted that “2021 was the year that AI went from an emerging technology to a mature technology - we’re no longer dealing with a speculative part of scientific research, but instead something that has real-world impact, both positive and negative.” 

A few weeks ago I wrote about the impressive scope of the Linux Foundation. The LF supports a large and growing number of open source projects in a wide variety of areas. AI is no different from other technology domains, so it’s not surprising that open source now plays a major role as AI is being increasingly integrated into the economy.

Disruptive Forces Necessitate Bold Decisions

In January of 2021 I attended Predictions 21, an online event organized by Forrester Research.  “Faced with the pandemic, firms did things that once seemed impossible - sometimes overnight,” said Forrester last year, adding that “2021 will be the year that every company - not just the 15% of firms that were already digitally savvy - doubles down on technology-fueled experiences, operations, products, and ecosystems.”

Earlier this year I attended Predictions 22, and was particularly curious to see how things had changed in the intervening year. “Disruptive Forces Necessitate Bold Decisions,” was the overriding message in this year’s event guide.  “The old ways of working no longer work. The future is up for grabs. Leading firms will use the crucibles of 2020 and 2021 to forge a path to an agile, creative, and resilient tomorrow.”

Let me summarize some of Forrester’s key predictions in three areas: technology, customer experience, and industry trends.

Foundation Models: AI’s Exciting New Frontier

Over the past decade, powerful AI systems have matched or surpassed human levels of performance in a number of specific tasks such as image and speech recognition, skin cancer classification and breast cancer detection, and highly complex games like Go. These AI breakthroughs have been based on deep learning (DL), a technique loosely based on the network structure of neurons in the human brain that now dominates the field. DL systems acquire knowledge by being trained with millions to billions of texts, images and other data instead of being explicitly programmed.

These task-specific, DL systems have generally relied on supervised learning, a training method where the data must be carefully labelled, - e.g., cat, not-cat, - thus requiring a big investment of time and money to produce a model that’s narrowly focused on a specific task and can’t be easily repurposed. The rising costs for training ever-larger, narrowly focused DL systems have prompted concerns that the technique was running out of steam.

Foundation models promise to get around these DL concerns by bringing to the world of AI the reusability and extensibility that have been so successful in IT software systems, from operating system like iOS and Android to the growing number and varieties of internet-based platforms.

Can We Trust Our Impressive AI Language Models?

One of the key findings of the 2022 AI Index Report was that large language models (LLMs) are setting records on technical benchmarks thanks to advances in deep neural networks and computational power that allows them to be trained using huge amounts of data. LLMs are now surpassing human baselines in a number of complex language tasks, including English language understanding, text summarization, natural language inference, and machine translation.

A.I. Is Mastering Language. Should We Trust What It Says?, a recent NY Times Magazine article by science writer Steven Johnson, took a close look at one such LLM, the Generative Pre-Trained Transformer 3, generally referred to as GPT-3. GPT-3 was created by the AI research company OpenAI. It’s been trained with over 700 gigabytes of data from across the web, along with a large collection of text from digitized books. “Since GPT-3’s release, the internet has been awash with examples of the software’s eerie facility with language - along with its blind spots and foibles and other more sinister tendencies,” said Johnson.

“So far, the experiments with large language models have been mostly that: experiments probing the model for signs of true intelligence, exploring its creative uses, exposing its biases. But the ultimate commercial potential is enormous. If the existing trajectory continues, software like GPT-3 could revolutionize how we search for information in the next few years.” Instead of typing a few keywords into Google and getting back a long list of links that might have the answer, you’d ask GPT-3 what you’re looking for in English and get back a well-written, accurate answer. “Customer service could be utterly transformed: Any company with a product that currently requires a human tech-support team might be able to train an L.L.M. to replace them.”

A Human-Compatible Safe, Controllable AI

“Even in its present state, the technology of artificial intelligence raises many concerns as it transitions from research into widespread use,” wrote UC Berkeley professor Stuart Russell in a recent essay, If We Succeed. “These concerns include potential misuses such as cybercrime, surveillance, disinformation, and political manipulation; the exacerbation of inequality and of many forms of bias in society; the creation and deployment of lethal autonomous weapons; and the usurpation of human roles in the economy and in social relationships.”

“My concern here, however, is with the potential consequences of success in creating general-purpose AI: that is, systems capable of quickly learning to perform at a high level in any task environment where humans (or collections of humans) can perform well.” Decades ago, Alan Turing expressed a similar concern. While answering a question during a lecture in 1951, Turing said: “It seems probable that once the machine thinking method had started, it would not take long to outstrip our feeble powers. … At some stage therefore we should have to expect the machines to take control.” Over the past decade, a number of public figures like Stephen Hawking and Nick Bostrom have argued that a superintelligent AI could become difficult or impossible for humans to control, and might even pose an existential threat to humanity.

Until recently, we didn’t have to worry about the consequences of such superhuman AIs because AI applications weren’t all that smart and were mostly confined to research labs. But, powerful AI systems have now matched or surpassed human levels of performance in a number of application- specific tasks such as image and speech recognition, skin cancer classification, breast cancer detection, and complex games like Jeopardy and Go. While these application-specific breakthroughs, - generally referred to as soft, or narrow AI, - were once viewed as the exclusive domain of humans, AI still lacks the deeper, general-purpose human intelligence that’s long been measured in IQ tests.

How Can You Trust the Predictions of a Large Machine Learning Model?

Artificial intelligence has emerged as the defining technology of our era, as transformative over time as the steam engine, electricity, computers, and the Internet. AI technologies are approaching or surpassing human levels of performance in vision, speech recognition, language translation, and other human domains. Machine learning (ML) advances, like deep learning, have played a central role in AI’s recent achievements, giving computers the ability to be trained by ingesting and analyzing large amounts of data instead of being explicitly programmed.

Deep learning is a powerful statistical technique for classifying patterns using large training data sets and multi-layer AI neural networks. Each artificial neural unit is connected to many other such units, and the links can be statistically strengthened or decreased based on the data used to train the system. But such statistical methods are not equally suitable for all tasks. Tasks that are particularly suitable for machine learning, exhibit several key criteria, such as the availability of large data sets of well-defined input-output pairs for training ML classifiers, - e.g., carefully labeled cat, not-cat pictures for cat recognition classifiers, and english-french document pairs for machine translation algorithms.

The methods behind a machine learning prediction, - subtle adjustments to the numerical weights that interconnect its huge number of artificial neurons, - are very difficult to explain because they’re so different from the methods used by humans. The bigger the training data set, the more accurate the prediction, but the more difficult it will be to provide a detailed, understandable explanation to a human of how the prediction was made.

A few weeks ago I attended an online seminar, - How Can You Trust Machine Learning? by Stanford professor Carlos Guestrin, - on the difficulty of understanding machine learning predictions. Guestrin’s seminar was based on a 2016 article he co-authored with Marco Tulio Ribeiro and Sameer Singh , “Why Should I Trust You?” Explaining the Predictions of Any Classifier.

The 2022 AI Index Report: AI’s Emerging Real-World Impact

On March 16, Stanford’s Institute for Human-Centered Artificial Intelligence (HAI) released the 2022 AI Index report, its fifth annual study on the impact and progress of AI. The comprehensive study was led by an interdisciplinary group of experts from across academia and industry, and highlights the rapid rate of technical and marketplace AI advances, as well as the growing ethical and regulatory concerns associated with AI.

“2021 was the year that AI went from an emerging technology to a mature technology - we’re no longer dealing with a speculative part of scientific research, but instead something that has real-world impact, both positive and negative,” said Jack Clark, co-chair of the AI Index. “This year’s AI Index tells us that AI is being integrated into the economy and the effects of it are beginning to go global across research, deployment, and even funding.” Two weeks ago I attended an online HAI seminar where Clark gave this excellent presentation on the AI Index.

The report is organized into five chapters: Technical Performance, AI Ethics, R&D, Economy and Education, and Policy and Governance. Let me summarize the key findings of each chapter.

The Tech Trends that Will Most Reshape Companies Over the Next Decade

“In the next decade, we’ll experience more progress than in the past 100 years combined, as technology reshapes health and materials sciences, energy, transportation, and a wide range of other industries and domains,” notes a recent McKinsey study on the The top trends in tech. “The implications for corporations are broad.”

“These trends may not represent the coolest, most bleeding-edge technologies. But they’re the ones drawing the most venture money, producing the most patent filings, and generating the biggest implications for how and where to compete and the capabilities you need to accelerate performance.”

“Unifying and underlying them all is the combinatorial effect of massively faster computation propelling new convergences between technologies; startling breakthroughs in health and materials sciences; an array of new product and service functionalities; and a strong foundation for the reinvention of companies, markets, industries, and sectors.”

How Does AI Improve Human Decision-Making?

“Artificial Intelligence (AI) is the newest general-purpose technology (GPT),” wrote Sukwoong Choia, Namil Kim, Junsik Kim, and Hyo Kang in a recent paper, How Does AI Improve  Human Decision-Making? Evidence from the AI-Powered Go Program. “One remarkable characteristic of AI is its ability to provide humans with high-quality predictions at relatively low cost and to automate a wide range of predictions. AI has already outperformed human professionals in many domains - including strategic gameplay, medical diagnosis, and new drug development.” 

“Furthermore, as a GPT, the domains where AI outperforms humans are expanding at a fast pace. The rapid development and adoption of AI thus raise an interesting yet pressing question about how AI affects human tasks in these various domains. Studies of AI and human capital, for instance, have examined the performance gap between humans and AI, highlighting AI’s potential for replacing jobs.” However, we should keep in mind that new technologies have been replacing workers and transforming economies for over two centuries. But, over time, these same technologies led to the creation of whole new industries and new jobs, increasing productivity and economic output, raising earnings, and augmenting the demand for labor.

Workers can increase their productivity and performance when assisted in their jobs by AI-based tools. But beyond its assistant role, AI can play a major instructional role by training human professionals to make better decisions. Recent technology advances have significantly improved the quality and reduced the cost of AI-based predictions.

The paper raises a number of important questions about the use of AI to improve human decisions making. Can we show quantitative evidence that AI-based predictions actually improve the quality of human decisions? If so, by what mechanisms are AI-based human decisions improved? And, do the improvements vary between depending on ones attitude toward AI-based decisions?

The Promise & Peril of Human-Like Artificial Intelligence

In his 1950 seminal paper, Computing Machinery and Intelligence, Alan Turing proposed what’s famously known as the Turing test, - a test of a machine’s ability to exhibit intelligent behavior indistinguishable from that of a human. If a human at a keyboard couldn’t tell whether they were interacting with a machine or a human, the machine is considered to have passed the Turing test. “Ever since, creating intelligence that matches human intelligence has implicitly or explicitly been the goal of thousands of researchers, engineers and entrepreneurs,” wrote Erik Brynjolfsson, - Stanford professor and Director of the Stanford Digital Economy Lab, - in a recent article, The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligence.

“The benefits of human-like artificial intelligence (HLAI) include soaring productivity, increased leisure, and perhaps most profoundly, a better understanding of our own minds. But not all types of AI are human-like - in fact, many of the most powerful systems are very different from humans - and an excessive focus on developing and deploying HLAI can lead us into a trap. … On the one hand, it is a path to unprecedented wealth, increased leisure, robust intelligence, and even a better understanding of ourselves. On the other hand, if HLAI leads machines to automate rather than augment human labor, it creates the risk of concentrating wealth and power. And with that concentration comes the peril of being trapped in an equilibrium where those without power have no way to improve their outcomes, a situation I call the Turing Trap.”

Over the past decade, powerful AI systems have matched or surpassed human levels of performance in a number of tasks such as image and speech recognition, applications like skin cancer classification and breast cancer detection, and complex games like Jeopardy and Go. These AI breakthroughs are generally referred to as soft, narrow or specialized AI, inspired by, but not aiming to mimic the human brain. They’ve been generally based on machine learning, that is, on the analysis of vast amounts of information using powerful computers and sophisticated algorithms, whose results exhibit qualities that we associate with human intelligence.

Realizing the Economic Promise of Predictive Analytics

Wikipedia defines predictive analytics as a set of statistical techniques, - such as data mining, business analytics, and machine learning, - “that analyze current and historical facts to make predictions about future or otherwise unknown events.” Increasingly powerful and inexpensive computing technologies, new algorithms and models, and huge amounts of data on almost any subject have led to major advances in predictive analytics over the past two decades.

“Worldwide revenue for ‘big data’ and business analytics solutions is forecasted to reach $274.3 billion by 2022,” wrote economists Erik Brynjolfsson, Wang Jin, and Kristina McElheran in The Power of Prediction, a research article published earlier this year. In principle, such widespread use of predictive analytics should have a positive impact of the performance of firms. “However, these investments have yet to yield productivity gains in the aggregate,” said the authors. “At the firm level, managers struggle to close the gap between the promise of predictive analytics and its performance. These concerns have been difficult to tackle empirically due to the rate of technological change and, ironically, a dearth of data.”

To address these concerns, the authors launched a research study in collaboration with the US Census Bureau to collect information on the use of predictive analytics in a representative sample of the US manufacturing industry, - an industry that’s historically been an early adopter of leading-edge technologies.

The Evolving Role of the CIO

“CIOs and other technology leaders have led heroic work to help their companies stay in business during the pandemic,” said a recent report, Pilots, co-pilots, and engineers: Digital transformation insights from CIOs for CIOS. “The question now is where will the focus of CIOs and their organizations be in the future?” To shed light on this question, the professional services firm Genpact surveyed 500 CIOs and technology leaders in partnership with the MIT Sloan CIO Symposium and Babson College professor Tom Davenport. Their findings were presented at the 2021 MIT Digital Symposium.

“We found a surprising level of commonality in terms of the technologies on which they are focused, the infrastructure they are attempting to build, and their view of expanding responsibilities,” was the report’s overriding finding. “High proportions of CIOs, for example, are focused on artificial intelligence (AI) and advanced analytics, moving to the cloud, and architecture modernization. There is, however, a lack of consensus on a critical issue: the role of the CIO in business transformation.”

I’ve had a window into the evolution of the CIO role over the past decade through my involvement with the MIT CIO Symposium. In the past, the primary responsibility of many CIOs was operating their companies’ IT infrastructures while keeping costs down. Given their role, they often reported to the COO or the CFO. But increasingly, CIOs have been given responsibility for their companies’ overall digital strategy working closely with senior executives across the business.

“The role continues to evolve,” notes the Genpact report. “Almost all CIOs expect their roles to expand. Almost all report to or interact with the CEO regularly. And many are exploiting the cloud, advanced analytics, and automation. The big future bet that unites all CIOs is artificial intelligence (AI). And to access new talent and skill sets, many are exploiting their external ecosystem partners. All of which bodes well for the CIO’s future transformational activities. In addition to flexing their technology muscles, many CIOs are still building their transformation muscles, which must include strength in change management and business knowledge.”

The Coming Era of Productivity Growth

“The last 15 years have been tough times for many Americans, but there are now encouraging signs of a turnaround,” wrote economists Erik Brynjolfsson and Georgios Petropoulos in The Coming Productivity Boom, a recent opinion article in the MIT Technology Review. “Productivity growth, a key driver for higher living standards, averaged only 1.3% since 2006, less than half the rate of the previous decade. But on June 3, the US Bureau of Labor Statistics reported that US labour productivity increased by 5.4% in the first quarter of 2021. What’s better, there’s reason to believe that this is not just a blip, but rather a harbinger of better times ahead: a productivity surge that will match or surpass the boom times of the 1990s.”

After growing at an average annual rate of around 2.8% between 1947 and 1973, US productivity has significantly slowed down, except for the Internet-driven productivity boost between 1996 and 2004. Despite the relentless advances of digital technologies over the past 15 years, - from smartphones and broadband wireless to cloud computing and machine learning, - productivity has only grown at an anemic 1.3%, between 2006 and 2019. Most OECD countries have seen similar slowdowns.

What accounts for this puzzling so-called productivity paradox and when might it finally end? Over the past several years, Brynjolfsson and his various collaborators have explored this question, first at MIT where he was faculty director of the Initiative on the Digital Economy, and since 2020 at Stanford, where he’s Director of the Stanford Digital Economy Lab. Brynjolfsson discussed alternative explanations for the paradox at a recent MIT conference.

The Three Types of AI: Artificial, Authentic, and Augmented Intelligence

“The history of work - particularly since the Industrial Revolution - is the history of people outsourcing their labor to machines,” notes a recent article in the Harvard Business Review, - AI Should Augment Human Intelligence, Not Replace It, - by National University of Singapore professor David De Cremer and chess grandmaster Garry Kasparov. “While that began with rote, repetitive physical tasks like weaving, machines have evolved to the point where they can now do what we might think of as complex cognitive work, such as math equations, recognizing language and speech, and writing. Machines thus seem ready to replicate the work of our minds, and not just our bodies.”

Throughout the Industrial Revolution there were periodic panics about the impact of automation on jobs, going back to the so-called Luddites, - textile workers who in the 1810s smashed the new machines that were threatening their jobs. Automation does indeed substitute for labor. However, automation also complements labor, raising economic outputs in ways that often lead to more long-run employment, not less.

Most jobs involve a number of tasks or processes. Some of these tasks are more routine in nature, while others require judgement, social skills and other human capabilities. The more routine, rules-based the task, the more amenable it is to automation. But just because some of the tasks have been automated, does not imply that the whole job has disappeared. To the contrary, automating the more routine parts of a job will often increase the productivity and quality of workers by complementing their skills with machines and computers, as well as enabling them to focus on those aspect of the job that most need their attention.

Business and Technology Predictions for 2021 and Beyond

Earlier this year, I attended Predictions 21, an online event organized by Forrester Research to help companies understand the key business and technology dynamics that will shape 2021 and beyond. “Faced with the pandemic, firms did things that once seemed impossible - sometimes overnight,” said the accompanying event guide. “Under the relentless pressure of new customer realities, the future came into focus: The value of your company depends on how customer-obsessed, resilient, creative, and adaptive you are in jumping to the next growth curve in your industry. … 2021 will be the year that every company - not just the 15% of firms that were already digitally savvy - doubles down on technology-fueled experiences, operations, products, and ecosystems.”

The past year has been truly chaotic. How can firms formulate their strategies for the next few years in such an uncertain environment? But, as former US president Dwight Eisenhower famously said when he was Commander of Allied Forces in WWII: “In preparing for battle I have always found that plans are useless but planning is indispensable.” In other words, you must carefully assess the various directions in a highly uncertain future while being ready to flexibly adjust to changing circumstances.

Much has been written about the post-pandemic new normal. There are multiple opinions on a number of areas, such as cities, globalization, supply chains, and labor markets. But, just about everyone predicts an increasingly digital post-pandemic new normal. “The COVID-19 crisis seemingly provides a sudden glimpse into a future world, one in which digital has become central to every interaction,” said McKinsey in an April, 2020 article. “The adoption of new technological behaviours in response to the pandemic, from video-conferencing to online shopping, means usage has already reached levels that were not expected for many more years,” noted The Economist several months later.

In addition to the online webinar, Predictions 21 includes a number of related articles and videos. Let me summarize a few of Forrester’s key predictions.

Will AI Ever Be Smarter Than a Baby?

I recently listened to a fascinating podcast where NY Times columnist Ezra Klein interviewed Berkeley psychologist Alison Gopney. Professor Gopney is best known for her research in cognitive science, particularly the study of children’s learning and development. She’s written extensively on the developmental phases of the human brain from babies to adults.

Gopnik, a member of the Berkeley AI Research group, has also been exploring the differences between human and machine intelligence, more specifically, what babies can teach us about AI. She’s long argued that babies and young children are smarter than we might think. In some ways, they’re even smarter than adults, let alone way smarter than the most advanced AIs.  

What do we mean by intelligence?

In 1994 the Wall Street Journal published the Mainstream Science on Intelligence, an article that included a definition that was agreed to by 52 leading academic researchers in fields associated with intelligence:

“Intelligence is a very general mental capability that, among other things, involves the ability to reason, plan, solve problems, think abstractly, comprehend complex ideas, learn quickly and learn from experience. It is not merely book learning, a narrow academic skill, or test-taking smarts. Rather, it reflects a broader and deeper capability for comprehending our surroundings - ‘catching on,’ ‘making sense’ of things, or ‘figuring out’ what to do.”

The Post-Pandemic Outlook for Technology, Jobs, and Skills

“The COVID-19 pandemic-induced lockdowns and related global recession of 2020 have created a highly uncertain outlook for the labour market,” said the World Economic Forum (WEF) in The Future of Jobs Report 2020. The pandemic has caused labor markets to change significantly faster than previously expected. What used to be considered the future of work has already arrived. As McKinsey noted in a May, 2020 article: “we have vaulted five years forward in consumer and business digital adoption in a matter of around eight weeks.”

The WEF report aims to shed light on the post-pandemic outlook for technology adoption, jobs and skills over the next five years, including detailed quantitative profiles on 15 industry sectors and 26 advanced and emerging countries. The report is based on a survey of senior executives from nearly 300 global companies which collectively employ 8 million workers. The survey asked 49 questions on the outlook for their companies’ workforce through 2025, including major trends affecting the labor market, the technologies their companies are adopting, the expected evolution of jobs and skills, their training and reskilling programs, and the near-term impact of the pandemic on their workforce.

“The global shift to a future of work is defined by an ever-expanding cohort of new technologies, by new sectors and markets, by global economic systems that are more interconnected than in any other point in history, and by information that travels fast and spreads wide. … As a new global recession brought on by the COVID-19 health pandemic impacts economies and labour markets, millions of workers have experienced changes which have profoundly transformed their lives within and beyond work, their well-being and their productivity. One of the defining features of these changes is their asymmetric nature - impacting already disadvantaged populations with greater ferocity and velocity.”

The Increasing Influence of Recommendation Systems in Our Everyday Lives

A few years ago, I attended a seminar by University of Toronto professor Avi Goldfarb on the economic value of AI. Goldfarb explained that the best way to assess the impact of a new radical technology is to look at how the technology reduces the cost of a widely used function. Computers, for example, are powerful calculators whose cost of arithmetic and other digital operations have dramatically decreased over the past several decades. As a result, we’ve learned to define all kinds of tasks in terms of digital operations, e.g., financial transactions, inventory management, word processing, photography. Similarly, the Internet and World Wide Web have drastically reduced the cost of communications and of access to all kinds of information, - including numbers, text, pictures, music and videos.

Viewed through this lens, the data and AI revolution can be viewed as reducing the cost of predictions. Predictions mean anticipating what is likely to happen in the future. Over the past decade, increasingly powerful computers, advanced machine learning algorithms, and the explosive growth of big data have enabled us to extract insights from the data and turn them into valuable predictions. As was previously the case with digital operations, communications and access to information, - we’re now able to reframe all kinds of applications as prediction problems. A major such family of applications are recommendation engines or recommender systems, which Wikipedia defines as “a subclass of information filtering system that seeks to predict the ‘rating’ or ‘preference’ a user would give to an item.”

“The essential function of recommender systems is mathematically predicting personal preference,” writes MIT visiting scholar Michael Schrage in his recently published book Recommendation Engines. But, “recommendation engines are far more intriguing and important than their definitions might suggest,” as they not only predict but also shape their users’ preferences. Throughout the book, Schrage explores the human yearning to get good, practical and actionable advice, -  whether from the gods, astrology or self-help books, - and the evolution of recommendations into our ubiquitous algorithm-based technologies to the point where they’ve almost become an extension of our brains. “More people around the world are becoming more reliant - even dependent - upon recommendation engines to better advise, inform, and inspire them.”

“Recommenders increasingly influence how individuals spend their time, money, and energy to get more from life. That explains why global organizations ranging from Alibaba to Netflix to Spotify to Amazon to Google invest so heavily in them.” These powerful platforms are driven by their huge economies of scale, - which are largely based on their highly personalized recommendations. The larger the network, the more data is available for recommending highly personalized offerings. That’s what network effects are all about: the more products or services a platform offers, the more users it will attract, helping it then attract more offerings, which in turn brings in more users, generates more data, and makes the platform even more valuable

The Current State of AI Adoption

For the past few years, McKinsey has been conducting a yearly online survey to help assess the state of AI adoption. The 2019 survey garnered responses from over 2,300 companies, and found that AI was becoming more mainstream, with nearly 80% of the responding companies using AI in some capacity. Most of these companies saw measurable benefits from their AI deployment, with 63% reporting year-over-year (YOY) revenue increase, while 44% reported YOY cost savings. However, much work was still necessary to scale the use of AI across the company, manage the risks, and retrain their workforce.

The most recent survey, took place in June of 2020 and received responses from almost 2,400 participants from different regions, industries, company sizes and functions. The State of AI in 2020, published in November, found that revenue increases had become a bit more common (66%) compared to the previous year, while cost decreases were now somewhat less common (40%). The biggest year-over-year increases were found in the strategy and finance functions (73% vs 59%), risk management (68% vs 57%), manufacturing (71% vs 61%), and supply-chain management (72% vs 63%). The biggest YOY cost decreases were found in strategy and finance (32% vs 50%), risk management (38% vs 54%), manufacturing (50% vs 64%), human resources (43% vs 55%), and product and/or service development (21% vs 29%).

What accounts for these (relatively small) differences between the two most recent surveys? “What we’ve said in the past about ‘following the money’ to find where AI adds value in organizations still holds true,” explained the report. “And, overall, many companies focused on growth in 2019 …; for that reason, it’s likely that we saw more companies driving revenues with AI rather than decreasing their costs - not because AI can’t effectively reduce costs.”

AI Is Mostly About Business Value, Not Technology

A few months ago, Babson College professor Tom Davenport convened a virtual meeting of chief data and analytic officers (CDAO) from a variety of industries to discuss how to best achieve a return on investments (ROI) in AI. “We wanted to learn to what degree these senior leaders shared our perspective that AI faces an important economic return issue, and what, if anything, their companies were doing to address it.”  Many participants said that a decent ROI remains a critical issue for AI projects.

Davenport has long been analyzing how companies should build up their AI capabilities to achieve their business objectives.  For example, in a 2018 Harvard Business Review article he co-authored, Davenport advised companies to build their AI capabilities through the lens of business opportunities, rather than technology.  As has been generally the case with new technologies, highly ambitious, multi-year moon shot projects are less likely to be successful than low-hanging-fruit projects.  Business process automation is one of the least expensive and easiest capability to implement, since companies have long been engaged with enhancing and automating their business processes.

The following year, Davenport talked about the state of AI in the enterprise at the annual conference of MIT’s Initiative on the Digital Economy  His talk was based on recent surveys by Deloitte of executives in US-based companies who were involved in AI projects.  The surveys found that 20-30% of enterprises were early adopters, having implemented at least one AI prototype or production application; most of the projects were in pilots with relatively few already in production; simple projects prevailed over more ambitious and complex ones; and implementation, integration, data issues and talent topped the list of challenges faced by these early adopters.

Are There Limits to the Predictability of Elections?

The elegant mathematical models of classical mechanics depict a world in which objects exhibit deterministic behaviors. These models make perfect predictions within the accuracy of their human-scale measurements.

But, once you start dealing with atoms, molecules and exotic subatomic particles, you find yourself in a very different  world, one with somewhat counter-intuitive behaviors governed by the laws of quantum mechanics.  The orderly, predictable models of classical physics have now given way to wave functions, uncertainty principles, quantum tunneling and wave-particle dualities.

But, the world of the very small is not the only one with non-deterministic behaviors.  So are highly complex systems, especially those systems whose components and interrelationships are themselves quite complex.  This is the case with social systems, which are based on individuals, groups, and institutions.  It’s quite a challenge to make accurate predictions in such systems due to the the dynamic nature of human behaviors.  Terms, like emergence, long tails, and butterfly effects - every bit as fanciful as quarks, charm and strangeness, - are part of the social systems lexicon.

Which brings us to the 2020 US election. “The polls were wrong again, and much of America wants to know why,” wrote NY Times journalist David Leonhardt in a recent article. “This is a disaster for the polling industry and for media outlets and analysts that package and interpret the polls for public consumption, such as FiveThirtyEight, The New York Times’ Upshot, and The Economist’s election unit,” said David Graham  in The Atlantic.

Building Better Jobs in an Age of Intelligent Machines

On November 18, the MIT Task Force on the Work of the Future released its final report, The Work of the Future: Building Better Jobs in an Age of Intelligent Machines.  The Task Force was commissioned in the spring of 2018 by MIT President Rafael Reif to address what may well be the most critical question of the digital economy: as emerging technologies raise aggregate economic output and the wealth of nations, will they also enable people to attain higher living standards, better working conditions, greater economic security, and improved health and longevity?  An interim report was released in September, 2019.

“Amidst a technological ecosystem delivering rising productivity, and an economy generating plenty of jobs (at least until the COVID-19 crisis), we found a labor market in which the fruits are so unequally distributed, so skewed towards the top, that the majority of workers have tasted only a tiny morsel of a vast harvest,” is the Task Force overriding conclusion.  Yet, it argues that with better policies in place, more people could enjoy good careers even as new technologies transform the very nature of work.

AI Technologies Are Fundamentally Changing How Work Gets Done

After decades of promise and hype, artificial intelligence is finally becoming one of the most important technologies of our era.  AI technologies, like machine learning, are clearly having a major impact on the very nature of work.  But, how can we best quantify their impact on the actual evolution of jobs?

The best approach for exploring the relationship between technology and jobs is to look at the individual tasks that comprise a job.  Most jobs involve a number of tasks.  Some of these tasks are relatively routine and based on well-understood rules, while others require judgement, social skills and other human capabilities.  The more routine and rules-based the task, the more amenable it is to automation. 

However just because some of its component tasks have been automated, does not imply that the whole job has disappeared.  To the contrary, automating the more routine parts of a job will often increase the productivity and quality of workers by complementing their skills with technologies and tools, thus enabling them to focus on those aspect of the job that most need their attention.  While automation  substitutes for labor, automation also complements labor, increasing productivity and other economic outputs in ways that often raise the demand for and earnings of workers.

“The emergence of artificial intelligence (AI) and machine learning (ML) poses a new set of opportunities - and challenges - for work and workers,” said The Future of Work: How New Technologies Are Transforming Tasks, a research report released last Fall by the MIT-IBM Watson AI Lab.  “The tasks that can be done by machine learning are much broader in scope than previous generations of technology have made possible.  The expanded scope will change the value employers place on tasks, and the types of skills most in demand.”

After Years of Promise and Hype, Is AI Once More Failing to Deliver?

The June 13 issue of The Economist included an in-depth look at the limits of AI, with seven articles on the subject.  “There is no question that AI - or, to be precise, machine learning, one of its sub-fields - has made much progress,” notes The Economist in the issue’s overview article.  “Computers have become dramatically better at many things they previously struggled with…  Yet lately doubts have been creeping in about whether today’s AI technology is really as world-changing as it seems.  It is running up against limits of one kind or another, and has failed to deliver on some of its proponents’ more grandiose promises.”

Transformative technologies, - remember the dot-com bubble, - are prone to hype cycles, when all the excitement and publicity accompanying their early achievements often lead to inflated expectations, followed by disillusionment if the technology fails to deliver.  But AI is in a class by itself, as the notion of machines achieving or surpassing human levels of intelligence has led to feelings of both wonder and fear over the past several decades.

The article reminds us that AI has gone through two such major hype cycles since the field began in the mid-1950s.  Early achievements, - like beating humans at checkers and proving logic theorems, - led researchers to conclude that machines would achieve human-level intelligence within a couple of decades.  This early optimism collapsed leading to the first so-called AI winter from 1974-1980.  The field was revived in the 1980s with the advent of commercial expert systems and Japan’s Fifth Generation project, but it didn’t last long, leading to the second AI winter from 1987-1993.

The Social Network Is the Computer

“Human beings have always been a social species,” writes MIT professor Sinan Aral in the opening paragraph of The Hype Machine, his recently published book.  “We’ve been communicating, cooperating, and coordinating with one another since we were hunting and gathering.”  Our increasingly complex social interactions have been the critical factor in the exponential increase of human cranial capacity over the past few million years.  “But today something is different.  Over the last decade, we’ve doused our kindling fire of human interaction with high-­octane gasoline.  We’ve constructed an expansive, multifaceted machine that spans the globe and conducts the flow of information, opinions, and behaviors through society.”

Professor Aral has been studying social media since its beginning in the early 2000s, when it was driven by the idealistic vision of connecting the world and providing free access to information.  The Hype Machine is what he now calls our global social media ecosystem.  This ecosystem has been designed to stimulate and manipulate the human psyche, “to draw us in and persuade us to change how we shop, vote, and exercise, and even who we love.”  His book nicely explains how the social media industrial complex works, how it affects us, and what we can do to help achieve its original vision while avoiding its later perils.  Let me discuss a few of its key points.

The AI Factory: A New Kind of Digital Operating Model

“Whether you’re leading a digital start-up or working to revamp a traditional enterprise, it’s essential to understand the revolutionary impact AI has on operations, strategy, and competition,” wrote Harvard professors Marco Iansiti and Karim Lakhani in “Competing in the Age of AI”, a recently published article in the Harvard Business Review (HBR).  Earlier this year, they also published a book of the same title, which expands on the ideas in the article and illustrates them with a number of concrete use cases.

The age of AI is being ushered by the emergence of a new kind of digital firm.  Rather than just relying on traditional business processes operated by its workers, these firms are leveraging software and data-driven algorithms to eliminate traditional constraints and transform the rules of competition.  Managers and engineers are responsible for the design of the new AI-based operational systems, but the system then runs the operations pretty much on its own.

“At the core of the new firm is a decision factory - what we call the AI factory,” note the authors.  “[T]he AI factory treats decision-making as a science.  Analytics systematically convert internal and external data into predictions, insights, and choices, which in turn guide and automate operational workflows…  As digital networks and algorithms are woven into the fabric of firms, industries begin to function differently and the lines between them blur.”

The Industrial Revolution transformed the economy by developing a scalable, repeatable approach to manufacturing.  The AI factory is now driving another fundamental transformation by industrializing the data gathering, decision making, and overall digital operations of 21st century firms.

Could AI Reshape the Global Balance of Power?

The National Security Commission on Artificial Intelligence (NSCAI) was established by the US Congress in Fiscal Year 2019 to “advance the development of artificial intelligence, machine learning, and associated technologies by the United States to comprehensively address the national security and defense needs of the United States.”  A few months ago, the 15 member Commission, - led by former Google CEO Eric Schmidt  and former deputy secretary of defense Robert Work, - released its interim report. The final report is due to be released in March, 2021.  It remains to be seen how the Covid-19 pandemic will impact the final report’s recommendations and release date.

“The convergence of the artificial intelligence revolution and the reemergence of great power competition… threaten the United States’ role as the world’s engine of innovation and American military superiority,” said the interim report in its opening statements.  “How the United States adopts AI will have profound ramifications for our immediate security, economic well-being, and position in the world…  We are concerned that America’s role as the world’s leading innovator is threatened… We know strategic competitors are investing in research and application.  It is only reasonable to conclude that AI-enabled capabilities could be used to threaten our critical infrastructure, amplify disinformation campaigns, and wage war.”

Like the Internet, - let’s remember that ARPANET was started in the late 1960s by the US Department of Defense, - AI is usable for military and civilian purposes.  But, - also like the Internet, - AI is a general purpose technology that can be used for a wide variety of applications, many of them beneficial, but others potentially threatening.

The Post-Pandemic Enterprise: What Will It Be Like?

In the near term, nations have been mostly focused on surviving the massive disruptions caused by Covid-19.  But, what about the longer term?  What will the post-pandemic new normal be like for societies and economies?  More specifically, how will the pandemic impact the world of business?  How can enterprises leverage the crisis to accelerate their journey toward what most everyone agrees will be an even faster changing future?  As Rahm Emanuel famously said in a 2008 WSJ interview: “You never want a serious crisis to go to waste.”

“The future is not what we thought it would be only a few short months ago,” said a recent McKinsey article, From thinking about the next normal to making it work.  “As businesses step into the post-coronavirus future, they need to find a balance between what worked before and what needs to happen to succeed in the next normal.”  The article offers 21 concrete recommendations for succeeding in the next normal, organized into seven major areas.  Let me summarize a few of these recommendations.

Building a More Resilient, Data-Driven Economy

“With each major crisis, be it war, pandemic, or major new technology, there has been a need to reinvent the relationships between individuals, businesses, and government,” wrote MIT professor Alex “Sandy Pentland in the first chapter of Building the New Economy.  Pentland cites two major historical examples.  In the early 20th century, the rise of mass manufacturing led to the creation of regulations governing working conditions and pay, health rules for mass-produced foods, and laws to prevent monopolies that stifled competition.  Then in mid-century, the decades following WWII saw greater access to higher education, racial and gender progress, and increased support for scientific research and medical advances.

“Today we face two simultaneous disruptions: one is the COVID-19 pandemic and resulting economic shock, and the second is the rise of pervasive digital data, crypto systems, and artificial intelligence (AI).”  The two disruptions are highly interrelated.  Digital technologies have been deployed to fight the global pandemic as well as helping us stay connected as we practice social distancing.

But, these same technologies are also increasing the already high levels of disinformation and fraud, threatening privacy rights with well-meaning public health technology measures, and likely to impact employment as institutions accelerate their embrace of digitization, AI and automation.  “These problems highlight the need to reinvent the ways data and AI are used in all of societies’ civic and government systems, both to guarantee that future pandemics can be handled better and to reinvigorate the economy but also to spread the economic benefits throughout society.”

High resilience in the face of an uncertain, changing environment is the essence of evolution and natural selection.  Building a new post-pandemic economy requires the creation of more agile, resilient systems and institutions to help us better adapt to an unpredictable future and withstand turbulent events like Covid-19.  In a resilient economy, power and decision-making should be distributed among a diverse set of stakeholders rather than concentrated in a few hands.

Why “The Techlash” Is a Threat to Growth and Progress

A few months ago, the Information Technology and Innovation Foundation (ITIF) published A Policymaker’s Guide to the “Techlash” - What It Is and Why It’s a Threat to Growth and Progress.  “Does information technology (IT) solve problems and make our lives easier, allowing us to do more with less?,” asks the ITIF report.  “Or does it introduce additional complexity to our lives, isolate us from each other, threaten privacy, destroy jobs, and generate an array of other harms?”

It wasn’t all that long ago that digital technologies and Big Tech were largely seen as catalysts for positive change: the Internet had become a global platform for collaborative innovation; social media was a liberating force, helping democratic uprisings like the Arab Spring; and the smartphone was transforming the lives of people all over the world.

But, the 2010s saw the emergence of what’s come to be called the techlash.  The Oxford English Dictionary (OED) defines techlash as “a strong and widespread negative reaction to the growing power and influence of large technology companies, particularly those based in Silicon Valley.”  The term seems to have originated in a November, 2013 article in The Economist, which said that tech elites are turning out to be some of the most ruthless capitalists around, and “will join bankers and oilmen in public demonology.”  By 2018, techlash was one of eight shortlisted entries for OED Word of the Year.

Even When Plans Are Useless, Planning Is Indispensable

“As scientists race to develop a cure for the coronavirus, businesses are trying to assess the impact of the outbreak on their own enterprises,” wrote MIT professor Yossi Sheffi in a February 18 article in the Wall Street Journal.  “Just as scientists are confronting an unknown enemy, corporate executives are largely working blind because the coronavirus could cause supply-chain disruptions that are unlike anything we have seen in the past 70 years.”

Sheffi is Director of the MIT Center for Transportation and Logistics.  He’s written extensively on the critical need for resilience in global enterprises and their supply chains, - including The Power of Resilience and The Resilient Enterprise, - so they can better react to major unexpected events.  Covid-19 is the kind of massively disruptive event he had in mind when he wrote those books.

While learning from historical precedents is always a good idea, recent supply chain disruptions - the 2003 outbreak of SARS in Asia, the 2011 Fukushima nuclear disaster, or the 2011 Thailand floods, - were very different from our current pandemic.  Those events were much more localized, lasted a relatively short time, and they mostly impacted supply, not demand.  The impact of Covid-19 is much bigger, affecting consumer demand as well as supply chains all over the world, and likely to last quite a bit longer.  “Today’s supply chains are global and more complex than they were in 2003,” with factories all over the world affected by lockdowns and quarantines.  Apple, for example, works with suppliers in 43 countries.

What History Tells Us About the Accelerating AI Revolution

A few weeks before our lives were turned upside down by Covid-19, I read Technology at Work v4.0, the fourth report in the Technology at Work Series developed by Citigroup in collaboration with Oxford University.  The report includes an excellent chapter on What History Tells Us About the Coming AI Revolution by Oxford professor Carl Benedikt Frey based on his 2019 book The Technology Trap.

Recent AI advances have “sparked much excitement…  yet despite this, most ordinary people don’t feel particularly optimistic about the future,” wrote Frey.  For example, a 2017 Pew Research survey found that three quarters of Americans expressed serious concerns about AI and automation, and just over a third believe that their children will be better off financially than they were.

But, in fact, serious concerns about the impact of technology are part of a historical pattern.  “Many of the trends we see today, such as the disappearance of middle-income jobs, stagnant wages and growing inequality were also features of the Industrial Revolution, which began in Britain around 1750.  This was a period of unprecedented technological change but also one of turbulent social and political change.”

An Increasingly Digital “New Normal”

About a dozen years ago, I attended a conference where I was interviewed on stage by then WSJ technology columnist Walter Mossberg.  He started out by asking me about IBM’s near-death experience in the early 1990s, and the subsequent technical and cultural transformation that made it possible for IBM to reinvent itself and survive, while many other IT companies didn’t make it.  In particular, we discussed whether a successful company transformation must be preceded by the kind of major crisis IBM went through.  When it comes to humans, the ancient Greeks certainly thought so, as reflected in their tragedies.

Transformative change is very difficult for established companies.  Over the years, they’ve amassed valuable assets and extensive organizations.  Already consumed with managing their existing operations, they may look at transformative change as more of a threat or distraction than an opportunity, - unless they’re in dire straits and have no other choice, as was the case with IBM.

A serious crisis is an opportunity for companies to focus on the actions needed to survive in a fast changing environment.  As Rahm Emanuel famously said in a 2008 interview with the WSJ: “You never want a serious crisis to go to waste.”  In that spirit, how should companies take advantage of the Covid-19 crisis, - arguably the biggest shock the world has experienced since WWII, - to accelerate their journey toward what most everyone agrees will be an increasingly digital future?

The Urgent Need to Strengthen the Nation’s Resilience

Following World War II and the onset of the Cold War with the Soviet Union, the US undertook a series of measures to strengthen the resilience of the country.  These included a significant expansion of government support for scientific research in universities and R&D labs, leading to product innovations from the private sector and better weapons from the defense industry, which contributed to making the US the most prosperous and secure nation in the world.

Another important measure was the expansion of educational opportunities, like the GI Bill which offered the nation’s 16 million WWII veterans payments of tuition and living expenses to attend high school, college or vocational/technical schools.  By 1956, over 2.2 million had used the GI Bill to attend college or university, and 5.8 million had used it for some kind of job training program.

In the 1950s the government enacted the National Interstate and Defense Highways Act, which led to the construction of over 48,000 miles of the Interstate Highway System at a total price estimated at over $500 billion, - the largest public work in America .  The Act had a dual purpose: facilitating the economic growth of the country as well as supporting the country’s defense during a conventional or nuclear war should it be necessary.

And, last but far from least, in the late 1960s the government launched ARPANET, the digital infrastructure that eventually became the Internet.  ARPANET was supported by the Department of Defense to significantly enhance the resilience of the country following a nuclear attack by enabling computers to communicate with each other using a flexible packet-switching digital network.

But, this post-war focus on resilience has significantly waned over the past few decades.  Let me explain.

Blockchain and Public Health Solutions

The Blockchain Research Institute (BRI) is a global think tank dedicated to the strategic implications of blockchain technologies to business, government and society.  On March 26, I participated in a virtual roundtable convened by the BRI to discuss the potential use of blockchain technologies for public health solutions.  The roundtable’s findings and recommendations were released in early April in Blockchain Solutions in Pandemics: A Call for Innovation and Transformation in Public Health.

The report identified five key areas where blockchain could be deployed to fight Covid-19 as well as future pandemics: identity, health records and shared data; just-in-time supply chains; sustaining the economy; a rapid response registry for medical professionals; and incentives models to reward responsible behavior.  In each of these areas, the report presented uses cases where blockchain is already being deployed, and recommended a number of blockchain related public health measures that will help better prepare for future pandemics.  Given the broad scope of the report, I will focus my attention on one area in particular: identity, health records and shared data.

Measuring the Effectiveness of Social Distancing Policies

One of the most interesting projects in the MIT Connection Science group I’m affiliated with is The Atlas of Inequality.  The project, - led by visiting professor Esteban Moro and professor Alex ‘Sandy’ Pentland - uses aggregated anonymous geolocation data from digital devices to estimate where different groups of people in US cities spend their time.  Over time, the project will be expanded to cities around the world.  The data show the significant income inequality among people in those cities, not just by neighborhoods as you’d expect, but also in the restaurants, stores and other places beyond their neighborhoods which they visit every day.

A couple of weeks ago, the Atlas research group started to apply their geolocation data and methods to analyze the effectiveness of the social distancing policies adopted in the New York metropolitan area in response to the Covid-19 pandemic.  These policies include school closures, bans on non-essential gatherings, limiting restaurants to take-out orders, and strict stay-in-place measures.   There’s no way to empirically measure the impact of these social distancing measures in real time on the spread of Covid-19.  You can only measure their impact retrospectively, or simulate what might happen in the future based on past data.

However, you can empirically address a key set of important question: how have these social distancing policies changed mobility and social behavior?; how does social distancing behavior vary across the New York metropolitan area?; how does the behavior vary across the variety of demographic groups in the NY metro area?; and overall, how well are people following these social distance measures?

The 2019 Artificial Intelligence Index

AI has emerged as the defining technology of our era, as transformative over time as the steam engine, electricity, and the Internet.  While still in its early stages, AI is already reshaping the economy, society, our personal lives and the very nature of work, with much more to come as the technology and applications mature, including the scientific research necessary to anticipate and fight future pandemics.  But, what’s the current state of AI and where is it heading?

To help address these important questions, the annual Artificial Intelligence Index was created under the auspices of the Stanford Institute for Human-Centered Artificial Intelligence, - guided by a Steering Committee of experts from academia and industry, and in collaboration with a number of sponsoring partners and data contributors.  The AI Index aims to “provide unbiased, rigorous, and comprehensive data for policymakers, researchers, journalists, executives, and the general public to develop a deeper understanding of the complex field of AI.”

Now in its third year, the 2019 AI Index Report was released this past December.  So was the associated 2019 AI Index Data, which includes three times as many data sets as the 2018 edition.  The report  comprises nine chapters.  Let me summarize a few of its highlights.

The Coming Era of Decision Machines

“Artificial intelligence (AI) is the pursuit of machines that are able to act purposefully to make decisions towards the pursuit of goals,” wrote Harvard professor David Parkes in A Responsibility to Judge Carefully in the Era of Prediction Decision Machines, an essay recently published as part of Harvard’s Digital Initiative.  “Machines need to be able to predict to decide, but decision making requires much more.  Decision making requires bringing together and reconciling multiple points of view.  Decision making requires leadership in advocating and explaining a path forward.  Decision making requires dialogue.”

In April, 2017 I attended a seminar by University of Toronto professor Avi Goldfarb on the economic value of AI.  Goldfarb explained that the best way to assess the impact of a new radical technology is to look at how the technology reduces the cost of a widely used function.  For example, computers are essentially powerful calculators whose cost of digital operations have dramatically decreased over the past several decades.  Over the years, we’ve learned to define all kinds of tasks in terms of digital operations, e.g., financial transactions, word processing, photography.  Similarly, the Internet has drastically reduced the cost of communications and of access to all kinds of information, - including text, pictures, music and videos.

Viewed through this lens, the AI revolution can be viewed as reducing the cost of predictions.  Prediction means anticipating what is likely to happen in the future.  Over the past decade, increasingly powerful and inexpensive computers, advanced machine learning algorithms, and the explosive growth of big data have enabled us to extract insights from all that data and turn them into valuable predictions.

Given the widespread role of predictions in business, government and everyday life, AI is already having a major impact on many human activities.  As was previously the case with arithmetic, communications and access to information, - we will be able to use predictions in all kinds of new applications.  Over time, we’ll discover that lots of tasks can be reframed as prediction problems.

The Long-Term Future of Work and Education: Three Potential Scenarios

“Experts differ widely in their predictions about how technological innovation will change the labor market, but they all see a need for changes in education,” write British professors Ewart Keep and Phillip Brown in  a recently published article, Rethinking the Race Between Education and Technology.  While experts don’t generally agree on much, they’re pretty much of one mind when it comes to the growing importance of skills and education in our 21st century digital economy.

Every past technological transformation ultimately led to more jobs, higher living standards and economic growth.  But, as a number of recent studies concluded, to ensure that this will indeed be the case, our emerging knowledge economy should be accompanied by the expansion of educational opportunities for everyone.

While noting that this is the most likely scenario for the next 10 - 15 years, Keep and Brown also consider two potential longer-term scenarios.  Perhaps AI will lead to even more pervasive and fundamental transformations in the nature of work, making it difficult for even those with a college or higher education to find a good job.  Beyond that, some have suggested that in the more distant future we might see an even more radical, science-fiction-like transformation: the end of work as we’ve long known it.

The authors argue that considering such a spectrum of possibilities will help us better prepare for what’s essentially an unpredictable future.  In that spirit, their paper discusses three different labor market scenarios: labor scarcity, job scarcity, and the end of work.

Can Democracy and Free Markets Survive in the Coming Age of AI?

Can technology plan economies and destroy democracy? is the provocative title of an essay in the end-of-2019 issue of The Economist.  “The success of market- and semi-market-based economies… has made the notion of a planned economy seem like a thing of the past.”  But, given all the data that can now be gathered by billions of smartphones and 10s of billions of sensors, - with many more to come, - could our increasingly intelligent and powerful AI systems “replace the autonomous choices on which the market is based?… And if technology can outperform the invisible hand in the economy, might it be able to do the same at the ballot box when it comes to politics?” 

As we’ve already seen, AI applications “can provide not just data on what people want and will tolerate, but also the means to manipulate those desires.  When such means are available to actors within or outside a state the struggle to gain, or for that matter retain, a democracy which reflects a genuine popular will might become even harder than it is.”  Could this all mean that free-market economics and liberal democracy will become obsolete over the coming century?

These questions were often raised and repeatedly tested throughout the 20th century, as various governments attempted to redesign their economies and societies in accord with what were believed to be scientific laws.  But, most such schemes, especially those carried out by authoritarian states, ended up as complete failures.  And some went tragically awry, - like Stalin’s collectivization of agriculture in the Soviet Union and Mao’s Great Leap Forward in China, - both of which brought death and disruption to millions.