Irving Wladawsky-Berger

Beyond Machine Learning: Capturing Cause-and-Effect Relationships

Artificial intelligence is rapidly becoming one of the most important technologies of our era.  Every day we can read about the latest AI advances from startups and large companies.  AI technologies  are approaching or surpassing human levels of performance in vision, speech recognition, language translation, and other human domains. Machine learning advances, like deep learning, have played a central role in AI’s recent achievements, giving computers the ability to be trained by ingesting and analyzing large amounts of data instead of being explicitly programmed.

Deep learning is a powerful statistical technique for classifying patterns using large training data sets and multi-layer AI neural networks.  It’s essentially a method for machines to learn from all kinds of data, whether structured or unstructured, that’s loosely modeled on the way a biological brain learns new capabilities.  Each artificial neural unit is connected to many other such units, and the links can be statistically strengthened or decreased based on the data used to train the system.  Each successive layer in a multi-layer network uses the output from the previous layer as input.

Machine learning can be applied to just about any domain of knowledge given our ability to gather valuable data in almost any area of interest.  But, machine learning methods are significantly narrower and more specialized than humans.  There are many tasks for which they’re not effective given the current state-of-the-art.  In an article recently published in Science, professors Erik Brynjolfsson and Tom Mitchell identified the key criteria that help distinguish tasks that are particularly suitable for machine learning from those that are not.  These include:

• Tasks that map well-defined inputs to well-defined outputs, - e.g., labeling images of specific animals, the probability of cancer in medical record, the likelihood of defaulting on a loan application;
• Large data sets exist or can be created containing such input-output pairs, - the bigger the training data sets the more accurate the learning;
• The capability being learned should be relatively static, - If the function changes rapidly, retraining is typically required, including the acquisition of new training data; and
• No need for detailed explanation of how the decision was made, - the methods behind a machine  learning recommendation, - subtle adjustments to the numerical weights that interconnect its huge number of artificial neurons, - are difficult to explain because they’re so different from those used by humans.

Redefining Work - Leveraging Human Capabilities in a Future of Expanding Automation

How will labor markets evolve in our 21st century digital economy?  What’s the likely future of jobs, given that our increasingly smart machines are now being applied to activities requiring intelligence and cognitive capabilities that not long ago were viewed as the exclusive domain of humans?  How will AI, robotics and other advanced technologies transform the very nature of work?

Over the past few years, a number of papers, reports and books have addressed these very important questions.  They generally conclude that AI will have a major impact on jobs and the very nature of work.  For the most part,  they view AI as mostly augmenting rather than replacing human capabilities, automating the more routine parts of a job and increasing the productivity and quality of workers, so they can focus on those aspect of the job that most require human attention.  Overall, few jobs will be entirely automated, but automation will likely transform the vast majority of occupations. 

A recent McKinsey report noted while there will likely be enough work to maintain full employment by 2030, the transition will be very challenging, “on a scale not seen since the transition of the labor force out of agriculture in the early 1900s in the United States and Europe, and more recently in in China.”  The report estimated that “up to 375 million workers, or 14 percent of the global workforce, may need to change occupations - and virtually all workers may need to adapt to work alongside machines in new ways.”

Given these predictions about the changing nature of work, what should companies do?  How should firms prepare for a brave new world where we can expect major economic dislocations along with the creation of new jobs, new business models and whole new industries, and where many people will be working alongside smart machines in whole new ways?

The Jobs Outlook for 2022

A few weeks ago, the World Economic Forum (WEF) released The Future of Jobs Report 2018.  The report takes an in-depth look at the world of work in what the WEF calls the Fourth Industrial Revolution. The report is based on a survey of over 300 chief human resource officers and top strategy executives from large global companies across 12 industry sectors.  These companies collectively represent more than 15 million employees, and conduct business in 20 developed and emerging economies which collectively account for about 70% of global GDP.

First introduced at its 2016 annual Davos Forum, the WEF positions the Fourth Industrial Revolution within the historical context of three previous industrial revolutions.  The First, - in the last third of the 18th century, - ushered the transition from hand-made goods to mechanized, machine-based production based on based on steam and water power.  The Second, - a century later, - revolved around steel, railroads, cars, chemicals, petroleum, electricity, the telephone and radio, leading to the age of mass production.  The Third, - starting in the 1960s, - saw the advent of digital technologies, computers, the IT industry, and the automation of process in just about all industries.

“Now a Fourth Industrial Revolution is building on the Third…” wrote WEF founder and chairman Klaus Schwab in a December, 2015 Foreign Affairs article.  “The possibilities of billions of people connected by mobile devices, with unprecedented processing power, storage capacity, and access to knowledge, are unlimited.  And these possibilities will be multiplied by emerging technology breakthroughs in fields such as artificial intelligence, robotics, the Internet of Things, autonomous vehicles, 3-D printing, nanotechnology, biotechnology, materials science, energy storage, and quantum computing.”

The Future of Jobs 2018 examines the potential of these advanced technologies to eliminate and create new jobs, as well as to improve the current workplace and prepare people for emerging jobs. Rather than looking at the future of work over the longer term, the report chose to examine the 2018-2022 period, which is within the planning horizon of the companies and executives that participated in the survey.

The Impact of AI on the World Economy

A few weeks ago I wrote about the economic value of AI based on a recently published report by PwC.  The report’s overriding finding was that AI technologies and applications will increase global GDP by up to 14% between now and 2030, the equivalent of an additional $15.7 trillion contribution to the world’s economy.  According to PwC, AI is the biggest economic opportunity over the next 10-15 years.

I now want to discuss a September, 2018 report by the McKinsey Global Institute on the impact of AI on the world economy.

The McKinsey report is based on simulation models of the impact of AI at the country, sector, company and worker levels.  It looked at their adoption of five broad categories of AI technologies: computer vision, natural language, virtual assistants, robotic process automation, and advanced machine learning.  Its data sources included survey data from approximately 3,000 firms in 14 different sectors; around 400 potential AI use cases across a variety of industries and functions; AI’s potential to automate and transform 800 existing occupations in 46 countries; and economic data from a number of organizations including the United Nations, the World Bank, the Organization for Economic Co-operation and Development (OECD), and the World Economic Forum.

Below is a summary of the report’s key findings. 

The Economic Value of Artificial Intelligence

 PwC recently released a report on the potential economic value of AI to different regions and industry sectors around the world.  The report defined AI, “as a collective term for computer systems that can sense their environment, think, learn, and take action in response to what they’re sensing and their objectives.”  By this broad definition, AI includes the automation of physical and cognitive tasks; assisting people to perform tasks better and faster; helping humans make better decisions; and automating decision making with no human intervention.

The report’s overriding finding is that AI is the biggest commercial opportunity for companies, industries and nations over the next few decades.  PwC estimates that AI advances will increase global GDP by up to 14% between now and 2030, the equivalent of an additional $15.7 trillion contribution to the world’s economy.

Around $6.6 trillion of the expected GDP growth will come from productivity gains, especially in the near term.  These include the continued automation of routine tasks, and the development of increasingly sophisticated tools to augment human capabilities.  Companies that are slow to adopt these AI-based productivity improvements will find themselves at a serious competitive disadvantage.

But, over time, increased consumer demand for AI-enhanced offerings will overtake productivity gains and result in an additional $9.1 trillion of GDP growth by 2030.  Moreover,  network effects, - that is, the more data and better insights companies are able to gather, the more appealing the products and services they’ll be able to develop, - will further increase consumer demand.  AI front-runners will gain an enormous competitive advantage through their ability to leverage this rich supply of customer data to shape product developments and business models, making it harder for slower moving competitors to catch up. 

Social Physics and Cybercrime Detection

A few weeks ago I wrote about social physics, a new discipline that aims to help us better understand and predict the behavior of human groups.  Social physics is based on the premise that all event-data representing human activity, - e,g,, phone call records, credit card purchases, taxi rides, web activity, - contain a special set of group behavior patterns.  As long as the data involves human activity, - regardless of the type of data, the demographic of the users or the size of the data sets, - similar behavioral dynamics apply.  These patterns can be used to detect emerging behavioral trends before they can be observed by other data analytics techniques.

Physics, biology and other natural sciences have long relied on universal patterns or principles to detect a faint signal within a large data set, - i.e., the proverbial needle in a haystack.  It’s what has enabled the discovery of very short lived elementary particles in physics, - like the Higgs boson  in 2013, - amidst the huge amounts of data generated by high energy particle accelerators.  In biology, it’s given rise to DNA sequencing and its growing list of applications in medicine, biotechnology and other disciplines. 

It’s not surprising that evolutionary biology and natural selection have led to similar universal patterns in the behavior of human crowds.  Humans and our ancestors have evolved with the drive to learn from each other because it’s been a major part of our survival over millions of years.  And if a new behavior, - whether the result of an innovative idea like the discovery of tools, or a mutation like a larger brain size, - helps a human group better adapt to a changing environment, natural selection will favor the survival of that group over others.

Social physics originated in MIT’s Human Dynamics Lab based on research by professor Alex (Sandy) Pentland, his then postdoctoral associate Yaniv Altshuler and their various collaborators.  In 2014, Pentland and Altshuler co-founded Endor, an Israeli-based startup that leverages social physics methods to make fast accurate predictions by analyzing data derived from human behavior. 

Social Physics - Reinventing Analytics to Better Predict Human Behaviors

Social physics first emerged over 200 years ago as an attempt to understand society and human behavior using laws similar to those of the physical sciences.  But, it wasn’t until the past two decades that we finally had enough data, powerful computers and sophisticated mathematical algorithms to develop quantitative theories of human social interactions.  We were now able to reliably predict how large groups of people make decisions by analyzing how information and ideas flow from person to person.

“The engine that drives social physics is big data: the newly ubiquitous digital data now available about all aspects of human life,” wrote MIT professor Alex (Sandy) Pentland in his 2014 book Social Physics: How Good Ideas Spread - The Lessons from a New Science.  “Social physics functions by analyzing patterns of human experience and idea exchange within the digital bread crumbs we all leave behind as we move through the world, - call records, credit card transactions, and GPS location fixes, among others.  These data tell the story of everyday life by recording what each of us has chosen to do… Who we actually are is more accurately determined by where we spend our time and which things we buy, not just by what we say we do.”

The book was the result of over a decade’s worth of research in the Human Dynamics group at MIT’s Media Lab.  Pentland, along with his graduate students and research associates, partnered with a variety of companies to obtain and analyze real-world data, properly anonymized to protect the privacy of the individuals whose behavior was reflected in the data.  They eventually discovered that all event-data representing human activity contain a special set of social activity patterns regardless of what the data is about.  These patterns are common across all human activities and demographics, and can be used to detect emerging behavioral trends before they can be observed by any other technique. 

Deep Learning: Is it Approaching a Wall?

Deep learning and related machine learning advances have played a central role in AI’s recent achievements, giving computers the ability to be trained by ingesting and analyzing large amounts of data instead of being explicitly programmed.  In just the past two years, Google’s deep-learning-based AlphaGo defeated the world’s top Go players, surprising most AI experts who thought that it would take another 5 to 10 years to achieve such a milestone.  Similarly, when Google switched to its new deep learning AI system in late 2016, it achieved an overnight improvement in the quality of its machine translations roughly equal to the total gains that the previous program had accrued over its 10 year lifetime.

As is typically the case with major technology achievements, - e.g., the dot-com bubble, - deep learning has quickly climbed to the top of Gartner’s hype cycle, where all the excitement and publicity accompanying new, promising technologies often leads to inflated expectations, followed by disillusionment if the technology fails to deliver.  AI may be particularly prone to such hype cycles, as the notion of machines achieving or surpassing human levels of intelligence leads to feelings of wonder as well as fear.  Over the past several decades, AI has gone through a few such hype cycles, including the so-called AI winter in the 1980s that nearly killed the field.

In a recent article, Deep Learning: A Critical Appraisal, author and NYU professor Gary Marcus offers a serious assessment of deep learning.  He argues that, despite its considerable achievements over the past 5 years, deep learning may well be approaching a wall, an opinion apparently shared by University of Toronto professor Geoffrey Hinton, the so-called Godfather of Deep Learning.  

AI - the Creation of a Human-Centric Engineering Discipline

AI is rapidly becoming one of the most important technologies of our era.  Every day we can read about the latest AI advances from startups and large companies, including applications that not long ago were viewed as the exclusive domain of humans.  Over the past few years, the necessary ingredients have finally come together to propel AI beyond the research labs into the marketplace: powerful, inexpensive computer technologies; huge amounts of data; and advanced algorithms.

Machine learning  and related algorithms like deep learning, have played a major role in AI’s recent achievements.  Machine learning gives computers the ability to learn by ingesting and analyzing large amounts of data instead of being explicitly programmed.  It’s enabled the construction of AI algorithms that can be trained with lots and lots of sample inputs, which are subsequently applied to difficult AI problems like language translation, natural language processing, and playing championship-level Go.

Over the past several decades, AI has been besieged by rounds of hype which over-promised, under-delivered, and nearly killed the field.  Once more, a recent Gartner article positioned machine and deep learning at the top of their hype cycle, - when all the excitement, publicity and promising potential often leads to a peak of inflated expectations, risking falling into the trough of disillusionment if the technology fails to deliver.  Now that AI is finally reaching a tipping point of market acceptance, it’s particularly important to be cautious and not repeat past mistakes.

In Artificial Intelligence - The Revolution Hasn’t Happened Yet, UC Berkeley professor Michael I. Jordan aims to inject such a note of caution.  “AI has now become the mantra of our current era…  The idea that our era is somehow seeing the emergence of an intelligence in silicon that rivals our own entertains all of us  -  enthralling us and frightening us in equal measure.  And, unfortunately, it distracts us…  Whether or not we come to understand intelligence any time soon, we do have a major challenge on our hands in bringing together computers and humans in ways that enhance human life.”

An Agile, Incremental Approach to Business Process Automation

I’ve long believed that customer self-service was key to the success of e-business, - the IBM Internet strategy I was closely involved with in the mid-late 1990s.  It was quite revolutionary how easy it was to now do for yourself so many ordinary activities that previously required a phone call during office hours or a trip to a store or office.

Moreover, such e-business applications were relatively easy to develop.  By integrating their existing transaction and data base applications with a web front-end, - a strategy we succinctly described as Web + IT, - any business could now be in touch with its customers, employees, suppliers and partners at any time of the day or night, no matter where they were.  Companies were able to engage in their core activities in a more productive way by web-enabling their back-end systems, that is, linking their web front-ends to the presentation services of their back-end applications.

I was reminded of IBM’s e-business strategy when recently reading about Robotic Process Automation (RPA), a technology for automating business processes based on emulating the manual actions of a human at a keyboard.  RPA aims to improve the operational efficiency of office and service workers by automating tedious, repetitive, tasks, such as those associated with widely used horizontal processes in HR, Finance & Accounting and IT services.

RPA enables process automation at a fraction of the cost and time of classic software development.  Rather than automating a process by redesigning the overall back-end application, RPA interfaces with the back-end system by performing the same actions that a human does via the application’s user interface.  RPAs thus creates kind of software robots, or bots for short, that work alongside the humans.

What Machine Learning Can and Cannot Do

Artificial intelligence is rapidly becoming one of the most important technologies of our era.  Every day we can read about the latest AI advances from startups and large companies.  Over the past few years, the necessary ingredients have come together to take AI across the threshold: powerful, inexpensive computer technologies; huge amounts of data; and advanced algorithms, especially machine learning.  Machine learning has enabled AI to get around one of its biggest obstacles, - the so-called Polanyi’s paradox.

Explicit knowledge is formal, codified, and can be readily explained to people and captured in a computer program.  But, tacit knowledge, a concept first introduced in the 1950s by scientist and philosopher Michael Polanyi, is the kind of knowledge we’re often not aware we have, and is therefore difficult to transfer to another person, let alone capture in a computer program.

“We can know more than we can tell,” said Polanyi in what’s become known as Polanyi’s paradox.  This common sense phrase succinctly captures the fact that we tacitly know a lot about the way the world works, yet aren’t able to explicitly describe this knowledge.  Tacit knowledge is best transmitted through personal interactions and practical experiences.  Everyday examples include speaking a language, riding a bike, and easily recognizing many different people, animals and objects.

Machine learning, and related advances like deep learning, have enabled computers to acquire tacit knowledge by being trained with lots and lots of sample inputs, thus learning by analyzing large amounts of data instead of being explicitly programmed.  Machine learning methods are now being applied to vision, speech recognition, language translation, and other capabilities that not long ago seemed impossible but are now approaching or surpassing human levels of performance in a number of domains.

The Transformative Power of Analytics - The Houston Astros: a Case Study

In 2013, the Houston Astros finished the season with a 51-111 record, - the worst record in the history of the franchise, having also lost over 100 games in the previous two years.  In 2017, the Astros won 101 games, finished first in the American League West Division, and went on to win their first ever World Series.  How did the Astros go from worst team record to first World Series victory in only four years?

The answer, in a nutshell, is analytics.  In December, 2011 the Astros hired Jeff Luhnow from the St Louis Cardinals as their General Manager.  As VP of scouting and player development in St Louis, Luhnow built a strong analytics department and enjoyed great success as one of the top talent producers in baseball, helping the Cardinals win the 2011 World Series as well as reach the playoffs from 2012 to 2015.  Luhnow then brought his analytics and management skills to Houston and proceeded to transform the team into a top contender in a short few years.

Today, just every major sports team makes extensive use of sports analytics, but none more so than Major League Baseball (MLB) teams.  Baseball has long been a game of statistics, collecting and analyzing vast amounts of data going back to the founding of the MLB in the years following the Civil War. 

Top MLB players are constantly compared not just to other contemporaneous players, but to other top players across the long history of the game, - a history that was very nicely depicted in Baseball, Ken Burns excellent documentary miniseries. Babe Ruth, Willie Mays, Mickey Mantle, Hank Aaron and countless other players are never forgotten in the world of baseball statistics.  For those of us who are fans, - as I am, not surprisingly given my Cuban roots, - baseball’s rich history is a major part of our enjoyment of the game. 

Getting on the AI Learning Curve: A Pragmatic, Incremental Approach

After decades of promise and hype, AI is now seemingly everywhere.  Over the past several years, the necessary ingredients have come together to propel AI beyond the research labs into the marketplace: powerful, inexpensive computer technologies; huge amounts of data; and advanced algorithms including machine learning.

While AI is likely to become one of the most important technologies of our era, we’re still in the early stages of deployment, especially outside leading-edge technology companies.  But, as AI continues its rapid progress, it’s not too early to ask a few important questions: What is AI’s overall value to the economy? What are the biggest application opportunities?; and, what are AI’s most serious challenges and limitations?

To address these questions, McKinsey recently published a discussion paper on the marketplace potential of AI.  The paper is particularly focused on machine learning and related technologies, and is based on a detail analysis of more that 400 use cases across 19 industries and 9 business functions.

“Two-thirds of the opportunities to use AI are in improving the performance of existing analytical use cases,” is the paper’s overriding finding.  This is a very interesting insight.  AI is now being successfully applied to tasks that not long ago were viewed as the exclusive domain of humans, - machine translation, natural language processing, defeating the world’s top Go players, - but only 16% of the use cases studied by McKinsey are greenfield cases, where only machine learning techniques can be used.  For the vast majority of the use cases, 69%, the key value of machine learning is to improve performance beyond that provided by traditional analytic techniques.  And, in the remaining 15% of cases, machine learning provided limited additional performance over existing analytical methods. 

Education, Work and US Leadership in the 21st Century

A few weeks ago, the Council on Foreign Relations (CFR) released The Work Ahead - Machines, Skills, and U.S. Leadership in the Twenty-First Century, a report by a CFR-sponsored Task Force to assess the future of work and its implications for the US economy and national security.  The Task Force was led by Penny Pritzker, - former Secretary of Commerce and founder and chair of PSP Partners, and by John Engler, - former Governor of Michigan and interim President of Michigan State University.

Their comprehensive report, - over 150 pages and 276 citations, - explored in great depth the changing nature of work as global competition and advanced technologies like AI, robotics, and smart IoT devices transform jobs and careers.  It states right up front that “The most important challenge facing the United States - given the seismic forces of innovation, automation, and globalization that are changing the nature of work - is to create better pathways for all Americans to adapt and thrive.  The country’s future as a stable, strong nation willing and able to devote the necessary resources and attention to meeting international challenges depends on rebuilding the links among work, opportunity, and economic security.”

For much of the 20th century, technology and globalization helped lead America to its leadership position in the world stage.  Underpinning this US leadership was the American Dream, - the promise that anyone can get ahead and achieve success and prosperity through talent and hard work.  But this promise has been eroding for decades.  For many of its citizens, the American Dream has been steadily disappearing.

Technology advances have led to massive innovations and efficiencies, enabling companies to get the same work done with significantly fewer people.  At the same time, many US-headquartered companies are truly global, doing business all over the world.  Beyond outsourcing jobs to countries with lower labor costs they’ve been investing and adding jobs where the demand is highest, - which has often been in faster growing emerging markets.

The US thus faces two major challenges: “creating new work opportunities, better career paths, and higher incomes for its people, while developing a workforce that will ensure U.S. competitive success in a global economy that will continue to be reshaped by technology and trade.” 

The Impact of AI on R&D and Innovation

For the past couple of centuries, general-purpose technologies (GPTs) have been the key drivers of productivity and economic growth, - thanks to their rapid improvements in price and performance, pervasive applications, and ability to spur complementary innovations across a wide variety of industries.  The steam engine, electricity and the internal combustion engine are prominent examples of GPTs in the 18th and 19th century.  More recently, semiconductors, computers and the Internet have led to the digital revolution of the past several decades.

Beyond innovations in existing sectors, the rapidly improving price/performance of GPTs have led over time to the creation of whole new applications and industries.  For example, the steady declines in the price of electricity-generated power and the improvement in the efficiency of electric motors led to the radical transformation of manufacturing in the early part of the 20th century with the advent of the assembly line.  It also led to the creation of the consumer appliance industry, e.g., refrigerators, dishwashers, washing machines.  Similarly, as the semiconductor industry took off, it led to the historical transition from the industrial economy of the past two centuries to our ongoing digital economy.

How about artificial intelligence?  Beyond its use by leading edge technology companies, we’re still in the early stages of AI deployment.  It’s only been in the last few years that major advances in machine learning have taken AI from the lab to early adopters in the marketplace.  While considerable innovations and investments are required for its wider deployment, AI is likely to become one of the most important GPTs in the 21st century. 

Harnessing the Collective Intelligence of Humans and Machines

For over a decade, MIT professor Thomas Malone has been conducting pioneering research on the collective intelligence of groups.  Malone is the founding director of the MIT Center for Collective Intelligence, and has authored and co-authored a number of seminal articles on the subject.  A few weeks ago, Malone published Superminds: The Surprising Power of People and Computers Thinking Together, - a book that nicely explains the concept of collective intelligence and how our increasingly capable machines are now complementing the intelligence of groups of people.  The book illustrates these concepts with a wide variety of examples and case studies.

He defines a supermind as “a group of individuals acting in ways that seem intelligent.”  A supermind has measurable properties just as individual do.  It can have a life of its own beyond those of its individuals constituents.  And, as Malone points out, throughout history, groups of people working together as superminds have been responsible for the vast majority of human achievements. 

From Horseless Carriages to Driverless Vehicles

Autonomous vehicles (AVs) may well be the quintessential symbol of our AI/robotics age.  Cars are a major part of our daily lives.  A self-driven car is a concept that requires little explanation, something we can all quickly grasp.  It wasn’t that long ago that the notion on an AV driving us around while we read or sleep would have felt like the stuff of science fiction.  Having experimental AVs coursing through public roads in Silicon Valley, Pittsburgh and Phoenix is concrete evidence that our smart machines are achieving human-like intelligence, raising a number of important questions:  how long before AVs are all around us?; how will they impact our lives?; what unintended consequences might we have to deal with?; and what should be done to ensure that they arrive as safely and smoothly as possible?

These are among the questions addressed in the March 1 issue of The Economist, which includes a comprehensive special report on autonomous vehicles with seven articles on the subject.  The special report starts out with the assumption that whatever technological hurdles lie in their way will be eventually overcome.  But there are wider economic, social and public policy issues to be explored, starting with: what can we learn from the transition to horseless carriages in the 20th century that can now be applied to the transition to driverless cars?

Human-Machine Work Teams

Will there be enough work in the future?  What’s the likely impact of our continuing technology advances on jobs?  How will they impact productivity?  These are all-important questions to reflect on as our increasingly smart technologies are now being applied to activities that not long ago were viewed as the exclusive domain of humans.

While no one really knows the answer to these questions, most studies of the subject have concluded that relatively few occupations, 10% or less, will be entirely automated and disappear over the next 10 - 15 years.  Instead, a growing percentage of occupations will significantly change as technologies automate the more routines tasks within those occupations.  People will still be involved, but their jobs will be transformed by the advanced tools they now have to master.  Moreover, a growing technology-based economy will likely create all kinds of new occupations, which will more than offset declines in occupations displaced by automation, - as has been the case over the past couple of centuries.

One would also expect that technology advances will increase the productivity of the workers involved in these new or transformed occupations.  But, if we look at the past 10-15 for guidance, we’ll find that productivity growth has significantly declined over this timeframe, notwithstanding huge technology advances like smartphones, cloud computing, big data and artificial intelligence.  Economist have proposed competing explanations for the declining productivity growth, but have so far failed to reach consensus.  Understanding this productivity puzzle may well hold the key to future productivity improvements and long-term economic growth.

Human + Machine: The Impact of AI on Business Transformation

Last week I wrote about the impact of blockchain technologies on business transformation.  I now want to turn my attention to the more immediate impact of AI on business, based on Human + Machine: Reimagining Work in the Age of AI, a recently published book by Accenture executives Paul Daugherty and Jim Wilson.

The book reminds us that technology has long been transforming business.  Electricity and standardized processes ushered the first wave of business transformations about 100 years ago.  Manufacturing was decomposed into a set of processes and reassembled into the assembly line, leading to the age of mass production.

Several decades later, IT and process automation brought us the second wave of business transformation.  Mainframes and data processing software enabled the automation of back-office processes in the 1960s and 1970s.  Front-office automation followed in the 1980s with the advent of PCs and client-server systems.  A decade later, advances in networking and ERP software led to  business process reengineering and management. 

“Now, the third wave involves adaptive processes,” write Daugherty and Wilson.  “This third era, which builds on the previous two, will be more dramatic than the earlier revolutions enabled by assembly lines and digital computers, and will usher in entirely new, innovative ways of doing business… This adaptive capability is being driven by real-time data rather than by an a priori sequence of steps.   The paradox is that although these processes are not standardized or routine, they can repeatedly deliver better outcomes.”

The MIT Intelligence Quest

How does human intelligence work, in biological as well as in engineering terms? And how can we use such an understanding of human intelligence to build wiser and more useful machines?  On February 1, MIT launched the Intelligence Quest (MIT IQ), - an initiative aimed at addressing these big questions by advancing the science and engineering of both human and machine intelligence.  MIT IQ aims “to discover the foundations of human intelligence and drive the development of technological tools that can positively influence virtually every aspect of society.”

MIT has been deeply involved in artificial intelligence since the field’s inception in the 1950s.  MIT professors  John McCarthy and Marvin Minsky were among the founders and most prominent leaders of the new discipline.  AI was one of the most exciting areas in computer sciences in the 1960s and 1970s.  Many of the AI leaders in those days were convinced that a machine as intelligent as a human being would be developed within a couple of decades.  They were trying to do so by somehow programming the machines to exhibit intelligent behavior, even though to this day we have little idea what intelligence is about, let alone how to translate intelligence into a set of instructions to be executed by a machine.  Eventually, all these early AI approaches met with disappointment and were abandoned in the 1980s.  After years of unfulfilled promises, a so called AI winter of reduced interest and funding set in that nearly killed the field.

AI was reborn in the 1990s when it adopted a more applied, engineering-oriented paradigm.  The new AI paradigm enabled computers to acquire intelligent capabilities by ingesting and analyzing large amounts of data using powerful computers and sophisticated algorithms.  Instead of trying to explicitly program intelligence, this new approach was based on feeding lots and lots of data to the machine, and then letting the algorithms discover patterns and extract insights from all that data.

Such a data-driven, machine learning approach produced something akin to intelligence or knowledge.  Moreover, unlike the explicit programming-based approaches, the statistical-based ones scaled very nicely.  The more data you had, the more powerful the supercomputers, the more sophisticated the algorithms, the better the results.  Machine learning and related advances like deep learning, have played a major role in AI’s recent achievements. 

A Framework for Building AI Capabilities

After decades of promise and hype, artificial intelligence has finally reached a tipping point of market acceptance.  AI is seemingly everywhere.  Every day we can read about the latest AI advances and applications from startups and  large companies.  AI was the star of the 2018 Consumer Electronic Show earlier this year in Las Vegas.

But, despite its market acceptance, a recent McKinsey report found that AI adoption is still at an early, experimental stage, especially outside the tech sector.  Based on a survey of over 3,000 AI-aware C-level executives across 10 countries and 14 sectors, the report found that 20 percent of respondents had adopted AI at scale in a core part of their business, 40 percent were partial adopters or experimenters, while another 40 percent were still waiting to take their first steps.

The report adds that the gap between the early AI adopters and everyone else is growing.  While many companies have yet to be convinced of AI’s benefits, leading edge firms are charging ahead.  Companies need to start experimenting with AI and get on the learning curve, or they risk falling further behind. 

AI will likely become the most important technology of our era as it’s improved upon over time, but we’re still in the early stages of deployment.  It’s only been in the last few years that complementary innovations, especially machine learning have taken AI from the lab to early marketplace adopters.  And, history shows that even after technologies start crossing over into mainstream markets, it takes considerable time, - often decades, - for the new technologies and business models to be widely embraced by companies and industries across the economy.

Human Beings Need a Story

It wasn’t that long ago that we didn’t have much use for probabilities in our daily life, - outside of weather reports, election predictions, baseball and financial markets.  But that’s all changed with the growing datafication of the economy and society.  Probabilities have been playing an increasing role in our work and personal life given our newfound ability to quantify just about anything.  In all kinds of everyday situations, - from medical diagnoses to financial decisions, -  we now have to accept the fact that it’s impossible to predict what will actually happen.  Instead, we have to get used to living in a complex world of uncertainties and probabilities.  We have to learn how to deal with the very messy world of big data, and how to best apply our learning to make good decisions and predictions.

Physics went through such a transition about 100 years ago.  In the deterministic world of classical mechanics, there’s always a real truth.  The same objects, subject to the same forces, will always yield the same results.  Elegant mathematical models can be used to make perfect predictions within the accuracy of their human-scale measurements.  Early in the 19th century, French mathematician and scientist Pierre-Simon Laplace observed that if we knew the precise state of the universe as represented by the position and speed of every one of its particles, classical mechanics would enable us to calculate all past and future states of the universe.

But, this predictable world began to fall apart in the early 20th century.  19th century classical physics was replaced by a kind of 20th century magical mystery tour, ruled by the new principles of quantum mechanics and relativity.   Classical mechanics could not explain the counter-intuitive and seemingly absurd behavior of energy and matter at atomic and cosmological scales.

At these scales, the world is intrinsically unpredictable.  Instead of a deterministic world, we now have a world based on probabilities.  You cannot predict all the future states of an electron, for example, based on its present state.  You can map out its behavior, but only as probability distributions of all the possible states it could be at.  Moreover, the Heisenberg uncertainty principle tells you that it’s impossible to know the exact state of a particle.  You cannot simultaneously determine its exact position and velocity with any great degree of accuracy no matter how good your measurement tools are.

The Impact of Automation on Everyday Life

This past October, the Pew Research Center released Automation in Everyday Life, a report on what Americans think about advanced technologies like artificial intelligence and robotics, and the impact they expect them to have on their everyday lives.  The report is based on a national survey of 4,135 randomly selected American adults.  To help gauge their opinion on such complex topics, the survey questions were framed around four specific scenarios related to these advanced technologies: driverless cars, workplace automation, robot caregivers, and computer algorithms that evaluate and hire job applicants.

“Americans anticipate significant impacts from various automation technologies in the course of their lifetime,” noted the report.  “Although they expect certain positive outcomes from these developments, their attitudes more frequently reflect worry and concern over the implications of these technologies for society as a whole.”

Let me discuss some of the report’s key findings.

AI and the Productivity Paradox

AI is being successfully applied to tasks that not long ago were viewed as the exclusive domain of humans, matching or surpassing human level performance in more and more domains.  But, at the same time, productivity growth has significantly declined over the past decade, and income has continued to stagnate for the majority of Americans.  This puzzling contradiction is addressed in Artificial Intelligences and the Modern Productivity Paradox, a working paper recently published  by the National Bureau of Economic Research (NBER).

The paper’s authors, - MIT professor Erik Brynjolfsson, MIT PhD candidate Daniel Rock, and University of Chicago professor Chad Syverson, - note that “aggregate labor productivity growth in the U.S. averaged only 1.3% per year from 2005 to 2016, less than half of the 2.8% annual growth rate sustained from 1995 to 2004…  What’s more, real median income has stagnated since the late 1990s and non-economic measures of well-being, like life expectancy, have fallen for some groups.”

This productivity puzzle isn’t confined to AI.  “Few topics in economics today in most large economies generate as much debate as the productivity puzzle,” said McKinsey in a March, 2017 report.  “In  the United States, productivity growth has declined sharply since 2004 yet digital technology has been widely apparent during this period…  The answer to this puzzle holds the key to future prosperity because now more than ever our economy depends on productivity improvements for long-term economic growth.  Economists have proposed competing explanations for declining productivity growth and so far have failed to reach a consensus.” 

AI and The Future of Work

Last month I attended AI and the Future of Work, a conference hosted by MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) and its Initiative on the Digital Economy (IDE).  The two-day agenda included over 20 keynotes and panels on AI-related topics, and around 60 speakers and panelists from academia and business.

New technologies have been replacing workers and transforming economies over the past two centuries.  But, over time, these same technologies led to the creation of whole new industries and new jobs.  While the technologies of the industrial economy helped to make up for our physical limitations, the technologies of the digital economy are now enhancing our cognitive capabilities.  They’re being increasingly applied to activities that not long ago were viewed as the exclusive domain of humans.  Will the AI revolution play out like past technology revolutions, - short term disruptions followed by long-term benefits, - or will this time be different?

Conference participants generally agreed that AI will have a major impact on jobs and the very nature of work.  But, for the most part, they viewed AI as mostly augmenting rather than replacing human capabilities, automating the more routine parts of a job and increasing the productivity and quality of workers, so they can focus on those aspect of the job that most require human attention.  Overall, a small percentage of jobs will be fully automated, while many more will be significantly transformed.

Conference participants also generally agreed that the more advanced AI-based transformations will not happen rapidly, but are likely decades away.  Much progress has been recently made in the ability to extract features from all the data we now have access to, as well as in machine learning algorithms that give computers the ability to learn by ingesting large amounts of data instead of being explicitly programmed.  While such statistical pattern recognition approaches can be applied to many tasks, they’re no substitute for model formation, the main approach used by humans, - from toddlers to physicists, - to understand how the world works.  We’re a long way from the development of AIs that truly learn and reason like people. 

Human-AI Decision Systems

I recently read The Human Strategy, a very interesting article on Human-AI decision systems by MIT Media Lab professor Sandy Pentland.  Pentland is the faculty director of MIT Connection Science, - with which I’m associated as a Fellow, - as well as director of the Human Dynamics Lab.  In 2014 he published Social Physics: How Social Networks Can Make Us Smarter.

“Perhaps the most critical function of any organization or society is its decision systems,” wrote Pentland.  “In modern societies, decision systems provide a leader the ability to make informed and timely decisions, supported by a complex enterprise of distributed information and communication systems that provide situational awareness.  Traditionally, decision systems have been confined to individual physical domains, such as logistics, physical plant, and human resources, and more recently virtual domains such as cyber, by both policy and technology, resulting in challenges with the integration of information across disparate domains.”

But, despite the increasingly complex decisions that organizations are called upon to make, decision-making remains human-intensive and anecdotal.  Few organizations have applied social network analysis to help them scale the size and expertise of the decision-making group.  Nor have they integrated the large amounts of data, analytical tools and powerful AI systems now at our disposal into their decision making systems. 

Where is Technology Taking the Economy

I recently read Where is Technology Taking the Economy?, an article in McKinsey Quarterly by W. Brian Arthur, - External Professor at the Santa Fe Institute , Visiting Researcher at PARC, and former faculty member at Stanford University.

According to Arthur, the digital revolution has morphed through three distinct eras over the past several decades.  The first era, in the 1970s and 1980s, brought us Moore’s law and the dramatic advances in semiconductor technologies.  From mainframe and supercomputers to PCs and workstation, IT was now being used in a wide variety of applications, from financial services and oil exploration, to computer-aided design and office systems.  “The economy for the first time had serious computational assistance.”

Then came the second era in the 1990s and 2000s, which enabled us to link computers together, share information, and connect digital processes.  “Everything suddenly was in conversation with everything else,” giving rise to “the virtual economy of interconnected machines, software, and processes…, where physical actions now could be executed digitally.”

We’re now in the third era, which began roughly in the 2010s.  It’s brought us smartphones, ubiquitous sensors, IoT devices and oceans and oceans of data.  Powerful computers and intelligent algorithms are enabling us to make sense of all that data by searching for patterns and doing  something with the results, including computer vision, natural-language processing, language translation, face recognition and digital assistants.

The Top Ten Emerging Technologies of 2017

Earlier this year, Scientific American, in collaboration with the World Economic Forum, published a special report on The Top Ten Emerging Technologies of 2017.  These technologies, - selected by a global panel of experts, - “are expected to become increasingly commonplace in the next few years,” and are “attracting increased funding or showing other signs of being ready to move to the next level.”

Here are the 10 technologies comprising the 2017 list, along with the reasons cited in the report for their selection:

Blockchain and the Future of the Firm

Last week I wrote about Machine, Platform, Crowd: Harnessing Our Digital Future, a recently published book by MIT’s Andy McAfee and Erik Brynjolfsson.  The book is organized into three main sections: Mind and Machine, Product and Platform, and Core and Crowd, each based on  a business trend that’s significantly reshaping the business world.  I based my discussion on the Mind and Machine section, which I found to be an excellent explanation of recent advances in artificial intelligence.

I now want to focus my attention on the provocative questions raised in the book’s latter chapters.  “In this era of powerful new technologies, do we still need companies?”  How are firms likely to evolve given the continuing advances of Internet-based technologies, as well as emerging blockchain-based technologies such as distributed ledgers and smart contracts?  “Are companies passé” in an increasingly decentralized economy?

Following the Great Depression and WW2, the country welcomed the stability promised by corporate capitalism.  Big, multinational companies dominated most industries, - GM, Ford and Chrysler in cars, Citibank, American Express and Morgan Stanley in finance, and Esso/Exxon, Mobil and Texaco in oil and gas.  It was an era characterized by bureaucratic corporate cultures, - not unlike military hierarchies - focused on organizational power and orderly prosperity.

This all started to change a few decades later with the advent of a more innovative, fast moving entrepreneurial economy.  The 1980s saw the rise of young, high-tech companies, - e.g., Microsoft, Apple, Oracle, Sun Microsystems, - and Silicon Valley became the global hub for innovation, emulated by regions around the world.  Turtlenecks and jeans replaced blue suits, white shirts, and ties.

The advent of the Internet and e-commerce pushed all these trends into hyperdrive in the 1990s.  The Internet made it much easier for companies to transact with each other around the world.  Vertically integrated firms evolved into virtual enterprises, increasingly relying on supply chain partners for many of the functions once done in-house.  Management experts noted that large firms were no longer necessary and would in fact be at a disadvantage in the Internet era when competing against agile, innovative smaller companies.

Minds and Machines

A few months ago, Andy McAfee and Erik Brynjolfsson published Machine, Platform, Crowd: Harnessing Our Digital Future, - their third book on the impact of the 21st century digital revolution on the economy and society, - following the publication of The Second Machine Age in 2014 and Race Against the Machine in 2011.  Brynjolfsson and McAfee are professor and research scientist respectively at MIT’s Sloan School of Management, as well as co-Directors of MIT’s Initiative on the Digital Economy.

The book is organized into three sections, each focused on a major trend that’s reshaping the business world: the rapidly expanding capabilities of machines; the emergence of large, asset-light platform companies; and the ability to now leverage the knowledge, expertise and enthusiasm of the crowd.  These three trends are combining into a triple revolution, causing companies to rethink the balance between minds and machines; between products and platforms ; and between the core and the crowd.

I cannot possible do justice to all three trends in one blog, so let me summarize the key themes of the Mind and Machine section, which I found to be an excellent explanation of the current state of AI.

Artificial Intelligence is Ready for Business; Are Businesses Ready for AI?

AI is now seemingly everywhere.  In the past few years, the necessary ingredients have come together to propel AI beyond the research labs into the marketplace: powerful, inexpensive computer technologies; advanced algorithms and models; and most important, oceans and oceans of data.

“Artificial intelligence is getting ready for business, but are businesses ready for AI?,” asks McKinsey in a recently published report - Artificial Intelligence: the Next Digital Frontier.  “AI adoption outside of the tech sector is at an early, often experimental stage,” is the report’s succinct answer.  “Few firms have deployed it at scale.”

The report is based on a survey of over 3,000 AI-aware C-level executives across 10 countries and 14 sectors.  Only 20 percent of respondents had adopted AI at scale in a core part of their business.  40 percent were partial adopters or experimenters, while another 40 percent were essentially contemplators.

AI encompasses a broad rage of technologies and application.  It’s often viewed as the leading edge of IT.  As soon as AI is successfully applied to a problem, the problem is no longer a part of AI.  The McKinsey report is focused on five technologies being increasingly deployed in business, that most everyone agrees are part of AI: robotics and autonomous vehicles, computer vision, language, virtual agents, and machine learning.

Automation Anxieties - We’ve Been Here Before

“The rise of artificial intelligence is the great story of our time,” notes What to Do When Machines Do Everything in its Preface.  The book was published earlier this year by Malcolm Frank, Paul Roehrig and Ben Bring of Cognizant’s Center for the Future of Work.  “Artificial intelligence has left the laboratory (and the movie lot)…  It’s pervading all the institutions that drive our global economy.… And this is just the beginning.”

The book deals with a number of important questions: When machines do everything, what am I going to do?; Will a robot take my job away?; How are humans going to make a living?; What will my industry look like in 10 years?; Will my children be better off than I am?

Overall, the authors are optimistic about the future, reminding us that we’ve been here before.  Automation anxieties have been with us ever since the 1810s, when the so-called Luddites smashed the new weaving machines that were threatening their textile jobs, and they continued to resurface over the past two centuries right along with advances in technology.

Over 60 years ago, the advent of computers led to a new round of automation fears.  In 1965, Newsweek devoted a special issue to The Challenge of Automation, which it called  “the most controversial economic concept of the age.  Businessmen love it.  Workers fear it.  The government frets and investigates and wonders what to do about it.

In his 1964 Bill creating the National Commission on Technology, Automation and Economic Progress, President Lyndon Johnson said that “Technology is creating both new opportunities and new obligations for us, opportunity for greater productivity and progress - obligation to be sure that no workingman, no family must pay an unjust price for progress.”

Robocalypse Now? Technology, Productivity and Employment

Is the Robocalypse upon us?, asked MIT economist David Autor in his presentation at a recent Forum of European central bankers.  His presentation was based on a paper co-written with Utrecht University economist Anna Salomons.  “Is productivity growth inimical to employment?,” they asked in the paper’s abstract.  “Canonical economic theory says no, but much recent economic theory says maybe  - that is, rapid advances in machine capabilities may curtail aggregate labor demand as technology increasingly encroaches on human job tasks.”

Fears that machines will put humans out of work are not new.  Throughout the Industrial Revolution there were periodic panics about the impact of automation on jobs, going back to the Luddites, - textile workers who in the 1810s smashed the new machines that were threatening their jobs.  But, “In the end, the fears of the Luddites that machinery would impoverish workers were not realized, and the main reason is well understood,” noted a 2015 article on the history of technological anxiety.

“The mechanization of the early 19th century could only replace a limited number of human activities.  At the same time, technological change increased the demand for other types of labor that were complementary to the capital goods embodied in the new technologies.  This increased demand for labor included such obvious jobs as mechanics to fix the new machines, but it extended to jobs for supervisors to oversee the new factory system and accountants to manage enterprises operating on an unprecedented scale.  More importantly, technological progress also took the form of product innovation, and thus created entirely new sectors for the economy, a development that was essentially missed in the discussions of economists of this time.”

Automation fears have understandbly accelerated in recent years, as our increasingly smart machines are now being applied to activities requiring intelligence and cognitive capabilities that not long ago were viewed as the exclusive domain of humans. “Previous technological innovation has always delivered more long-run employment, not less.  But things can change,” said a 2014 Economist article.  “Nowadays, the majority of economists confidently wave such worries away…  Yet some now fear that a new era of automation enabled by ever more powerful and capable computers could work out differently.”

Serious AI Challenges that Require Our Attention

Several weeks ago Vanity Fair published and article by NY Times columnist Maureen Dowd, - Elon Musk’s Billion-Dollar Crusade to Stop the AI Apocalypse.  “Elon Musk is famous for his futuristic gambles, but Silicon Valley’s latest rush to embrace artificial intelligence scares him,” noted Dowd.  “And he thinks you should be frightened too.”

Entrepreneur and inventor Elon Musk is one of a number of world-renowned technologists and scientists who have expressed serious concerns that AI might be an existential threat to humanity, a group that includes Stephen Hawking, Ray Kurzweil and Bill Gates.  But, the vast majority of AI experts do not share their fears.  A few months ago, Stanford University’s One Hundred Year Study of AI project published a report by a panel of experts assessing the current state of AI.  Their overriding finding was that:

“Contrary to the more fantastic predictions for AI in the popular press, the Study Panel found no cause for concern that AI is an imminent threat to humankind.  No machines with self-sustaining long-term goals and intent have been developed, nor are they likely to be developed in the near future.  Instead, increasingly useful applications of AI, with potentially profound positive impacts on our society and economy are likely to emerge between now and 2030, the period this report considers.  At the same time, many of these developments will spur disruptions in how human labor is augmented or replaced by AI, creating new challenges for the economy and society more broadly.”

Just because experts conclude that, - at least for the foreseeable future, - AI does not pose an imminent threat to humanity, doesn’t mean that such a powerful technology isn’t accompanied by serious challenges that require our attention.

Become a More Productive, Empathetic, Creative Person With the Help of AI-Based Tools

Despite dramatic advances in technology, most of the world’s economies have been stuck in a long period of slow growth and slow productivity.  This is one of the most serious challenges in our 21st century economy.  Opinions abound, but there’s little consensus on its causes, and, nobody seems to know what to do about it, or how long it will likely last, - years or decades. 

In a recent article in the MIT Sloan Management Review, MIT Research Fellow Michael Schrage proposed a provocative and counterintuitive approach for enhancing innovation and productivity through man-machine collaborations.  Schrage’s approach has been more influenced by behavioral economics than by technology or algorithmic advances.  Instead of just asking how can people create more valuable innovation?, why not also ask How can innovation create more valuable people?  Don’t just leverage advanced technologies, - e.g., bots, software agents, and digital assistants, - to automate away a large portion of the workforce, but also focus on enhancing innovation and productivity by leveraging technology to create higher-performance versions of employees.

“Designing and training smarter algorithms may be cheaper and easier than retraining smart people,” wrote Schrage.  “Advocates of autonomous systems and machine learning typically innovate to minimize or marginalize human involvement in business processes.  For them, people are part of the problem, not the solution.  Organizations that take productivity seriously, however, understand that false dichotomies make poor investments: Smarter machines can - and should - be keys to unlocking greater returns from human capital.”

The Emerging Data Economy

The Economist’s May 6 issue referred to data in its cover as the world’s most valuable resource.  Its lead article, - Data is giving rise to a new economy, - called it the fuel of the future.  “Data are to this century what oil was to the last one: a driver of growth and change.”  Both oil refineries and data centers fulfill similar roles: “producing crucial feedstocks for the world economy.”  Much of modern life would not exist without the cars, plastics and drugs made possible by oil refineries.  Similarly, data centers “power all kinds of online services and, increasingly, the real world as devices become more and more connected.”

Data has been closely intertwined with our digital technology revolution since the early days of the IT industry.  Data processing was the term then used to describe the applications of IT to automate highly structured business processes, e.g., financial transactions, inventory management, airline reservations.  Over time, increasingly sophisticated applications were developed to better manage key business operations along with their associated data, including enterprise resource planning, customer relationship management and human resources.  Beyond their use in operations, the information generated by these various applications was collected in data warehouses, and a variety of business intelligence tools were used to analyze the data and generate management reports.

These commercial applications dealt mostly with structured information in those early years of computing.  But at the same time, the scientific community was developing tools for managing, analyzing and visualizing the high volumes of much more unstructured data generated by their  experiments and observations.  Physicists, astronomers, biologists, and other scientists and engineers were developing methodologies and architectures for dealing with very large volumes of unstructured data, as well as analytical techniques, like data mining, for discovering patterns and extracting insights from all that data.

Then came the explosive growth of the Internet in the mid-1990s.  Ever since, digital technologies have been permeating just about every nook and cranny of the economy, society and our personal lives.  Data is now being generated by just about everything and everybody around us, including the growing volume of online and offline transactions, web searches, social media interactions, billions of smart mobile devices and 10s of billions of smart IoT sensors.

Not Your Grandfather’s Manufacturing

The February 23 issue of the NY Times Magazine was devoted to the future of work, and in particular, to what it called the new working class.  The Oxford Dictionary defines working class as “The social group consisting of people who are employed for wages, especially in manual or industrial work.”  The working class includes many traditional blue-collar occupations, - factory workers, truck drivers, electricians, plumbers, - but it also now includes an increasing number of white-collar and service jobs.

While the new working class comprises a variety of jobs, most discussions on the topic are generally centered on the deindustrialization of America over the past few decades, as well as on the ensuing decline in both the number and the wages of manufacturing jobs.  “Now when politicians invoke the working class, they are likely to gesture, anachronistically, to an abandoned factory,” notes the issue’s introductory article.

The ongoing transformation of manufacturing jobs was the subject of Learning to Love Our Robot Co-Workers by Kim Tingley.  Her article nicely explained the major changes taking place in US manufacturing, especially the appearance of a new generation of flexible, programmable, moderately priced robots that are designed to safely collaborate with humans, - each doing what they do best.

Robotics is an exciting, fast moving discipline, which is playing an increasingly important role in the future of manufacturing.  All computers are defined by what their brains, - that is, their hardware and software, - are capable of computing and controlling.  Robots are computers that have both a brain and a body.  A robot’s capabilities are defined by what its brains and body can jointly do.

The Simple, Economic Value of Artificial Intelligence

I recently attended a very interesting talk , - Exploring the Impact of Artificial Intelligence: Prediction versus Judgment, - by University of Toronto professor Avi Goldfarb.  The talk was based on recent research conducted with his UoT colleagues Ajay Agrawal  and Joshua Gans.  In addition to an in-depth paper aimed at a research audience, they’ve explained their work in two more general interest articles, one in the Harvard Business Review and the second in the MIT Sloan Management Review.

In their opinion, “the best way to assess the impact of radical technological change is to ask a fundamental question: How does the technology reduce costs?  Only then can we really figure out how things might change.”  For example, the semiconductor revolution can be viewed as being all about the dramatic reductions in the cost of arithmetic calculations.  Before the advent of computers, arithmetic was done by humans with the aid of various kinds of devices, from the abacus to mechanical and electronic calculators.

Then came digital computers, which are essentially powerful calculators whose cost of arithmetic operations has precipitously decreased over the past several decades thanks to Moore’s Law.  Over the years, we’ve learned to define all kinds of tasks in terms of such digital operations, e.g., inventory management, financial transactions, word processing, photography.  Similarly, the economic value of the Internet revolution can be described as reducing the cost of communications and of search, thus enabling us to easily find and access all kinds of information, - including documents, pictures, music and videos.

How does this framing now apply to our emerging AI revolution?  After decades of promise and hype, AI seems to have finally arrived, - driven by the explosive growth of big data,  inexpensive computing power and storage, and advanced algorithms like machine learning that enable us to analyze and extract insights from all that data.  Agrawal, Fans and Goldfarb provide an elegant answer to this question in their HBR article.  “Machine intelligence is, in its essence, a prediction technology, so the economic shift will center around a drop in the cost of prediction.”

Automation and Employment in the 21st Century

Ever since the advent of industrialization over 200 years ago, there’ve been periodic fears about the impact of technology-based automation on jobs.  In the 1810s, for example, the so-called Luddites smashed the new machines that were threatening their textile jobs.  But each time those fears arose in the past, technology advances ended up creating more jobs than they destroyed.

Automation anxieties have understandably accelerated in recent years, as AI-related innovations, including robots and smart machines of all kinds, are now being applied to activities requiring intelligence and cognitive capabilities that not long ago were viewed as the exclusive domain of humans.  The concerns surrounding AI’s long term impact on jobs may well be in a class by themselves.

There’s a broad consensus that AI will have a major impact on jobs and the very nature of work, but it’s much less clear what that impact will be.  Will AI play out like past technology innovations, - highly disruptive in the near term, but ultimately leading to the creation of new jobs, whole new industries, and a rising standard of living?  Or will this time be different, as AI-based innovations end up replacing a large portion of the workforce, - leading to mass unemployment, economic dislocations and social unrest?

Machine Learning and Knowledge Discovery

After decades of promise and hype, artificial intelligence is finally achieving an inflection point of market success.  It’s now seemingly everywhere   In the past few years, the necessary ingredients have come together to propel AI forward beyond the research labs into the marketplace: huge amounts of data; powerful, inexpensive computer technologies; and the advanced algorithms needed to analyze and extract insights from those oceans of data.  This is evidenced by the number of companies embracing AI as a key part of their strategies, the innovative, smart products and services they’re increasingly bringing to market, and the volume of articles being written on the subject.

I’d like to discuss a couple of such articles I recently read, one on the major advances recently achieved in machine learning, and the other explaining the differences between machine learning and knowledge discovery.  

This past December, the NY Times Magazine published a very interesting article, The Great AI Awakening by Gideon Lewis-Kraus.  The article told the story about Google’s adoption of an AI first strategy, and in particular, its use of deep machine learning to dramatically improve Google Translate, one of its more popular online services.  In addition, the article nicely explains the technologies developed by the Google Brain research project to achieve its breakthrough improvements.

The Fourth Industrial Revolution - Risks and Benefits

The Fourth Industrial Revolution (4IR) was the central theme of the 2016 World Economic Forum (WEF) that took place a year ago in Davos, Switzerland.  It continued to play a prominent role in the recently concluded 2017 annual meeting.   Coming to grips with the impact of the fourth industrial revolution was among the top leadership priorities discussed at this year’s meeting.

Over the past year, Klaus Schwab, - WEF founder and executive chairman, - has described his vision for the fourth industrial revolution in a number of articles as well as a book on the subject.  Dr. Schwab positions the 4IR within the historical context of three previous industrial revolutions.  The First, - starting in the last third of the 18th century, - introduced new tools and manufacturing processes based on steam and water power.  The Second, - a century later, - saw the advent of steel, oil, electricity, mass production and associated inventions including the telephone, light bulbs phonographs and cars.  The Third, - starting in the middle of the last century, - has brought us digital technologies, computers, the IT industry, and the automation of processes in just about all industries.

The 4IR builds on our ongoing digital revolution.  It “entails nothing less than a transformation of humankind,” wrote Dr. Schwab in his book’s introduction  “We are at the beginning of a revolution that is fundamentally changing the way we live, work, and relate to one another.  In its scale, scope and complexity, what I consider to be the fourth industrial revolution is unlike anything humankind has experienced before…”

“Consider the unlimited possibilities of having billions of people connected by mobile devices, giving rise to unprecedented processing power, storage capabilities and knowledge access.  Or think about the staggering confluence of emerging technology breakthroughs, covering wide-ranging fields such as artificial intelligence (AI), robotics, the internet of things (IoT), autonomous vehicles, 3D printing, nanotechnology, biotechnology, materials science, energy storage and quantum computing, to name a few.  Many of these innovations are in their infancy, but they are already reaching an inflection point in their development as they build on and amplify each other in a fusion of technologies across the physical, digital and biological worlds.”

The Emerging, Unpredictable Age of AI

In a 1930 essay, Economic Possibilities for our Grandchildren, English economist John Maynard Keynes wrote about the onset of “a new disease” which he called technological unemployment, that is “unemployment due to our discovery of means of economising the use of labour outrunning the pace at which we can find new uses for labour.”

“But this is only a temporary phase of maladjustment,” he added.  “I would predict that the standard of life in progressive countries one hundred years hence will be between four and eight times as high as it is.”  Keynes believed that technological progress would lead us to a brighter future.  By 2030, people would likely work no more than 15 hours a week, and their biggest problem would be how to use their leisure and freedom from economic cares.

I was reminded of Keynes’ predictions while reading a number of recent articles on our emerging age of AI.  After decades of unfulfilled promises and hype, AI seems to be reaching a tipping point.  The necessary ingredients are finally coming together: lots and lots of data, with the volume of data pouring in expected to double every three years or so; advanced machine learning algorithms that extract insights and learn from all that data; drastically lowered technology costs for collecting, storing and analyzing these oceans of information; and access to an increasing variety of data-driven, cloud-based AI applications.

A small, but prominent group of technologists and scientists have warned that at some future time, a superintelligent AI might pose an existential threat to humanity.  But while dismissing such dire concerns, most experts worry that the real threat is that AI advances could lead to widespread economic dislocation and social unrest.  “Contrary to the more fantastic predictions for AI in the popular press, the Study Panel found no cause for concern that AI is an imminent threat to humankind…” was the conclusion of a recent study by AI experts.  “At the same time, many of these developments will spur disruptions in how human labor is augmented or replaced by AI, creating new challenges for the economy and society more broadly.”

The Competitive Value of Data: From Analytics to Machine Learning

A recent article by NY Times reporter Steve Lohr discussed the rising importance of data as a major competitive differentiator.  The article noted that regulators, policy makers and academics in Europe and the US are increasingly concerned that the vast data assets of digital giants could become a competitive barrier to startups and innovation.

Such competitive concerns have long applied to hardware and software platforms in the IT industry.  IBM’s System 360 family of mainframes, announced in 1964, became the premier platform for commercial computing over the following 25 years by developing a 3rd party ecosystem of add-on hardware, software and services.  In 1969, the US Department of Justice launched an antitrust suit against IBM based on its market dominance, which was eventually dropped in 1982 given the changing environment in the IT industry.

In the 1980s and 1990s, the explosive growth of personal computers was largely driven by the Wintel platform based on Microsoft’s Windows operating systems and Intel’s microprocessors, which attracted an even  larger ecosystem of hardware and software developers.  It also attracted the attention of the Justice Department and several states, which sued Microsoft in the 1990s, - a lawsuit that was eventually settled.  More recently, the European Commission has accused Google of unfair competition based on its Android mobile operating system.

The competitive concerns surrounding these various platforms are closely linked to the concept of network effects.  Scale significantly increases a platform’s value.  The more 3rd party applications and services a platform offers, the more users it will attract, helping it then attract more offerings, which in turn brings in more users, which then makes the platform even more valuable… and on and on and on.

AI and Public Policy

Two years ago, Stanford University launched the One Hundred Year Study of AI (AI100), “to study and anticipate how the effects of artificial intelligence will ripple through every aspect of how people work, live and play.”  One of its key missions is to convene a Study Panel of experts every five years to assess the then current state of the field, as well as to explore both the technical advances and societal challenges over the next 10 to 15 years. 

The first such Study Panel recently published Artificial Intelligence and Life in 2030, a report that examined the likely impact of AI on a typical North American city by the year 2030.  The report is organized into three main sections: Section I described the key research trends influencing AI’s future; Section II examined the key economic sectors that are most likely to be impacted by AI;  and Section III looked into issues surrounding AI and public policy.  Over the past several weeks I’ve discussed the first and second sections.  I now would like to turn my attention to Section III: Prospects and Recommendations for AI Public Policy.

“Throughout history, humans have both shaped and adapted to new technologies.  This report anticipates that advances in AI technologies will be developed and fielded gradually - not in sudden, unexpected jumps in the techniques themselves - and will build on what exists today, making this adaptation easier… The measure of success for AI applications is the value they create for human lives.  Going forward, the ease with which people use and adapt to AI applications will likewise largely determine their success.”

The report then adds some very important warnings.  “Conversely, since AI applications are susceptible to errors and failures, a mark of their success will be how users perceive and tolerate their shortcomings.  As AI becomes increasingly embedded in daily lives and used for more critical tasks, system mistakes may lead to backlash from users and negatively affect their trust.”

AI, Automation and the US Economy

On December 20, the White House released Artificial Intelligence, Automation, and the Economy, a new report that investigates how AI will likely transform job markets over time, and recommends policy responses to address AI’s impact on the US economy.  This report is further evidence that AI is now reaching the kind of market impact that requires well thought out strategies by both business and government.

AI research has been around since the early days of IT, - having gone through ups and downs over the past several decades.  But it’s recent advances based on machine learning and related data-driven technologies are still relatively new, making it hard to predict where AI will be heading over time.

Harder still is predicting AI’s longer term economic and societal impact.  Think of anticipating the impact of the emerging Internet revolution back in the mid 1990s, before the advent of e-commerce and social media, let alone smartphones, IoT and cloud computing in the 2000s.  That’s roughly where we are with AI today.

But, there’s one big difference.  The Internet generated a fair degree of hype, especially in the dot-com era of the late 1990s, but the overriding feelings were ones of hope and excitement.  Not so with AI.  Along with admiration for its considerable accomplishments, - from assisting in the treatment of rare forms of cancer to self-driving cars, - there are serious fears that AI advances will lead to massive job losses, economic dislocations and social unrest.

Becoming a Data-Driven Business: Challenges and Opportunities

A few weeks ago, McKinsey published The age of analytics: Competing in a data-driven world, a comprehensive report on the state of big data, and in particular, on the challenges and opportunities a company faces as it strives to become a data-driven business.

Big data,- including analytics, data science, artificial intelligence and related information-based technologies - are now everywhere.  “Is big data all hype?,” asks McKinsey in the report’s introduction.  “To the contrary: earlier research may have given only a partial view of the ultimate impact… the range of applications and opportunities has grown and will continue to expand.  Given rapid technological advances, the question for companies now is how to integrate new capabilities into their operations and strategies - and position themselves in a world where analytics can upend entire industries.”

It’s very hard to anticipate the consequences of disruptive innovations.  Even harder is predicting when the impact will be felt across the economy and society.  It’s often been said that truly transformative innovations are overhyped in the short term but under-hyped in the long term.  Think of electricity and automobiles, the Internet more recently and now big data.

The Transformative Power of Cloud Computing

I was recently involved in two different meetings, each convened by an IT research organization focused on providing strategic advice to CIOs.  My participation in each of the CIO  meetings was in the form of a fireside chat with a senior analyst of the organization.  Given that I’ve closely followed cloud computing over the years, the state of cloud was one of the main topics we discussed.

For a while now I’ve thought of cloud as a new model of computing in the IT world.  For the IT industry, a new computing model is a very big deal.  In the sixty years or so since there’s been an IT industry, this would be only the third such model, centralized and client-server computing being the two previous ones.  Mainframes and PCs were the defining technologies of the centralized model and client-server models respectively.

The Internet is the defining technology of the cloud computing model.  There are clearly other major technologies around us, - e.g., smartphones, IoT, analytics, AI, - but when you think about it, all of them rely on their connections to cloud-based data, applications, and services for much of their functionality.

Cloud computing has gone through three major stages over the past decade: IT-as-a-service in its initial years, then application innovation in it’s next stage, and it’s now just entering the business transformation stage.  Let me say a few words about the first two before turning to business transformation.

How Will AI Likely Impact How We Work, Live and Play?

A few weeks ago I discussed whether AI is finally reaching a tipping point, mostly based on a recently published report, - Artificial Intelligence and Life in 2030.  The report was developed by a study panel of AI experts convened by the One Hundred Year Study of AI (AI100), an initiative launched at Stanford University in December, 2014 “to study and anticipate how the effects of artificial intelligence will ripple through every aspect of how people work, live and play.”  To better understand the future impact of AI on everyday lives, the panel focused the study on the likely influence of AI on a typical North American city by the year 2030.

The report is organized into three main sections.  Section I, - What is Artificial Intelligence?, - describes how researchers and practitioners define AI, as well as the key research trends that will likely influence AI’s future.  Section II looks into AI’s overall impact on various sectors of the economy, while the third Section, examines AI issues related to public policy.

My previous discussion was primarily focused on Section I.  I’d now like to turn my attention to Section II, - AI by Domain.  To help analyze where AI might be heading, the study panel narrowed its explorations to the eight domains most likely to be impacted by AI:

Digital Twin: Bringing the Physical and Digital Worlds Closer Together

A few weeks ago I first learned about a relatively new concept - Digital Twin.  A Digital Twin is essentially a computerized companion to a real-world entity, be it an industrial physical asset like a jet engine, an individual’s health profile, or a highly complex system like a city.  It’s a highly realistic, one-to-one digital model of each such specific physical entity.

Digital Twin helps bring the physical and digital worlds closer to each other.  It’s intertwined with and complementary to the Internet of Things (IoT).  The huge amounts of data now collected by IoT sensors on physical objects, personal devices and smart systems make it possible to represent their near real-time status in their Digital Twin alter-ego.

“The myriad possibilities that arise from the ability to monitor and control things in the physical world electronically have inspired a surge of innovation and enthusiasm,” said a 2015 McKinsey report on the Internet of Things.  Experts estimate that the number of connected things or devices will reach 50 billion by 2020, growing to 100s of billions in the decades ahead.  The economic potential of the smart solutions this makes possible is enormous, possibly reaching several trillion dollars within a decade.

Has AI (Finally) Reached a Tipping Point?

After many years of promise and hype, AI seems to be finally reaching a tipping point of market acceptance.  “Artificial intelligence is suddenly everywhere… it is proliferating like mad.”  So starts a Vanity Fair article published around two years ago by author and radio host Kurt Andersen.  And, this past June, a panel of global experts convened by the World Economic Forum (WEF) named Artificial Intelligence, - Open AI Ecosystems in particular - as one of its Top Ten Emerging Technologies for 2016 because of its potential to fundamentally change the way markets, business and governments work.  

AI is now being applied to activities that not long ago were viewed as the exclusive domain of humans.  “We’re now accustomed to having conversations with computers: to refill a prescription, make a cable-TV-service appointment, cancel an airline reservation - or, when driving, to silently obey the instructions of the voice from the G.P.S,” wrote Andersen.  The WEF report noted that “over the past several years, several pieces of emerging technology have linked together in ways that make it easier to build far more powerful, human-like digital assistants.”

What will life be like in such an AI-based society?  What impact is it likely to have on jobs, companies and industries?  How might it change our everyday lives?

These questions were addressed in Artificial Intelligence and Life in 2030, a report that was recently published by Stanford University’s One Hundred Year Study of AI (AI100).  AI100 was launched in December, 2014 “to study and anticipate how the effects of artificial intelligence will ripple through every aspect of how people work, live and play.”  The core activity of AI100 is to convene a Study Panel every five years to assess the then current state of the field, review AI’s progress in the years preceding the report, and explore the potential advances that lie ahead as well the technical and societal challenges and opportunities these advances might raise.