Irving Wladawsky-Berger

Regulation by Design: Embedding Regulatory Objectives into the Design of AI Systems

In its early decades, IT helped companies become significantly more productive by automating many of their processes, reengineering their overall operations, and reaching out beyond the boundaries of the enterprise. But, their actual products were largely unaffected. This has all been changing in the 21st century with the rise of the Internet of Things (IoT), Big Data, and Artificial Intelligence, whose combined impact is driving a new era of smart connected products.

As the world’s digital and physical infrastructures converge, digital technologies are designed right into complex products, — e.g., jet engines, power generators, medical equipment, energy pipelines. Massive amounts of usage data can now be gathered over the internet, stored and analyzed by sophisticated applications to help monitor the product and anticipate potential problems. This is particularly important in industries where safety by design can have a significant economic impact and in some cases, literally save lives. Safety by design features are now in widespread use in all kinds of mechanical, electronic, and other complex physical systems.

What if we could similarly embed regulatory objectives directly into the technical design of AI systems?, asked Robert Mahari in  his keynote on Regulation by Design at the recent 2024 MIT IDE Annual Conference. Mahari is pursuing a joint JD-PhD degree. He received a JD at the Harvard Law School in 2022 and is now a PhD candidate in the MIT Media Lab research group led by professor Alex ‘Sandy’ Pentland.

“Compliance and regulation by design represent a risk-management paradigm that’s uniquely suited for AI,” Mahari said. “Intelligent technology design can proactively prevent failures and risks.”

AI systems are the result of a very complex supply chain, including the choice of the large amounts of data needed to train AI models, and the difficulty of testing, predicting, and explaining the models’ expected behavior. As a result, compliance with regulatory and ethical objectives is very hard for the users of AI-based applications who have little control or understanding of how the AI system works. Instead, as is the case with advanced engineering systems, can an AI system monitor how it’s used, identify high risk sessions, alert its developers and overseers, and thus ensure compliance?

Language is a Tool for Communication, Not for Thinking

I often look to biology and evolution for inspiration when thinking about highly complex systems. So I was very intrigued when several weeks ago I learned about the work being done by Elemental Cognition, a company founded in 2015 by my former IBM colleague David Ferrucci. Ferrucci led the team that developed the Watson computer system, which in 2011 won the television quiz show Jeopardy! against two of the world’s top Jeopardy champions. Let me explain.

Large language models (LLMs), chatbots, and generative AI have introduced technologists like me to the fascinating world of human language and cognition. Last year, for example, I learned the difference between four important linguistic concepts in a 2020 research paper by linguistic professors Emily Bender and Alexander Koller.

• Form is any observable expression of language, whether written, spoken, or signed.
• Communicative intent is the purpose a speaker intends to achieve through language, such as to convey some information or just to socialize.
• Meaning is the relation between the form in which the language is expressed and the communicative intent it’s being used to evoke in the listener or reader.
• Understanding is the listener’s ability to capture the meaning that the speaker intends to convey.

The authors wrote that while the success of LLMs and chatbots on many natural language tasks is very exciting, “these successes sometimes lead to hype in which these models are being described as understanding language or capturing meaning.” However, “a system trained only on form has apriori no way to learn meaning.” Research on language acquisition has found that “human language learning is not only grounded in the physical world around us, but also in interaction with other people in that world. … Human children do not learn meaning from form alone and we should not expect machines to do so either.”

Embracing Beneficial Friction for Human-Centered AI

Psychological studies have shown that our judgement is affected by the many decisions we make every day and the friction-based paint points of making these decisions. So, not surprisingly, we look to technology and algorithms to help us make our decisions as frictionless as possible, said Renee Gosline in her keynote at the 2024 MIT IDE Annual Conference. Gosline is a Research Scientist and Senior Lecturer at the MIT Sloan School of Management, and the head of the Human-First AI group at MIT's Initiative on The Digital Economy. “But when AI is involved, sometime we need to add beneficial friction. Sometimes it’s useful for us to engage System 2,” she added, referencing the pioneering behavioral research on human judgment and decision-making by Daniel Kahneman, for which he was awarded the 2002 Nobel Prize in Economics.

In his 2011 bestseller Thinking, Fast and Slow, Kahneman wrote that our mind is composed of two very different systems for reasoning and making decisions, which he called System 1 and System 2.  System 1 is the intuitive, fast and emotional part of our mind. Thoughts come automatically and very quickly to System 1, without us doing anything to make them happen. System 2 is the slower, logical, more deliberate part of the mind. It’s where we make complex decisions by evaluating and choosing among multiple options.

Gosline’s human-first AI research group aims to “add beneficial friction in AI-mediated systems to ensure that humans are in the loop,” as well as to reduce bad friction. When a choice is being made, “we might want to remove friction so that we can make the best choice with AI’s help. But there may be circumstances when we want to add friction to reduce harm.”

How Does the Linux Foundation Work and What Does It Do?

I have long been involved with the Linux Foundation (LF). In 2000, a consortium of companies, including IBM, HP, and Intel, founded the Open Source Development Labs (OSDL), a non-profit organization to support the continued development of Linux and promote its use in enterprise computing. A few years later, in 2007, the OSDL merged with the Free Standards Group to become the Linux Foundation. At the time, I was leading the Linux initiative that IBM had launched in January of 2000 to embrace Linux across all the company’s products and services. In 2011, when the LF marked the 20th anniversary of Linux at its annual Linux conference, I had the privilege of giving a keynote presentation where I recounted my personal involvement with Linux and open source.

Over the past decade, the LF has undergone  a major expansion, as open source became widely accepted as a paradigm for innovation across a full suite of technologies, proving its utility beyond the collaborative development of the Linux operating system. Its impact has been felt across just about all industry sectors in our fast growing digital economy. Consequently, its annual conferences were rebranded Open Source Summits to be more representative of the LF’s expanded open source mission beyond Linux. In April of 2021, the LF announced the formation of Linux Foundation Research to broaden the understanding of open source projects and to explore new opportunities for open source initiatives. Later that year, Hilary Carter, LF’s then VP of Research, invited me to become a member of the LF Research Advisory Board.

I am truly impressed by the current scope of the Linux Foundation. The LF now includes over 1,400 company members, supports over 1000 open source projects in a variety of vertical and horizontal industry sectors, holds over 70 events around the world every year, and provides training and certification programs to equip developers with essential skills, not just for coding, but to support the management and best practices the projects themselves. The mission of the LF was quite easy to explain when it was mostly focused on Linux, but it’s quite a bit more complicated now.

LF’s Executive Director Jim Zemlin recently addressed the difficulty of explaining what the LF does and how it works in his June 13 weekly newsletter to the LF board and team members. Zemlin wrote that beyond the technical community, many don’t understand much about how the LF operates, such as the important role of the LF’s company members in sponsoring open source projects, and that generally, the key maintainers of LF’s largest projects are not volunteers but full-time employees of member companies.

The Emerging Data-Centric AI Era: Where Will All the Data Come From?

The data-centric AI era started about 25 years ago when the explosive growth of the internet led to what’s become known as big data, that is, the availability of huge amounts of digital data, including text, voice, and images. The 2010s saw major innovations in multi-layered deep learning algorithms, followed in the past few years by the advent of foundation models, including generative AI, large language models, and chatbots.

Given the explosive growth of interest in AI, the demand for data keeps increasing. No matter what an organization hopes to achieve, success is impossible without ready access to high-quality data. But, as data becomes increasingly critical for business success, how are enterprises adjusting to the increasing importance of data? Where is all the data needed to train AI models going to come from? And what are the potential legal and ethical issues that companies need to watch out for?

To explore these important questions, I moderated a panel on The Data Provenance Dilemma at the 2024 MIT Sloan CIO Symposium on May 14. “Generative AI models are highly dependent on the quality and quantity of data used in their training. But, many of these models are being trained on vast, diverse, and inconsistently documented datasets that have been raising serious concerns about the legal and ethical risks involved,” notes the brief for the panel in the Symposium agenda. “The panel will discuss the complexities of using large, diverse datasets in the training of generative AI models, the difficulties involved in understanding the provenance of the data being used, and the kinds of tools and standards needed for the responsible use of these powerful models.”

The panel included Mike Mason, chief AI officer of the technology consultancy Thoughtworks; Shayne Longpre, a doctorate candidate at the MIT Media Lab; and Robert Mahari, who’s pursuing a joint JD-PhD degree at the Harvard Law School and MIT’s Media Lab. Let me summarize the key points we discussed in the panel.

Advancing Global Trade through Open-Source, Digital Bill of Lading

“Imagine you’re a cargo owner in the year 1450,” begins “The multi-billion-dollar paper jam: Unlocking trade by digitalizing documentation,” a McKinsey article published in October of 2022. “You hand over your goods to the ship that will carry them across the world, and are presented with a bill of lading — a piece of paper stating what you’re shipping, where it comes from, and where it’s heading. Fast forward to the year 2022: The world has changed dramatically, but the bill of lading remains relatively unchanged. Today, the bill of lading process is still reliant on the physical transfer of paper records and applies to roughly 40 percent of all containerized trade transactions.”

“Current trade documentation spans many documents and processes, and is a manual, time-consuming, and resource-intensive process for all stakeholders. Documentation for a single shipment can require up to 50 sheets of paper that are exchanged with up to 30 different stakeholders. The bill of lading, issued by carriers to acknowledge receipt of cargo from the shipper, is one of the most important trade documents required for shipping.”

According to McKinsey, the bill of lading accounts for between 10 and 30 percent of total trade documentation costs; adopting an electronic bill of lading could save $6.5 billion in direct costs and enable between $30 billion and $40 billion in new global trade volume. “While the banking and aviation industries have implemented digital standards enabling automated trade systems, shipping has not matured far beyond where it was in the 1400s.”

In a recent article, “Advancing Global Trade through Open-Source Electronic Bill of Lading,” the Digital Supply Chain Institute (DSCI) explained the role of bill of lading in global supply chains. “The bill of lading (B/L) functions as an important role in global trade, providing a tangible record of cargo ownership, conditions, and delivery obligations,” according to the article. “While deeply entrenched in trade practices, the traditional paper-based bill of lading has its shortcomings: inefficiencies stemming from manual processes have led to delays, errors, and a higher susceptibility to loss and fraud.”

The Critical Value of Data to Business Success in the Emerging AI Era

“Data has become an increasingly critical component to business success,” said “Modernizing Data with Strategic Purpose,” a recently published report by the technology consultancy Thoughtworks and MIT Technology Review Insights. “The ability to make timely and informed decisions, create tailored customer experiences, and identify new opportunities has enabled the rise of today’s leading digital companies. And with the recent explosion of interest in AI, the demand for data has only increased. No matter what an organization hopes to achieve, success is impossible without ready access to high-quality data. Despite advances in technologies, extracting and transforming enterprise data into a usable asset remains a tremendous challenge for most organizations.”

The report is based on a survey conducted in early 2024 of 350 senior data and technology executives from organizations in the US, the UK, Germany, Singapore, and Australia that earn $500 million or more in annual revenue, with almost half (47%) having revenue of $10 billion or more. Eight industries are represented in the survey: financial services, energy, health care and life sciences, manufacturing, public sector, publishing and media, retail, and travel and transport.

The survey sheds light on how enterprises are adjusting to the increasing importance of data in our emerging data-centric AI era. The data-centric AI era started about 25 years ago when the explosive growth of the internet led to what’s become known as big data, that is, the availability of huge amounts of digital data, including text, voice, and images. Digital data has continued to grow exponentially, and is now estimated to have reached around 150 zettabytes (10²¹ bytes). All these data has enabled AI to make great strides in the 2010s with multi-layered deep learning algorithms, and more recently with foundation models, including generative AI (GenAI), large language models, and chatbots.

“As AI pushes data modernization to the top of more organizations’ agendas, it will also become increasingly important to ensure that the data strategy is closely aligned to the broader business strategy and data leaders are able to clearly articulate how data and analytics can help business units achieve their objectives,” notes the report. “This will not only ensure critical buy-in, but also put the organization in the best position to achieve its goals and lay a solid foundation for continuous improvement, evolution, and value creation.”

Artificial Intelligence: Realistic Expectations vs. Irrational Exuberance

The 2024 MIT Sloan CIO Symposium took place on Tuesday, May 14 at the Royal Sonesta, a hotel overlooking the Charles River a short walk from the MIT campus in Cambridge, MA. Not surprisingly, AI was the dominant theme in this year’s Symposium, with a number of keynotes and panels on the topic. In addition, a pre-event program was added on the day before the Symposium, which included a number of more informal roundtable discussions on various aspects of AI, such as legal risks in AI deployment, AI as a driver for productivity, and human’s role in AI-augmented workplaces.

The Symposium’s closing keynote, What Works and Doesn't Work with AI, was delivered by MIT professor emeritus Rodney Brooks. Professor Brooks was director of the MIT AI Lab from 1997 to 2003, and was then the founding director of MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) from 2003 until 2007. A robotics entrepreneur, he’s founded of a number of companies, including iRobot, Rethink Robotics, and Robust.AI.

“There is a lot of AI and robotics hype right now,” said the blurb describing Brooks’ keynote in the Symposium agenda. “Amongst it are a few important innovations that may help many businesses. The trick is to figure out what is close to deployable and what is off in an uncertain distant future. This keynote will talk both about the traps all of us fall in to evaluating AI claims and demonstrations, and what to look for specifically which will get you to a solid understanding of the time frame for if and when technology will be ready to deploy.”

Let me summarize his keynote.

An Open Source, Standards-Based Approach for the Future of Supply Chains

In 2018 I participated in a blockchain panel at a conference of senior supply chain executives representing a variety of industries and companies. I welcomed the opportunity to learn how these supply chain executives felt about the potential impact of blockchain technologies in complex supply chains.

At the time, I was convinced that blockchain technologies would be a major next step in the evolution of the internet. Two years earlier, for example, the World Economic Forum (WEF) had named The Blockchain as one of the Top Ten Emerging Technologies for 2016 in its annual list. The WEF report compared the blockchain to the internet, noting that “Like the Internet, the blockchain is an open, global infrastructure upon which other technologies and applications can be built.  And like the Internet, it allows people to bypass traditional intermediaries in their dealings with each other, thereby lowering or even eliminating transaction costs.”

I also believed that supply chain applications would emerge as the killer app for blockchain technologies, that is, an IT application whose value is simple to explain, its use is fairly intuitive, and the application turns out to be so useful that it helps propel the success of new technologies or products. For example, spreadsheets and word processing played a major role in the 1980s adoption of personal computers, as did e-mail and the World Wide Web in the 1990s mainstream success of the internet.

But, it hasn’t quite worked as expected, either for blockchain technologies or for their applications in supply chains. “Blockchain, the technology underpinning bitcoin and other cryptocurrencies, for years has been viewed by some companies as a way to drive industry-transforming projects, among them the tracking of assets through complex supply chains,” according to “Blockchain Fails to Gain Traction in the Enterprise,” an article published in the Wall Street Journal (WSJ). “So far that hasn’t happened.”

Health and AI

The March 30, 2024 issue of The Economist includes a special  section on Health and AI, with six articles on the topic. “Artificial intelligence (AI) is generating excitement and hyperbole everywhere, but in the field of health care it has the potential to be transformational,” said the lead article, “The AI doctor will see you … eventually.” “In Europe analysts predict that deploying AI could save hundreds of thousands of lives each year; in America, they say, it could also save money, shaving $200bn-360bn from overall annual medical spending, now $4.5trn a year (or 17% of GDP).”

Healthcare is a system of coupled systems, encompassing medical and pharmaceutical research; the delivery of healthcare to patients by a variety of practitioners, including hospitals, physicians, nurses, and pharmacists; and the insurance companies and governments that pay for healthcare. It’s a highly regulated industry, which creates major barriers for the sort of innovative start-ups that have been the engine of transformation in other sectors. In advanced economies, a handful of companies, — e.g., Cerner, Epic, Athena, — support large healthcare providers with proprietary platforms that don’t interoperate with each other, making it difficult for smaller companies and startups to develop innovative AI tools and applications as has been the case in other industries.

There’s considerable hope that AI could help us better deal with the inherent complexity of the healthcare sector. “AI systems can enhance diagnostic accuracy and disease tracking, improve the prediction of patients’ outcomes and suggest better treatments,” notes The Economist. “It can also boost efficiency in hospitals and surgeries by taking on tasks such as medical transcription and monitoring patients, and by streamlining administration. It may already be speeding the time it takes for new drugs to reach clinical trials. New tools, including generative AI, could supercharge these abilities.”

However, “although AI has been used in health care for many years, integration has been slow and the results have often been mediocre.” Among the major reasons for the slow progress are the concerns about accuracy and trust necessary to protect patients’ safety. “Improving accuracy and reducing bias in AI tools requires them to be trained on large data sets that reflect patients’ full diversity.” But, while there’s lots of available health data, the data is highly fragmented making it difficult to use properly.

An Economic Framework for Understanding AI

“Artificial intelligence (AI) systems touch the lives of virtually every American,” said “An Economic Framework for Understanding Artificial Intelligence,” an overview of the economic potential of AI which was recently released by the White House Council of Economic Advisors (CEA) as part of their “2024 Economic Report of the President.” “In recent years, AI systems have advanced rapidly as recent developments in computing, data availability, and machine learning models have simultaneously come together to produce rapid improvements.”

“Still, much remains unknown,” the CEA added. “While AI’s capabilities will depend in part on the technology itself, its effects will be shaped by economic, regulatory, and social pressures. How society deploys this technology and what technology-specific guardrails are implemented will be critical factors in determining both the breadth and magnitude of its effects.”

“An economic framework, combined with a basic understanding of AI technology, allows us to make predictions about when, how, and why AI may be adopted. While such a framework can also tell us what broader effects AI adoption may have, applying economic insights to an evolving and proliferating technology like AI is especially challenging. However, it is also especially valuable, because decisions made at the onset of a new technology have a greater influence on its eventual impact.”

The AI Economic Framework is a rather long and comprehensive document. Let me briefly discuss a few of the its key points.

Who Still Works from Home?

Remote work, — aka work from home (WFH), — has been around for decades, but took off in the mid-late 1990s with the explosive growth of the internet. Some even predicted that the internet would lead to the decline of cities, because it would enable people to work, be in touch with friends and colleagues, and shop from home. Why would anyone choose to live in an expensive and crowded metropolitan area, when they could live in a more affordable, less stressful, potentially healthier location? Instead of declining, superstar cities continued to generate the greatest levels of innovation and good jobs, thus attracting a disproportionate share of the world’s talent.

But, everything changed when the COVID-19 pandemic spread worldwide in early 2020. “The coronavirus crisis is forcing white-collar America to reconsider nearly every aspect of office life,” wrote a June, 2020 NY Times Magazine article. “Some practices now seem to be wastes of time, happily discarded; others seem to be unexpectedly crucial, and impossible to replicate online. For workers wondering right now if they’re ever going back to the office, the most honest answer is that even if they do, the office might never be the same.”

The article cited the experience of Accenture, which at the time had around 500,000 employees in more than 200 cities in 120 countries. Before the pandemic, no more than 10% worked remotely on any given day. But, by the middle of March, nearly all were asked to work from home. Employees adapted quickly, said Accenture’s CTO. The volume of video calls went up by a factor of six while audio calls tripled. Despite having to switch from face-to-face to audio and video interactions, overall productivity actually went up as measured by several metrics.”

A Deteroriating Global Risk Outlook

“Last year’s Global Risks Report warned of a world that would not easily rebound from continued shocks,” wrote Saadia Zahidi, managing director of the World Economic Forum (WEF), in the Preface of The Global Risks Report 2024. “As 2024 begins, the 19th edition of the report is set against a backdrop of rapidly accelerating technological change and economic uncertainty, as the world is plagued by a duo of dangerous crises: climate and conflict.”

“Underlying geopolitical tensions combined with the eruption of active hostilities in multiple regions is contributing to an unstable global order characterized by polarizing narratives, eroding trust and insecurity,” she added. “At the same time, countries are grappling with the impacts of record-breaking extreme weather, as climate-change adaptation efforts and resources fall short of the type, scale and intensity of climate-related events already taking place.”

The Global Risks Report 2024 is based on two complementary surveys: the Global Risks Perception Survey (GRPS), the WEF’s source of original risk data, which includes the insights and opinions of over 1,500 leaders from academia, business, government, the international community and civil society; and the Executive Opinion Survey (EOS) of over 11,000 leaders from 113 countries who were asked to identify risks that pose the most severe threat to each of their countries over the next two years. In addition, the report includes insights from over 200 risk specialists.

The WEF report analyzed global risks and presented its findings along three distinct timeframes:

• The current term are the risks most likely to present a material crisis on a global scale in 2024.
• The short term considers global risks which are likely to play out over the next two years.
• The long term considers global risks that are likely to be most severe over the next ten years.

What’s the Value of Open Source Software Based on Actual Usage Data?

“The value of a non-pecuniary (free) product is inherently difficult to assess,” wrote Manuel Hoffmann, Frank Nagle, and Yanuo Zhou in their recent working paper, “The Value of Open Source Software.” “A pervasive example is open source software (OSS), a global public good that plays a vital role in the economy and is foundational for most technology we use today.” The paper reminded us that in 2011, VC Mark Andreessen famously argued that software is eating the world. Then two years ago, VC Joseph Jacks added that open source is eating software FASTER than software is eating the world.

“Other recent studies have come to similar conclusions showing that open source software (OSS) — software whose source code is publicly available for inspection, use, and modification and is often created in a decentralized manner and distributed for free — appears in 96% of codebases, and that some commercial software consists of up to 99.9% freely available OSS,” said the paper. “Although in its early days OSS frequently copied features from existing proprietary software, OSS today includes cutting edge technology in various fields including artificial intelligence (AI), quantum computing, big data, and analytics.”

But, despite the increasing importance of OSS to the economy, its overall impact has been difficult to quantify. The reason is that the value created by a good or service is traditionally measured by multiplying the price p times the quantities sold q, but with OSS, the p is generally zero since open source code is publicly available, and its actual usage q has been very hard to measure.

The Case for Open Healthcare Systems

As we’ve learned since the advent of the Industrial Revolution, major technological advances have the potential to radically transform a whole industry, but realizing that potential generally requires large intangible investments and a fundamental rethinking the industry being transformed. So, it’s not surprising that there’s much hope and excitement that the advent of AI as a major 21st century technological advance might, over time, help to radically transform our highly complex and expensive healthcare industry. 

Healthcare is a system of coupled systems, encompassing medical and pharmaceutical research; the delivery of healthcare to patients by a variety of practitioners, including hospitals, physicians, nurses, and pharmacists; and the insurance companies and governments that pay for healthcare. Healthcare costs have continued to rise across the world, especially in the US. Total healthcare spending in 2023 was approximately $4.7 trillion, accounting for 18% of US GDP, and is projected to grow at an average of 5.5% per year to over $7 trillion in 2031, roughly 20% of US GDP.

The potential evolution of healthcare brings to mind my personal experience in the information technology (IT) industry for the past 50 years.

The Uncertain Impact of AI on Economies and Societies

“Artificial intelligence (AI) promises to boost productivity and growth, but its impact on economies and societies is uncertain, varying by job roles and sectors, with the potential to amplify disparities,” said “GenAI: Artificial Intelligence and the Future of Work,” a recently published report by the International Monetary Fund (IMF). “As a positive productivity shock, AI will expand economies’ production frontiers and will lead to reallocations between labor and capital while triggering potentially profound changes in many jobs and sectors. AI offers unprecedented opportunities for solving complex problems and improving the accuracy of predictions, enhancing decision-making, boosting economic growth, and improving lives. However, precisely because of its vast and flexible applicability in numerous domains, the implications for economies and societies are uncertain.”

“The impact of AI is also likely to differ significantly across countries at different levels of development or with different economic structures,” adds the IMF report. “Advanced economies, with their mature industries and service-driven economies, typically have a higher concentration of jobs in sectors that require complex cognitive tasks. These economies are therefore both more susceptible to, yet better positioned to benefit from, AI innovations.”

“Conversely, emerging market and developing economies, often still reliant on manual labor and traditional industries, may initially face fewer AI-induced disruptions. However, these economies may also miss out on early AI-driven productivity gains, given their lack of infrastructure and a skilled workforce. Over time, the AI divide could exacerbate existing economic disparities, with advanced economies harnessing AI for competitive advantage while emerging market and developing economies grapple with integrating AI into their growth models.”

The Promise of Digital Health in the 21st Century

In 2021 the Linux Foundation (LF) announced the formation of Linux Foundation Research, a new organization to broaden the understanding of open source ecosystems and to explore opportunities for new open source initiatives. Given my long involvement with Linux, the Linux Foundation and open source communities in general, I was invited to become a member of the newly created LF Research Advisory Board (RAB).

At a September, 2023 meeting of the Advisory Board, we discussed that one of the few industry sectors in which the LF does not have projects is healthcare, despite its size and importance around the world. The LF had launched healthcare initiatives in the past, but they all eventually failed. At that meeting, LF Research launched a study to understand what we should be doing in the healthcare sector. I’m involved in the study, and for the past several months, I’ve been learning about the opportunities of digital technologies in healthcare systems by reading a number of articles and talking to key experts.

“The Promise of Digital Health: Then, Now, and the Future,” a discussion paper published in June of 2022 by the US National Academy of Medicine is one of the articles that I found most instructive. The paper is based on the contributions of 25 member of the National Academy of Medicine (NAM), including two of the experts I’ve recently spoken with, John Halamka and Peter Lee.

The Potential Impact of Open Source Generative AI in the Business World

“Generative AI, commonly referred to as GenAI, stands at the forefront of a technological revolution, profoundly altering diverse sectors by synthesizing vast amounts of data and generating new outputs,” said the “2023 Open Source Generative AI Survey Report,” published by the Linux Foundation (LF) in December of 2023. “From creating intricate artworks and composing music to designing novel pharmaceutical compounds and simulating realistic human language, the potential applications of GenAI are vast and transformative.”

“The open source approach, rooted in principles of transparency, collaboration, and shared innovation, holds transformative potential for the advancement of GenAI technologies. By democratizing access to AI algorithms and datasets, open source initiatives allow a broad and diverse pool of developers to contribute to, refine, and critique GenAI systems. This collective intelligence accelerates the pace of innovation and uncovers and rectifies biases or vulnerabilities that might otherwise go unnoticed in closed development environments.”

To help understand the potential impact of open source GenAI on the market, LF Research and LF AI & Data launched a worldwide survey. The survey explored the current state of GenAI technologies in companies, including models, databases, applications, and frameworks.

A Revolutionary Technology Is Not the Same As a Technological Revolution

“Artificial intelligence is almost certainly revolutionary in the sense that it will spawn new technology platforms, transform or eliminate many industries, and create new ones,” wrote British-Venezuelan economic historian Carlota Perez in a recent article, “What Is AI’s Place in History?” “But it must be understood as belonging to a larger, more mature technological revolution that began a half-century ago.”

 In her influential 2002 book, “Technological Revolutions and Financial Capital,” Perez wrote that technological revolutions have long been engines of growth, rejuvenating and transforming economies and societies. Since the advent of the Industrial Revolution, we’ve had a major technological revolution approximately every 60 years. First was the age of machines and factories starting in Britain in the 1770s. It was followed by the age of steam, coal and iron in the1830s; electricity, steel, and heavy engineering in the 1870s;  automobiles, oil and mass production in the 1900s; and the information and communications technology (ICT) and digital revolution in the 1970.

Technological revolutions encompass two different periods, each lasting 20 to 30 years. The installation period is the time of creative destruction, when novel exciting technologies emerge on the market, entrepreneurs launch many new startups based on these promising technologies, and venture capitalists encourage experimentation with new business models and money-making schemes. Inevitably, these speculative behaviors lead to a financial bubble, which eventually crashes and results in a period of economic stagnation.

After the crash, comes the deployment period, a time of institutional recomposition. The now well accepted technologies become the norm. Infrastructures and industries are better defined and more stable, and production capital drives long-term growth and expansion, spreading and multiplying the successful business models. New paradigms emerge for guiding innovation. Over time, these new paradigms transform the economy and everything around it, as well as re-shaping social behavior and the institutions of society.

What’s the State of Income Inequality Around the World?

Over the past few decades, technology advances like the smartphone and wireless internet have significantly improved the quality of life of billions around the world. The economic development brought about by globalization led to the Gintic decline of extreme poverty in China, East and South Asia, and Latin America. Globalization was supposed to boost prosperity, as nations were becoming more economically interdependent, but it’s also led to major dislocations in labor markets, benefiting workers in low-cost developing nations while severely impacting workers in the US and other advanced economies. The promise of technological progress and globalization as drivers of growth and prosperity has been a reality for many, but it’s also created winners and losers within nations, leading to rising economic inequality.

“Across the globe, but especially in the wealthy economies of the West, the gap between the rich and the rest has widened year after year and become a chasm, spreading anxiety, stoking resentment, and roiling politics,” wrote economist Branko Milanovic in “The Great Convergence: Global Equality and Its Discontents,” a recent article in Foreign Affairs. “Globalization, the argument goes, may have enriched certain elites, but it hurt many other people, ravaging one-time industrial heartlands and making people susceptible to populist politics.”

“There is much that is true about such narratives — if you look only at each country on its own,” added Milanovic. “Zoom out beyond the level of the nation-state to the entire globe, and the picture looks different. Global inequality refers to “the income disparity between all citizens of the world at a given time, adjusted for the differences in prices between countries. … At that scale, the story of inequality in the twenty-first century is the reverse: the world is growing more equal than it has been for over 100 years.”

Inequality is commonly measured by the Gini coefficient, a statistical measure of income or wealth inequality within a group, a nation, or the whole world that was first developed over 100 hundred years ago. A Gini score of 0 means perfect equality, where all income and wealth are the same for all members of the group, while a score of 100 means maximal inequality, where a single individual has all the income and all others have none.

Could AI Reshape the Value and Nature of Human Expertise?

“A recent Gallup poll found that 75% of U.S. adults believe AI will lead to fewer jobs,” wrote MIT economist David Autor in a recent article, “AI Could Actually Help Rebuild The Middle Class.” “But this fear is misplaced. The industrialized world is awash in jobs, and it’s going to stay that way. Four years after the Covid pandemic’s onset, the U.S. unemployment rate has fallen back to its pre-Covid nadir while total employment has risen to nearly three million above its pre-Covid peak.”

“Due to plummeting birth rates and a cratering labor force, a comparable labor shortage is unfolding across the industrialized world (including in China),” he added. “This is not a prediction, it’s a demographic fact. All the people who will turn 30 in the year 2053 have already been born and we cannot make more of them. Barring a massive change in immigration policy, the U.S. and other rich countries will run out of workers before we run out of jobs.”

In his article, Autor argues that AI has the potential to transform the labor market by reshaping the nature of human expertise. AI offers us the opportunity to extend the value of human expertise by enabling “a larger set of workers equipped with the necessary foundational training to perform higher-stakes decision-making tasks currently arrogated to elite experts, such as doctors, lawyers, software engineers and college professors.”

How to Diversify Admissions to Elite Private Colleges

“After the Covid pandemic made it difficult for high school students to take the SAT and ACT, dozens of selective colleges dropped their requirement that applicants do so,” wrote David Leonhardt in “The Misguided War on the SAT,” a recent NY Times article. “Colleges described the move as temporary, but nearly all have since stuck to a test-optional policy. It reflects a backlash against standardized tests that began long before the pandemic, and many people have hailed the change as a victory for equity in higher education.”

“Now, though, a growing number of experts and university administrators wonder whether the switch has been a mistake,” added Leonhardt. “Research has increasingly shown that standardized test scores contain real information, helping to predict college grades, chances of graduation and post-college success. Test scores are more reliable than high school grades, partly because of grade inflation in recent years.”

Leonhardt’s article is primarily based on two recent studies published by Opportunity Insights, a not-for-profit organization based at Harvard that conducts data-driven scientific research on how to improve upward mobility. Each of the studies analyzed the value of SAT and ACT standardized test scores in predicting academic success at the 12 so-called Ivy-Plus colleges, — the eight Ivy League colleges plus Chicago, Duke, MIT, and Stanford.

While using different data and analytical methodologies, the overall conclusion of each of these studies was similar: standardized SAT and ACT scores are highly predictive of academic success at the Ivy-Plus colleges regardless of the students’ socioeconomic backgrounds. In addition, the second study also found that standardized SAT and ACT scores are highly predictive of post-college career success, such as attendance at top graduate schools, high earnings, and employment at prestigious firms. Let me discuss each of these studies.

The Digital Trust Framework: How to Implement New Technologies and Services Worthy of Trust

“Digital trust is a necessity in a world where digital technologies support and mediate virtually all economic transactions, social connections and institutions,” said Earning Digital Trust: Decision-Making for Trustworthy Technologies, a report published by the World Economic Forum (WEF) in November of 2022. The report defined digital trust as “the expectation by individuals that digital technologies and services –- and the organizations providing them –- will protect all stakeholders’ interests and uphold societal expectations and values.”

But, the report noted that “trust is significantly eroding on a global scale. In order to reverse this trend, leaders and organizations creating and implementing new technologies and digital services must make decisions that are worthy of trust.” To address this challenge, the WEF launched the Digital Trust Initiative in 2021. The Initiative convened an interdisciplinary group of over 60 experts and leaders in privacy, cybersecurity, law, technology ethics, and other fields. The group was asked to establish a consensus among key stakeholders on the meaning of digital trust, as well as to come up with measurable steps to make better, more trustworthy decisions regarding new technologies and digital services.   

The Origins and Content of New Work

“Broadly speaking, many — perhaps most — workplace technologies are designed to save labor,” wrote MIT economist David Autor in his 2015 paper, “Why Are There Still So Many Jobs? The History and Future of Workplace Automation.” “Given that these technologies demonstrably succeed in their labor saving objective and, moreover, that we invent many more labor-saving technologies all the time, should we not be somewhat surprised that technological change hasn’t already wiped out employment for the vast majority of workers?, asked professor Autor.

The answer, he noted, underlines a fundamental economic reality that’s frequently overlooked: “tasks that cannot be substituted by automation are generally complemented by it.” Automation does indeed substitute for labor. However, automation also complements labor, raising economic outputs in ways that often lead to higher demand for workers. Articles often overstate the extent of machine substitution for human labor “and ignore the strong complementarities between automation and labor that increase productivity, raise earnings, and augment demand for labor.”

Most jobs involve a number of tasks or processes. Some of these tasks are more amenable to automation, while others require judgement, social skills and other human capabilities. But just because some of the tasks have been automated, does not imply that the whole job has disappeared. To the contrary, automating the more routine parts of a job will often increase the productivity and quality of workers, by complementing their skills with machines and computers, as well as enabling them to focus on those aspect of the job that most need their attention.

The advent of automated teller machines (ATMs) in the 1970s is a case in point. By 2010, there were approximately 400,000 ATMs in the US.  But, not only were bank tellers not eliminated, but their numbers actually rose modestly from 500,000 in 1980 to 550,000 in 2010, driven by two major forces. First, as a result of IT advances that  reduced the costs of operating a bank branch, the number of urban bank branches increased significantly by 2010. Second, while most of the routine cash-handling tasks of bank employees were automated by ATM technologies, IT-based innovations enabled a broader range of bank employees to become involved in relationship banking, providing a variety of relationship-based services to customers, including credit cards, personal loans, mortgages, and investment options.  

Open Source AI: Opportunities and Challenges

“Since the 1980s, open source has grown from a grassroots movement to a vital driver of technological and societal innovation,” said “Standing Together on Shared Challenges,” a report published by Linux Foundation Research in December of 2023. “The idea of making software source code freely available for anyone to view, modify, and distribute comprehensively transformed the global software industry. But it also served as a powerful new model for collaboration and innovation in other domains.”

The report is based on the Open Source Congress that was convened by LF Research in July of 2023 in Geneva to discuss the key challenges facing the open source community, such as safeguarding critical open source infrastructures and ensuring that new regulations are compatible with open source principles and practices. In addition, the Open Source Congress explored the opportunities for open source collaborations on important new topics, in particular, artificial intelligence. Given my interest in “How the Original Promises of the Open Source Movement Now Apply to AI Systems,” I’ll focus my discussions below on the report’s section on AI.

“Does AI Change Everything? What is Open?” is the theme of the report’s AI module. “For the OSS community, AI presents an array of opportunities and challenges. The community leaders assembled in Geneva discussed the need to align on a definition of open AI, as well as on the challenges created by AI-enabled code generators for licensing, security, and intellectual property. Finally, Congress participants reflected on the broader societal impacts of AI and the role of the open source community in addressing issues such as bias, privacy, and existential threats to humanity.”

Technologies that Will Drive Business Transformation Over the Next Two Years

In early December, Deloitte released “Tech Trends 2024,” its 15th annual report that “chronicles the growing business imperative to balance today’s tactical needs with tomorrow’s strategic ambitions.” The report is focused on six major technology trends that are likely to be critical to business transformation over the next 18-24 months. Let me discuss each of these trends, starting with:

Genie out of the bottle: Generative AI as growth catalyst.

Not surprisingly, generative AI and its potential impact on business and the world is Deloitte’s overriding trend. “Philosophers have long debated whether machines are capable of thought, but generative AI makes the question moot,” said the report. “Regardless of whether it possesses intelligence in the philosophical sense, it does in a practical sense, creating the opportunity for huge productivity and efficiency gains in enterprise settings. Now that machines can behave, comprehend, and narrate like humans, the question becomes how this will impact business and the world broadly.”

The Current State and Future Trends of Enterprise Blockchain Technologies

“Blockchain is one of the major tech stories of the past decade,” said a December, 2022 McKinsey article, “What is Blockchain.” “Everyone seems to be talking about it — but beneath the surface chatter there’s not always a clear understanding of what blockchain is or how it works. Despite its reputation for impenetrability, the basic idea behind blockchain is pretty simple,” namely: “Blockchain is a technology that enables the secure sharing of information.”

That same month, a WSJ article, “Blockchain Fails to Gain Traction in the Enterprise,” noted that for years, blockchain “has been viewed by some companies as a way to drive industry-transforming projects, among them the tracking of assets through complex supply chains.” But, “So far, that hasn’t happened,” the article added.

I’ve been closely following the evolution of blockchain technologies for a number of years. Between 2016 and 2023, I’ve posted over 50 entries on blockchain and related technologies in my blog. For example, in 2017 I asked Is Blockchain the Major Next Step in the Evolution of the Internet?, based on the fact that the previous year, the World Economic Forum (WEF) had named The Blockchain as one of its Top 10 Emerging Technologies for 2016. In the blog I wrote that “Like the Internet, the blockchain is an open, global infrastructure upon which other technologies and applications can be built. And like the Internet, it allows people to bypass traditional intermediaries in their dealings with each other, thereby lowering or even eliminating transaction costs.”

The Coming AI Revolution

“The Coming AI Economic Revolution: Can Artificial Intelligence Reverse the Productivity Slowdown?” was recently published in Foreign Affairs by James Manyika and Michael Spence, two authors I’ve long admired. James Manyika is senior VP of research, technology and society at Google, after serving  as chairman and director of the McKinsey Global Institute from 2009 to 2022. Michael Spence, a co-recipient of the 2001 Nobel Prize in Economics, is professor in economics and business at NYU’s Stern School of Business, and was previously professor of management and dean of the Stanford Graduate School of Business.

“By the beginning of the next decade, the shift to AI could become a leading driver of global prosperity,” wrote the authors. “The prospective gains to the world economy derive from the rapid advances in AI — now further expanded by generative AI, or AI that can create new content, and its potential applications in just about every aspect of human and economic activity. If these innovations can be harnessed, AI could reverse the long-term declines in productivity growth that many advanced economies now face.”

“This economic revolution will not happen on its own,” they added. Unleashing an AI-powered economy will require a new policy framework that fosters AI’s most productive uses and enhance human potential and ingenuity. “These policies must promote technologies that augment human capabilities rather than simply replace them; encourage AI’s widest possible implementation, both within and across different sectors, especially in areas that tend to have lower productivity; and ensure that firms and sectors undergo necessary process and organizational changes and innovations to effectively capitalize on AI’s potential.”

Taking the Pulse of AI in Medicine

“AI explodes: Taking the Pulse of artificial intelligence in medicine,” is the title of the latest issue of the Stanford Medicine Magazine. The issue includes a number of articles that explore the promise of AI in medicine, ranging from What’s driving this tumor, — which discusses the efforts to stymie breast cancer through gene testing and AI, — to Adding ethics to the mix when developing health care AI, — which deals with the potential hazards posed by algorithms developed by AI experts with no formal training in the ethical standards for treating patients.

“Imagine a future where your doctor has an AI medical assistant by their side – distilling, in seconds, a world’s worth of medical research into a personalized treatment plan for you,” wrote Dr. Lloyd Minor, Dean of the Stanford University School of Medicine in the issue’s Letter from the Dean. “What if, at the click of a button, a researcher could design a custom molecule with the potential to treat a previously untreatable disease? With artificial intelligence’s rapid emergence, we are barreling toward this reality. Academic medical centers around the world, including Stanford Medicine, have begun investigating how AI, including large language models such as ChatGPT, can help us improve patient care, reduce clinician workload, better understand complex biological systems and accelerate drug discovery.”

As I discussed in a recent blog, “The Promise of Generative AI in Healthcare,” there’s a lot of excitement that AI might help us address our highly complex healthcare industry. Healthcare is a system of coupled systems, encompassing medical and pharmaceutical research; the delivery of healthcare to patients by a variety of practitioners, including hospitals, physicians, nurses, and pharmacists; and the insurance companies and governments that pay for healthcare.

According to Wikipedia, the healthcare industry comprises over 10% of the GDP of most developed countries. “The per capita expenditure on health and pharmaceuticals in OECD countries has steadily grown from a couple of hundred in the 1970s to an average of US$4'000 per year in current purchasing power parities.” In 2022, US healthcare spending “grew 4.1% to $4.5 trillion in 2022, or $13,493 per person, and accounted for 17.3% of Gross Domestic Product (GDP).”

In addition to its inherent complexity, healthcare has several attributes that make the successful deployment of new technologies significantly more challenging than in other industries. HIPPA, for example, protects the privacy of individuals in the US, but it also restricts the data sharing that’s essential to achieving many of the benefits of generative AI. And because the stakes in healthcare are too high to tolerate flaws that could harm patients, it’s harder to introduce new technologies and applications compared to most other industries.

The Case for an AI-Powered Productivity Boom

“Large language models such as ChatGPT are emerging as powerful tools that not only make workers more productive but also increase the rate of innovation, laying the foundation for a significant acceleration in economic growth,” wrote economists Martin Neal Bailey, Erik Brynjolfsson, and Anton Korinek in “Machines of mind: The case for an AI-powered productivity boom,” a Brookings Institutions report. “However, official statistics will only partially capture the boost in productivity because the output of knowledge workers is difficult to measure. The rapid advances can have great benefits but may also lead to significant risks, so it is crucial to ensure that we steer progress in a direction that benefits all of society.”

The authors noted that generative AI systems are machines of the mind, increasingly capable of generating coherent and contextually appropriate text, images, videos, and audio, in a wide range of information-based tasks. Millions of knowledge workers, — from doctors and lawyers to managers and sales people, — will experience ground-breaking improvements in their productivity within a few years.

The Dueling Visions for the Soul of AI

On November 17, OpenAI's board of directors ousted chief executive and co-founder Sam Altman, saying in a statement that “The board no longer has confidence in his ability to continue leading OpenAI.” Then on November 22, after an intense pressure campaign from employees and investors, OpenAI announced that it had reached “an agreement in principle for Sam to return to OpenAI as CEO” with a reconstituted board.

What led to this chaotic governance drama over approximately 107 hours from November 17 to 22?

“Many of the people at the company seem simultaneously motivated by the scientist’s desire to discover, the capitalist’s desire to ship product and the do-gooder’s desire to do this all safely,” wrote NY Times columnist David Brooks In “The Fight for the Soul of A.I.,” where he discussed the conflicting issues that led to OpenAI’s chaotic 4.5 days. “Is this fruitful contradiction sustainable? Can one organization, or one person, maintain the brain of a scientist, the drive of a capitalist and the cautious heart of a regulatory agency?”

The Promise of Generative AI in Healthcare

“Since they became publicly available in late 2022, generative artificial intelligence (genAI) tools such as ChatGPT have elicited enormous enthusiasm, as well as concern, in all sectors of the economy,” said “Will Generative Artificial Intelligence Deliver on Its Promise in Health Care?,” a recent article in the Journal of the American Medical Association (JAMA) by Robert Wachter, — professor and chairman of the Department of Medicine at the University of California, San Francisco (UCSF), and Erik Brynjolfsson, — professor and director of the Digital Economy Lab at Stanford University.

“But the potential impact of genAI in health care seems particularly noteworthy. In a field in which an estimated 30% of the $4.3 trillion spent each year in the US adds little to no value, in which many tens of thousands of people die yearly from preventable mistakes, and in which access to care is fragmented and inequities are commonplace, it is natural to be enthusiastic about the potential for genAI to improve quality, efficiency, equity, and patient experience.”

A few weeks ago I posted an entry in my blog on “AI and the Future of Healthcare Systems,” in which I discussed the huge challenges posed by the inherent complexity of the healthcare sector of the economy. Healthcare is a system of coupled systems, comprised of medical and pharmaceutical research; the delivery of healthcare to patients by a variety of practitioners, including hospitals, physicians, nurses, and pharmacists; and the insurance companies and governments that pay for healthcare. The convoluted interactions of these various  domains, — each of which is quite large and complex in its own right, — is one of the main reasons why healthcare systems are so incredibly complex.

Given the central role of data in AI, electronic health records (EHRs) play a critical role in the development of AI systems capable of dealing with the complex real-world challenges in the healthcare industry. As explained by the Centers for Medicare & Medicaid Services (CMS): “An Electronic Health Record (EHR) is an electronic version of a patients medical history, that is maintained by the provider over time, and may include all of the key administrative clinical data relevant to that persons care under a particular provider, including demographics, progress notes, problems, medications, vital signs, past medical history, immunizations, laboratory data and radiology reports.”

The World Ahead 2024: The World Is Changing at Mind-Boggling Speed

In mid-November, The Economist published “The World Ahead 2024,” its 38th annual issue that examines the trends and events that will likely shape the coming year. Last year, the overriding message from “The World Ahead 2023” was that after two years in which the pandemic was the dominating force shaping the immediate future, the war in Ukraine would be the main driver in 2023, causing the world to have to grapple with the conflict's impact on a series of unpredictable issues, incluging geopolitics, security, inflation, energy markets, and China’s post-pandemic path.

“Life comes at you fast,” wrote World Ahead editor Tom Sandage  in his introduction to the  “The World Ahead 2024.” “Whether it’s the upsurge in armed conflict, the redrawing of the global energy-resources map or rapid progress in artificial intelligence (AI), the world is changing at mind-boggling speed. From the situation in the Middle East to the adoption of electric vehicles to the treatment of obesity, things look very different from the way they did just a year or two ago.”

How Can Companies Figure Out How to Best Apply Generative AI?

“Business leaders are struggling to understand how seriously they should take the latest phenomenon in the world of artificial intelligence: generative AI,” wrote Andrew McAfee, Daniel Rock, and Erik Brynjolfsson in their recent Harvard Business Review (HBR) article “How to Capitalize on Generative AI.”  

“On one hand, it has already displayed a breathtaking ability to create new content such as music, speech, text, images, and video and is currently used, for instance, to write software, to transcribe physicians’ interactions with their patients, and to allow people to converse with a customer-relationship-management system. On the other hand, it is far from perfect: It sometimes produces distorted or entirely fabricated output and can be oblivious to privacy and copyright concerns.”

“Is generative AI’s importance overblown? Are its risks worth the potential rewards? How can companies figure out where best to apply it?,” the authors asked. To illustrate how to best answer these questions, the article references a recent research paper by Brynjolfsson and two collaborators, Generative AI at Work, which shows that there are ways to both reap the benefits of generative AI and contain its risks.

Is College Still a Good Investment?

In 2014, NY Times journalist David Leonhardt published a column with the provocative title: “Is College Worth It?” Despite the mounting debts incurred by many students to obtain a post-secondary education, “The decision not to attend college for fear that it’s a bad deal is among the most economically irrational decisions anybody could make in 2014. The much-discussed cost of college doesn’t change this fact.” According to a recent paper, said Leonhardt, “Over the long run, college is cheaper than free. Not going to college will cost you about half a million dollars.”

But, over the past few years, an increasing number of articles have questioned whether college is still a good investment. “Was your degree really worth it?,” is one such article, published earlier this year in The Economist. “That question once seemed a no-brainer,” said the article. “For decades young adults in rich countries have flocked to higher education. Governments have touted college as a boon for social mobility and economic growth. Yet as fees rise and graduate earnings stagnate, disillusionment is growing.”

The Economist cited a recent poll published in the Wall Street Journal (WSJ) that found that a majority of Americans, 56%, think that a four-year degree is no longer worth the time and money, a marked reversal from the 53% of Americans who were bullish on college just a decade ago.

“Skepticism is strongest among people ages 18-34, and people with college degrees are among those whose opinions have soured the most, portending a profound shift for higher education in the years ahead,” wrote the WSJ. “Enrollment in U.S. colleges declined by about 15% over the last decade while the growth in alternative credentials, including apprenticeships, increased sharply. In 2017, doubt over the value of a college degree was greatest among men, Republicans and people living in rural areas. That disaffection preceded a widening gender gap in higher education as hundreds of thousands of men left college during the pandemic.”

How Can AI Accelerate the Pace of Scientific Discovery?

A recent issue of The Economist included a special focus on “How AI Can Revolutionize Science,” with three articles on the topic. “Debate about artificial intelligence (AI) tends to focus on its potential dangers: algorithmic bias and discrimination, the mass destruction of jobs and even, some say, the extinction of humanity,” noted the issue’s lead article. “As some observers fret about these dystopian scenarios, however, others are focusing on the potential rewards. AI could, they claim, help humanity solve some of its biggest and thorniest problems. And, they say, AI will do this in a very specific way: by radically accelerating the pace of scientific discovery, especially in areas such as medicine, climate science and green technology.”

“Could they be right?,” asked the The Economist, reminding us that in the 1990s we had high hopes that the internet would reduce inequality and eradicate nationalism by transforming the world into a connected global village. Instead, internet-based social media platforms have been blamed for fueling political and ethnic polarization around the world.

“But the mechanism by which AI will supposedly solve the world’s problems has a stronger historical basis, because there have been several periods in history when new approaches and new tools did indeed help bring about bursts of world-changing scientific discovery and innovation.”

Winners and Losers in the Emerging Age of AI

“The development of AI is as fundamental as the creation of the microprocessor, the personal computer, the Internet, and the mobile phone,” wrote Microsoft co-founder Bill Gates in “The Age of AI has begun,” a March, 2023 blog. “It will change the way people work, learn, travel, get health care, and communicate with each other. Entire industries will reorient around it. Businesses will distinguish themselves by how well they use it.”

Over the past two centuries, major transformative technologies like AI have led to both winners and losers. Kodak, Blockbuster, Digital, Wang, and BlackBerry are among the corporate giants who were once leaders in their fields, but were unable to survive the disruptive technologies of the past few decades. Amazon, Alphabet/Google, Microsoft, Facebook/Meta, and Apple have been among the big winners in the internet-based digital economy.

A recent issue of The Economist explored this question. We may all assume that given the continuing pace of technology and business change, no company is safe from disruption. But, in “America’s corporate giants are getting harder to topple,” The Economist questioned these assumptions. “America Inc has experienced surprisingly little competitive disruption during the internet age. Incumbents appear to have become more secure, not less.”

Working With AI’s Human-Like Alien Intelligence

“When OpenAI unleashed its humanlike ChatGPT software on the world last year, one thing was clear: These AI systems are coming for our jobs. But don’t write off the humans just yet.” said “The New Jobs for Humans in the AI Era,” a WSJ article published on October 5. As has been the case with major technologies over the past two centuries, — e.g., steam power, electricity, the internet,  — AI will both threaten and lead to the creation of new jobs. While still in the early stages, “AI is already creating new opportunities,” said the article, mentioning a few of those new opportunities.

I found two of those new jobs particularly intriguing: prompt engineer and AI psychotherapist. Generative AI and large language models (LLM) are a new kind of human-like alien intelligence that even the people building them don’t really understand how they work. Researchers are attempting to unlock the AI black box in hopes of understanding how to best work with these powerful, alien technologies.

Let me discuss each of these two jobs.

Could Generative AI End Up Reducing the Growing Inequality in Labor Markets?

Over the past three decades, high skill jobs requiring expert problem solving and complex communication skills significantly expanded, with the earnings of the college educated workers needed to fill such jobs rising steadily. Conversely, opportunities and wages declined for less educated middle skill blue-collar manufacturing jobs and white-collar administrative jobs whose careers have been upended by automation.

“But the new kind of automation — artificial intelligence systems called large language models, like ChatGPT and Google’s Bard — is changing that,” noted a recent NY Times article, “In Reversal Because of A.I., Office Jobs Are Now More at Risk.” “These tools can rapidly process and synthesize information and generate new content. The jobs most exposed to automation now are office jobs, those that require more cognitive skills, creativity and high levels of education. The workers affected are likelier to be highly paid, and slightly likelier to be women, a variety of research has found.”

The NYT article referenced two that analyzed the occupations most exposed to AI, one from the Pew Research Center, the other from Goldman Sachs Research.

AI and the Future of Healthcare Systems

In 2009 I participated in a panel at an MIT Symposium on complex systems where I gave a talk on complex social organizations. The panel included talks on financial, energy, and healthcare systems by three eminent leaders in their fields. I was particularly impressed by the talk given by Denis Cortese, who at the time was the president and CEO of the Mayo Clinic, and who after retiring in 2010, joined Arizona State University as Foundation Professor and director of its Center for Healthcare Delivery and Policy.

Dr. Cortese explained that healthcare is a system of coupled systems. Healthcare is composed of three interconnected domains: knowledge, — the domain of medical research, where new ideas, inventions and medical approaches are developed; care delivery, — the domain of physicians and hospitals where patients are treated; and payers, — the domain of insurance and governments that pay for the delivery of healthcare. Each of these domains is quite large and complex in its own right, but their convoluted interactions is one of the main reasons why healthcare systems are so incredibly complex.

Could AI now help us better deal with the inherent complexity of healthcare systems? After decades of promises and hype, AI has finally become the defining technology of our era. Over the past two decades, the necessary ingredients have come together to propel AI beyond universities and research labs into the broader marketplace: powerful, inexpensive computer technologies; advanced algorithms and models; and huge amounts of all kinds data. Data has been the key element in the major AI advances over the past 20 years, including big data and data science in the 2000s, machine and deep learning in the 2010s, and Large Language Models (LLMs) and generative AI in the past few years.

In trying to understand the potential use of AI in healthcare systems, I came across the work of John Halamka. Dr. Halamka is president of the Mayo Clinic Platform, an organization that aims to drive innovations in diagnosis, treatment, and operational improvements in healthcare systems. He’s also a prolific writer, having authored a number of articles and books on the subject.

How the Original Promises of the Open Source Movement Now Apply to AI Systems

“AI systems don’t operate like traditional software – they require distinct development processes and rely on specialized and costly resources currently pooled in the hands of a few large tech companies,” wrote David Gray Widder, Meredith Whittaker, and Sarah Myers West in a recent research paper, “Open (for Business): Big Tech, Concentrated Power, and the Political Economy of Open AI” (Open AI). “Even so, many of the original promises of the open source movement, which were made in reference to open source software, are now being projected onto ‘open’ AI. From the promise that open source could democratize software development, to the view that many eyes on open code could ensure it did what it said it did and was free of vulnerabilities, to the perspective that open source levels the playing field, allowing the most innovative to triumph. Open source software did many of these things, to varying degrees. But ‘open’ AI is a different story.”

I’ve been personally involved with open source, open standards, and related initiatives for the past few decades. In the mid-late 1990s, I led IBM’s Internet Division, and let's remember that a major part of the explosive growth of the internet and World Wide Web was due to the widespread availability of open source implementation of their key open standards. In the early 2000s I led IBM’s Linux initiative, which played a leading role in organizing a consortium of companies to support the development of Linux which later became the Linux Foundation (LF). And, for the past two years, I’ve been a member of the Advisory Board of the Linux Foundation Research division.

In trying to understand how the original promises of the open source movement now apply to this new generation of AI systems, I found the Open AI paper quite helpful. Let me summarize some the key points discussed in the paper.

Reconciling a Puzzling Paradox: Slow Productivity Growth Despite Breakneck Technology Advances

“One of the most enduring macroeconomic puzzles of the last several decades is the pervasive slowdown in productivity growth across industrialized nations, despite breakneck advances in information and communication technologies (ICT) and electronics,” wrote economists Daron Acemoglu, David Autor, and Christina Patterson in their recent paper Bottlenecks: Sectoral Imbalance and the US Productivity Paradox.

Over the past three decades, ICT and electronics patents and productivity growth have been moving in starkly different directions. The total number of patents granted between 1990 and 2010 grew from 99,000 to 208,000, with ICT and electronics patents accounting for 80% of the increase. And, while total factor productivity (TFP), — generally considered the primary contributor to GDP growth, —grew by 1.7% in the US between 1997 and 2005, its growth has been minimal, just around 0.4% since 2005.

“How can these facts be reconciled?,” ask the authors. Are we in a “new age of abundance” driven by our increasingly smart machines? Or have we entered “an age of slower growth because the most-impactful technologies have already been developed and exploited?”

Jobs Expected to Grow and Jobs Expected to Decline Through 2030

“The COVID-19 pandemic disrupted labor markets globally during 2020,” said a February 2021 McKinsey report on “The future of work after COVID-19.” “The short-term consequences were sudden and often severe: Millions of people were furloughed or lost jobs, and others rapidly adjusted to working from home as offices closed. Many other workers were deemed essential and continued to work in hospitals and grocery stores, on garbage trucks and in warehouses, yet under new protocols to reduce the spread of the novel coronavirus.”

Two and a half years later, a recently published report by the McKinsey Global Institute (MGI), “Generative AI and the future of work in America,” paints a radically different picture: “the US job market has come roaring back from its sudden drop. The nature of work has changed as many workers have stuck with remote or hybrid models and employers have sped up their adoption of automation technologies. More recently, the accelerated development of generative AI, with its advanced natural language capabilities, has extended the possibilities for automation to a much wider set of occupations.”

The US labor market is now undergoing a rapid evolution in the way people work and the work people do. “Some 8.6 million occupational shifts took place from 2019 through 2022. Now even more change is in store. We expect an additional 12 million occupational shifts by 2030.”

The Critical Value of Human-Created Knowledge to the Future of Generative AI

“In early 2021, a Wikipedia editor peered into the future and saw what looked like a funnel cloud on the horizon: the rise of GPT-3, a precursor to the new chatbots from OpenAI,” wrote author and journalist Jon Gertner in “Wikipedia’s Moment of Truth,” a recent NY Times Magazine article. “When this editor — a prolific Wikipedian who goes by the handle Barkeep49 on the site — gave the new technology a try, he could see that it was untrustworthy. The bot would readily mix fictional elements (a false name, a false academic citation) into otherwise factual and coherent answers. But he had no doubts about its potential.”

The article caught my attention because I’ve long been relying on Wikipedia as my go-to website for looking up topics I want to learn more about, as well as using links to Wikipedia articles as references in the weekly blogs I’ve been posting since 2005.

Over the past decade, Wikipedia has become much more than an encyclopedia, — “a kind of factual netting that holds the whole digital world together.” Google, Bing, Siri, Alexa, and other search engines and digital assistants often rely on Wikipedia for the information needed to answer users’ questions. More recently, Wikipedia has been one of the largest sources of the data, — currently estimated at around 3% to 5%, — for training Large Language Models (LLMs) and related chatbots. Wikipedia has played a major role in the digital world because its large amounts of data are free, easily accessible, high quality, and well-curated.

The World Economic Five Year Jobs and Skills Outlook

Earlier this year, the World Economic Forum (WEF) published “The Future of Jobs Report 2023.” The WEF has been publishing Future of Jobs Reports since 2016 to explore how socio-economic and technology trends are likely to shape the evolution of jobs and skills over the following 5 years.

“In 2023, labour-market transformations driven by technological breakthroughs, such as the coming of age of generative artificial intelligence (AI), are being compounded by economic and geopolitical disruptions and growing social and environmental pressures,” wrote WEF Managing Director Saadia Zahidi in the Preface of the 2023 Report. Encompassing almost 300 pages, the report explores how jobs and skills are likely to evolve in the 2023-2027 period. Its trends and predictions are based on a survey of over 800 large companies which collectively employ over 11.3 million workers across 27 industry clusters and 45 economies from all around the world.

Let me discuss a few of the report’s key findings and predictions.

Answers from Gartner Experts to Key Enterprise Questions about Generative AI

“Worldwide IT spending is projected to total $4.7 trillion in 2023, an increase of 4.3% from 2022,” said Gartner in its July 19 forecast of IT spending. “As CIOs continue to lose the competition for IT talent, they are shifting spending to technologies that enable automation and efficiency to drive growth at scale with fewer employees.” The forecast adds that “While generative artificial intelligence (AI) is top of mind for many business and IT leaders, it is not yet significantly impacting IT spending levels. In the longer-term, generative AI will primarily be incorporated into enterprises through existing spending.”

The forecast includes a link to an excellent article, “Gartner Experts Answer the Top Generative AI Questions for Your Enterprise.” The overall assessment of the Gartner experts is that “Generative AI isn’t just a technology or a business case — it is a key part of a society in which people and machines work together.” Let me summarize their answers to some key questions.

What is Generative AI? In answer to a question or prompt, generative AI can create an impressive variety of content based on the characteristics of its training data, including images, videos, music, speech, text, software code and product designs. Generative AI is based on foundation models, - the name coined by the Stanford Institute for Human-Centered Artificial Intelligence to large machine learning models that are trained on vast amounts of data, and can thus be adapted to a wide range of tasks.

Will Work from Home Stick?

Working from home (WFH) has been around for decades. The share of WFH three or more days per week was under 1% in 1980, growing modestly with the rise of the internet to 2.4% in 2010 and 4.0% in 2018. Then came Covid-19, forcing tens of millions around the world to work from home and triggering a mass workplace experiment that broke through the technological and cultural barriers that had prevented WFH adoption in the past.

Economists Jose Maria Barrero (Instituto Tecnológico Autónomo de México), Nicholas Bloom (Stanford University), and Stephen J. Davis (University of Chicago) have been tracking the evolution of WFH since May of 2020 by conducting monthly surveys. Their surveys ask a number of questions about working arrangements with WFH during the pandemic, as well as worker preferences and employer plans after the pandemic ends. Typical respondent are 40 to 50 years old, have one to three years of college, and earned $40 to $50 thousand in 2019.

One of their first surveys found that the percentage of paid full days worked from home once COVID hit in April of 2020 was 61.4%, a huge increase from their 4.8% WFH estimate just before COVID. The percentage then went down in subsequent months. One year later, in April of 2021, WFH was around 45%.

Productivity Gains of Generative AI for Software Developers

In June of 2023, McKinsey published “The Economic Potential of Generative AI: The Next Productivity Frontier.” Based on its analysis of 63 business use cases, and estimates of its effect on the productivity of the global workforce, McKinsey’s study projected that generative AI could add an additional $6.1 trillion to $7.9 trillion annually, boosting the overall impact of artificial intelligence on the global economy by an annual $17.1 trillion to $25.6 trillion.

The McKinsey study found that while generative AI use cases could have an impact on most enterprise business functions, four in particularly could account for approximately 75% of the total annual value from generative AI use cases: customer operations, marketing and sales, research and development, and software engineering.

Digital technologies, including advanced analytics and machine learning algorithms, have been applied to the first three functions for the past few decades, so it’s easier to understand how GenAI would build on previous work as well as give rise to innovative new advances. But that hasn’t quite been the case with software engineering.

In a recent article, “Quantifying the Productivity Gains of Generative AI for Developers,” IBM Fellow Jerry Cuomo nicely explained the role of generative AI in enhancing the productivity of software developers by examining the potential benefits for developers of varying experience levels, from novice to experts. Over the years, Cuomo has played a major role in a number of major software advances, from IBM’s WebSphere Application Server to open source Hyperledger blockchain technologies. He’s currently CTO in IBM's Consulting business unit where he’s responsible for AI-based automation technologies and strategy.

“The productivity gains enabled by the introduction of generative AI allow for a shift to value and create opportunities for increased innovation, improved quality, enhanced customer experience, and faster time-to-market,” wrote Cuomo. “Specifically, we estimate that generative AI can lead to a 15–20% increase in the number of new products or features developed, a 10–15% reduction in the number of bugs found in production, a 5–10% increase in customer retention and loyalty, and a 10–15% reduction in time-to-market for new products or features.”

What Small Children Can Do that AI Doesn’t Know How to Do (Yet)

“It’s natural to ask whether large language models like LaMDA (short for Language Model Dialogue Application) or GPT-3 are really smart — or just double-talk artists in the tradition of the great old comedian Prof. Irwin Corey, ‘The World’s Greatest Authority,’ wrote UC Berkeley cognitive and developmental psychologist Alison Gopnik in ‘What AI Still Doesn’t Know How to Do,’ a July, 2022 WSJ essay. “But I think that’s the wrong question. These models are neither truly intelligent agents nor deceptively dumb. Intelligence and agency are the wrong categories for understanding them.”

“Instead, these AI systems are what we might call cultural technologies, like writing, print, libraries, internet search engines or even language itself. They are new techniques for passing on information from one group of people to another. Asking whether GPT-3 or LaMDA is intelligent or knows about the world is like asking whether the University of California’s library is intelligent or whether a Google search knows the answer to your questions. But cultural technologies can be extremely powerful — for good or ill.”

A recent article in The Economist, “How AI could change computing, culture and the course of history,” made a similar point. That article aimed to give us a sense of the world-changing transformations we might expect from generative AI by discussion two of of the most transformative cultural technologies of the past few hundred years: the printing press and the web browser.

Why Transformative AI Is So Hard to Achieve

“Humans have a good track record of innovation,” wrote Arjun Ramani and Zhengdong Wang in an essay which systematically explains “Why transformative artificial intelligence is really, really hard to achieve.” “The mechanization of agriculture, steam engines, electricity, modern medicine, computers, and the internet — these technologies radically changed the world. Still, the trend growth rate of GDP per capita in the world's frontier economy has never exceeded three percent per year.”

“Yet many people are optimistic that artificial intelligence is up to the job. AI is different from prior technologies, they say, because it is generally capable — able to perform a much wider range of tasks than previous technologies, including the process of innovation itself. Some think it could lead to a Moore’s Law for everything, or even risks on a par with those of pandemics and nuclear war.”

The essay consists of three sections: the transformational potential of AI is constrained by its hardest problems; major technical hurdles remain; and social and economic hurdles may limit AI’s impact. Let me summarize a few of the key arguments in each section.