Irving Wladawsky-Berger

The Emerging Data-Centric AI Era: Where Will All the Data Come From?

The data-centric AI era started about 25 years ago when the explosive growth of the internet led to what’s become known as big data, that is, the availability of huge amounts of digital data, including text, voice, and images. The 2010s saw major innovations in multi-layered deep learning algorithms, followed in the past few years by the advent of foundation models, including generative AI, large language models, and chatbots.

Given the explosive growth of interest in AI, the demand for data keeps increasing. No matter what an organization hopes to achieve, success is impossible without ready access to high-quality data. But, as data becomes increasingly critical for business success, how are enterprises adjusting to the increasing importance of data? Where is all the data needed to train AI models going to come from? And what are the potential legal and ethical issues that companies need to watch out for?

To explore these important questions, I moderated a panel on The Data Provenance Dilemma at the 2024 MIT Sloan CIO Symposium on May 14. “Generative AI models are highly dependent on the quality and quantity of data used in their training. But, many of these models are being trained on vast, diverse, and inconsistently documented datasets that have been raising serious concerns about the legal and ethical risks involved,” notes the brief for the panel in the Symposium agenda. “The panel will discuss the complexities of using large, diverse datasets in the training of generative AI models, the difficulties involved in understanding the provenance of the data being used, and the kinds of tools and standards needed for the responsible use of these powerful models.”

The panel included Mike Mason, chief AI officer of the technology consultancy Thoughtworks; Shayne Longpre, a doctorate candidate at the MIT Media Lab; and Robert Mahari, who’s pursuing a joint JD-PhD degree at the Harvard Law School and MIT’s Media Lab. Let me summarize the key points we discussed in the panel.

Advancing Global Trade through Open-Source, Digital Bill of Lading

“Imagine you’re a cargo owner in the year 1450,” begins “The multi-billion-dollar paper jam: Unlocking trade by digitalizing documentation,” a McKinsey article published in October of 2022. “You hand over your goods to the ship that will carry them across the world, and are presented with a bill of lading — a piece of paper stating what you’re shipping, where it comes from, and where it’s heading. Fast forward to the year 2022: The world has changed dramatically, but the bill of lading remains relatively unchanged. Today, the bill of lading process is still reliant on the physical transfer of paper records and applies to roughly 40 percent of all containerized trade transactions.

“Current trade documentation spans many documents and processes, and is a manual, time-consuming, and resource-intensive process for all stakeholders. Documentation for a single shipment can require up to 50 sheets of paper that are exchanged with up to 30 different stakeholders. The bill of lading, issued by carriers to acknowledge receipt of cargo from the shipper, is one of the most important trade documents required for shipping.”

According to McKinsey, the bill of lading accounts for between 10 and 30 percent of total trade documentation costs; adopting an electronic bill of lading could save $6.5 billion in direct costs and enable between $30 billion and $40 billion in new global trade volume. “While the banking and aviation industries have implemented digital standards enabling automated trade systems, shipping has not matured far beyond where it was in the 1400s.”

In a recent article, “Advancing Global Trade through Open-Source Electronic Bill of Lading,” the Digital Supply Chain Institute (DSCI) explained the role of bill of lading in global supply chains. “The bill of lading (B/L) functions as an important role in global trade, providing a tangible record of cargo ownership, conditions, and delivery obligations,” according to the article. “While deeply entrenched in trade practices, the traditional paper-based bill of lading has its shortcomings: inefficiencies stemming from manual processes have led to delays, errors, and a higher susceptibility to loss and fraud.”

The Critical Value of Data to Business Success in the Emerging AI Era

“Data has become an increasingly critical component to business success,” said “Modernizing Data with Strategic Purpose,” a recently published report by the technology consultancy Thoughtworks and MIT Technology Review Insights. “The ability to make timely and informed decisions, create tailored customer experiences, and identify new opportunities has enabled the rise of today’s leading digital companies. And with the recent explosion of interest in AI, the demand for data has only increased. No matter what an organization hopes to achieve, success is impossible without ready access to high-quality data. Despite advances in technologies, extracting and transforming enterprise data into a usable asset remains a tremendous challenge for most organizations.”

The report is based on a survey conducted in early 2024 of 350 senior data and technology executives from organizations in the US, the UK, Germany, Singapore, and Australia that earn $500 million or more in annual revenue, with almost half (47%) having revenue of $10 billion or more. Eight industries are represented in the survey: financial services, energy, health care and life sciences, manufacturing, public sector, publishing and media, retail, and travel and transport.

The survey sheds light on how enterprises are adjusting to the increasing importance of data in our emerging data-centric AI era. The data-centric AI era started about 25 years ago when the explosive growth of the internet led to what’s become known as big data, that is, the availability of huge amounts of digital data, including text, voice, and images. Digital data has continued to grow exponentially, and is now estimated to have reached around 150 zettabytes (10²¹ bytes). All these data has enabled AI to make great strides in the 2010s with multi-layered deep learning algorithms, and more recently with foundation models, including generative AI (GenAI), large language models, and chatbots.

“As AI pushes data modernization to the top of more organizations’ agendas, it will also become increasingly important to ensure that the data strategy is closely aligned to the broader business strategy and data leaders are able to clearly articulate how data and analytics can help business units achieve their objectives,” notes the report. “This will not only ensure critical buy-in, but also put the organization in the best position to achieve its goals and lay a solid foundation for continuous improvement, evolution, and value creation.”

Artificial Intelligence: Realistic Expectations vs. Irrational Exuberance

The 2024 MIT Sloan CIO Symposium took place on Tuesday, May 14 at the Royal Sonesta, a hotel overlooking the Charles River a short walk from the MIT campus in Cambridge, MA. Not surprisingly, AI was the dominant theme in this year’s Symposium, with a number of keynotes and panels on the topic. In addition, a pre-event program was added on the day before the Symposium, which included a number of more informal roundtable discussions on various aspects of AI, such as legal risks in AI deployment, AI as a driver for productivity, and human’s role in AI-augmented workplaces.

The Symposium’s closing keynote, What Works and Doesn't Work with AI, was delivered by MIT professor emeritus Rodney Brooks. Professor Brooks was director of the MIT AI Lab from 1997 to 2003, and was then the founding director of MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) from 2003 until 2007. A robotics entrepreneur, he’s founded of a number of companies, including iRobot, Rethink Robotics, and Robust.AI.

“There is a lot of AI and robotics hype right now,” said the blurb describing Brooks’ keynote in the Symposium agenda. “Amongst it are a few important innovations that may help many businesses. The trick is to figure out what is close to deployable and what is off in an uncertain distant future. This keynote will talk both about the traps all of us fall in to evaluating AI claims and demonstrations, and what to look for specifically which will get you to a solid understanding of the time frame for if and when technology will be ready to deploy.”

Let me summarize his keynote.