The Equation: How ChatGPT Revealed ‘Bloat’ in Corporate Disclosures
- August 25, 2023
- CBR - Artificial Intelligence
In a sample of US companies’ annual reports from recent years, the management discussion and analysis section contained almost 20,000 words on average. Not all investors have the time and expertise to make sense of so much text, which raises the question: Does the MD&A section need to be so long? Chicago Booth PhD student Alex G. Kim and Booth’s Maximilian Muhn and Valeri Nikolaev used ChatGPT to summarize MD&A disclosures, as well as transcripts of earnings conference calls, and their findings suggest that the answer is no. The researchers measured text “bloat” by calculating the difference in word count between the original document and what ChatGPT determined to be its optimal summary length—which trades off “signal” (relevant) and “noise” (redundant) words. The disclosures analyzed were bloated by about 70 percent, they find, indicating a high amount of relatively uninformative content. To learn more, read “ChatGPT Could Help Investors Make More Informed Decisions.”
Illustration by Peter Arkle
Their markets have some familiar economic distortions.
How NFTs Defy the Laws of Supply and DemandAn expert panel discusses the ethics and practicalities of personalizing pricing.
Is It Fair to Charge People Different Prices?MIT’s Daron Acemoğlu joins hosts Bethany McLean and Luigi Zingales to discuss the key challenges of ensuring that new technology creates broadly shared benefits.
Capitalisn’t: Is Technological Progress Good for Everyone?Your Privacy
We want to demonstrate our commitment to your privacy. Please review Chicago Booth's privacy notice, which provides information explaining how and why we collect particular information when you visit our website.