Heterogeneous Narrative Content in Annual Reports Published as PDF Files: Extraction, Classification and Incremental Predictive Ability

Abstract

We develop, describe and evaluate a web-based software tool for batch extraction and analysis of digital PDF annual report files. The retrieval method retains information on document structure thereby enabling clear delineation between narrative and financial statement components of reports, and between individual sections within the narratives component. Retrieval accuracy exceeds 95% in manual validations and large-sample tests confirm that extracted content varies predictably with economic and regulatory factors. We apply the tool to a comprehensive sample of reports published by U.K. non-financial firms between 2003 and 2014, and examine the incremental predictive power for future earnings of different performance sections from the same report. While performance-related commentaries prepared by management and the independent board chair are individually predictive for future earnings, only chairman-authored content is incrementally informative when considered jointly. Further, management-authored content has lower independent predictive ability when insiders are more optimistic than the board chair. Results support the view that the predictive power of narratives varies with authors’ reporting incentives and that exaggerated optimism in management commentary reflects obfuscation.