Literary and Linguistic Computing Advance Access originally published online on September 12, 2008
Literary and Linguistic Computing 2008 23(4):409-424; doi:10.1093/llc/fqn019
| ||||||||||||||||||||||||||||||||||||||||||||||||||||
Meaning and mining: the impact of implicit assumptions in data mining for the humanities
Tufts University, Somerville, MA, USA
University of Virginia, Charlottesville, VA, USA
Correspondence: Brad Pasanek, English Department, University of Virginia, PO Box 400121, 427 Bryan Hall, Charlottesville, VA 22904-4121, USA. E-mail: bmp7e{at}virginia.edu
 |
Abstract |
|---|
As the use of data mining and machine learning methods in the humanities becomes more common, it will be increasingly important to examine implicit biases, assumptions, and limitations these methods bring with them. This article makes explicit some of the foundational assumptions of machine learning methods, and presents a series of experiments as a case study and object lesson in the potential pitfalls in the use of data mining methods for hypothesis testing in literary scholarship. The worst dangers may lie in the humanist's; ability to interpret nearly any result, projecting his or her own biases into the outcome of an experiment—perhaps all the more unwittingly due to the superficial objectivity of computational methods. We argue that in the digital humanities, the standards for the initial production of evidence should be even more rigorous than in the empirical sciences because of the subjective nature of the work that follows. Thus, we conclude with a discussion of recommended best practices for making results from data mining in the humanities domain as meaningful as possible. These include methods for keeping the the boundary between computational results and subsequent interpretation as clearly delineated as possible.