Language and Reality in Writing Assessment

Abstract

I recently attended a conference previously unknown to me and to most college English faculty: The Assessment Forum of American Association for Higher Education (AAHE). (I was there to give a paper on measurement of writing ability and on evaluation of writing programs.) The experience of that conference ought to have been routine; after all, I have directed a variety of large-scale writing programs and I have been speaking and publishing on writing assessment for over fifteen years; I have also spent many years as chair of an English department and as a writing program administrator. But experience of hearing papers and discussions at that conference was not at all routine; it was both troubling and enlightening, as well as quite new in unexpected ways. My first reaction to sessions on writing measurement at AAHE was that I had entered a new world. The papers not only made different assumptions about writing than I, as a writing teacher, writer, and researcher, normally make, but came out of a wholly different scholarly community of discourse, one that calls itself the assessment movement. The references were entirely unfamiliar, procedures were different, and approach to subject struck me as insensitive to what writing is all about. But all of these differences seemed to center on way people spoke (and hence thought) about measurement: I was in a foreign country, language was different, and that difference changed everything. I had entered a new discourse community in a field in which I was a well-published specialist, and none of my knowledge or experience seemed to matter. And yet discourse was about measuring writing ability and evaluating writing programs, that is, about what has (however accidentally) become my specialty. I felt disoriented. When I returned home from AAHE I found a flier from Jossey-Bass, publisher of my 1985 book, Teaching and Assessing Writing. I don't expect book to appear on every flier marketing division puts out, but this little