Mapping out the Hexagon Measurement Framework as a Blueprint Underlying Measurement in the Human Sciences

This paper explores some of the conceptual complexities associated with developing a learning progression where its final object is represented as a cycle. By way of introduction to this conceptual and theoretical review, the paper first describes some of the conceptualizations underlying the work of the BEAR Center in developing learning progressions. The core of all of these developments is the construct map, the first building block of the BEAR Assessment System (BAS). After introducing the concept of a learning progression, this paper summarizes the elements of the BAS, emphasizing the central role of the construct map. This paper then describes a series of several different ways to interpret the relationship between the idea of a construct map and the idea of a cycle-based progression. Along the way, the paper discusses some strengths and limitations of these conceptualizations, focusing on issues related to both education and measurement. The paper concludes with some general reflections. Keywords: measurement, assessment, learning progressions, assessment structurehttp://dx.doi.org/10.7764/PEL.51.1.2014.12

This paper explores some of the conceptual complexities associated with developing a learning progression where its final object is represented as a cycle. By way of introduction to this conceptual and theoretical review, the paper first describes some of the conceptualizations underlying the work of the BEAR Center in developing learning progressions. The core of all of these developments is the construct map, the first building block of the BEAR Assessment System (BAS). After introducing the concept of a learning progression, this paper summarizes the elements of the BAS, emphasizing the central role of the construct map. This paper then describes a series of several different ways to interpret the relationship between the idea of a construct map and the idea of a cycle-based progression. Along the way, the paper discusses some strengths and limitations of these conceptualizations, focusing on issues related to both education and measurement. The paper concludes with some general reflections. Keywords: measurement, assessment, learning progressions, assessment structurehttp://dx.doi.org/10.7764/PEL.51.1.2014.12

This article is a written version of the Presidential Address1 I gave at the annual meeting of the National Council on Measurement in Education (NCME) in April 2017. It is a call to NCME members (and others who read this, of course) to rebalance their focus so that classroom assessments are seen as being at least as important as large‐scale assessments for education (in fact, in my view, they are more important). The article reviews research literature about the effects of classroom assessment to establish its importance for education. Then, the roles of large‐scale assessment are reviewed, and, in particular, it is noted how these can have negative results when the large‐scale assessments are not well aligned with sound curriculum and instructional and assessment practices grounded in theories of learning. In the next two sections (a) the idea of a learning progression is described as a way to facilitate the coherence between classroom and large‐scale assessment and (b) the idea of a “roadmap” is described, being the assessment components of the learning progression. This is followed by a description of an example of such a roadmap, developed for the Assessing Data Modeling and Statistical Reasoning project using the BEAR Assessment System (BAS). Finally, a concluding discussion reviews the ways that the coherence between large‐scale and classroom assessments can be achieved using the BAS, and hence make measurement more important for education.

Being Human is a masterful argument for the value and necessity of the human sciences and of their history. In a reflexive dialogue with a long Continental tradition, from Giambattista Vico to Hans-Georg Gadamer, Smith makes a case for the human sciences qua sciences proper. This requires some qualification for the English reader, to whom ‘science’ normally means ‘natural science’, whilst Smith employs it in the non-disciplinary sense of the original scientia. In a nutshell, the argument is that human sciences are sciences just as much as the natural ones, that they are defined by different purposes – not objects or methods – and that they are constitutively historical and moral. The human sciences are, in principle as in practice, irreducible to the natural ones – indeed, the opposite argument emerges throughout the book. Their legitimacy is grounded on their intrinsically reflexive character – as opposed to the extrinsic ‘reflectivity’ of the natural sciences – that expresses itself in the specificity of their object (the concrete, historical making of being human) and in their dialogical, hermeneutic approach. There is no place out of history. Thus, materialistic and naturalistic claims to ‘exclusive access’ (p. 7), to knowledge about what is human, are simply declared as ‘mistaken’, on grounds that being human is not about possessing a nature, rather it is a reflexive act engaging the past, present and future in a moral process of self-formation. ‘Human’, Smith argues, is a moral category, defined in and by its making. That is why the human sciences do not, and cannot, constitute a disciplinary form of knowledge, but ‘[create] a social space where disciplines seek to co-operate’ (p. 213). All sciences that have a bearing on being human can be human sciences, provided that their own historicity is acknowledged, and with it, the necessity of multiple perspectives on being human. Being Human can be read as an argument for historical science as the pinnacle of knowledge, the science of all sciences in their concrete becoming. Smith seeks to avoid this by constant reference to a multiplicity of legitimate knowledges, serving different contingent purposes. This leads to some complications. First, the problem of the epistemological relations among the sciences: one cannot see how the human sciences, in this context, can ever be open to any input from the natural sciences. ‘Indeed, knowledge of nature needs reinterpretation in the light of knowledge of people, not vice versa’ (p. 13). Much as the multiplicity of the approaches is stressed, again, as inherent to the concept of human sciences, a hierarchy of knowledge unfolds through the book, reminiscent of Croce’s absolute historicism (which Smith does not address). Second, the reference to different values and interests grounding the multiplicity of perspectives opens up a related, if different problem: that of the concrete historical relations of the natural and human sciences. Smith does not address this issue systematically, although at all critical points but one he makes enlightening references to the institutional and political dimensions of these boundary disputes. Where he fails to provide this contextualisation is in relation to the present. The Humboldtian university, which provided the blueprint for the disciplinary and professional organisation of knowledge, was consubstantial to the ideal of Bildung. That model has come to a crisis: the scientific disciplines are dissolving into interdisciplinary fields, while the criteria of productivity and significance of the natural sciences, together with their organisation of labour, are being extended to all education and knowledge production. The historical sciences of the human, therefore, find themselves logically superordinate, for the dignity of their object and their bearing at once theoretical and moral, but actually subordinate, being evaluated on grounds they cannot share. Smith makes a brave and timely move in showing that the sciences of being human are logically sound and, moreover, epistemologically and morally necessary as sciences of anthropopoiesis, generation of meaning and value. But the fact that all sciences have a value-based foundation says nothing about the relative force of these values, and of their concrete, ideal and political effects. ‘Natural’, we must not forget, is as moral a category as ‘human’, and a most powerful one nowadays.

Method, Techne and Auto-kinesis Ryan Bishop (bio) "I write differently from how I speak, I speak differently from how I think, I think differently from how I should think, and so on into the furthest depths of obscurity." – Franz Kafka "That the machine does not run by itself means something else: a mechanism without its own energy. The machine is dead. It is death. Not because we risk death in playing with machines, but because the origin of machines is the relation to death." – "Freud and the Scene of Writing" (227) "Auto- repr. Gr.- 'self, one's own, by oneself, independently,' combining form of self. Exceedingly common in Gr.; in L. only in a few words adopted from Gr. without analysis, as autochthones, autographus, automatus; more common in med.L.; and largely used in the mod. langs. In Eng., to a certain extent, a living element, prefixable to scientific terms denoting action or operation, whence occasionally to others, in combinations that are more or less nonce-words. In free composition as a prefix element, its chief meanings are: (a) of oneself, one's own; self-; (b) self-produced or -induced (pathologically) within the body or organism; (c) spontaneous, self-acting, automatic." – OED The Auto-: Derrida and the Human Sciences Perhaps something about the "auto-" can help us understand aspects of the situation we find ourselves in forty years after "Structure, Sign and Play" (SSaP) as well as the other writings by Jacques Derrida published in the watershed year of 1967, insofar as the Human Sciences have increasingly lost both the human and science into the many disciplinary traps we find lurking in the humanities, social sciences, and physical sciences. The division of the faculties of the university that come so naturally and automatically to us now mimic the division of our corporeal faculties, with those most directly connected to the organic senses receiving the most funding and state support insofar as they are found in the physical sciences. The university's various divisions constitute but one site of the cloven nature of the Human Sciences. Perhaps "the auto-" can offer us a few insights into how we have arrived here because the "auto-" as it emerges in Derrida's writings functions as a hinge between the event (organic/animate) and the machine (calculable/inanimate). i The "auto-" reveals the tensions between method and event, mechanical repeatability and organic individuality, and representation and production. It can also tell us much about movement. Movement and momentum occur frequently in the works of Derrida from this period (and others) and are essential to differance, though their influence is often a covert one. The "auto-" can be seen operating in iterability as well, shuttling between the necessary mechanics of repetition and the unpredictability of enunciation central to iterability. In Speech and Phenomenon (SaP), Derrida deconstructs Husserl's "ideality" through the mechanisms of "repetition" and "repeatability" and thus has iterability in play more or less from the outset though not given its proper name as yet. Thus, the "auto-" offers us a figure and a problematic that is found in the tensions central to both difference and iterability. As the OED definition presented above indicates, the prefix "auto" over time performs its content. This affix is self-performing, almost auto-grammatic or auto-semantic. The movement from Greek to early Latin, to medieval Latin, and "largely modern languages" embodies "the auto-" itself in a momentum of usage that is indicated by but not reducible to an increase of use and application. "The auto-" enacts its auto-attributes, its auto-ness. And this auto-ness has much to say about the Human Sciences some forty years on from SSaP as they pertain to method (representation and production) and critical reading. The tension between representation and production as modes and goals of method within the Human Sciences is a tension found in the difficult term "Human Sciences" although it is a tension shot through with complementarity and connections. This tension, which repeats the ancient pull between truth and rhetoric – or in a different register, between nomos and physis -- is one of the explicit inquiries of SSaP. The legacy of the article, however, does little to convince...

This paper aims at laying this ghost of Religion as a Science to rest by establishing the link between Physical sciences and Human sciences using scientific methodology. We intend to put a case for the Human sciences by systemati- cally arguing out the fact that Human sciences are truly sciences and that the very methodology employed by the physical sciences are the ones used in social sciences. We shall also establish where they differ especially as regards intention. It is also our hope that we explicate the scientific character of religious knowledge and to establish the third way in which we can study both physical and social sciences. Part One deals with the nature of science which will help us to know exactly what we mean by We shall also examine the relationship that exists between physical sciences and social sciences. Part Two deals with the scientific character of religious knowledge and how it fits within the general understanding of sci- ence. In Part Three, we trace the development of phenomenology of religion as the method for studying religion and how phenomenology is a science just like any other Finally, we shall apply the knowledge so gained to the study of religion and how religion is studied. In the final analysis, we want to find out whether religious studies can truly be called Religious science.

This chapter aims to present a brief conceptual history of philosophical thinking about measurement, concentrating in particular on the issues of objectivity and subjectivity, realism and nonrealism, and the role of models in measurement, as well as a discussion of how these philosophical issues have shaped thinking and discourse about measurement in both the human and physical sciences. First, three perspectives on measurement and its epistemic status are discussed, grouped as (a) naive realism, (b) operationalism, and (c) representationalism. Following this, we discuss how these perspectives have informed thinking about the concept of validity in the human sciences, and how they have influenced the way in which measurement is characterized in different contexts as being dependent on empirical and/or mathematical constraints. We then attempt to synthesize these perspectives and propose a version ofmodel-dependent realismwhich maintains some of the elements of each of these perspectives and at the same time rejects their most radical aspects, by acknowledging the fundamental role of models in measurement but also emphasizing that models are always modelsofsomething: the empirical components of measurement are designed and operated to guarantee that, via such models, measurement results convey information on the intended property. The analysis also provides a simple explanation of two of the most critical stereotypes that still affect measurement science: the hypotheses that (1) measurement is quantification, which hides the relevance of the empirical component of the process, and that (2) measurement is only a process of transmission and presentation of preexisting information, usually intended as the “true value” of the measurand, which instead neglects the role of models in the process.

NATURE AS ANIMATING: THE SOUL IN THE HUMAN SCIENCES HIS ESSAY ADDRESSES the problem of the fragmentation of knowledge on the contemporary scene, nd proposes that the rediscovery of the Aristotelian concept of nature can go far toward providing a solution.1 Well known is the situation in academe, where specialization is the price of advancement and tenure, and where few professors are capable of ranging outside their fields to assess truth claims or attain a comprehensive overview. No less serious is the compartmentalization of knowledge at research institutes and "think-tanks," where competent scholars are engaged in detailed analyses of problems in economics, political science, and international security, but where it has proven difficult to generate studies that direct prudent action by government leaders. Here the basic problem is the perennial gap that intrudes itself between knowledge and action, between what Aristotle identified centuries ago as theoria and praxis, which we may label, following him, as that between the theoretical and practical disciplines. The direction of sensible action in the sphere of human affairs, in Aristotle's view, pertained to ethics and politics, which he regarded as practical sciences-concerned not merely with knowing but with knowing as ordered to doing. The practical orientation of scholar1 The article is an expanded version of a colloquium paper read at the Woodrow Wilson International Center for Scholars, Washington, D.C., on November 8, 1984, with the title "The Idea of Nature: Its Contemporary Relevance for Ethics and Politics." .An earlier draft was read in the Seminar on Problems of .Authority and Participation at the same Center on .August 13, 1984, with the title "The Modeling of Nature: Can the Soul Be Put Back Into the Human Sciences? " The author wishes to thank Edmund Pellegrino and Otto Bird for their helpful commentaries on the colloquium paper, and James Billington, Prosser Gifford, and .Ann Sheffield for providing the stimulating ambience in which it could be written and presented. 61~ THE SOUL IN THE HUMAN SCIENCES 613 ship-the ideal embodied in " knowing as ordered to doing "is a concern that goes far beyond the needs of academe and research institutes. Its neglect on the contemporary scene is but an instance of the more pervasive fragmentation of knowledge that characterizes our culture. The theme of this essay is that the concept of nature, particularly as animating and instantiated in the human soul, can be fruitful in overcoming such fragmentation in a basic way: by reuniting the physical and the human sciences and showing how action or doing can be related to both.2 By the physical sciences we mean the speculative or theoretical sciences concerned with nature, the phusis of the Greeks, whence the term "nature " in our title. Among such sciences one might include physics, astronomy, chemistry, biology, psychology in its more theoretical aspects, and so on. The human sciences we take to embrace those concerned with man's affairs: the social and political sciences, ethics and politics, economics, the behavioral sciences in their more clinical aspects, etc. They less obviously are concerned with nature, and yet they are but manifestations of human nature in action, as will be shown in the sequel. Thus nature as seen in the world of nature and as embodied in human nature as part of that world is the concept around which we propose our integration. The regulative idea is simple: nature is an intrinsic principle of perfective activity, and the better we understand a nature or a natural kind the more we can appreciate how it should act. Thus we would bridge the " is " and the " ought " by rooting the norm for action in an objective standard: a nature that is not completely refractory to understanding. Here it is important to observe that there is a vast difference between knowing all there is to know about a nature and having no knowledge of it at all. By the somewhat elliptical expression, " a nature that is not completely refractory to understanding," 2 For an exposition of the concept of nature and the intellectual context in which the following development should be situated, see W. A. Wallace, "The Intelligibility of Nature: A Neo-Aristotelian View," Review of Metaphysics...

For most people, even today, phenomenology stands squarely on the human science side of a ‘two worlds’ divide between human science and physical science that has dominated the understanding of the sciences throughout the twentieth century. Phenomenology has been associated with human interpretation and with a hermeneutical method which has been seen as antithetical to the facticity and formal methods of the natural sciences. However, phenomenology’s relationship to science has always been more interesting and complex than this. There have been a few in the last century who have understood the role of practice and hermeneutics even in the hardest of the natural sciences, and today the ranks of those who question the division of science into two worlds—along with a metaphysics of different realms of meaning and material—is growing. At the same time, the essentially negative ‘post-modern’ critique of a dualist metaphysics is also being supplemented by a more positive and ‘constructive’ metaphysics which sees us creating our practical ‘worlds’ and knowledge hermeneutically in material and especially technical situations. This ‘technoconstructive’ view might be seen to be essentially about the way we construct human environments in which specific logics, functionalities and meanings are technically supported. It is a view, therefore, which may lead to an understanding of the way in which urban environments are ‘technoconstructions’ which support specific urban societies and economies. I review these issues and demonstrate how the Amsterdam of the seventeenth century could be seen as just such a ‘technoconstruction’. I also insert a subtext which problematises a common understanding of complexity science as just another set of formal methods, which unifies science by applying the same formal methods to both human and natural sciences, and I suggest instead that all science should be understood as material hermeneutics and ‘technoconstruction’.

This paper discusses how assessment practices in higher education can improve or hinder learning. An example is given to illustrate some common educational practices that may be contributing to underpreparation and underperformance of students. Elements of effective learning environments that may better address underlying metacognitive issues are discussed. The principles of the Berkeley Evaluation & Assessment Research Assessment (BEAR) System are introduced, and their use to improve learning is described in the context of the UC Berkeley ChemQuery project.

This chapter advances a definition for “college-ready data-based reasoning�? and describes the development of the Critical Reasoning for College Readiness (CR4CR) Assessment. This assessment has both summative and formative elements, coordinated by an underlying learning progression. Drawing on a literature review on statistics curricula, we have developed (a) a framework for data-based reasoning at the college-entry level and (b) an instrument to measure two of the constructs in that framework: Linking Data to a Claim (LDC) and Formal Inference (FoI). The LDC construct describes student development in thinking about the link between data and the content of a statistical claim, while FoI describes student development in critical reasoning when making formal inference with respect to the notions of practical and statistical significance. Using the BEAR Assessment System (BAS) iterative approach for the instrument development, we found that the developmental progressions defined as FoI and LDC are promising, but that further iterations of the BAS cycle are needed.

In this article, we are trying to grasp the role of hisroricism in the understanding of epistemology in the late of XX century. From Bacon to enlightenment, it has been understood that the only criterion of science based on natural sciences. The extent of science has also been determined as study according to the method of the natural sciences, therefore the sciences concerned with history and society has also determined according to method of the natural sciences. In this article authors aims to introduce to movement called Historicism. Which is emerged in XIX century as a critical viewpoint against classical approach to the science. Most influential figure of this movement was German thinker Wilhelm Dilthey. Dilthey had an anti-positivist attitude towards the established methodology by natural science. Which was saying that in order to be a science every researcher must have rigorous set of rules and their research must based on experiment results, observable facts, and objective evidence. Starting from Dilthey and with help of other philosophical schools new movement called historicism starts its journey to establishing new methodology to human and social science. And this movement made a classification of science. They divided science into natural and spiritual science. Each of science has its own methods and object of study. They believed that to social and human study we cannot apply natural science methods of research due to it is not a physical or biological subject but it is social life and human destiny and history. Considering this process of change, is it possible to talk about historicism as a contemporary epistemological approach? As a methodology, can we talk about history in the separation of positive science? What is the subject of history in social and human sciences? By moving from this questions, we will try to understand the role of historicism in the contemprory philosophy on the hermeneutical phenomenological approach.

The Macy Conferences on Cybernetics were a series of 10 interdisciplinary scientific meetings that took place in New York between 1946 and 1953. The meetings were sponsored by the Macy Foundation, which aimed to promote interdisciplinary approaches to the social, behavioral, and medical sciences. Co-organized by neuropsychiatrist Warren S. McCulloch and Frank Fremont-Smith, medical director of the Macy Foundation, the meetings brought together a variety of scientists from mathematics, psychology, engineering, anthropology, physics, ecology, psychiatry, neurophysiology, linguistics, and sociology. The conferences strove to apply tools from the physical sciences and mathematics to problems in the biological and human sciences. Such tools stemmed first from Norbert Wiener’s work on the anti-aircraft predictor, in which he employed the concept of negative feedback to explain purposeful behavior, and second from McCulloch’s work with Walter Pitts on the logic of neural activity, which purported to embody logical reasoning in the physiology of the brain. Wiener and McCulloch touted the practice of hypothetical modelling as a bridge over the divide between the natural and the artificial, and a method for explaining purposeful behavior in organisms and machines. Discussions at the Macy Conferences expanded on this work, and participants discussed and debated models of cognitive functions such as sensation, communication, memory, and learning, all cast as functions of the mind and exemplars of purposeful behavior. Thus, the meetings signal a major shift in 20th-century psychology, when discussions of the mind took on a more central place in psychological discourse. Behaviorist psychologists in the early 20th century had largely rejected concepts of mind as unscientific and not objective. The Macy Conferences, in contrast, placed the mind at the nexus of interdisciplinary inquiry across the divide between the physical and human sciences, and helped to bring back the mind as a topic of objective, scientific inquiry in psychology and in the emerging cognitive sciences.

Building a learning progression for scientific imagination: A measurement approach

The importance of the construct to the fields of measurement and cognitive science cannot be overstated. Without an understanding of the construct, including clarity and scope of the substantive and structural aspects, one cannot ensure valid use and interpretation of a constructed measure. In this sense, measurement and cognitive science are fundamentally connected through the construct. One important construct that lacks clarification in definition and structure is a sense of belonging in science. This is especially true for adolescent age students. Unfortunately, this attribute is often vaguely conceptualized and largely missing from the literature for school-age students, and therefore, in need of a rigorous theoretical foundation supported by empirical evidence to ensure meaningful use of any assessment or interpretation of results. Using the BEAR Assessment System’s approach to constructing measures, which includes using Rasch family modeling, data were collected from high school students through eight exploratory interviews, 12 think-aloud interviews, focus groups comprised of 9–12 participants per group (45 students in total), and 537 surveys; and from five experts to develop and validate a 12-item self-report survey of high school students’ sense of belonging in science. Sources of evidence for reliability, validity (content, internal structures, response processes, and relation to other variables), and fairness were collected and analyzed to produce a construct-centered survey. Overall, findings produced strong evidence for the valid, reliable, and fair interpretation and use of the Sense of Belonging in Science Survey (BiSS). This research highlights the importance of the construct as the driver of the design and quality assurance of a measure.