Showing posts with label Measurability. Show all posts
Showing posts with label Measurability. Show all posts

Friday, November 27, 2015

Validity ~ A Key Standard of Scientific Research

Validity ~ A Key Standard of scientific Research


By Prof. Mauri Yambo
(1996; updates: 2004, 2006, 2015)


INTRODUCTION

Nine key standards, or principles, of scientific research can be gleaned from texts on research method. As I see them, they are:


3. Control
4. Measurability
5. Validity
6. Reliability (Pending)
7. Objectivity (Pending)
8. Ethics 
9. Representativeness.

I say something about each of the nine standards in separate posts, as shown in the links above. What I want to briefly talk about here is the validity standard. 


Validity means the applicability, genuineness, appropriateness or truthfulness of the methods, instruments, tools, measures (or indicators), or arguments used in the quest for knowledge, or search for answers to vexing questions – and therefore of the conclusions arrived at.  


CLICK HERE To Access the Full Text of "Validity ~ A Key Standard of Scientific Research"


























[CSO 302, CSO 501]

Sunday, November 08, 2015

CSO 302: Nine Key Standards of Scientific Research


INTRODUCTION TO NINE STANDARDS OF SCIENTIFIC RESEARCH

Certain broad standards, principles or criteria have been established for determining what scientific research is all about, and what it is not. That is, the standards help us to determine in some detail whether, or the extent to which, a proposed or completed study meets the expectations of the relevant scientific community -- in the present case, Sociology. They all apply, to a greater or lesser degree, to quantitative or qualitative research, or a combination of the two. The identity or image of Sociology as a discipline, or of any other discipline for that matter, does not somehow disappear just because one wishes to do qualitative, or indeed quantitative, research.

We can clearly identify nine such standards or criteria. These are: universality, replicability, control, measurability (Leedy, 1980: 46); validity, reliability, objectivity, ethics (Comte, 1853; Durkheim, 1982; Weber, 1964: 126-130; Giddens, 1993: 114-116) and representativeness (Sarantakos, 1994: 18-26; Weber, 1964: 110). The cited authors are only examples of scholars who have engaged in conversations about these standards. 

I enthusiastically take the opportunity to share with the reader my own understanding and critique of each of the standards, and of related conversations by other scholars, on separate blog pages. Links to the respective blog pages are embedded in the list below, and readers are invited to click on each at their convenience:

3. Control
4. Measurability
5. Validity
6. Reliability (Pending)
7. Objectivity (Pending)
8. Ethics 
9, Representativeness.


Let me, as I conclude this brief piece, invite debate. The more robust the debate, the better all around.

P.S: An earlier version of this introduction was published in early November 2015, but was quickly withdrawn ('reverted to draft') to allow for more of the nine key standards to first appear. Six standards have now been published. The seventh, "Ethics", has taken more time than previously anticipated -- as the filling of one gap or other in the narrative revealed the exciting need to do yet another, and so on -- but is nearly done. The remaining two will follow soon after it. The release of this updated introduction today (January 25th, 2016) thus appeared as appropriate as it was ever going to be, and so here it is.


References
American Sociological Association, ASA (1999) Code of Ethics and Policies and Procedures of the ASA Committee on Professional Ethics. Washington, DC: ASA

Becker, Lawrence C. and Charlotte B. Becker, Eds (2003) A History of Western Ethics. Second Edition. New York and London: Routledge.

British Sociological Association, BSA (2002) Statement of Ethical Practice for the British Sociological Association. Durham: BSA (consider the PDF version provided)

Comte, Auguste (1853) The Positive Philosophy of Auguste Comte. Volume I. Trans. Harriet Martineau. New York: D. Appleton and Co.

Cooper, John M. (2003) "Classical Greek Ethics", pp. 9-18, in Lawrence C. Becker and Charlotte B. Becker (2003) A History of Western Ethics. Second Edition. New York and London: Routledge.

Durkheim, Emile (1957) Professional Ethics and Civic Morals. Trans. Cornelia Brookfield. Longon and New York: Routledge.

Durkheim, Emile (1982) The Rules of Sociological Method and Selected Texts on Sociology and Its Method. Edited with an Introduction by Steven Lukes. Trans: W.D. Halls. New York: The Free Press

Giddens, Anthony (1993) New Rules of Sociological Method: A Positive Critique of Interpretative Sociologies. Second Edition. Stanford: Stanford University Press

International Sociological Association (2001) Code of Ethics. Madrid: ISA

Jones, Robert Alun (1986) Emile Durkheim: An Introduction to Four Major Works. Beverly Hills, CA: Sage Publications, Inc. (CLICK HERE: Excerpts from Jones' book focusing on Durkheim's The Rules of Sociological Method)

Kahn, Charles H. (2003) "Presocratic Greek Ethics", pp. 1-8), in Lawrence C. Becker and Charlotte B. Becker (2003) A History of Western Ethics. Second Edition. New York: Routledge.

Leedy, Paul D (1980) Practical Research: Planning and Design. Second Edition. New York:  Macmillan Publishing Co.


Sarantakos, Sortirios (1994) Social Research. London: The Macmillan Press

Weber, Max (1964) The Theory of Social and Economic Organization. Edited with an Introduction by Talcott Parsons. New York: The Free Press

Measurability: A Key Standard of Scientific Research

Nine key standards, or principles, of scientific research can be gleaned from texts on research method. As I see them, these are:


3. Control
4. Measurability
5. Validity
6. Reliability (Pending)
7. Objectivity (Pending)
8. Ethics 
9. Representativeness.

I say something about each of the nine standards in separate posts, as shown in the links above. What I want to briefly talk about here is the measurability standard. 

Measurability 

Measurability means susceptibility to measurement. It means, in other words, that what is to be measured must embody quantities and/or qualities -- or have features, dimensions or characteristics -- that can be subjected to appropriate or 'true' measurement. Concerning the defining characteristics of a measurement, Bell (1999) notes that:
"A measurement tells us about a property of something. It might tell us how heavy an object is, or how hot, or how long it is. A measurement gives a number to that property. Measurements are always made using an instrument of some kind. Rulers, stopwatches, weighing scales, and thermometers are all measuring instruments. The result of a measurement is normally in two parts: a number and a unit of measurement, e.g. ‘How long is it?... 2 metres." 
The measurability rule is anchored on the above conceptions, and so requires that the variables around which the researcher intends to collect data should be measurable, or susceptible to acceptable ‘measurement’ (Leedy, 1980: 46)[1]. This is easier done in the natural sciences than in the social sciences; in quantitative studies than in qualitative. Still, one must, in the social sciences too, endeavor to quantify, measure and evaluate. Indeed, the guiding principle of the measurability rule -- its corollary, in other words -- is this: "What can be measured must be measured." Thus, not measuring what can be measured is not an option allowed anyone.

In quantitative research, the measurability standard features prominently in all methodological procedures that revolve around, or build up to, hypothesis testing. The testability of a hypothesis is indeed a function of the measurability of the variables that constitute it. Such measurability is, in turn, dependent on the indicators chosen to represent them; but one is not entirely free to choose just any indicator(s). They must be such as most peers or reviewers or supervisors or sponsors can be persuaded to accept as valid and reliable. Still, one has some leeway in choosing the indicators one wishes to use, so long as the reviewers, supervisors or funding entities are prepared to see or accept one's findings “in the light" of the chosen indicators.

Viswanathan (2010: 285-210) has interrogated in depth the challenges encountered in "Measure development procedures," particularly in connection with quantitatively-oriented social science research. Among these challenges, which he believes are not sufficiently appreciated, is the underpinning assumption, which he faults, that "a construct can be [readily and invariably] isolated and examined." Here is his line of thinking:
"By measuring or manipulating individual constructs, relationships between constructs are studied and substantive hypotheses about these relationships are tested. The very notion that numbers can be assigned to attributes of people, objects, or events is presumed on being able to study attributes or constructs separate from other constructs. After all, measurement relates to rules for assigning numbers to attributes of people, objects and events. [But] this is not the case for many phenomena. A complex network of constructs may influence a phenomenon and may not be separable into individual constructs for purposes of measurement." 
Measurability procedures implemented in qualitative -- that is, 'non-numerical' -- research attempt, not always successfully, to overcome or circumvent such intractables as Viswanathan has pointed out. These procedures include, for example, “comparative judgement (arranging factors in a hierarchy of importance)” or  “scaling (correct versus incorrect responses to a given set of questions)” (Leedy, 1980: 46). Other ‘non-numerical’ strategies that have been used, according to Worsley (1992: 113)[2] include: “careful classification[3], organizing and combining of field-notes [which] requires patient checking and cross-checking and the application of systematic techniques.” But he acknowledges that “numerical methods are sometimes applied to field-data too” (Worsley, 1992: 113). Indicators are often used as proxies/surrogates for more fuzzy or abstract concepts, such as status (Worsley, 1992: 96). Such indicators are inevitably numerical. 

One may also, in connection with the nominal level of measurement (the simplest level), and even with the ordinal level of measurement, calculate frequencies/percentages, and cross-classify in qualitative research. Scaling, moreover, is not just about correct v. incorrect. Incorporating comparative judgement, one may also use scales of: high v. low, do v. don’t, very high to very low, very good to very bad, strongly agree to strongly disagree.

To be fair to everyone, no one is quite attempting stubbornly to square the circle in this measurability conversation. Still, the challenges of measuring require, and will surely be tempered with, constant and open-minded vigilance -- as well as an abundance of capacity to deal with critiques and contrary views, including (so be it) one's own self-criticism. Bell (1999: 1), like others before her, subsumes this conversation under the theme "uncertainty of measurement". Thus:
"Uncertainty of measurement is the doubt that exists about the result of any measurement. You might think that well-made rulers, clocks and thermometers should be trustworthy, and give the right answers. But for every measurement - even the most careful - there is always a margin of doubt. In everyday speech, this might be expressed as ‘give or take’ ... e.g. a stick might be two metres long ‘give or take a centimetre’."



[1] Sarantakos talks of the need for precision in measurement (pp. 18-26)
[2] Peter Worsley, ed. 1992. The New Introducing Sociology. Revised Third Edition. London: Penguin Books.
[3] Another word for classification, given by Worsley (1992: 97) is categorization; and both, he argues, are an often overlooked “form of measurement” – even if they are “the simplest level” (that is, the nominal level) of measurement. There are in total four levels of measurement, the others being, in an ascending order of complexity: Ordinal (or rank-order), interval and ‘ratio’ scale (Worsley, 1992: 97-98).



REFERENCES

Bell, Stephanie (1999) Measurement Good Practice Guide: A Beginner's manual to Uncertainty of Measurement. (No. 11, Issue 2). Taddington: National Physics Laboratory

Leedy, Paul D. (1980) Practical Research: Planning and Design. Second Edition. New York:  Macmillan Publishing Co.,

Sarantakos, Sartirios (1994) Social Research. London: The Macmillan Press

Viswanathan, Mathu (2010) "Understanding the Intangibles of Measurement in the Social Sciences," pp. 285-312, in Geoffrey Walford, Eric Tucker and Mathu Viswanathan, Eds. (2010) The SAGE Handbook of Measurement. Los Angeles: SAGE 

Worsley, Peter, ed (1992) The New Introducing Sociology. Revised Third Edition. London: Penguin Books