Showing posts with label Representativeness. Show all posts
Showing posts with label Representativeness. Show all posts

Friday, November 27, 2015

Validity ~ A Key Standard of Scientific Research

Validity ~ A Key Standard of scientific Research


By Prof. Mauri Yambo
(1996; updates: 2004, 2006, 2015)


INTRODUCTION

Nine key standards, or principles, of scientific research can be gleaned from texts on research method. As I see them, they are:


3. Control
4. Measurability
5. Validity
6. Reliability (Pending)
7. Objectivity (Pending)
8. Ethics 
9. Representativeness.

I say something about each of the nine standards in separate posts, as shown in the links above. What I want to briefly talk about here is the validity standard. 


Validity means the applicability, genuineness, appropriateness or truthfulness of the methods, instruments, tools, measures (or indicators), or arguments used in the quest for knowledge, or search for answers to vexing questions – and therefore of the conclusions arrived at.  


CLICK HERE To Access the Full Text of "Validity ~ A Key Standard of Scientific Research"


























[CSO 302, CSO 501]

Sunday, November 08, 2015

CSO 302: Nine Key Standards of Scientific Research


INTRODUCTION TO NINE STANDARDS OF SCIENTIFIC RESEARCH

Certain broad standards, principles or criteria have been established for determining what scientific research is all about, and what it is not. That is, the standards help us to determine in some detail whether, or the extent to which, a proposed or completed study meets the expectations of the relevant scientific community -- in the present case, Sociology. They all apply, to a greater or lesser degree, to quantitative or qualitative research, or a combination of the two. The identity or image of Sociology as a discipline, or of any other discipline for that matter, does not somehow disappear just because one wishes to do qualitative, or indeed quantitative, research.

We can clearly identify nine such standards or criteria. These are: universality, replicability, control, measurability (Leedy, 1980: 46); validity, reliability, objectivity, ethics (Comte, 1853; Durkheim, 1982; Weber, 1964: 126-130; Giddens, 1993: 114-116) and representativeness (Sarantakos, 1994: 18-26; Weber, 1964: 110). The cited authors are only examples of scholars who have engaged in conversations about these standards. 

I enthusiastically take the opportunity to share with the reader my own understanding and critique of each of the standards, and of related conversations by other scholars, on separate blog pages. Links to the respective blog pages are embedded in the list below, and readers are invited to click on each at their convenience:

3. Control
4. Measurability
5. Validity
6. Reliability (Pending)
7. Objectivity (Pending)
8. Ethics 
9, Representativeness.


Let me, as I conclude this brief piece, invite debate. The more robust the debate, the better all around.

P.S: An earlier version of this introduction was published in early November 2015, but was quickly withdrawn ('reverted to draft') to allow for more of the nine key standards to first appear. Six standards have now been published. The seventh, "Ethics", has taken more time than previously anticipated -- as the filling of one gap or other in the narrative revealed the exciting need to do yet another, and so on -- but is nearly done. The remaining two will follow soon after it. The release of this updated introduction today (January 25th, 2016) thus appeared as appropriate as it was ever going to be, and so here it is.


References
American Sociological Association, ASA (1999) Code of Ethics and Policies and Procedures of the ASA Committee on Professional Ethics. Washington, DC: ASA

Becker, Lawrence C. and Charlotte B. Becker, Eds (2003) A History of Western Ethics. Second Edition. New York and London: Routledge.

British Sociological Association, BSA (2002) Statement of Ethical Practice for the British Sociological Association. Durham: BSA (consider the PDF version provided)

Comte, Auguste (1853) The Positive Philosophy of Auguste Comte. Volume I. Trans. Harriet Martineau. New York: D. Appleton and Co.

Cooper, John M. (2003) "Classical Greek Ethics", pp. 9-18, in Lawrence C. Becker and Charlotte B. Becker (2003) A History of Western Ethics. Second Edition. New York and London: Routledge.

Durkheim, Emile (1957) Professional Ethics and Civic Morals. Trans. Cornelia Brookfield. Longon and New York: Routledge.

Durkheim, Emile (1982) The Rules of Sociological Method and Selected Texts on Sociology and Its Method. Edited with an Introduction by Steven Lukes. Trans: W.D. Halls. New York: The Free Press

Giddens, Anthony (1993) New Rules of Sociological Method: A Positive Critique of Interpretative Sociologies. Second Edition. Stanford: Stanford University Press

International Sociological Association (2001) Code of Ethics. Madrid: ISA

Jones, Robert Alun (1986) Emile Durkheim: An Introduction to Four Major Works. Beverly Hills, CA: Sage Publications, Inc. (CLICK HERE: Excerpts from Jones' book focusing on Durkheim's The Rules of Sociological Method)

Kahn, Charles H. (2003) "Presocratic Greek Ethics", pp. 1-8), in Lawrence C. Becker and Charlotte B. Becker (2003) A History of Western Ethics. Second Edition. New York: Routledge.

Leedy, Paul D (1980) Practical Research: Planning and Design. Second Edition. New York:  Macmillan Publishing Co.


Sarantakos, Sortirios (1994) Social Research. London: The Macmillan Press

Weber, Max (1964) The Theory of Social and Economic Organization. Edited with an Introduction by Talcott Parsons. New York: The Free Press

Saturday, October 31, 2015

Representativeness: A Key Standard of scientific Research

Nine key standards, or principles, of scientific research can be gleaned from texts on research method. As I see them, these are:

3. Control
4. Measurability
5. Validity
6. Reliability (Pending)
7. Objectivity (Pending)
8. Ethics 
9. Representativeness.

I say something about each of the nine standards in other posts. What I want to briefly talk about here is representativeness.


Representativeness[1] [ = Generalizability]: The representativeness standard is applied differently in quantitative and qualitative research. In quantitative research, representativeness refers to the degree to which the sample selected for study can legitimately be said to reflect or embody the broad characteristics of the population in which it is embedded. More pragmatically, a sample is representative if it embodies the specific characteristics of the population that are of interest to a given researcher or study.  Thus, if we were to beam or project a transparency of the sample's outline or contours or segments (or proportions) onto a screen 'pre-loaded' with the population's outline or contours or segments (or proportions), we should expect the two images to perfectly match when the respective scales match. The fundamental question to be 'frontally' interrogated or incontrovertibly answered in any specific quantitative research, as Weber was amply aware, is where and how the material so pre-loaded is, was or can/should be obtained in the first place. 

Broadly speaking, quantitative research begins with the assumption that the contours of a population, in terms of size and structure, are accurately and adequately documented in relevant census or other survey data related to the population; and that the researcher has ample access to the data. The quantitative researcher is enjoined to select a sample the size and components of which are statistically and structurally proportionate to the population that they are supposed to represent. However, for many vexing problems which researchers seek to tackle, and research questions which they may want to answer, such ready-made population maps are in reality non-existent.

Qualitative sociological or anthropological research, likewise, is premised on a pre-existing and deep pre-understanding of the 'broad nature' of the society or population in question, based on prior studies and/or a variety of other sources. However, the reality of field research does not often enough bear out the premise. Consequently, pre-understanding must itself be constructed as an 'immediate' prelude to -- indeed, even as a necessary part of -- the anticipated study, Such pre-understanding then becomes the basis for constructing what Weber, with great insight, termed ideal types. 

Concerning ideal types (idealtypus, in German), Weber (1978: 19-22) argues as follows:
"Sociology seeks to formulate type concepts and generalized uniformities of empirical process. … As in the case of every generalizing science, the abstract character of the concepts of sociology is responsible for the fact that, compared with actual historical reality, they are relatively lacking in fullness of concrete content. To compensate for this disadvantage, sociological analysis can offer a greater precision of concepts. … In all cases, rational or irrational, sociological analysis both abstracts from reality and at the same time helps us to understand it, in that it shows with what degree of approximation a concrete historical phenomenon can be subsumed under one or more of these concepts. For example, the same historical phenomenon may be in one aspect feudal, in another patrimonial, in another bureaucratic, and in still another charismatic. In order to give a precise meaning to these terms, it is necessary for the sociologist to formulate pure ideal types of the corresponding forms of action which in each case involve the highest possible degree of logical integration … But precisely because this is true, it is probably seldom if ever [the case] that a real phenomenon can be found which corresponds exactly to one of these ideally constructed pure types. The case is similar to a physical reaction which has been calculated on the assumption of an absolute vacuum. … When reference is made to 'typical' cases, the term should always be understood, unless otherwise stated, as meaning ideal types, which may in turn be rational or irrational …"
Thus, in qualitative research, as Sarantakos has noted, “sampling...is not based on probability theory, and the size of the sample is usually too small to reflect the attributes of the population concerned. Instead, the sampling procedures used are related to theoretical sampling and are geared towards essential and typical units. Selection [that is, the quest for representativeness] does not stress random procedures but rather theoretical sampling, that is, [it is geared] towards the theoretically important units” (Sarantakos, 1994: 27).

Though it is not usually known or talked about -- or, more importantly, fully appreciated in sociological, or qualitative research, circles -- the fact is that Max Weber's notion of ideal types long ago preemptively freed sociology's qualitative researchers from what one may call the conceptual 'yoke of the quantitative sample'. Incidentally, sociologists' counterparts in anthropology have never felt as constrained by this version of the tyranny of numbers. 

As Priyadarshini (n.d.) has tried to say, moreover:
"Just as an ideal model is constructed by the natural scientists as an instrument and means for knowing nature, so the social scientist creates [ideal types] as a tool for systematizing and comprehending individual facts, against which the investigator can measure reality. It [serves that purpose] because of its separation from empirical reality and difference from it."
Importantly, in this regard, Sarantakos (1994: 27) has further, and pointedly, clarified that while “qualitative researchers consider generalisations to be important, they relate them to the typical cases they study, not to random theory and principles. Generalisation becomes obvious out of the intersubjective clarification of validity. The essential argument here is that generalisation is based on the typical case studied, which is thought to be representative of a species...; what qualitative research claims is that such findings can be interpreted beyond the cases studied and are examples of an ‘exemplar generalisation’, or ‘analytic generalisation’...”


REFERENCES:

Priyadarshini, S. (n.d.) "Weber's 'Ideal Types': Definition, Meaning, Purpose and Use"


Sarantakos, Sartirios (1994) Social Research. London: The Macmillan Press

Weber, Max (1978) Economy and Society: An Outline of Interpretative Sociology (Guenther Ross and Claus Wittich, editors and translators). Berkeley: University of California Press.




[1] In quantitative studies this means having such characteristics/capacity/quality as do capture or reflect all the key aspects of the population (or that segment of the population that is of interest).