Showing posts with label Quality. Show all posts
Showing posts with label Quality. Show all posts

Friday, October 30, 2015

Control: A Key Standard of Scientific Method


Nine key standards, or principles, of scientific research can be gleaned from texts on research method. As I see them, these are:

3. Control
4. Measurability
5. Validity
6. Reliability (Pending)
7. Objectivity (Pending)
8. Ethics 
9. Representativeness.

I say something about each of the nine standards in other posts. What I want to briefly talk about here is the control standard. 

Control

By control we mean establishing or maintaining the integrity or identity or boundaries of the sample/specimen/subject/site against all disturbance, unwanted/unintended influence or “contamination” by external/extraneous factors or even by the researcher himself or herself. In effect, control means quality control. 

In experimental design, Yu (n.d.) points out, the kind of control called for is, specifically, variance control  -- which is indeed a form of quality control. According to Leedy, control suggests establishing parameters: “Parameters are important. All research is conducted within an area sealed off by given parametric limitations. By such control, we isolate those factors which are critical to the research. Control is important for replication. An experiment should be repeated under the identical conditions and in the identical way in which it was first carried out. It is also important for consistency with the research design” (Leedy, 1980: 46).

Giorgio (n.d.) notes that, in the laboratory setting, the control function tends to be too narrowly carried out in practice, in a way that even conceptually distorts the meaning of control. Thus:
"...control practically comes to mean manipulate. That is because the laboratory setting is itself the creation of the scientist, and it is deliberately created in order for the researcher to be able to dictate to the situation. Any thing that is left to chance is seen as a demerit. The dictionary con firms these ideas by defining control as exercising “authority or dominating influence over; to hold in restraint or check; to direct or regulate.” Thus a strong sense of control means being able to do things at will, to be able to have desires transformed into realities in as brief a time as it takes to accomplish the task."
But, he argues, "control does not have to be defined so narrowly." Thus, for him, control:
"...could mean to be respectfully present in a situation so that one could respond knowledgeably and appropriately with readiness to the perceived spontaneous happenings of a situation. In this sense, control refers to a certain kind of “intentional presence,” a certain way of looking, an informed being present that at the same time does not actively intervene in the unfolding of the event to be observed... [The] knowledge that the researcher has guides his expectations so that he knows how to interpret or evaluate his ongoing perceptions. The researcher can do this without active intervention, but it is still a form of control because directedness and restraint are used by the researcher in perceiving the situation. Thus control implies observation, that is, it is an educated looking."
Admittedly, in the social sciences, in contrast to the natural sciences, control is more varied and more nuanced, and sometimes more problematic, but not impossible. For example, determining the parameters of, or controlling for variance in, a social research includes such considerations as scope and study limitations. Moreover, one can ensure control over the following, among others: [1] the setting of the interview, or the conditions under which the respondent is interviewed, [2] the accuracy/precision of the questions asked and the responses given. [3] the language of the interview. [4] the quality of training given to interviewers, other research assistants and supervisors. [5] the actual supervision process. [6] the parameters of both the experimental and the control group.

Archaeologists and paleontologists, who do not represent the image of the typical natural scientist, and who routinely work away from the public view, offer outstanding templates for quality control in their persistent quest for new discoveries. They are quite adept at protecting the sites of their ongoing work against contamination and interference, in time and space. In important ways, the work of the crime (or accident) investigator, often partially done in full view of the media and the public, at its best obeys the strictures of the control standard,

Clearly, controls are crucial not just in experimental designs and field observations, but also, and perhaps more dramatically so, in all situations in which the conscious and pre-emptive gathering and establishing of incontrovertible evidence is called for; for example, in the prosecutor's mandate, or in the context of a claim to/of the discovery of a consequential artifact. Both of which are typically subjected to strict and detailed scrutiny, skepticism and even attack.



REFERENCES:

Leedy, Paul D. (1980) Practical Research: Planning and Design. Second Edition. New York:  Macmillan Publishing Co.,

Giorgi, Amedeo (n.d.) "The Role of Observation and Control in Laboratory and Field Research Settings"

Jaikumar, Maheswari (2014) "Experimental Research Design" Slideshare.net

Mann, CJ (2003) "Observational Research Methods. Research Design II: Cohort, Cross Sectional and Case-Control Studies"

Yu, Chong-Ho (n.d.) "Experimental Design as Variance Control"

Tuesday, January 22, 2013

Universities Act 2012: Toward Quality Varsity Education in Kenya

An online article posted in Daily Nation on January 21, 2013, and titled  "New Law Wants Varsities to Walk the Quality Talk" (To read, click here), observed that several universities in Kenya have recently been bragging about their quality-based ISO certification. However, a new law to govern the operations and steer the standards of Kenya's public universities -- Universities Act 2012 -- was recently enacted, and was to be implemented under the auspices of the Commission for University Education (CUE), successor to the Commission for Higher Education (CHE). Quality is the key word at CUE, and the newly appointed Head, himself a university don of long standing, could not during an interview say enough about quality as the over-riding criterion of excellence in Kenya's higher education. And yet, I am thinking, quality is a vexed concept, being easier to talk about from a distance than to implement in any comprehensive way, and to assure in the trenches. I am sensing that comments already made in response to the article -- comments such as by TumuTumu, Mheshimiwa and Kenya Yetu -- have hit the nail on the head in substantial measure. 

Quality and standards are the driving concerns in the online article as well. So is walking the talk. However, there is room to make a few other observations, fill a few gaps, as follows:


CUE must go beyond platitudes if it is to make a difference in quality assurance. In the first place, it has to define quality in measurable and, importantly, consequential ways. I don't think KEBS has the standards to make our universities great. It can of course create them in proper consultation with those who operate exactly where the rubber meets the road -- the lecturers and researchers (though, indeed, a disappointing number of lecturers have deeply ingrained habits which exacerbate the rot). 


The main point, however, is that you cannot demand quality on a higher plane if you don't have (or squander in administrative excess and impunity) the financial, material and technical resources required to realize the desired quality. Exceptional or just good lecturers, as human resources, are, up to a point, a component of these resources that must be sourced. They cannot procure, retain, remunerate and motivate themselves -- someone else must do so, and not grudgingly -- in an environment which no one seems to tend with any healthy passion. There's too much inbreeding at our universities. Too much, and in some instances growing, ethnicity -- and even clanism and cronyism.

You cannot have fruit if you don't grow fruit trees, or have procurement power. When all else is said and done, the Achilles' Heel of our higher education is that we have not closed the loop in PhD training, in two ways: (a) We are not training enough based on our own priorities and resources (no sovereignty here) to meet present needs and replace those we lose to attrition of one kind or another; (b) Too many of the few we train we train locally -- and so under-expose intellectually/scholastically and experientially, and so condemn to what may turn out to be, in quality terms, a downward spiral toward a mediocrity we may be too afraid to acknowledge. 

It is a joke for our universities, which are supposed to be universal institutions, to call themselves world class when you have to search and search and not find find any world-class academics from other places willing to join us full-time.

Monday, April 02, 2012

Thick Description ~ CSO 302

"... : if you want to understand what a science is, you should look in the first instance not at its theories or its findings, and certainly not at what its apologists say about it; you should look at what the practitioners of it do.
In anthropology, or anyway social anthropology, what the practioners (sic) do is ethnography. And it is in understanding what ethnography is, or more exactly what doing ethnography is, that a start can be made toward grasping what anthropological analysis amounts to as a form of knowledge. This, it must immediately be said, is not a matter of methods. From one point of view, that of the textbook, doing ethnography is establishing rapport, selecting informants, transcribing texts, taking genealogies, mapping fields, keeping a diary, and so on. But it is not these things, techniques and received procedures, that define the enterprise.
What defines it is the kind of intellectual effort it is: an elaborate venture in, to borrow a notion from Gilbert Ryle, "thick description." ~ Clifford Geertz (1973: 5-6) [Quote from his book, The Interpretation of Cultures. New York: Basic Books]
Gilbert Ryle's concept of thick description, as popularized in the disciplines of anthropology and sociology by Clifford Geertz (see, also, this article), refers to the successive addition of layer upon layer of detail to a phenomenon or process or event being described -- building up from 'literal' (or simple or lay) to 'thin' (or journalistic) to thick (or 'deep' or scholarly) description -- such that, true to the second law of dialectics, the quantum (quantity) of descriptions progressively transforms into a qualitative synthesis of the 'totality' of aspects of the phenomenon in question. It is like adding pixels and mega-pixels, one measured 'spread' after another, to a picture until one achieves the highest possible level of clarity, or picture quality.

Thick description is widely accepted as a major qualitative data analysis method or technique. However, I have preferred to use the concept synthesis in the above definition, as it more satisfactorily captures what for me is the core purpose of thick description. There is debate, however, concerning the relative merits of analysis and synthesis in pushing the boundaries of knowledge.

Analysis, an anchor concept in both quantitative and qualitative research, which is used routinely and unquestioningly by nearly all scientists (natural and social), does not seem to be quite apt here. B.N Ghosh (1985: 23), for example, has suggested that “analysis plays a more important role than synthesis” during “the initial stages of a science”; but “as the science becomes more and more progressive, synthesis plays a more and more important role. But in every science both the methods are used simultaneously.” He (1985: 24) adds that:

“A science aims at not only arriving at the truth but also at expounding the truth. A synthetic method is necessarily expository because it puts together the elements of a phenomenon in a systematic manner. In synthesis, exposition is possible because the entire elements are completely known and, as such, they can easily be arranged in an orderly way. The discovery of truth, however, is made possible by the method of analysis.”

I think that the aim and effect of thick description is to expound in 'full' the details, the 'totality', of the object of description. However, the end-product of thick description cannot be touted as a "complete" exposition of that which is (to be or has been) described; and I suspect that thick description was never intended for such a purpose.

NOTE: For more on thick description read:
1.This article by Joseph Ponterotto
2. Fei-Wen Liu's article

PS: Quote at the top added on September 11, 2015

Monday, March 19, 2012

Introductory Remarks at the Start of a UNES/UoN-Sponsored Proposal Writing Workshop


BY Prof. Mauri Yambo (Workshop Coordinator), March 19, 2012


1. INTRODUCTION

May I take the opportunity, as the workshop coordinator, to once again welcome you to this five-day workshop; and to thank you for deciding and finding the time to come. It was a good decision, and it is an honour to have you.


2. OVERALL PURPOSE OF THE WORKSHOP

The overall purpose of this workshop, the eighth in a series of proposal writing workshops sponsored by UNES and the office of the DVC (RPE), is to significantly enhance the quality of research and project proposals written by academic and senior technical staff of the University of Nairobi.

It is expected that enhanced proposal writing capability will lead to:

a. A significant increase in the number of research/project grants, and related funding, won worldwide by University of Nairobi staff. As you may know, the university, as a corporate entity, expects a 15% share of the gross annual revenue from these grants;

b. The publication of more scholarly works: refereed journal articles, book chapters and books;

c. Increased participation by academic staff in scholarly and professional workshops and conferences, and an increased and growing number of evidence-based presentations at such gatherings.

A total of 500 staff are to be trained in these workshops. Out of these, it is expected that at least 10% will become proficient/successful proposal writers.


3. DIMENSIONS OF QUALITY

Quality has two broad dimensions: Form and Content.:

a. The Form (Design, Outline, Format or Structure) may be good, but the Content (such as Problem Statement, Gap Identification, Causality Statement, Logic, Premises) bad – that is, weak or incoherent or without a clear or persuasive or any value-proposition, or generally sub-par;

b. Or the Content may be good, but the Form bad (incoherent, disjointed, incomplete or idiosyncratic);

c. Or, as is too often the case, both the Form and the Content may be below the expectations of:

(i) The Funding Agency: Funding agencies tend to place a high premium on the coherence of argumentation and presentation; and, just as important, the promise of rigour: rigorous problem-solving backed by an evidence-based, logical and imaginative turn of mind; or,

(ii) The self-critical proposer: who, it is to be imagined, is always looking to reach higher levels of quality – in terms of conception and execution – but has generally lacked the opportunity and forum, such as are provided in this series of workshops, to openly and ‘safely’ speak heart-to-heart and share experiences and concerns with colleagues and peers across disciplines.


4. FACILITATORS

There are four facilitators in this workshop, as you have heard in the introductions. They are your colleagues. And though there is no denying that the university is endeavouring to realize workshop goals, as above stated, through them, they are your peers, not your teachers The flow of learning will be in both directions – and even in multiple directions. Believe me, I have already seen it in previous workshops.

All in all, the facilitators, as a group, have a big challenge, rooted in a clear set of deliverables – short-term and medium-term.

There is a certain degree of common ground which we, the facilitators, will endeavour to share with you. We have noted that this common ground has expanded in the course of the seven previous workshops, as we have responded to participants’ feedback, reviewed the programme and engaged in self-criticism. Beyond the common ground, however, we urge you to view the content of our presentations as if they emanated from four separate “books” – which it is up to you to digest: accept or disregard or query or synthesize as your critical faculties and/or research needs may direct you to do


5. WORKSHOP STRUCTURE

The workshop has three broad components:

(a) Presentations and discussions led by different facilitators, as indicated in the workshop programme already in participants’ folders;

(b) Group Work involving the drafting of research or project proposals;

(c) Presentation, on the last workshop day, of proposals developed by different groups.


6. CONCERNING GROUP WORK AND CALLS FOR PROPOSALS

As already noted, Group Work will revolve around the preparation of jointly written proposals, and the eventual presentation of at least the first draft to workshop participants. Participants may choose to respond to the call for a research or project proposal. In view of the constraint imposed on proposal writing by the workshop’s short duration and the ad hoc nature of the groups, the presentations will be very cautiously evaluated on the basis of score sheets prepared, just in the last two weeks, by the facilitators. But we urge you to take the format of the score sheets, and the weighting of the various items, very seriously as you carry on your task.

Five “Calls for Proposals” will be available to participants. Each group will be at liberty to choose any of the five calls for the purposes of Friday's presentations. Four of the calls are hypothetical, while one is actual and current, as follows:

(a) The Ogot Foundation: Call for project proposals on Hunger in the Horn of Africa, focusing on any of hunger’s myriad causes in any specified “local area” within the region. Value of the hypothetical call: Kshs 10 million;

(b) Capital Markets Authority of Kenya (CMA): Call for applied finance research proposals covering three broad areas of interest within Kenya’s asset management community: applied finance research, asset management knowledge and related issues, and knowledge dissemination. Value of the hypothetical call: US$15,000;

(c) Youth Advisory Board: Call for project proposals on Youth Community Service Learning Projects focusing on any of the following: environmental responsibility, disaster preparedness, driver safety, financial education, and bridging the achievement gap through higher education. Value of the hypothetical call: US$150,000.

(d) Domestic Violence Research: Call for research proposals designed, inter alia, to enhance community response capacity through direct services and support to victims and their families; and to strengthen governmental, legal and cultural interventions. Value of the hypothetical call: Kshs 5 million.

(e) Swiss Re’s International Resource Award for Sustainable Watershed Management 2013: Call for proposals for the implementation of sustainable watershed management projects. A proven track record in sustainable planning and/or management of water or other resources will be particularly advantageous. This is an actual annual award, which may be granted to one or several projects. Its value for the year 2013 is US$ 150,000. Deadline for the return of initial application forms: 30 April 2012.


7. PROPOSAL FORMATS AND LENGTHS

The Score Sheets alluded to above incorporate proposal formats which you should, at the very least, bounce off your own groups’ consensus-ideas of format, as you draft your full proposals. The respective facilitators will share with you their more detailed conceptions of format. Each workshop day should therefore be both interesting and full of perspectives to interrogate.

The maximum length of a full proposal is typically “not more than 15 pages” There will be at least two sources in your folders which point to the fifteen page limit; and that is before line spacing and font size are specified. At the National Science Foundation (NSF) of the USA, line spacing (whether double or single) is left to the discretion of the proposer, but maximum page limit is set at 15. The Center for Nonprofit Management also sets the maximum page limit at 15. The sample proposal prepared by Prof. Madara Ogot (former MD of UNES), which appears as Handout 2 in your folder, is already some 8 pages long, single-spaced. This is before we include certain essential components of a full proposal.

While it will be up to you to decide on the lengths of your proposals, of course within the above limits, I wish to inform you that each group will be given only ten minutes to present its proposal on Friday, beginning at noon.


8. FINAL WORD

I believe that you will find ways to make your respective teams work – the teams that you will join presently. That is, work closely enough to produce a draft, in five intense days.

Let me now give way to the first facilitator, Dr. Machoki, whose day Monday is, as the programme shows you. My day is tomorrow. Dr. Marete will facilitate on Wednesday. Mr. Matseshe will take you through all matters financial and budgetary on Thursday. He will be back Friday morning with Dr. Machoki, to round off their parts. All the four of us will be with you from the start of group presentations at noon on Friday until the end of the workshop at 4. Thank you.