Daily Logs: June 30, 2012

June 30, 2012   No Comments

Daily Logs: June 13, 2012

June 13, 2012   No Comments

Essay: Action Science

A short summary that I wrote for a class on Participatory Modes of Inquiry about Action Science — one of many threads in the participatory action research (PAR) tradition. “Participation” is a tricky concept in academic realm where the “experts” who do the studying tend to exert power over “laypeople” who get studied. As I consider the academic lifestyle more seriously, I wonder in what ways my work can subvert this dominant mode of operation? Participatory research tends to take longer and hence be more expensive because it requires real relationships with people and lots of listening. On the other hand, one can argue it’s more likely to have catalytic validity especially when it comes to “wicked problems” — the kind that deal in human values and can’t be solved, but only “managed.”

________________________________________

The Action Science (AS) approach to action research (AR) distinguishes itself from other forms of AR in its attempt to remarry practical action with scientific method and scientific rigor (Greenwood & Levin, 2007). The strand of research offers a direct response to the problem of “rigor versus relevance” in which norms of ‘rigorous’ positivist science such as experimentation under controlled conditions and separation between the researcher and the researched may produce results that are irrelevant or invalid for practitioners working to affect social change (Friedman, 2001, p. 160); on the other hand, more ‘relevant’ alternative action research methodologies may define validity by the positive social effect they engender and eschew rigorous empirical testing or attempts to develop falsifiable theory. AS attempts to bridge this “widening gap between social science theory/research and social science-based professional practice” (Friedman 2001, p. 159) by arguing that rigor and relevance can both be achieved by collapsing “theory building and theory testing” together into one systematic inquiry (Greenwood & Levin, 2007, p. 224).

Action Science embraces dual objectives of improved social practice and the development of generalizable theories of practice through intervention, in contrast to the detached observation of traditional science. Specifically, AS intervention attempts to address “intractable conflicts and difficult dilemmas faced by social practitioners” through the act of “confrontation” (Friedman, 2001, p. 160). Confrontation requires practitioners to uncover implicit theories of action (also known as “theories in use”) and reconcile them with what they say they believe (“espoused theories”):

The goal of action science inquiry is to help practitioners discover the tacit choices they have made about their perceptions of reality, about their goals and about their strategies for achieving them. The fundamental assumption of action science is that by gaining access to these choices, people can achieve greater control over their own fate. (Friedman, 2001, p. 161):

For example, in his article on the “paradox of participation” in action research, Friedman (2009) and his co-researchers engage in a meta-analysis of a “failed” project between an Israeli university and an Arab-Palestinean NGO. Through critical reflection and analysis of meeting transcripts, the researchers confront the conflict between their espoused values of equal and full participation and an implicit theory of action that required the NGO to take on a role as fully invested co-inquirer regardless of its own perspective and goals. The inquiry helped both to mend the strained relationship between the academic team and the NGO leadership and also developed “actionable knowledge” to help others build better participative relationships (Friedman, 2001, p. 1).

In line with its emphasis on developing generalizable theories of action, AS has its own well-developed set of precepts. For example, AS delineates between Model I and Model II theories of action. A Model I theory of action is characterized by defensiveness and unilateral control, whereas Model II features “minimally defensive interpersonal and group relationships, high freedom of choice, and high risk taking” (Argyris et. al., 1985, p. 102, qtd. in Greenwood & Levin, 2007, p. 226). AS interventions often attempt to move a group from Model I defensiveness to Model II open inquiry. Friedman’s (2001) work with the Open House organization attempted to interrupt a cycle of conflict between two subgroups in the organization by constructing a causal map of the conflict that allowed staff members to “test their own interpretations,” “see clearly their own blindness,” and eventually “redesign their theories of action” (Friedman, 2001, p. 165).

While praising AS for its attempts to address both “scientific clarity and practical utility,” Greenwood & Levin (2007) also point out the shortcomings of the approach. In particular, they note that AS assumes that individuals’ “natural” state is Model I defensiveness. This is problematic for a number of reasons. First, the narrow focus on defensiveness ignores the “richness of human motivations” beoynd defensiveness (Greenwood & Levin, 2007, p. 230). Second, the approach ignores the broader political, economic, and cultural context that may influence or determine Model I or Model II theories of action by placing the onus on individuals or organizations to create internal change. Finally, this view creates a chasm between participants (who are doomed to defensiveness) and action scientists who are presumed to have a special ability to transcend these limitations; this places the researcher in a special elite status, yet AS does not address this difference directly. Friedman’s (2009) previously referenced work on the “paradox of participation” shows that even experienced AS researchers are not immune to acting out Model I theories of action, and glossing over implicit power differentials between researchers and participants can undermine participatory relationships. Thus while AS holds significant promise as an approach to address difficult to solve and unique organizational and social problems, these criticisms point to the need for more reflective work in the vein of Friedman (2007) to develop AS theory further.

Greenwood, Davydd and Levin, Morten. 2007.  Action Science and Organizational Learning, in   Introduction to Action Research, 2nd Edition.  Thousand Oaks, CA:  Sage, pp  223-235.

Friedman, Victor.  Action Science:  Creating Communities of Inquiry in Communities of Practice.  Chapter 19 in The SAGE Handbook of Action Research, 1st Edition, ed. by P. Reason and H. Bradbury. Thousand Oaks, CA:  Sage, 159-170.

Friedman, Victor.  2009.  The Paradox of Participation in Action Research.  Action Research. 7(2)263-290.

April 14, 2012   No Comments

Essays: Changing Definition of Validity in the Social Sciences

I wrote this paper for a class on participatory action research that I took last semester — it ranks among my favorite courses. Rather than focus on practice or methods, this was a review of different strands of participatory research, action research and community-based research, with an emphasis on understanding the similarities and  differences between different approaches situating our own approaches and philosophies.

The concept of “validity” is a tricky one for action researchers and something I’ll continue to grapple with as I embark on my dissertation. I do the work that I do because I’m part of a movement that wants to change our current food system to be more diverse, locally-integrated, environmentally resilient, and equitable. I happen to think that a combination of informed action/experimentation, and rigorous documentation/analysis/evaluation is part of the way to effect that change. But what makes this “research” research? By what criteria should my “results” be judged and deemed “valid”?

Written for a “mini-paper” reading response 4/13/11:

_____________________________________________

The concept of validity in social science research originally developed within a positivist paradigm. Since the advent of new approaches to human inquiry that challenge positivist assumptions about the nature of reality and the purpose of research (such as critical theory, constructivism, and participatory research), the concept of validity has stretched beyond its original meaning.
The positivist approach to inquiry assumes truth is observable and testable, that the purpose of research is to explain and predict, and that social science should be objective, value-free, and clearly separated from practice. Within this mode of thinking, asking about the validity of research means asking whether our tests or methods accurately measure “whatever it is that is supposed to be measured” (p. 343, Wolcott, 1990). On the other hand, “transgressive” forms of validity like the crystalline or situated validity embraced by researchers like Laurel Richardson and Patti Lather, seek instead to intentionally “problematize reliability, validity and truth” (Richardson qtd in Guba & Lincoln, 2005). In an article examining both contradictions and blurring between old and new research paradigms, Lincoln and Guba (2005) suggest that in all cases, validity seeks to address the question:

Are these findings sufficiently authentic (isomorphic to some reality, trustworthy, related to the way others construct their social worlds) that I may trust myself in action on their implications? More to the point, would I feel sufficiently secure about these findings to construct social policy of legislation based on them? (p. 205)

Lincoln and Guba (2005) separate validity into two parts: validity of method and validity of interpretation. They posit that traditional positivist definitions of validity like the kind described by Litwin (1995) in “How to Measure Survey Reliability and Validity,” deal mostly in the “rigor in the application of method” (Lincoln & Guba, 2005, p. 205). While critical theorists, constructionists, and other “new-paradigm” researchers are not exempt from questions about their methods of observation, they also grapple with questions of how, what, and why we interpret observations.

Wolcott’s 1990 article, “On Seeking – and Rejecting – Validity in Qualitative Research,” is an early example of a struggle to look beyond a concept of validity tied to methodological rigor or procedure and get at valid interpretation, or rigor “in ascribing salience to one interpretation over another and for framing and bounding an interpretative study itself” (Lincoln & Guba, 2005, p. 205). Wolcott starts off describing the tactics he employs to “satisfy the implicit challenge of validity” and “not get it all wrong” (1990, p. 347). He then pushes beyond the concept of validity tied to criteria like internal consistency and the capacity to predict, and proposes instead that ethnographic research should seek to understand social structures that we humans construct. In 1990, Wolcott calls this a ‘rejection’ of validity, but fifteen years later, Lincoln and Guba describe how other new-paradigm researchers have chosen to stretch rather than reject the concept of validity and ask not only about what constitute valid methods of measurement and observation, but also what constitutes valid interpretation. “Can our cocreated constructions be trusted to provide some purchase on some important human phenomenon [what Wolcott might call understanding]?” (2005, p. 206)

The shift in focus from methodological validity to questions about interpretive validity is ultimately rooted in a shift in the ontology and epistemology of new modes of social science. In order to determine whether research findings are authentic to ‘reality’ and to know whether and how our findings engage with ‘reality,’ we must first understand how we view the nature of reality (ontology) and how we acquire knowledge about this reality (epistemology). For example, foundationalists who believe in a transcendental reality might say “real phenomena necessarily imply certain final, ultimate criteria for testing them as truthful” (Lincoln & Guba, 2005, p. 204). On the other hand, antifoundationalists who refute the idea of a truth separate from human perception might argue “agreement regarding what is valid knowledge arises from the relationship between members of some stake-holding community” (Lincoln & Guba, 2005, p. 204). In the latter case, what is valid must always be negotiated because reality only exists as it is constructed between people.

Certain definitions of what is valid go beyond questions about the nature of reality and knowledge into the purpose and ethical obligations associated with inquiry (axiology).

When social inquiry becomes the practice of a form of practical philosophy – a deep questioning about how we shall get on in the world and what we conceive to be the potentials and limits of human knowledge and functioning – then we have some preliminary understanding of what entirely different criteria might be for judging social inquiry. (Lincoln and Guba, 2005, p. 206)

Ontological, educative, catalytic and tactical validities, for example, ask about the outcome of inquiry; specifically, increased awareness or increased capacity or tendency for individual or collective action. These types of validity play a major role in participatory research and action research because these modes of inquiry tend to make social transformation or change their explicit end-goal. Here what research is ‘valid’ becomes less about what mirrors reality and more about what has the capacity to change, form or shape reality.

_____________________________________________

Works Cited:

Guba, Egon G. and Lincoln, Yvonna S. 2005. Paradigmatic Controversies, Contradictions, and Emerging Confluences. In: Handbook of Qualitative Research, Third Edition, edited by N. Denzin and Y Lincoln. Thousand Oaks, CA: Sage Publications.

Litwin, M.W. 1995. How to Measure Survey Reliability and Validity. In The Survey Kit, edited by Arlene Fink. Thousand Oaks, CA: Sage Publications.

Wolcott, H. F. 1994. On Seeking – and Rejecting – Validity in Qualitative Research. Chapter 11, in: Transforming Qualitative Data: Description, Analysis, and Interpretation. Thousand Oaks, CA: Sage Publications.

July 25, 2011   2 Comments