Impact Assessment Tools
Soliya has collaborated with researchers to establish evaluation tools for virtual exchange.
Soliya and the Saxelab Social Cognitive Neuroscience Laboratory at MIT and the Annenberg School of Communication at the University of Pennsylvania, have worked together over the years to identify and establish evaluation tools to measure attitude changes and skill development that young people can achieve through virtual exchange programs.
Adapting tools from intergroup contact theory, our hope is to not only demonstrate the impact of innovative virtual programs but also help professionalize this growing field – fostering the emergence of best practices, as well as establishing a basis for comparative evaluation across diverse models.
The Tools
-
This is an interactive visual tool that measures the degree to which an individual feels a sense of commonality with another group. Research indicates that increased self-other overlap correlates with compassion and predicts pro-social behavior, i.e. increased willingness to forgo personal rewards to alleviate the suffering of the other (Batson, Turk, Shaw & Klein, ‘95), and is associated with greater trust and cooperative exchange (Zak & Knack, ‘01).
-
This measure consists of a ‘feeling thermometer’ that is widely used to assess intergroup negativity (Choma, Hodson, & Costello, 2012; S. Paolini, M. Hewstone, E. Cairns, & A. Voci, 2004; Turner & West, 2012) and is employed to measure affect towards the ‘other’.
-
Responses to another group can be heavily dependent upon how you think that group perceives you (Vorauer and Sasaki, 2009). This has been demonstrated to be particularly important for the perception that the other group listens to and respects your views: research shows that ‘feeling heard’ facilitates positive change in intergroup behaviors, even in groups involved in direct protracted conflict (e.g. Israelis and Palestinians) (Bruneau and Saxe, 2012; Sagy et al., 2002). The Peace and Conflict Neuroscience Lab measures meta-perceptions that the other group ‘listens to’ and ‘respects’ your own group.
-
Another specific meta-perception that we have found to be particularly damaging to intergroup relations is the view that the other group thinks of your group as less ‘evolved’ than their own (Kteily, Hodson and Bruneau, 2016).
For example, we have shown that the degree to which Americans feel dehumanized by Iranians predicts their resistance to the Iran nuclear accord and their willingness to engage in open warfare with Iran (Kteily, Hodson and Bruneau, 2016); and for Muslim Americans, feeling dehumanized by Donald Trump and Americans in general predicts support for violent versus non-violent collective action, and unwillingness to report suspicious activity in their communities to the FBI (Kteily and Bruneau, in press).
-
One consequence of feeling dehumanized is the tendency to dehumanize the other group, in turn. We have used a set of items to determine how much people blatantly dehumanize the other group (Kteily, Bruneau, Waytz and Cotterill, 2015).
We have found that this measure predicts real-world outcomes in a number of intergroup contexts: openness to warrantless wiretapping and torture of Arab terror suspects in the U.S. (Kteily, Bruneau, Waytz and Cotterill, 2015), the acceptance among Israelis of Palestinian civilian casualties during the War in Gaza in 2014 (Bruneau and Kteily, in review), the rejection of Muslim refugees in Denmark, Spain, Greece and Hungary (Bruneau, Kteily and Lasse, in review), a bias by Hungarian teachers in placing minority Roma students into low track schools (Bruneau, et al., in review).
-
Participants are asked to report their agreement with statements that present a range of perspectives toward the other identity group. This measure enables Saxelab to assess whether participants going through the virtual exchange program are able to challenge norms that perpetuate intergroup conflict.
Norms of intergroup conflict (e.g. belief in the ‘Clash of Civilizations’ hypothesis) have been shown to help drive violent intergroup conflict (e.g. in Rwanda), so diminishing these norms is particularly desirable to help buffer against future conflict (Paluck, 2009).
-
MIT Saxelab is partnering with the Collective Intelligence Group at MIT to develop cooperative online games that are designed to measure communication and collaboration skills across cultures. The games are played before and after the virtual exchange program to gauge whether participants become better able to overcome anxieties and performance inhibitors in cross-cultural environments.
Soliya continues to be committed to developing and adapting novel and innovative approaches to measure changes in attitudes between groups. We welcome ideas and collaborations from experts in the field.
-
Batson, C. Daniel et al. “Information function of empathic emotion: learning that we value the other's welfare.” Journal of Personality and Social Psychology 68 (1995): 300-313.
Bruneau, E. G., & Saxe, R. (2012). The power of being heard: The benefits of ‘perspective-giving’ in the context of intergroup conflict. Journal of Experimental Social Psychology, 48(4), 855–866.
Choma, B. L., Hodson, G., & Costello, K. (2012). Intergroup disgust sensitivity as a predictor of islamophobia: The modulating effect of fear. Journal of Experimental Social Psychology, 48(2), 499–506.
Crisp, R. J., & Turner, R. N. (2012). Imagined intergroup contact. In G. Hodson & M. Hewstone (Eds.), Advances in Intergroup Contact (pp. 135-151). Hove: Psychology Press (Taylor & Francis).
Kteily, N., Hodson, G., & Bruneau, E. (2016). They see us as less than human: Metadehumanization predicts intergroup conflict via reciprocal dehumanization. Journal of Personality and Social Psychology, 110(3), 343–370.
Kteily, N., Bruneau, E., Waytz, A., & Cotterill, S. (2015). The ascent of man: Theoretical and empirical evidence for blatant dehumanization. Journal of Personality and Social Psychology, 109(5), 901–931.
Kteily, N., Bruneau, E., Waytz, A., & Cotterill, S. (2015). The ascent of man: Theoretical and empirical evidence for blatant dehumanization. Journal of Personality and Social Psychology, 109(5), 901–931.
Paluck, E. L. (2009). Reducing intergroup prejudice and conflict using the media: A field experiment in Rwanda. Journal of Personality and Social Psychology, 96(3), 574–587.
Paolini, S., Hewstone, M., Cairns, E., & Voci, A. (2004). Effects of Direct and Indirect Cross-Group Friendships on Judgments of Catholics and Protestants in Northern Ireland: The Mediating Role of an Anxiety-Reduction Mechanism. Personality and Social Psychology Bulletin, 30(6), 770–786.
Sagy, Shifra & Adwan, Sami & Kaplan, Avi. (2002). Interpretations of the past and expectations for the future of Israeli and Palestinian youth. The American journal of orthopsychiatry. 72. 26-38.
Vorauer, J. D., & Sasaki, S. J. (2009). Helpful only in the abstract? Ironic effects of empathy in intergroup interaction. Psychological Science, 20(2), 191–197.
Zak, Paul J. and Knack, Stephen, Trust and Growth (September 18, 1998).