Original Research Reports

Citizenship and Socio-Political Integration: A Person-Oriented Analysis Among Russian-Speaking Minorities in Estonia, Finland and Norway

Tuuli Anna Renvik*a, Joel Mannerb, Raivo Vetikc, David L. Samd, Inga Jasinskaja-Lahtib

Abstract

This survey study utilized a person-oriented approach to explore the patterns of socio-political integration among Russian-speaking minority group members in three neighboring countries in the Baltic area: Estonia (n = 482), Finland (n = 252), and Norway (n = 215). Three profiles were obtained in all countries: critical integration, separation, and assimilation. In the whole sample, critical integration was the most common acculturation profile. After the profiles were established, they were examined vis-à-vis citizenship and integration context to see, whether and to what extent, the objective (i.e., citizenship) and subjective (i.e., perceived social status and sense of belonging) socio-political integration of Russian-speakers corresponded with each other. Critical integration and separation were the most common profiles among participants holding national citizenship of the country of residence, while foreign citizenship was not related to any specific profile. Separation was rare among participants holding dual citizenship, but it was the most common profile among participants with undetermined citizenship. Also, intergroup context was associated with socio-political integration: critical integration and separation were the most common profiles of Russian-speakers in Estonia, critical integration and assimilation profiles in Finland, and assimilation profile in Norway. The results are discussed in relation to previous variable-oriented research and official integration policies of the countries studied.

Keywords: citizenship, socio-political integration, acculturation, person-oriented approach

Journal of Social and Political Psychology, 2020, Vol. 8(1), https://doi.org/10.5964/jspp.v8i1.1140

Received: 2019-01-21. Accepted: 2019-08-07. Published (VoR): 2020-02-28.

Handling Editor: Debra Gray, University of Winchester, Winchester, United Kingdom

*Corresponding author at: Open University, P.O. Box 3 (Fabianinkatu 33), 00014 University of Helsinki, Helsinki, Finland. E-mail: tuulianna.renvik@helsinki.fi

This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

“National citizenship is the highest standard of equal treatment”, wrote Bauböck and colleagues (2013, p. 40), as only after becoming full citizens, will the interests and opinions of immigrants be considered by political parties and representative institutions. Indeed, national citizenship is crucial for immigrant integration, as it can be seen as a concrete way of accommodating cultural diversity and promoting inter-ethnic equality. The link between citizenship and integration has been studied quite extensively in the fields of political science and sociology (Goodman, 2015), and increasingly also in social and acculturation psychology (see de Vroome et al., 2014; Ersanilli & Koopmans, 2011; Kus-Harbord & Ward, 2015; Verkuyten & Martinovic, 2012). However, it is still unclear whether and to what extent objective (i.e., citizenship) and subjective (i.e., perceived social status and sense of belonging) socio-political integration correspond with each other in different societal contexts. We argue that in order to answer this question, a person-oriented approach is needed to complement the dominating variable-oriented research. Namely, with a person-oriented approach, it is possible to acknowledge the heterogeneity of immigrant populations and their integration profiles (cf. Grigoryev & van de Vijver, 2018; Haugen & Kunst, 2017; Maehler, Weinmann, & Hanke, 2019).

This study aims at continuing and contributing to the strand of research that bridges social, political, and acculturation psychological theories on immigrant integration. With our data from Russian-speakers in Estonia, Finland and Norway, we are able to describe their different profiles of socio-political integration and show how these profiles are linked to their citizenship status (i.e., national, foreign, dual and undetermined citizenship). Our theoretical approach is built on the idea that objective and subjective socio-political integration are intertwined (Fick, 2016; Hainmueller, Hangartner, & Pietrantuono, 2015, 2017), and that integration is a mutual intergroup process between immigrants and the receiving society (Bourhis, Moise, Perreault, & Senecal, 1997; Horenczyk, Jasinskaja-Lahti, Sam, & Vedder, 2013). Ideally, an immigrant takes an active part in one’s integration process, and the state acknowledges this willingness to be a full member of society by granting citizenship. However, in practice, states can regulate access to citizenship in many ways, and an immigrant can also refuse to apply for a citizenship, e.g., when perceiving that one is being treated unfairly. In these cases, objective and subjective integration do not go hand in hand. This is the puzzle we aim to study among Russian-speakers in three countries with different citizenship policies and intergroup contexts.

Integration as a Mutual Process [TOP]

Immigrant integration can be approached from a plethora of complementary viewpoints. In this study, we lean on a widely utilized acculturation psychological approach, which corresponds with the common basic principles for immigrant integration at the level of the European Union: integration means “people’s joint involvement in, and attachment to, both their heritage culture and the larger society of settlement” (Berry & Sam, 2013, p. 156; see also Council of the European Union, 2004). At societal level, full integration cannot be reached without non-discrimination and equal access to all spheres of society (Berry & Sam, 2013; Council of the European Union, 2004), and when cultural diversity is cherished and equitable participation is widely accepted, integration equals the fulfilled ideals of multiculturalism (Berry, 2016).

Importantly, integration is a dynamic, mutual process that involves both immigrants and members of the receiving society (Berry, 1997; Bourhis et al., 1997; Horenczyk et al., 2013). However, it should be noted that the more powerful majority group plays a great role in creating opportunities and ways for integration for immigrants and other ethnic minority group members (Berry & Sam, 2013; Bourhis et al., 1997). Research has shown that perceived opportunities for becoming a full member contribute to immigrants’ strategies of approaching vs. distancing themselves from the receiving society (e.g., Berry et al., 2006). Thus, integration is not only about individual strategies of whether and how to blend in.

As regards the definition of socio-political integration, Wright and Bloemraad (2012) distinguished social inclusion, political inclusion, and political engagement as its essential components, and emphasized the roles of ethnic and national identities in them. Similarly, Fischer-Neumann (2014) stressed the importance of identities, when examining the socio-political integration of immigrants through sense of belonging and involvement in politics. Following the theorization on politicized collective identity (Simon & Grabow, 2010; Simon & Klandermans, 2001), the author argued for the centrality and the constructive role of dual (i.e., ethnic and national) identification in immigrants’ social integration (Fischer-Neumann, 2014). Previous research from one of the present research contexts, Finland, echoes this idea. Larja (2017) studied 15-29 year old youth with foreign background and examined their social integration from the viewpoint of ethnic and national identification (cf., Hutnik, 1991; see also Dovidio, Gaertner, & Saguy, 2009, p. 9-10). The results indicated that most youth with Finnish citizenship were integrated (35%; high national and ethnic identification) or assimilated (32%; high national and low ethnic identification), while these profiles were not that common among youth with foreign citizenship (21% and 11%, respectively). Among foreign citizens, separation orientation (51%; low national and high ethnic identification) was more common than among Finnish citizens (20%).

When interpreting previous results related to national identification, it should be noted that in some studies (e.g. Ersanilli & Koopmans, 2010; Fick, 2016), civic identification with the country or society has been measured (e.g., “I feel that I am a member of the German society”), while other studies (e.g. Larja, 2017) have focused on identification with the ethnic majority group (e.g., “I feel that I am Finnish”). In European nation states, national identification is often very ethnically laden, but society as a whole creates more inclusive grounds for common civic identification (for discussion, see e.g., Brylka, Mähönen, & Jasinskaja-Lahti, 2015). In this study, we focus on civic national identification with society.

Importantly, when studying socio-political integration from the viewpoint of social identities, also perceptions of acceptance and social status need to be acknowledged. For example, Simon and Grabow (2010) studied Russian immigrants in Germany and showed the importance of perceived maltreatment for politicized dual identification to develop. When facing inequality and/or pressure to assimilate, ethnic minorities often transform their identities into more defensive or reactive forms (e.g., Jasinskaja-Lahti, Mähönen, & Liebkind, 2012; Mähönen, Jasinskaja-Lahti, & Liebkind, 2011; Verkuyten & Martinovic, 2012; Vetik & Helemäe, 2011). In other words, strong ethnic identification can be associated both with integrationist and separatist orientation in relation to engaging in contact with the national majority – depending on how immigrants perceive the prevailing intergroup relations in society (Barrette, Bourhis, Personnaz, & Personnaz, 2004; see also Verkuyten, 2006). Another reaction to perceived inequality among immigrants is national dis-identification, which compromises positive intergroup relations with the majority and socio-political engagement (Jasinskaja-Lahti, Celikkol, Renvik, Eskelinen, Vetik, & Sam, 2018; Jasinskaja-Lahti, Liebkind, & Solheim, 2009).

Therefore, following previous research discussed above (e.g., Simon & Ruhs, 2008; Verkuyten, 2006; Verkuyten & Martinovic, 2012; Vetik 2018; Wright & Bloemraad, 2012), we approach Russian-speaking minority group members’ socio-political integration through their sense of belonging in the ethnic ingroup and the society at large, accompanied by perceptions of group status (perceived discrimination, status legitimacy and permeability of group boundaries) and stance towards the national majority (attitudes towards and trust in majority). Finally, it should be acknowledged that the way immigrants see their possibilities for equal membership and belonging cannot be understood in isolation from legal recognition. Thus, as discussed in more detail below, in this study, we focus on both objective and subjective socio-political integration - recognition in terms of granted citizenship and subjective sense of membership (cf., Wright & Bloemraad, 2012) - and their interplay in different integration contexts.

The Relationship Between Naturalization and Integration [TOP]

Naturalization (i.e., granting national citizenship) is an essential part of immigrant integration (see Huddleston & Vink, 2015). Using a variety of cross-national and single-country surveys, Wright and Bloemraad (2012) have concluded that citizenship fosters immigrants' socio-political inclusion and political engagement. Hainmueller et al. (2017) found in Switzerland that naturalization also promoted immigrants’ long-term integration. The design of Hainmueller et al. (2017, see also 2015) was unique in its focus on close naturalization referendums, in which the naturalization decision was as good as random, enabling them to study the causal relationship between citizenship and integration outcomes. There is also valuable longitudinal evidence from Germany (Fick, 2016; Maehler et al., 2019) supporting the idea that citizenship acquisition promotes identification with receiving society and might also support the compatibility of ethnic and civic national identities.

However, not all immigration contexts are equally welcoming: there are substantial differences in the ease of naturalization processes, as well as in integration policies. In their study among Turkish immigrants in the Netherlands, France and Germany, Ersanilli and Koopmans (2010) studied whether naturalization is positively associated with socio-cultural integration measured as civic national identification, proficiency and use of the national language, and interethnic social contacts. They found this pattern of results only in France and Germany, where a certain degree of cultural assimilation has traditionally been required from new citizens. Context also played a role in a Simonsen’s (2017) study in 14 Western countries: While citizenship appeared as an important marker of national belonging for national majority members in all countries studied, the largest difference was between Norway and Finland. The importance of citizenship was the least pronounced in Finland, while in Norway, the role of citizenship was stressed more than in any of the other European countries (Simonsen, 2017).

One way towards inclusiveness and formal recognition of dual identities is to allow immigrants’ dual citizenship of country of residence and country of origin/emigration. Even within Europe, countries differ greatly in their views on dual citizenship. This has evoked also relevant research on whether allowing dual citizenship is a risk or an aid when it comes to integration. Ersanilli and Koopmans (2010) compared the situation of Turkish immigrants in the Netherlands, France, and Germany. In France, where dual citizenship is unconditionally allowed, the positive association between naturalization and socio-cultural integration was the strongest, compared to the other two contexts studied. In contrast, the strict restrictions regarding dual citizenship in Germany did not make German Turks any better integrated than their fellows in France. Ronkainen (2011) has pointed out that the key reason for nation states to restrict dual citizenship has been the expectation of undivided loyalty from the citizens toward their state. As recently shown in a study in Finland, Germany, and the Netherlands (Jasinskaja-Lahti, Renvik, Van der Noll, Eskelinen, Rohmann, & Verkuyten, 2019), immigrants’ dual citizenship is indeed associated with majority group members’ reserved attitudes, mistrust, and reluctance to assist immigrants in their integration process (see also Kunst, Thomsen, & Dovidio, 2019). However, as noted by Ronkainen (2011), dual citizenship has different meanings among the dual citizens themselves. In the Finnish context, he found that the functions of dual citizenship were mainly described in terms of transnationalism, rather than in terms of political affiliations or state loyalties. Being questioned can feel unfair by immigrants themselves, leading to identity and attitudinal reactions (see Verkuyten & Martinovic, 2012). From this viewpoint, more research is clearly needed also on the less studied group of dual citizens.

Russian-Speakers in Estonia, Finland, and Norway [TOP]

This study focuses on Russian-speakers’ socio-political integration in Estonia, Finland and Norway. These neighboring countries within the Baltic region were chosen because of their contextual similarities: they share state borders with each other and Russia and have Russian-speaking minorities. They also create interesting avenues for between-country comparisons. First, as regards political alliances, out of these three countries, Finland is the only country that is not a member of the NATO, and Norway is the only country that is not a member of the EU. Second, as discussed in more detail below, the numbers of Russian-speakers and the inclusiveness of citizenship and integration policies vary between the countries (MIPEX, 2015). Third, the migration reasons of Russian-speakers in the countries studied vary: while family reunification and ethnic remigration have mostly characterized Russian immigration to Finland, work and family reunification have been the primary motivations of Russians to come to Norway (Sandnes, 2018; Sutela & Larja, 2015; Utlendingsdirektoratet, 2018). In Estonia, it was rather the state border than the people that moved: Russians in Estonia are internal migrants from the times when the country was a part of the Soviet Union. As a result, Russians in Estonia have lived there for generations and do not regard themselves as immigrants at all (see Brubaker, 1996).

As regards the situation of Russian-speakers in these countries, in Estonia, the share of foreign-origin population was 27 percent at the beginning of 2016 (Tammur, 2017). Most of these people are Russian-speakers, who constitute around 25 percent of the total population according to the 2011 census. After Estonia gained independence, ethnic Russians have lost their previously privileged status and have become a relatively deprived group with devalued group identity and problems with integrating into the society (Kus-Harbord & Ward, 2015). The strict, ethnically laden citizenship policies have had a negative impact on the integration of Russian speakers in the labor market as well as society in general, and as a reaction, this minority has shown strong defensive identities (Lauristin et al., 2012; Vetik & Helemäe, 2011).

In Finland, around seven percent of the whole population have an immigrant background, and around 20 percent of them speak Russian as their mother tongue (Statistics Finland, 2017). The intergroup relations between Russian immigrants and the Finnish majority are characterized by discrimination owing to historical conflicts (e.g., the wars between Finland and the Soviet Union in 1939-1940 and 1941-1944), and Russians have been considered one of the least welcome immigrant groups (Jaakkola, 2009). Prior research among Russian-speaking immigrants has attested that ethnic discrimination is common (e.g., Larja et al., 2012) and it has detrimental effects on their identification with Finnish society (Jasinskaja-Lahti, Mähönen, & Ketokivi, 2012).

Of the three countries, Norway inhabits the smallest community of Russian-speakers. At the time of the data collection, immigrants accounted for ca. 13 percent of the total population in Norway, with only two percent of immigrants speaking Russian as their mother tongue (Statistics Norway, 2016). However, Russians were the fifth largest immigrant group and the largest non-EU group in the country before the so-called refugee crisis in 2015 (Olsen, 2015). Similar to Finland, a larger increase in Russian-speaking happened after the collapse of the Soviet Union in 1990. Systematic research on the integration of this group is limited, but as marriages are one of the main reasons to migrate to Norway from Russia, there is a body of research on intercultural marriages, transnational family ties, and the labour market situation of Russian women in Norway (e.g., Flemmen, 2008; Heyse, 2010; Munkejord, 2017). Based on these studies, it is clear that also in Norway, Russian-speakers face prejudice, and that their social status can be considered as relatively low.

As regards citizenship policies, in all these countries, extended residence and language ability are the basic requirements for citizenship. Dual citizenship of Russia is allowed only in Finland, with approximately one third of the Russian-speaking minority possessing dual citizenship (Statistics Finland, 2016). Until recently, Norway did not welcome or encourage dual citizenship, but this is changing. Estonia belongs to the countries least tolerant of dual citizenship in the European Union (Bauböck et al., 2013). Also more generally speaking, citizenship acquisition rates among the foreign-born are among the lowest in Estonia when compared to other European countries (Bauböck et al., 2013, see also MIPEX, 2015). In 2016, one third of the first generation Russian-spekers living in Estonia had Estonian citizenship, another one third were Russian citizens, one fifth had so-called undetermined citizenship (i.e., were not recognized by any state as its citizen), and the rest were citizens of other countries (often from the former Soviet Union) (Tammur, 2017). However, the share of Estonian citizens is increasing, and the share of undetermined citizenship is decreasing (Tammur, 2017; Estonian Ministry of Internal Affairs, 2018).

As regards the background of undetermined citizenship, the adoption of the Citizenship Act in 1993 (see Barrington, 1995) forced most Estonian-Russians to go through of naturalization process that made language proficiency as a criterion for acquiring citizenship. Many Russian-speakers regard this process as unjust and discriminatory, and seemingly well-intended efforts to increase Estonian language proficiency in schools is often seen as assimilationist (Vetik & Helemäe, 2011, see also Kruusvall et al., 2009). As a result, many Russian-speakers have not acquired Estonian citizenship. Estonia does grant social protection to all legal residents regardless of their citizenship status, and residents with undetermined citizenship can vote in local elections. Also at the level of practicalities, undetermined citizenship does not hinder everyday living in Estonia and makes it easier to travel to Russia (Nimmerfeldt, Schulze, & Taru, 2011). Nevertheless, undetermined citizens are not structurally integrated as they do not have equal political rights in terms of voting or standing for in national elections, or equal access to the major institutions such as education and labour market (Nimmerfeldt et al., 2011). Thus, in the present research, the special case of Estonian Russians with undetermined citizenship is particularly acknowledged.

Aim and Research Questions [TOP]

Recently, Goodman (2015) evaluated the current state of research on the relationship between citizenship and immigrant integration and called for studies that would not necessarily be theory-confirming but theory-developing. One possibility for theoretical development is to strengthen the line of research that acknowledges the mutuality of socio-political integration (see Berry & Sam, 2013), instead of approaching it merely though the strategies or skills of an immigrant individual. In this study, we are able to study the relationship between objective socio-political integration (i.e. “Am I legally ‘one of us’?”) and subjective socio-political integration by taking into account also perceived opportunities for integration (i.e. “Am I considered as ‘one of us’? Do I feel that I am a full member of this society?”). Furthermore, one empirical possibility for specifying the existing theories further is to utilize a person-oriented analysis. Namely, previous research on immigrant integration could be criticized for over-reliance on sample homogeneity: most studies have assumed that patterns at the level of the sample apply to all (or most) participants (for research examples, see Sam & Berry, 2016). Acculturation psychological research has increasingly started to acknowledge the value of a person-oriented approach and complemented the predominantly variable-oriented literature by examining the variety of profiles among different immigrant subgroups (Bámaca-Colbert & Gayles, 2010; Grigoryev & van de Vijver, 2018; Haugen & Kunst, 2017; Inguglia & Musso, 2015; Kruusvall et al., 2009; Maehler et al., 2019; Mancini, Navas, López-Rodríguez, & Bottura, 2018).

As pointed out by Verkuyten (2006), integration policies in one socio-political context can have a different meaning in another, and something that works in one country does not necessarily work in another. Moreover, there is research evidence showing that due to within-country and within-group variation, the integration profiles of immigrants rarely parallel the state’s official integration policy (Berry et al., 2006; see also Horenczyk et al., 2013). Thus, we start the analysis by utilizing a person-oriented approach and exploring the characteristics of socio-political integration of Russian-speaking minority group members separately and jointly in the three countries studied (RQ1). More specifically, we will focus on how Russian-speaking minority group members perceive the status hierarchies and intergroup boundaries in the societies they are living in, what are their identification patterns, and how do they evaluate national majority group members (for a similar approach to socio-political integration, see e.g., Verkuyten & Martinovic, 2012). Then, with pooled data, we will examine the extent to which different integration profiles are represented in Estonia, Finland and Norway (RQ2) and among participants holding national, foreign, dual, or undetermined citizenship (RQ3).

Method [TOP]

Participants and Procedure [TOP]

This study utilizes Estonian, Finnish, and Norwegian survey data collected for a broader cross-cultural research project MIRIPSi between 2012 and 2016. The Estonian data was collected among a random sample of Russian-speaking adult population in May 2015. Out of the participants, 81% were born in Estonia and represent second or third generation Russians. More than 90% reported having lived in Estonia for more than 25 years, i.e., for the whole post-Soviet period. The questionnaires were completed during face-to-face interviews. In Finland, data was collected between June and November 2012, by approaching a representative sample of Russian-speaking adults by mail. All participants had been born in the Soviet Union/the Russian Federation and had moved to Finland before 2008. The Norwegian data was collected between November 2015 and January 2016. From all legal residents of Norway, adults who identified themselves as Russians were randomly selected and invited by phone to take part in the study. Upon agreeing, a link to an electronic questionnaire was sent. In all countries, participation in the study was fully voluntary and anonymous.

The response rate was 65% for Estonia, 39% for Finland and 33% for Norway. Due to data attrition, the final sample used in the analyses was not representative of the populations. However, the response rates can be considered as typical for survey studies conducted in these countries. In the final sample there were 955 participants (n = 482 for Estonia, n = 254 for Finland, and n = 219 for Norway).

The socio-demographic characteristics of the sample are presented in Table 1. The majority of participants in all countries were female and, on average, middle-aged. As regards citizenship, there were differences between the countries, χ2(6) = 502.157, p < .001: there were more national citizens in the Estonian sample compared to Finland and Norway, and the number of foreign citizens differed between all three countries (Norway > Estonia > Finland). Dual citizenship is not allowed in Estonia, and in Norway it is only a special case: thus, also in our data there were more dual citizens in Finland than in Norway. In Estonia, the citizenship of approximately every fifth participant was undetermined.

Measures [TOP]

In this study, we utilized measures used in previous social and acculturation psychological research and back-translated them from English to Russian. The descriptive statistics of each scale by country are presented below.

Perceived discrimination was measured with five items (Berry, Phinney, Sam, & Vedder, 2006) assessed on a five-point Likert-scale (1 = Strongly disagree to 5 = Strongly agree): In my opinion <national majority group members> have treated Russian immigrants unfairly or otherwise negatively; I think that <national majority group members> don't accept Russian immigrants; I think that <national majority group members> have something against me because I'm a Russian immigrant; <national majority group members> have teased or insulted me because I'm a Russian immigrant; <national majority group members> have threatened or attacked me because I'm a Russian immigrant (M = 2.31, SD = .85, α = .86 in the total sample; M = 2.46, SD = .74, α = .84 in Estonia; M = 2.34, SD = .93, α = .84 in Finland; M = 1.95, SD = .89, α = .83 in Norway).

Perceived social status of the ingroup in relation to that of the national majority group was measured using a single item adapted from Louis, Duck, Terry, Schuller, and Lalonde (2007) and assessed on a five-point Likert-scale (1 = Strongly disagree to 5 = Strongly agree): “Compared to <national majority group members>, the social and economic standing of Russian minority is low” (M = 2.53, SD = .95 in the total sample; M = 2.00, SD = .71 in Estonia; M = 2.94, SD = .77 in Finland; M = 3.23; SD = .90 in Norway).

Perceived status legitimacy was measured with two items adapted from Louis and colleagues (2007) and assessed on a five-point Likert-scale (1 = Strongly disagree to 5 = Strongly agree): The status of the Russian immigrants in <country> is the way it should be; Russian immigrants deserve its present status in <country> (M = 2.36, SD = 1.13 in the total sample; M = 1.71, SD = .76 in Estonia; M = 2.98, SD = 1.00 in Finland; M = 3.05, SD = 1.13 in Norway, and the Spearman-Brown split-half reliability coefficient = .85, .77, .80, and .74, respectively).

Perceived permeability of group boundaries was measured with a single item adapted from Louis and colleagues (2007) and assessed on a five-point Likert-scale (1 = Strongly disagree to 5 = Strongly agree): Russian immigrants are accepted in <Estonian/Finnish/Norwegian> society (M = 2.99, SD = 1.12 in the total sample; M = 2.62, SD = 1.07 in Estonia; M = 2.90, SD = .90 in Finland; M = 3.89, SD = 1.12 in Norway).

Ethnic identification was measured with four items (cf., Mlicki & Ellemers, 1996; Phinney & Devich-Navarro, 1997) assessed on a five-point Likert-scale (1 = Strongly disagree to 5 = Strongly agree): I see myself as / I feel that I am Russian; I am proud that I am Russian; I am glad that I am Russian; It is important for me that I am Russian (M = 4.30, SD = .73, α = .90 in the total sample; M = 4.4, SD = .55, α = .87 in Estonia; M = 4.05, SD = .87, α = .85 in Finland; M = 4.35, SD = .83, α = .89 in Norway).

Civic national identification with society was measured with four items (cf., Mlicki & Ellemers, 1996; Phinney & Devich-Navarro, 1997) assessed on a five-point Likert-scale (1 = Strongly disagree to 5 = Strongly agree): I feel that I am a member of <Estonian/Finnish/Norwegian> society; I am proud to be a member of <Estonian/Finnish/Norwegian> society; I am glad to be a member of <Estonian/Finnish/Norwegian> society; It is important for me to be a member of <Estonian/Finnish/Norwegian> society (M = 3.65, SD = .91, α = .91 in the total sample; M = 3.47, SD = .87, α = .92 in Estonia; M = 3.47, SD = .87, α = .89 in Finland; M = 4.00, SD = .91, α = .81 in Norway).

Outgroup trust towards the national majority was measured with three items (cf., Paolini, Hewstone, & Cairns, 2007) assessed on a five-point Likert-scale (1 = Strongly disagree to 5 = Strongly agree): In my opinion most of the <outgroup members> are trustworthy; I think that most <outgroup members> would treat me fairly even if they had a chance to take advantage of me; <Outgroup members> won't take advantage of me if I trust them (M = 3.59, SD = .86, α = .83 in the total sample; M = 3.26, SD = .74, α = .87 in Estonia; M = 3.90, SD = .76, α = .75 in Finland; M = 3.94, SD = .93, α = .86 in Norway).

Outgroup attitudes towards the national majority was measured with a feeling thermometer (e.g., Haddock, Zanna, & Esses, 1993). The participant evaluated their feelings towards native majority group members on a scale between 0 = very cold to 100 = very warm. For the analysis, values were then divided by 20, so that they were on a similar five-point scale as the rest of the variables used (M = 3.60, SD = 1.00 in the total sample; M = 3.58, SD = 1.00 in Estonia; M = 3.59, SD = .98 in Finland; M = 3.65; SD = 1.03 in Norway).

In addition, a set of socio-demographic background variables (i.e., sex, age, marital status, education and employment status) were used in the following analyses (see Table 1). For correspondence and cluster analyses, age was recoded into six categories (18-24, 25-34, 35-44, 45-54, 55-64, and 65-74). Educational background was transformed into three groups: Basic, Secondary and Higher Education. In Estonia and Norway, data on education was gathered by specific educational categories (see Table 1).

Data on education was gathered in Finland by years of schooling, and so in order to match Estonian and Norwegian data as well as possible, less than 11 years of schooling was considered as Basic Education, between 11 and 15 years of schooling was considered as Secondary Education, and over 15 years was considered as Higher Education. In the transformed variable used in the analyses, less than secondary education was considered as Basic, and university or college level education was considered as Higher Education. To compare this classification to the International Standard Classification of Education (ISCED, 2011), Basic Education is comprised of school levels up to ISCED Level 2, Secondary Education of ISCED Levels 3 to 4, and Higher Education of ISCED Levels 6 to 8 (5 being virtually non-existent). ISCED classification of lower secondary education is considered as Basic Education, and higher secondary education is included as Secondary Education.

Table 1

Socio-Demographic Characteristics of the Sample by Country

Variable Estonia
(n = 482)
Finland
(n = 252)
Norway
(n = 215)
Total
(N = 955)
Agea 48.22 (15.6) 43.88 (11.9) 40.87 (11.0) 45.38 (14.0)
Sexb
Female 262 (54.4) 198 (78) 164 (74.9) 624 (65.3)
Male 220 (45.6) 56 (22) 55 (25.1) 331 (34.7)
Citizenshipb
National citizenship 254 (52.7) 20 (7.9) 23 (10.9) 297 (31.4)
Foreign citizenship 127 (26.3) 105 (41.7) 131 (62.1) 363 (38.4)
Dual citizenshipc 0 (0.0) 127 (50.4) 57 (27.0) 184 (19.5)
Undetermined citizenshipd 101 (21.0) 0 (0.0) 0 (0.0) 101 (10.7)
Married or cohabitingb
Yes 395 (63.3) 193 (76.9) 157 (71.7) 655 (68.8)
No 117 (36.7) 58 (23.1) 62 (28.3) 297 (31.2)
Employment situatione
Entrepreneur 20 0 10 30
Employed 259 157 135 551
Unemployed 17 38 23 78
Student 27 21 23 71
Retired 134 9 8 151
At home 25 14 13 52
Other 0 14 7 21
Educatione
Years 15.31 (3.08)a
Basic education 35 2
Vocational education 44 10
Secondary education 356 67
Higher education 47 140

aValues reported = M (SD). bValues reported = n (%). cNo Estonian data. dEstonian data only. eValues reported = n.

Data Analysis [TOP]

First, a confirmatory factor analysis was conducted to test the four-factor structure of ethnic identification, national identification, perceived discrimination and outgroup trust items. We also tested this four-factor model against a one-factor baseline model, to show the distinctiveness of the four latent constructs. After this, we performed multivariate measurement invariance tests to see if the four-factor model holds across the three countries.

To analyze the general pattern of relationships between the eight variables tapping socio-political integration and socio-demographic characteristics, we performed a multiple correspondence analysis (MCA) with principle variable normalization (SPSS 25) separately for each country. Next, to identify integration profiles, the object score variables obtained from MCA were utilized in a two-step cluster analysis with log-likelihood distance measure and Schwarz’s Bayesian Criterion Clustering (Schwarz, 1978). Finally, based on the preliminary country-specific analyses, we ran correspondence and cluster analyses in pooled data, and used cross-tabulation and chi-square tests to examine the distribution of participants to different profiles within and between countries and within each citizenship category.

Results [TOP]

Confirmatory Factor Analysis [TOP]

Confirmatory factor analysis of items used to measure ethnic identification, national identification, perceived discrimination and outgroup trust was run in Mplus 8.1 with robust maximum likelihood estimator. Goodness of fit indices indicated that a four-factor model had a relatively good fit with the data, χ2(98) = 285.28, p < .001; RMSEA = .05; CFI = .96; TLI = .96; SRMR = .04, unlike a single-factor model which did not fit the data, χ2(106) = 4226.95, p < .001; RMSEA = .20; CFI = .20; TLI = .09; SRMR = .25. Thus, the factors were distinctive at the level of the whole sample. Next, we tested the factorial equivalence of these four measures across the three countries. When testing configural invariance, the model fit was adequate, χ2(294) = 635.10, p < .001; RMSEA = .06; CFI = .95; TLI = .93; SRMR = .05, and we also found support for partial metric invariance, χ2(315) = 566.01, p < .001; RMSEA = .05; CFI = .96; TLI = .95; SRMR = .06, after setting two items measuring discrimination to covary (i.e. <national majority group members> have teased or insulted me because I'm a Russian immigrant; <national majority group members> have threatened or attacked me because I'm a Russian immigrant). Thus, we concluded that the factorial structure works well enough in all three countries for the purpose of using sum scores of ethnic identification, national identification, perceived discrimination and outgroup trust in the following analyses.

Integration Profiles: A Country-Specific Analysis [TOP]

MCA of socio-demographic characteristics and the eight variables tapping socio-political integration produced two dimensions explaining 47.7. percent of the total variance in Estonia, 46.6 percent in Finland, and 51.1 percent in Norway. A two-step cluster analysis of the object scores obtained from MCA identified three clusters with adequate silhouette measures of cohesion and separation (.6) in each country. The means of the variables composing the profiles in each country are presented in Figures 1, 2, and 3.

Figure 1

Socio-political integration profiles in Estonia.

Figure 2

Socio-political integration profiles in Finland.

Figure 3

Socio-political integration profiles in Norway.

While also socio-demographic characteristics were included in the analysis as background variables, the theoretical interpretationii of the profiles was based on the variables tapping socio-political integration from the viewpoint of perceived status and sense of belonging. In all clusters, i.e. profiles in all countries, ethnic identification was quite high, but there were some interesting differences in the other variables forming the profilesiii. For example, regardless of the integration profile, Russian-speakers in Estonia saw their ingroup’s status and its legitimacy in a more negative light than their co-ethnics in Finland and Norway. However, the most notable and systematic finding was that in all countries, the pattern of the profiles found was very similar.

Namely, the first profile was characterized by highest levels of perceived discrimination, lowest levels of perceived status, status legitimacy and permeability of group boundaries, high ethnic identification, lowest national identification, lowest outgroup trust and most critical attitudes towards the national majority. In other words, participants in this profile identified mainly with their ethnic ingroup and took a negative stance towards the majority that was perceived to treat the ingroup in an unjust manner. In contrast, the second profile was characterized by lowest levels of perceived discrimination, highest levels of perceived status, status legitimacy and permeability of group boundaries, high ethnic identification, highest national identification, highest outgroup trust and most positive attitudes towards the national majority. Thus, these participants identified relatively highly with both ethnic and national groups and took a very positive stance towards the majority that was seen to grant access to the society. In the third profile, ethnic identification was again high, and the mean values of the rest of the variables fell in between the mean values present in the two previous clusters. In other words, this profile was characterized by high ethnic but moderate national identification, paired with critical views about the majority group and ingroup’s possibilities to be considered as an equal member of the society.

Based on previous acculturation and social psychological research (e.g., Berry et al., 2006; Berry & Sam, 2013; Bourhis et al., 1997; Horenczyk et al., 2013), these profiles were named as Separation, Assimilation, and Critical Integration, respectively. The third profile was characterized by orientation towards both ethnic and national groups, thus resembling the integration orientation defined in previous research (cf., Berry et al., 2006). However, this profile was also characterized by critical views of the ingroup’s position: participants in this profile perceived higher levels of discrimination and lower social standing of their ingroup than those in the assimilation profile, but they were also more concerned about the legitimacy of this group’s status position than assimilationists. Following similar observations from Estonia by Kruusvall and colleagues (2009), we decided to call this profile critical integration. It should be noted that ethnic identification was high in all the profiles: even within assimilation profile, ethnic identification was equally high to national identification. This speaks for the salience of ethnic identity among Russian participants in all three countries. Given that the pattern of the results was so similar in the three countries studied, we moved to the final analyses where the pooled data set was utilized.

Integration Profiles vis-à-vis Citizenship and Country of Residence [TOP]

With pooled data, MCA of socio-demographic characteristics and the eight variables tapping socio-political integration produced two dimensions explaining 42.9 percent of the total variance, out of which 26.9 percent was explained by the first dimension and 16 percent by the second dimension. Again, a two-step cluster analysis of the object scores obtained from MCA identified three clusters with an adequate silhouette measure of cohesion and separation (0.6). The interpretation of the clusters, i.e., socio-political integration profiles, was the same as in the country-specific analyses presented above, and the descriptive statistics of the variables forming the three profiles are presented in Table 2.

Table 2

Descriptive Statistics of the Variables Forming the Socio-Political Integration Profiles

Variable Separation (268) Assimilation (214) Critical integration (473)
Agea 49.26 (14.47) 43.1 (11.78) 44.21 (14.3)
Sexb
Female 149 (23.9) 154 (24.7) 321 (51.4)
Male 119 (36.0) 60 (18.1) 152 (45.9)
Married or cohabitingb
Married 172 (26.2) 157 (24.0) 326 (49.8)
Unmarried 96 (32.3) 56 (18.9) 145 (48.8)
Employment situationb
Employer 8 (26.7) 6 (20.0) 16 (53.3)
Employed 143 (26.0) 141 (25.6) 267 (48.5)
Unemployed 22 (28.2) 17 (21.8) 39 (50.0)
Student 8 (11.3) 19 (26.8) 44 (62.0)
Retired 73 (48.3) 10 (6.6) 68 (45.0)
Homemaker 11 (21.2) 12 (23.1) 29 (55.8)
Other 3 (14.3) 9 (42.9) 9 (42.9)
Ethnic identificationa 4.45 (.61) 4.18 (.84) 4.27 (.73)
National identificationa 3.02 (.92) 4.12 (.84) 3.80 (.71)
Legitimacya 1.32 (.63) 3.82 (.79) 2.28 (.69)
Statusa 1.52 (.48) 3.81 (.52) 2.52 (.48)
Perceived discriminationa 2.93 (.79) 1.75 (.74) 2.22 (.71)
Outgroup trusta 2.87 (.80) 4.21 (.67) 3.72 (.66)
Thermometera 2.96 (.98) 4.02 (.91) 3.77 (.88)
Permeabilitya 1.89 (.80) 4.04 (.88) 3.13 (.88)

aValues reported = M (SD). bValues reported = n (%).

To validate the meaningfulness of the profiles with another method, we tested whether the mean values of each variable differed statistically significantly between the profiles in the pooled data. According to post-hoc comparisons, F(2, 952) = 9.22, p < .001, η2 = .019, the level of ethnic identification was higher in separation profile (M = 4.45, SD = .04) than in assimilation (M = 4.18, SD = .05) and critical integration profiles (M = 4.27, SD =.03) at p < .001 level, but there was no difference in the mean level of ethnic identification between assimilation and critical integration profiles (p = .468). More generally speaking and confirming the results of cluster analysis, the other variables of interest differed statistically significantly (p < .001) between acculturation profiles in a post-hoc ANOVA with Bonferroni correction. At the level of the whole sample, critical integration was the most common profile (49.5%), followed by separation (28.1%) and assimilation (22.4%) profiles.

The final analytical step needed to answer our research questions was to examine the integration profiles vis-à-vis country and citizenship status. Table 3 presents the cross-tabulation between country and integration profile, χ2(4) = 264.07, p < .001. Numerically, critical integration was the most typical profile in Estonia and Finland. In Estonia, separation profile was slightly rarer than critical integration. In Finland, there was no statistically significant difference between the prevalence of critical integration and assimilation profiles. In Norway, assimilation was the most common profile, followed by critical integration. The main differences between the countries, χ2(4) = 264.035, p < .001, as presented in Table 4, boil down to separation and assimilation profiles. Separation was relatively more common in Estonia compared to Finland and Norway, and assimilation was relatively more common in Norway compared to Estonia and to a lesser degree, Finland.

Table 3

Distribution of Socio-Political Integration Profiles Within Countries

Country Separation Assimilation Critical integration
Estonia
n (%) 215a (44.6%) 21b (4.4%) 246c (51.0%)
Adjusted residual 11.5 -13.5 0.9
Finland
n (%) 30a (11.8%) 81b (31.9%) 143b (56.3%)
Adjusted residual -6.7 4.2 2.5
Norway
n (%) 23a (10.5%) 112b (51.1%) 84c (38.4%)
Adjusted residual -6.6 11.6 -3.8

Note. Each subscript letter denotes a subset of two-step cluster number categories whose column proportions do not differ significantly from each other within each country at the .05 level.

Table 4

Distribution of Socio-Political Integration Profiles Between Countries

Profile Finland Estonia Norway
Separation
n (%) 30a (11.2%) 215b (80.2%) 23a (8.6%)
Adjusted residual -6.7 11.5 -6.6
Assimilation
n (%) 81a (37.9%) 21b (9.8%) 112c (52.3%)
Adjusted residual 4.2 -13.5 11.6
Critical integration
n (%) 143a (30.2%) 246a (52.0%) 84b (17.8%)
Adjusted residual 2.5 0.9 -3.8

Note. Each subscript letter denotes a subset of two-step cluster number categories whose column proportions do not differ significantly from each other between each country at the .05 level.

Table 5 presents the cross-tabulation between citizenship and integration profile, χ2(4) = 115.351, p < .001. Critical integration and separation were the most common profiles among participants holding national citizenship. Foreign citizenship was not clearly associated to any specific profile, but only differentiated between critical integration and assimilation profiles. Among participants holding dual citizenship, critical integration was the most common profile, followed by assimilation. While separation was rare among participants holding dual citizenship, it was the most common profile among participants with undetermined citizenship. However, also a considerable number of participants with undetermined citizenship represented critical integration. When interpreting the results related to citizenship, it should be remembered that in our data, all participants with undetermined citizenship resided in Estonia, and dual citizens mainly came from Finland (with some from Norway). Statistical analysis of acculturation profiles simultaneously by citizenship and country was not meaningful due to limited sample size.

Table 5

Distribution of Socio-Political Integration Profiles within Citizenship Categories

Citizenship category Separation Assimilation Critical integration
National citizenship
n (%) 89a (30.0%) 38b (12.8%) 170a (57.2%)
Adjusted residual 0.8 -4.7 3.2
Foreign citizenship
n (%) 100a, b (27.5%) 99b (27.3%) 164a (45.2%)
Adjusted residual -.4 3.0 -2.2
Dual citizenship
n (%) 21a (11.4%) 72b (39.1%) 91c (49.5%)
Adjusted residual -5.7 6.2 -0.1
Undetermined citizenship
n (%) 57a (56.4%) 0 (0.0%) 44c (43.6%)
Adjusted residual 6.7 -5.7 -1.3

Note. Each subscript letter denotes a subset of two-step cluster number categories whose column proportions do not differ significantly from each other within each citizenship category at the .05 level. Dual citizenship is not allowed in Estonia, and in Norway, it is only an aberration. Undetermined citizenship, in turn, only concerns Russian-speakers in Estonia.

Discussion [TOP]

This was one of the very few studies that utilized a person-oriented approach to socio-political integration and examined it vis-à-vis with citizenship (however, see Lauristin et al., 2012) and societal context. With this approach, it was possible to depict meaningful subgroup differences within the socio-political integration of Russian-speaking minority group members in the Baltic area. Before turning to the role of citizenship and our country-specific findings, a few words regarding the overall picture are needed, as the general pattern of socio-political integration profiles was similar between the three countries studied.

In previous studies, integration is often found to be the most common acculturation orientation among immigrants (Berry et al., 2006), at least when conceptualizing it as relatively high involvement in both ethnic and national cultures (cf. Snauwaert et al., 2003). This is what we also found when approaching socio-political integration from the viewpoint of mutual intergroup relations: through perceived status and sense of belonging among Russian-speakers in the Baltic region at the level of the whole sample. More specifically, our data spoke for critical integration, as orientation towards both ethnic and national cultures was paired with a critical view on ingroup’s social standing. This interpretation echoes the findings of another cluster-analytic study conducted among Russian-speakers in Estonia. Namely, Kruusvall and colleagues (2009) found participants representing an integration profile to be quite well adapted but still not fully oriented towards participation in the larger society, as they did not regard civic engagement to be meaningful in the context of strong assimilation pressure from the majority group. Thus, Russian-speaking minority members in the Baltic region seem to take a critical stance towards larger society, even when they are quite well integrated in terms of involvement in both ethnic and national cultures.

Also in line with most previous research, we did not find a marginalization profile, in which people would be oriented towards neither ethnic nor national cultures (see e.g., Berry et al., 2006; but for an exception among Russian-speakers in Estonia, see Kruusvall et al., 2009). However, speaking for the previously attested context-dependency of acculturation orientations (e.g., Jasinskaja-Lahti, Horenczyk, & Kinunen, 2011; Phinney et al., 2001), there were some important differences between the countries studied. While critical integration and separation were the most common profiles in Estonia, in Finland, critical integration and assimilation profiles were the most typical ones, and in Norway, assimilation was found most often.

This pattern of results can be seen to reflect the different situations of the Russian-speaking minority in the countries studied. Even though there is value in looking at the general picture of relationships between citizenship and socio-political integration, from an acculturation and social psychological viewpoint it is also interesting to discuss the intergroup contexts in which specific relationships occur (cf., Verkuyten, 2006). It should be noted that at the time of data collection (starting in 2012 in Finland and ending in early 2016 in Norway), the rise of populist anti-immigration movement had just started but not reached the same extent in the Baltic region as in many other parts of the Europe. This should be kept in mind when interpreting the perceived opportunities of Russian-speakers to integrate in the prevailing normative and attitudinal environments: the research context would be somewhat different now, when for example in Finland, the Finns Party came second in the parliamentary elections of 2019 with its anti-immigration agenda.

When looking at how the countries studied fared in the most recent migrant integration policy index (MIPEX, 2015), Finland and Norway shared the fourth place, while Estonia came 22nd of the 38 countries compared. Also in our data, there were similarities between Finland and Norway: assimilation profile was found often in both countries (cf. Larja, 2017, for Finnish context), even though it was more pronounced in Norway. Based on MIPEX indicators, it is difficult to make strong claims about the differences between Finland and Norway as integration contexts. However, regarding the factors central to the present study, the state of affairs related to anti-discrimination and access to (especially dual) nationality is slightly better in Finland than in Norway. Also, there might be somewhat higher pressure to assimilate in Norway (cf. Simonsen, 2017). In the official integration program of Norway, immigrants are expected to show high Norwegian proficiency and good understanding of the society (MIPEX, 2015), while in Finland, integration is officially portrayed as a mutual, two-way process (Government of Finland, 2016). There might be also more practical reasons for the differences found between Norway and Finland. Namely, it might be easier to maintain Russian culture by being in touch with family and friends when living among a bigger group of Russian-speakers in Finland, closer to Russia. Thus, in the light of all this information, it is understandable that assimilation profile was the most typical acculturation profile among the small group of Russian-speaking immigrants in Norway.

In Finland and Norway, Russian-speakers represent relatively small and recent immigrant groups, with possibly positive expectations about their future prospects in the new home country. In contrast, Russian-speakers in Estonia represent a big, established minority group. Despite having lived in the country for generations, the position of Russian-speakers continues to be disadvantaged and segregated (MIPEX, 2015; Vetik & Helemäe, 2011). For example, Kus-Harbord and Ward (2015) reported ethnic identification and perceived ingroup devaluation to be negatively associated with adaptation and intergroup relations with majority Estonians. Further, in another person-oriented study by Kruusvall and colleagues (2009), every third Russian-speaker in Estonia represented a separation profile, integration profile was characterized by a critical stance towards societal participation, and no clear-cut assimilation profile was found. Thus, our country-specific as well as comparative findings corroborate previous variable- and person-oriented research that has brought forward the difficult situation of Russian-speakers in Estonia. From the viewpoint of mutual integration, the core of the problem is in the discordance between majority and minority groups: Russian-speakers feel pressure to assimilate and see their social position as unjust, and react to this with distancing themselves from the Estonian society (cf. Bourhis et al., 1997; Horenczyk et al., 2013).

As regards citizenship, critical integration and separation were the most common profiles among participants holding national citizenship of the country of residence. Recent studies utilizing a variable-oriented approach (e.g., Fick, 2016; Hainmueller et al., 2015, 2017; Verkuyten & Martinovic, 2012) have suggested national citizenship to promote immigrant integration, and also our person-oriented results pointed to this direction. However, in our data, national citizenship was also associated with separation profile, and both ethnic and national identities were relatively pronounced. The high number of those with national citizenship in the separation profile shows that objective and subjective socio-political integration do not always go hand in hand. Also importantly, gaining national citizenship does not need to require assimilation or even a non-critical integrationist orientation. Instead, we argue that our results speak for the politicization of the identities of Russian-speakers in the three countries studied: even among naturalized immigrants or minority group members, strong ethnic and national identities and a critical stance towards the ingroup’s position are needed for challenging inequalities effectively (see, e.g., Simon & Grabow, 2010; Simon & Klandermans, 2001). Our analysis may have identified the potential agents of social change especially in Estonia, where separation profile and national citizenship were relatively more common than in the other two countries.

It was somewhat surprising to find that foreign citizenship was not strongly related to any specific profile, as could have been expected particularly for separation, based on previous research (e.g., Larja, 2017). One explanation for this may be found from research on psychological citizenship (i.e., the subjective sense of being a citizen) (Sindic, 2011). Namely, immigrants without a legal recognition of their countries of residence can develop different forms of affiliation with society, and this way form alternatives to recognized national membership (Sindic, 2011). Thus, foreign citizenship does not necessarily support nor prevent subjective socio-political integration. Alternatively, our finding may support the notion by Ronkainen (2011) that foreign citizenship may serve a rather pragmatic function for many immigrants, while being unrelated to perceived status and feeling of belonging. Yet another, more technical reason is that the share of participants with foreign citizenship differed substantially in different countries. This made it impossible to fully disentangle context- and citizenship-related patterns in integration profiles.

When it comes to the special case of Russian-speakers with undetermined citizenship in Estonia, they mostly represented separation profile. Also Nimmerfeldt and colleagues (2011) found Russian-speakers with undetermined citizenship to be the least structurally integrated, when looking at their rights and access to education and labour market. Lauristin and colleagues (2012), in turn, found people with undetermined citizenship to be often linguistically, culturally and politically poorly integrated. In his integration report, Vetik (2015) found that people with undetermined citizenship in Estonia had low trust in local institutions, but the majority of them would have still liked to obtain Estonian citizenship. One could argue that there is a will but no way to full societal membership, without meeting the strict language requirements for Estonian citizenship (see also Nimmerfeldt et al., 2011). The situation is problematic particularly in North-East of Estonia, where opportunities to practice Estonian language are limited, as Estonian Russians form about 80% of the population.

Finally, our findings regarding dual citizenship shed new light on this much debated but rarely studied group of immigrants. Namely, dual citizenship was most closely associated with critical integration profile, followed by assimilation profile. As we found no evidence of Russian-speakers with dual citizenship to isolate from broader society, the concerns related to the allegedly divided loyalties of immigrants with dual citizenship especially in the Finnish context (e.g., Jasinskaja-Lahti et al., 2019; Kananen, Ronkainen, & Saari, 2018; Ronkainen, 2011) seem exaggerated. Also recent research from Germany has suggested that tolerating dual citizenship does not jeopardize immigrants’ identification with their country of residence (Maehler et al., 2019).

Also the caveats of this study should be discussed. In her evaluation of studies focusing on citizenship and integration policies, Goodman (2015, p. 1905) crudely states that “what scholars know about the effects of immigration and citizenship policy is subject to data and sample selection”. Indeed, limitations related to causality and generalizability are central also for the present study. Using observational data, our aim was not to test if citizenship affects socio-political integration. Instead, we leaned on causally robust studies that give a reason to expect naturalization to promote immigrant integration (Hainmueller et al., 2015, 2017), and linked our research to previous studies on the integration of Russian minority in Baltic region. However, future research should also keep the other causal direction in mind: in their study with longitudinal and representative data, Maehler and colleagues (2019) found immigrants who were already naturalized as well as immigrants aiming to become naturalized identify more strongly with Germany than non-naturalized respondents.

While one of the strengths of our study was to utilize data on the same minority group in three countries, with non-representative samples and only three countries, it is not possible to make broad generalizations or robust cross-cultural comparisons. Also, due to limited and varying sample sizes and the different citizenship policies in the three countries studied, the research design was not optimal for between-country comparisons. Thus, we could not simultaneously examine the integration profiles by citizenship category and by country. Even though this research was designed in close collaboration between our teams in Estonia, Finland and Norway, due to practical reasons, the data collection could not be executed simultaneously. However, during the time of data collection, there were no such large-scale changes in political power relations or integration policies that would significantly limit the interpretation of our results. Finally, it should be noted that we were not able to control for the length of stay or the immigrant generation of our participants, as we did not have equivalent indicators in all countries. Besides avoiding these limitations when designing future research, we would like to call for studies with an even broader scope of variables tapping integration. For example, language proficiency and social contacts with national majority group members and co-ethnics could not be included in the present study, although being known as central indicators of integration (e.g., Berry et al., 2006; Ersanilli & Koopmans, 2010).

When thinking about the broader message of this study, it is noteworthy that ethnic identification was high in all three acculturation profiles, while there were substantial differences in the other variables tapping perceived status and sense of belonging. This highlights the importance of including a variety of indicators in studies of socio-political integration. The picture painted by the results would have been much different if we would have focused, for example, only on the identification conceptualization of integration (cf. Hutnik, 1991; Maehler et al., 2019). Including perceived social status in the analysis of citizenship is important because opportunities for equal membership in society are not just perceptions in the heads of immigrants, but reflect societal hierarchies and mutual intergroup relations (cf., Berry & Sam, 2013). For example, in their comparative study, Wright and Bloemraad (2012) concluded that immigrants living in countries characterized by high access to citizenship and recognition of multicultural values felt included by and trusting of their fellow residents and government institutions. Naturalization policies can be considered to be “at the heart of a state’s integration policy” (Huddleston & Vink, 2015, p. 1), but in the light of our findings, efforts still need to be made for Russian-speakers in the Baltic region to be able to feel that they are in the heart of the society.

Notes [TOP]

i) There are two previous publications in which Estonian and Finnish (Renvik, Brylka, Konttinen, Vetik, & Jasinskaja-Lahti, 2018) and Estonian, Finnish and Norwegian (Jasinskaja-Lahti et al., 2018) data from the project was used. The commonalities of these studies are related to a focus on perceived discrimination and national identification, but the present study is the first to focus on citizenship and a broad array of indicators of socio-political integration, and to utilize a person-oriented approach.

ii) Speaking for the robustness of the findings in each country and in the whole sample, the interpretation of the profiles remained similar also when leaving socio-demographic background variables out from the analysis.

iii) Except for ethnic identification, differences in variable means between the profiles were significant at p < .01 level.

Funding [TOP]

The Finnish part of this research was supported by the KONE Foundation (grant numbers 31–219 and 4704917). The Estonian and Norwegian parts of the research were supported by the EEA funding through the Research Council of Norway (grant EMP 138).

Competing Interests [TOP]

The authors have declared that no competing interests exist.

Acknowledgments [TOP]

We would like to thank Göksu Celikkol, Annu-Riina Lamberg, Emma Nortio and Elena Waschinski (Department of Social Research, University of Helsinki, Finland) for their practical assistance during the projects. We also thank Marguerite Beattie for proofreading the manuscript. This study was carried out as part of the international project Mutual Intercultural Relations in Plural Societies, coordinated by John Berry [see J. W. Berry (Ed.) (2017). Mutual intercultural relations. Cambridge, United Kingdom: Cambridge University Press, and project website for details http://www.victoria.ac.nz/cacr/research/mirips].

References [TOP]

  • Bámaca-Colbert, M. Y., & Gayles, J. G. (2010). Variable-centered and person-centered approaches to studying Mexican-origin mother–daughter cultural orientation dissonance. Journal of Youth and Adolescence, 39, 1274-1292. https://doi.org/10.1007/s10964-009-9447-3

  • Barrette, G., Bourhis, R. Y., Personnaz, M., & Personnaz, B. (2004). Acculturation orientations of French and North African undergraduates in Paris. International Journal of Intercultural Relations, 28, 415-438. https://doi.org/10.1016/j.ijintrel.2004.08.003

  • Barrington, L. W. (1995). Nations, states, and citizens: An explanation of the citizenship policies in Estonia and Lithuania. Review of Central and East European Law, 21, 103-148. https://doi.org/10.1163/157303595X00066

  • Bauböck, R., Honohan, I., Huddleston, T., Hutcheson, D., Shaw, J., & Vink, M. P. (2013). Access to citizenship and its impact on integration: European summary and standards. Retrieved from http://muep.mau.se/handle/2043/16098

  • Berry, J. W. (1997). Immigration, acculturation, and adaptation. Applied Psychology, 46, 5-34. https://doi.org/10.1111/j.1464-0597.1997.tb01087.x

  • Berry, J. (2016). Diversity and equity. Cross Cultural & Strategic Management, 23, 413-430. https://doi.org/10.1108/CCSM-03-2016-0085

  • Berry, J. W., Phinney, J. S., Sam, D. L., & Vedder, P. (2006). Immigrant youth: Acculturation, identity, and adaptation. Applied Psychology, 55, 303-332. https://doi.org/10.1111/j.1464-0597.2006.00256.x

  • Berry, J. W., & Sam, D. L. (2013). Accommodating cultural diversity and achieving equity. European Psychologist, 18, 151-157. https://doi.org/10.1027/1016-9040/a000167

  • Bourhis, R. Y., Moise, L. C., Perreault, S., & Senecal, S. (1997). Towards an interactive acculturation model: A social psychological approach. International Journal of Psychology, 32, 369-386. https://doi.org/10.1080/002075997400629

  • Brubaker, R. (1996). Nationalism reframed: Nationhood and the national question in the New Europe. Cambridge, United Kingdom: Cambridge University Press.

  • Brylka, A., Mähönen, T. A., & Jasinskaja-Lahti, I. (2015). National identification and intergroup attitudes among members of the national majority and immigrants: Preliminary evidence for the mediational role of psychological ownership of a country. Journal of Social and Political Psychology, 3, 24-45. https://doi.org/10.5964/jspp.v3i1.275

  • Council of the European Union. (2004). Common basic principles for immigrant integration policy in the EU. Retrieved from https://ec.europa.eu/migrant-integration/librarydoc/common-basic-principles-for-immigrant-integration-policy-in-the-eu

  • de Vroome, T., Verkuyten, M., & Martinovic, B. (2014). Host national identification of immigrants in the Netherlands. International Migration Review, 48, 76-102. https://doi.org/10.1111/imre.12063

  • Dovidio, J. F., Gaertner, S. L., & Saguy, T. (2009). Commonality and the complexity of “we”: Social attitudes and social change. Personality and Social Psychology Review, 13, 3-20. https://doi.org/10.1177/1088868308326751

  • Ersanilli, E., & Koopmans, R. (2010). Rewarding integration? Citizenship regulations and the socio-cultural integration of immigrants in the Netherlands, France and Germany. Journal of Ethnic and Migration Studies, 36, 773-791. https://doi.org/10.1080/13691831003764318

  • Ersanilli, E., & Koopmans, R. (2011). Do immigrant integration policies matter? A three-country comparison among Turkish immigrants. West European Politics, 34, 208-234. https://doi.org/10.1080/01402382.2011.546568

  • Estonian Ministry of Internal Affairs. (2018). Citizenship and migration. Retrieved from https://www.siseministeerium.ee/en/activities/citizenship-and-migration

  • Fick, P. (2016). Does naturalization facilitate integration? Zeitschrift für Soziologie, 45, 107-121. https://doi.org/10.1515/zfsoz-2015-1006

  • Fischer-Neumann, M. (2014). Immigrants’ ethnic identification and political involvement in the face of discrimination: A longitudinal study of the German case. Journal of Ethnic and Migration Studies, 40, 339-362. https://doi.org/10.1080/1369183X.2013.847362

  • Flemmen, A. B. (2008). Transnational marriages–Empirical complexities and theoretical challenges: An exploration of intersectionality. NORA, 16, 114-129. https://doi.org/10.1080/08038740802140244

  • Goodman, S. W. (2015). Conceptualizing and measuring citizenship and integration policy: Past lessons and new approaches. Comparative Political Studies, 48, 1905-1941. https://doi.org/10.1177/0010414015592648

  • Government of Finland. (2016). Government Integration Programme for 2016–2019 and Government Resolution on a Government Integration Programme (Publications of the Ministry of Economic Affairs and Employment, 47/2016). Retrieved from http://julkaisut.valtioneuvosto.fi/handle/10024/79156

  • Grigoryev, D., & van de Vijver, F. (2018). Acculturation expectation profiles of Russian majority group members and their intergroup attitudes. International Journal of Intercultural Relations, 64, 90-99. https://doi.org/10.1016/j.ijintrel.2018.03.001

  • Haddock, G., Zanna, M. P., & Esses, V. M. (1993). Assessing the structure of prejudicial attitudes: The case of attitudes toward homosexuals. Journal of Personality and Social Psychology, 65, 1105-1118. https://doi.org/10.1037/0022-3514.65.6.1105

  • Hainmueller, J., Hangartner, D., & Pietrantuono, G. (2015). Naturalization fosters the long-term political integration of immigrants. Proceedings of the National Academy of Sciences of the United States of America, 112, 12651-12656. https://doi.org/10.1073/pnas.1418794112

  • Hainmueller, J., Hangartner, D., & Pietrantuono, G. (2017). Catalyst or crown: Does naturalization promote the long-term social integration of immigrants? The American Political Science Review, 111, 256-276. https://doi.org/10.1017/S0003055416000745

  • Haugen, I., & Kunst, J. R. (2017). A two-way process? A qualitative and quantitative investigation of majority members’ acculturation. International Journal of Intercultural Relations, 60, 67-82. https://doi.org/10.1016/j.ijintrel.2017.07.004

  • Heyse, P. (2010). Deconstructing fixed identities: An intersectional analysis of Russian-speaking female marriage migrants’ self-representations. Journal of Intercultural Studies, 31, 65-80. https://doi.org/10.1080/07256860903487661

  • Horenczyk, G., Jasinskaja-Lahti, I., Sam, D. L., & Vedder, P. (2013). Mutuality in acculturation: Toward an integration. Zeitschrift für Psychologie mit Zeitschrift für Angewandte Psychologie, 221, 205-213. https://doi.org/10.1027/2151-2604/a000150

  • Huddleston, T., & Vink, M. P. (2015). Full membership or equal rights? The link between naturalisation and integration policies for immigrants in 29 European States. Comparative Migration Studies, 3(8), 1-19. https://doi.org/10.1186/s40878-015-0006-7

  • Hutnik, N. (1991). Ethnic minority identity: A social psychological perspective. Oxford, United Kingdom: Clarendon Press/Oxford University Press.

  • Inguglia, C., & Musso, P. (2015). Intercultural profiles and adaptation among immigrant and autochthonous adolescents. Europe’s Journal of Psychology, 11, 79-99. https://doi.org/10.5964/ejop.v11i1.872

  • ISCED. (2011). International Standard Classification of Education. Retrieved from http://uis.unesco.org/en/topic/international-standard-classification-education-isced

  • Jaakkola, M. (2009). Maahanmuuttajat suomalaisten näkökulmasta. Asennemuutokset 1987–2007 [Immigrants from the perspective of Finns: Change in attitudes in years 1987–2007]. Helsinki, Finland: City of Helsinki Information Centre.

  • Jasinskaja-Lahti, I., Celikkol, G., Renvik, T. A., Eskelinen, V., Vetik, R., & Sam, D. L. (2018). When psychological contract is violated: Revisiting the Rejection-Disidentification Model of immigrant integration. Journal of Social and Political Psychology, 6, 484-510. https://doi.org/10.5964/jspp.v6i2.890

  • Jasinskaja-Lahti, I., Horenczyk, G., & Kinunen, T. (2011). Time and context in the relationship between acculturation attitudes and adaptation among Russian-speaking immigrants in Finland and Israel. Journal of Ethnic and Migration Studies, 37, 1423-1440. https://doi.org/10.1080/1369183X.2011.623617

  • Jasinskaja-Lahti, I., Liebkind, K., & Solheim, E. (2009). To identify or not to identify? National disidentification as an alternative reaction to perceived ethnic discrimination. Applied Psychology, 58, 105-128. https://doi.org/10.1111/j.1464-0597.2008.00384.x

  • Jasinskaja-Lahti, I., Mähönen, T. A., & Ketokivi, M. (2012). The dynamics of ethnic discrimination, identities and outgroup attitudes: A pre–post longitudinal study of ethnic migrants. European Journal of Social Psychology, 42, 904-914. https://doi.org/10.1002/ejsp.1916

  • Jasinskaja-Lahti, I., Mähönen, T. A., & Liebkind, K. (2012). Identity and attitudinal reactions to perceptions of inter-group interactions among ethnic migrants: A longitudinal study. British Journal of Social Psychology, 51, 312-329. https://doi.org/10.1111/j.2044-8309.2011.02059.x

  • Jasinskaja-Lahti, I., Renvik, T. A., Van der Noll, J., Eskelinen, V., Rohmann, A., & Verkuyten, M. (2019). Dual citizenship and perceived loyalty of immigrants. Group Processes & Intergroup Relations. Advance online publication. https://doi.org/10.1177/1368430219872809

  • Kananen, M., Ronkainen, J., & Saari, K. (2018). Nationality orientations: Social and transnational ties of young Finnish-Russian dual citizens. Yhteiskuntapolitiikka, 83, 518-531.

  • Kruusvall, J., Vetik, R., & Berry, J. W. (2009). The strategies of inter-ethnic adaptation of Estonian Russians. Studies of Transition States and Societies, 1, 3-24.

  • Kunst, J. R., Thomsen, L., & Dovidio, J. F. (2019). Divided loyalties: Perceptions of disloyalty underpin bias toward dually-identified minority-group members. Journal of Personality and Social Psychology, 117(4), 807-838. https://doi.org/10.1037/pspi0000168

  • Kus-Harbord, L., & Ward, C. (2015). Ethnic Russians in post-Soviet Estonia: Perceived devaluation, acculturation, well-being, and ethnic attitudes. International Perspectives in Psychology: Research, Practice, Consultation, 4, 66-81. https://doi.org/10.1037/ipp0000025

  • Larja, L. (2017). Joka kolmas ulkomaalaistaustainen nuori samaistuu sekä suomalaisuuteen että taustamaahansa [Every third youth with foreign background identifies with both Finnishness and their country of origin]. Retrieved from http://www.tilastokeskus.fi/tietotrendit/artikkelit/2017/joka-kolmas-ulkomaalaistaustainen-nuori-samaistuu-seka-suomalaisuuteen-etta-taustamaahansa/

  • Larja, L., Warius, J., Sundbäck, L., Liebkind, K., Kandolin, I., & Jasinskaja-Lahti, I. (2012). Discrimination in the Finnish labor market: An overview and a field experiment on recruitment. Helsinki, Finland: Ministry of Employment and Economy.

  • Lauristin, M., Kaal, E., Kirss, L., Kriger, T., Masso, A., Nurmela, K., … Jufereva, M. (2012). Estonian integration monitoring 2011: Summary. Tallinn, Estonia: Poliitikauuringute Keskus Praxis.

  • Louis, W. R., Duck, J. M., Terry, D. J., Schuller, R. A., & Lalonde, R. N. (2007). Why do citizens want to keep refugees out? Threats, fairness and hostile norms in the treatment of asylum seekers. European Journal of Social Psychology, 37, 53-73. https://doi.org/10.1002/ejsp.329

  • Maehler, D. B., Weinmann, M., & Hanke, K. (2019). Acculturation and naturalization: Insights from representative and longitudinal migration studies in Germany. Frontiers in Psychology, 10, Article 1160. https://doi.org/10.3389/fpsyg.2019.01160

  • Mähönen, T. A., Jasinskaja-Lahti, I., & Liebkind, K. (2011). Cultural discordance and the polarization of identities. Group Processes & Intergroup Relations, 14, 505-515. https://doi.org/10.1177/1368430210379006

  • Mancini, T., Navas, M., López-Rodríguez, L., & Bottura, B. (2018). Variants of biculturalism in migrant and host adolescents living in Italy and Spain: Testing the importance of life domains through the Relative Acculturation Extended Model. International Journal of Psychology, 53, 71-80. https://doi.org/10.1002/ijop.12432

  • MIPEX. (2015). Migrant integration policy index 2015. Retrieved from http://www.mipex.eu/

  • Mlicki, P. P., & Ellemers, N. (1996). Being different or being better? National stereotypes and identifications of Polish and Dutch students. European Journal of Social Psychology, 26, 97-114. https://doi.org/10.1002/(SICI)1099-0992(199601)26:1<97::AID-EJSP739>3.0.CO;2-F

  • Munkejord, M. C. (2017). Local and transnational networking among female immigrant entrepreneurs in peripheral rural contexts: Perspectives on Russians in Finnmark, Norway. European Urban and Regional Studies, 24, 7-20. https://doi.org/10.1177/0969776415587122

  • Nimmerfeldt, G., Schulze, J., & Taru, M. (2011). The relationship between integration dimensions among second generation Russians in Estonia. Studies of Transition States and Societies, 3, 76-91.

  • Olsen, B. W. (2015, July 31). 38% of Russian immigrants in Norway live in the North. Barents Observer. Retrieved from https://barentsobserver.com/en/society/2015/07/38-russian-immigrants-norway-live-north-31-07

  • Paolini, S., Hewstone, M., & Cairns, E. (2007). Direct and indirect intergroup friendship effects: Testing the moderating role of the affective-cognitive bases of prejudice. Personality and Social Psychology Bulletin, 33, 1406-1420. https://doi.org/10.1177/0146167207304788

  • Phinney, J. S., & Devich-Navarro, M. (1997). Variations in bicultural identification among African American and Mexican American adolescents. Journal of Research on Adolescence, 7, 3-32. https://doi.org/10.1207/s15327795jra0701_2

  • Phinney, J. S., Horenczyk, G., Liebkind, K., & Vedder, P. (2001). Ethnic identity, immigration, and well-being: An interactional perspective. The Journal of Social Issues, 57, 493-510. https://doi.org/10.1111/0022-4537.00225

  • Renvik, T. A., Brylka, A., Konttinen, H., Vetik, R., & Jasinskaja-Lahti, I. (2018). Perceived status and national belonging: The case of Russian speakers in Finland and Estonia. Revue Internationale de Psychologie Sociale, 31(1), Article 9. https://doi.org/10.5334/irsp.149

  • Ronkainen, J. K. (2011). Mononationals, hyphenationals, and shadow-nationals: Multiple citizenship as practice. Citizenship Studies, 15, 247-263. https://doi.org/10.1080/13621025.2011.549723

  • Sam, D. L., & Berry, J. W. (Eds.). (2016). The Cambridge handbook of acculturation psychology. Cambridge, United Kingdom: Cambridge University Press.

  • Sandnes, T. (2018). Innvandrere i Norge 2017 [Immigrants in Norway]. Oslo, Norway: Statistics Norway.

  • Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461-464. https://doi.org/10.1214/aos/1176344136

  • Simon, B., & Grabow, O. (2010). The politicization of migrants: Further evidence that politicized collective identity is a dual identity. Political Psychology, 31, 717-738. https://doi.org/10.1111/j.1467-9221.2010.00782.x

  • Simon, B., & Klandermans, B. (2001). Politicized collective identity: A social psychological analysis. The American Psychologist, 56, 319-331. https://doi.org/10.1037/0003-066X.56.4.319

  • Simon, B., & Ruhs, D. (2008). Identity and politicization among Turkish migrants in Germany: The role of dual identification. Journal of Personality and Social Psychology, 95, 1354-1366. https://doi.org/10.1037/a0012630

  • Simonsen, K. B. (2017). Does citizenship always further immigrants’ feeling of belonging to the host nation? A study of policies and public attitudes in 14 Western democracies. Comparative Migration Studies, 5, Article 3. https://doi.org/10.1186/s40878-017-0050-6

  • Sindic, D. (2011). Psychological citizenship and national identity. Journal of Community & Applied Social Psychology, 21, 202-214. https://doi.org/10.1002/casp.1093

  • Snauwaert, B., Soenens, B., Vanbeselaere, N., & Boen, F. (2003). When integration does not necessarily imply integration: Different conceptualizations of acculturation orientations lead to different classifications. Journal of Cross-Cultural Psychology, 34, 231-239. https://doi.org/10.1177/0022022102250250

  • Statistics Finland. (2016). Record number of Finnish citizenships was granted in 2016. Retrieved from https://www.stat.fi/til/kans/2016/kans_2016_2017-05-12_tie_001_en.html

  • Statistics Finland. (2017). Population structure. Retrieved from https://www.tilastokeskus.fi/tup/suoluk/suoluk_vaesto_en.html

  • Statistics Norway. (2016). Immigrants and Norwegian-born to immigrant parents, 1 January 2016. Retrieved from https://www.ssb.no/en/befolkning/statistikker/innvbef/aar/2016-03-03

  • Sutela, H., & Larja, L. (2015). Yli puolet Suomen ulkomaalaistaustaisista muuttanut maahan perhesyistä [Over half of people with foreign background in Finland have migrated to the country because of family reasons]. Ulkomaista syntyperää olevien työ ja hyvinvointi tutkimus 2014 [verkkojulkaisu]. Helsinki, Finland: Tilastokeskus. Retrieved from https://www.stat.fi/tup/maahanmuutto/art_2015-10-15_001.html

  • Tammur, A. (2017). Native and foreign-origin population in Estonia. Quarterly Bulletin of Statistics Estonia, 1/17, 50-56. Retrieved from https://www.stat.ee/publication-2017_quarterly-bulletin-of-statistics-estonia-1-17

  • Utlendingsdirektoratet. (2018). Årstabeller/rapport 1998-2016 [Report 1998-2016]. Retrieved from https://www.udi.no/en/statistics-and-analysis/annual-reports/annual-reports-from-previous-years/

  • Verkuyten, M. (2006). Multicultural recognition and ethnic minority rights: A social identity perspective. European Review of Social Psychology, 17, 148-184. https://doi.org/10.1080/10463280600937418

  • Verkuyten, M., & Martinovic, B. (2012). Immigrants’ national identification: Meanings, determinants, and consequences. Social Issues and Policy Review, 6, 82-112. https://doi.org/10.1111/j.1751-2409.2011.01036.x

  • Vetik, R. (2015). Estonian national identity: feeling of belongingness among Estonian Russians and readiness for inclusion of minorities among ethnic Estonians (Integration Monitoring of Estonian Society 2015, a report to the Ministry of Culture of Estonian Republic by the Institute of Baltic Studies, Tallinn University and the Center of Political Research Praxis, 32-41).

  • Vetik, R. (2018). National identity among ethnic Estonians and Estonian Russians [in Estonian]. Acta Politica Estica, 8, 85-104.

  • Vetik, R., & Helemäe, J. (Eds.). (2011). The Russian second generation in Tallinn and Kohtla-Järve: The TIES Study in Estonia. Amsterdam, the Netherlands: Amsterdam University Press. https://doi.org/10.5117/9789089642509

  • Wright, M., & Bloemraad, I. (2012). Is there a trade-off between multiculturalism and socio-political integration? Policy regimes and immigrant incorporation in comparative perspective. Perspectives on Politics, 10, 77-95. https://doi.org/10.1017/S1537592711004919




Creative Commons License
ISSN: 2195-3325
PsychOpen Logo