Please use this identifier to cite or link to this item: http://bura.brunel.ac.uk/handle/2438/30095
Full metadata record
DC FieldValueLanguage
dc.contributor.authorSchimmelpfennig, R-
dc.contributor.authorSpicer, R-
dc.contributor.authorWhite, CJM-
dc.contributor.authorGervais, W-
dc.contributor.authorNorenzayan, A-
dc.contributor.authorHeine, S-
dc.contributor.authorHenrich, J-
dc.contributor.authorMuthukrishna, M-
dc.date.accessioned2024-11-11T15:02:39Z-
dc.date.available2024-11-11T15:02:39Z-
dc.date.issued2024-10-08-
dc.identifierORCiD: Robin Schimmelpfennig http://orcid.org/0000-0002-6506-8183-
dc.identifierORCiD: Rachel Spicer http://orcid.org/0000-0002-2807-8796-
dc.identifierORCiD: Cindel J. M. White https://orcid.org/0000-0001-6050-2449-
dc.identifierORCiD: Will Gervais https://orcid.org/0000-0001-7790-1665-
dc.identifierORCiD: Michael Muthukrishna http://orcid.org/0000-0002-7079-5166-
dc.identifier93-
dc.identifier.citationSchimmelpfennig, R. et al. (2024) 'Methodological concerns underlying a lack of evidence for cultural heterogeneity in the replication of psychological effects', Communications Psychology, 2 (1), 93, pp. 1 - 16. doi: 10.1038/s44271-024-00135-z.en_US
dc.identifier.urihttps://bura.brunel.ac.uk/handle/2438/30095-
dc.descriptionData availability: The data we used for analysis is secondary data that was kindly shared with us by the authors of the Many Labs 2 study. The full dataset contains personally identifiable information of participants and according to the authors of ML2 [15. Klein, R. A. et al. Many Labs 2: Investigating Variation in Replicability Across Samples and Settings. Adv. Methods Pract. Psychological Sci. 1, 443–490 (2018). doi url: https://doi.org/10.1177%2F2515245918810225] cannot be publicly shared beyond what is available at ML2’s repository (https://osf.io/ux3eh/) [52. Klein, R. et al. Many Labs 2: Investigating Variation in Replicability Across Sample and Setting, https://doi.org/10.17605/OSF.IO/8CD4R (2022).]. The intermediate and final results of our analysis are available at https://doi.org/10.17605/OSF.IO/QRDXC [53. Robin, S. et al. Many Labs 2 - Reanalysis. OSF Repository, https://doi.org/10.17605/OSF.IO/QRDXC (2024).].en_US
dc.descriptionCode availability: We have shared our code at https://doi.org/10.17605/OSF.IO/QRDXC [53. Robin, S. et al. Many Labs 2 - Reanalysis. OSF Repository, https://doi.org/10.17605/OSF.IO/QRDXC (2024). ].-
dc.description.abstractThe multi-site replication study, Many Labs 2, concluded that sample location and setting did not substantially affect the replicability of findings. Here, we examine theoretical and methodological considerations for a subset of the analyses, namely exploratory tests of heterogeneity in the replicability of studies between “WEIRD and less-WEIRD cultures”. We conducted a review of literature citing the study, a re-examination of the existing cultural variability, a power stimulation for detecting cultural heterogeneity, and re-analyses of the original exploratory tests. Findings indicate little cultural variability and low power to detect cultural heterogeneity effects in the Many Labs 2 data, yet the literature review indicates the study is cited regarding the moderating role of culture. Our reanalysis of the data found that using different operationalizations of culture slightly increased effect sizes but did not substantially alter the conclusions of Many Labs 2. Future studies of cultural heterogeneity can be improved with theoretical consideration of which effects and which cultures are likely to show variation as well as a priori methodological planning for appropriate operationalizations of culture and sufficient power to detect effects.en_US
dc.description.sponsorshipM.M. acknowledges support from the Canadian Institute for Advanced Research (CIFAR) grant no. CP22-005 and Templeton World Charity Foundation grant TWCF0612. R.S. acknowledges support from the Swiss National Science Foundation (grant no. 100018_185417/1).en_US
dc.format.extent1 - 16-
dc.languageen-
dc.language.isoenen_US
dc.publisherSpringer Natureen_US
dc.rightsAttribution 4.0 International-
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/-
dc.subjectcultural and media studiesen_US
dc.subjecthuman behaviouren_US
dc.titleMethodological concerns underlying a lack of evidence for cultural heterogeneity in the replication of psychological effectsen_US
dc.typeArticleen_US
dc.identifier.doihttps://doi.org/10.1038/s44271-024-00135-z-
dc.relation.isPartOfCommunications Psychology-
pubs.issue1-
pubs.publication-statusPublished online-
pubs.volume2-
dc.identifier.eissn2731-9121-
dc.rights.licensehttps://creativecommons.org/licenses/by/4.0/legalcode.en-
dc.rights.holderThe Author(s)-
Appears in Collections:Dept of Life Sciences Research Papers

Files in This Item:
File Description SizeFormat 
FullText.pdfCopyright © The Author(s) 2024. Rights and permissions: Open Access. This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/.1.85 MBAdobe PDFView/Open


This item is licensed under a Creative Commons License Creative Commons