Use of machine learning methods to understand discussions of female genital mutilation/cutting on social media ============================================================================================================== * Gray Babbs * Sarah E. Weber * Salma M. Abdalla * Nina Cesare * Elaine O. Nsoesie ## Abstract Female genital mutilation/cutting (FGM/C) describes several procedures that involve injury to the vulva or vagina for nontherapeutic reasons. Though at least 200 million women and girls living in 30 countries have undergone FGM/C, there is a paucity of studies focused on public perception of FGM/C. We used machine learning methods to characterize discussion of FGM/C on Twitter in English from 2015 to 2020. Twitter has emerged in recent years as a source for seeking and sharing health information and misinformation. We extracted text metadata from user profiles to characterize the individuals and locations involved in conversations about FGM/C. We extracted major discussion themes from posts using correlated topic modeling. Finally, we extracted features from posts and applied random forest models to predict user engagement. The volume of tweets addressing FGM/C remained fairly stable across years. Conversation was mostly concentrated among the United States and United Kingdom through 2017, but shifted to Nigeria and Kenya in 2020. Some of the discussion topics associated with FGM/C across years included Islam, International Day of Zero Tolerance, current news stories, education, activism, male circumcision, human rights, and feminism. Tweet length and follower count were consistently strong predictors of engagement. Our findings suggest that (1) discussion about FGM/C has not evolved significantly over time, (2) the majority of the conversation about FGM/C on English-speaking Twitter is advocating for an end to the practice, (3) supporters of Donald Trump make up a substantial voice in the conversation about FGM/C, and (4) understanding the nuances in how people across cultures refer to and discuss FGM/C could be important for the design of public health communication and intervention. **Author Summary** Female genital mutilation/cutting (FGM/C) refers to procedures that involve injury to the vulva and vagina for nontherapeutic reasons. At least 200 million women and girls living in 30 countries have undergone FGM/C. In many countries, there is not public perception research on FGM/C. When research is conducted, survey respondents may not answer truthfully about their opinions. We used Twitter data from 2015 to 2020 to better understand how the public thinks about FGM/C. We found that the conversation has generally stayed the same in this time period. Early in the study, users discussing FGM/C were mostly from the United States and United Kingdom, but later in the study, users were mostly from Nigeria and Kenya. Many people posted about stopping FGM/C, especially on the International Day of Zero Tolerance for Female Genital Mutilation and using the hashtag #endfgm. Some people used FGM/C to justify Islamophobia and connected it with other practices like honor killings and acid attacks. We hope that this research can be used to inform communication about FGM/C in different countries to improve understanding about the practice and, design culturally effective campaigns to end FGM/C. ## Introduction Female genital mutilation/cutting (FGM/C) is an umbrella term for procedures that involve injury to the vulva and vagina for nontherapeutic reasons.1 At least 200 million women and girls living in 30 countries have undergone FGM/C.2 Rates of FGM/C are generally decreasing, but the rates by which they are decreasing vary by country and region.3,4 FGM/C is most prevalent in Eastern, Northeastern, and Western Africa and also occurs among migrants and refugees worldwide.1 FGM/C is practiced across religions and is not solely associated with any religious group.5,6 FGM/C is illegal in many countries, including nearly all of the countries where it is most commonly practiced.7 FGM/C is considered a violation of human rights law and a pressing public health issue.8 It is associated with a number of negative short-term health outcomes, including hemorrhage, shock, and infection, as well as long-term physical complications, including chronic infections, painful urination, sexual health challenges, and obstetric complications.9 Studies have also pointed to a relationship between FGM/C and adverse mental health outcomes, including post-traumatic stress disorder (PTSD), anxiety and depression.10 Negative public discourse on FGM/C can perpetuate stigma for women and girls in diasporic communities that practice (or are perceived to practice) FGM/C.11 A qualitative study reported that people who have undergone FGM/C feel pressure to lie about their FGM/C status to avoid stigmatization or social exclusion in their new cultural contexts.12 Other studies note that cut women in the diaspora report a perceived sense of “feeling different” from their peers,13,14 above and beyond differences due to immigration status and race/ethnicity alone.15 This stigma causes many women to completely avoid discussion about FGM/C.14 Analysis of social media discussion offers the opportunity to assess sentiments, knowledge and attitudes towards FGM/C globally. Social media platforms offer users the ability to connect with global communities. Their perceived anonymity can bring traditionally private conversations into the public sphere, serving as valuable resources for understanding perceptions of stigmatized issues.16–18 Social media data are uniquely positioned to track public conversations over time, particularly for sensitive topics that may be difficult to capture via surveys such as, miscarriage, preterm birth19 and circumcision.20 Moreover, social media offers the opportunity to analyze how issues are framed within a conversation space, as they containlongitudinal information, and user-to-user replies. However, few studies to date have used social media data to analyze FGM/C discussions.21 We aim to characterize the substance of conversations about FGM/C on Twitter between 2015 and 2020 and assess any changes over time. Our analysis focuses on conversation prevalence, geographic distribution, framing and themes, frequently used terms, characteristics of users engaging in the conversation, and factors influencing engagement. This study is the first of its scale to describe and analyze social media conversations about FGM/Cs. Our findings can aid medical professionals, public health practitioners, governmental agencies, and advocacy organizations seeking to leverage social media to inform FGM/C-related communications and interventions. ## Materials and methods ### User characteristics To understand user volume and account type, we compared the number of users who tweeted about FGM/C each year, the number of users with verified accounts, and the proportion of users each year who were newly engaged. We defined new engagement as users who tweeted about FGM/C for the first time for each year during the study period. We examined top terms found in user descriptions by normalizing, stemming, and removing all stop words from user description text and calculating the frequency of each word used. We extracted the top 15 words used each year. Overall, a total of 25 words were included in at least one year’s top 15 most frequently used words. Finally, we calculated the proportion of user descriptions each year containing each word and compared over time. Using extracted country names, we calculated the proportion of total users each year who identified each country in their user location, and we evaluated changes in the most frequently identified countries across years. ### Characterizing FGM/C conversations over time We measured the number of tweets, retweets and likes in each year of the study period. We measured tweet volume on International Day of Zero Tolerance for FGM by assessing number of tweets on February 6 of each year in the study period. We also evaluated the use of FGM/C terminology by determining the frequencies of the terms “female circumcision,” “cutting,” “mutilation,” “excision,” and “alteration.” Presence of terms in a tweet were not mutually exclusive. Top words in tweet text were found using the same method as the user description. We extracted the top 15 words used each year and calculated the proportion of tweets each year containing each word. Overall, 34 words were included. To characterize conversations about FGM/C, we used Correlated Topic Modelling (CTM) to identify major topics in our corpus.22,23 CTM is an extension of latent Dirichlet allocation (LDA) topic modeling, which assumes that documents (tweets) are generated from a finite group of topics. CTM is distinguished, however, by the recognition that topics within a document may be correlated with one another. We ran CTM models separately for each year of analysis. Topics were inferred by the research team based on groupings of terms that were most commonly found in and most unique to a topic. Topics were cross-validated by referencing the text of tweets containing each topic’s unique terms. Ten topics were selected for each year, after exploratory analysis. Reported example tweets have been modified slightly to preserve user anonymity, according to best practices.24 Tweet topics that were specific to an event or particular year were synthesized using only tweets from the year the topic was identified. ### Understanding user engagement We analyzed tweet and user characteristics associated with greater user engagement using two classifiers – support vector machine (SVM) and random forest models, which have been used in similar studies.25,26 We fit models first on all of the years in the data. We then fit models on each year’s subset, using the number of retweets to represent user engagement. Number of retweets was classified into two categories: high retweets were defined as the year’s 90th retweet percentile or above, and low retweets were a random matched sample of tweets with zero retweets. We chose retweet count as the representation of user engagement because it had little missingness compared to like count, favorite count, reply count, and quote count. We split all user engagement models into train and test sets using a 70/30 split ratio. We optimized the random forest model with varying numbers of trees and inclusion of predictors. Account level variables in the model included number of accounts followed, number of accounts following, number of tweets tweeted, and account verification. Tweet level variables included tweeting on a high volume date (defined as a top 11 date for the dataset), tweet length, and inclusion of key FGM/C terminology in the tweet (“alteration,” “circumcision,” “cutting,” “excision,” “mutilation,” “fgm”). We compared accuracy between the SVM and random forest models and ran separate models for each of the six study years. All analyses were completed in R Version 4.0.2. ### Ethics Statement The protocol was approved by the Boston University Medical Campus Institutional Review Board (Protocol Number: H-41567) and determined exempt. Consent was not obtained from participants because all data were collected from publicly available sources. The study posed no risks to individuals or individual privacy. ## Results ### User characteristics During the study period from 2015 to 2020, 338,845 unique users tweeted about FGM/C. The most users were engaged in conversations in 2017 and 2018, and the least users were engaged in 2016 (Table 1). The number of users decreased steadily from 2017 to 2020. Users were similar from 2015-2016; only 23.4% of users in 2016 had not previously tweeted about FGM/C in 2015. However, in 2017, 83.7% of users joined FGM/C discussions for the first time during the study period and the percentage of newly engaged users remained high from 2018-2020. A similar percentage of users each year were verified, excluding a spike in verified users in 2016. View this table: [Table 1.](http://medrxiv.org/content/early/2022/07/15/2022.07.14.22277640/T1) Table 1. Number of users engaged in conversations around FGM/C over the study period and frequency of new and verified users within each year The most common terms in user descriptions were “views,” “news,” “health,” and “love” (Fig 1). Other prevalent terms included “world,” “writer,” “social,” “rights,” “life,” and “Trump.” Notably, “MAGA” and “conservative” were also among the top user description terms. When comparing user description terms from year-to-year, there were no considerable changes in term prevalence over time. ![Fig 1.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/07/15/2022.07.14.22277640/F1.medium.gif) [Fig 1.](http://medrxiv.org/content/early/2022/07/15/2022.07.14.22277640/F1) Fig 1. Most Prevalent Terms in User Descriptions in 2020 We linked 100,267 (30%) of our 338,845 unique users to countries based on user descriptions. The conversation was concentrated among six countries (United States, United Kingdom, Nigeria, Kenya, India and Australia), though relative proportions changed over time (Fig 2). In 2015 and 2016, the highest proportion of users were from the UK (20% and 21% respectively), followed by the United States, Nigeria, Kenya and Australia. From 2017 to 2019, users were heavily concentrated in the United States (between 19% and 24% of all users during this time). In 2020, the countries with the highest proportion of users were Kenya (15%) and Nigeria (14%), followed by the USA (10%), UK (10%), and India (7%). ![Fig 2.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/07/15/2022.07.14.22277640/F2.medium.gif) [Fig 2.](http://medrxiv.org/content/early/2022/07/15/2022.07.14.22277640/F2) Fig 2. User Geographic Distribution in 2015, 2017 and 2020 ### Characterizing FGM/C conversations over time The overall volume of tweets addressing FGM/C remained moderately stable between 2015 and 2020 (Fig 3). We observed the greatest number of tweets (291,187) in 2017. This represents a two-fold jump in the number of tweets over the preceding year. Likes and retweets increased steadily between 2016 and 2018, after which likes continued to increase and retweets dropped. ![Fig 3:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/07/15/2022.07.14.22277640/F3.medium.gif) [Fig 3:](http://medrxiv.org/content/early/2022/07/15/2022.07.14.22277640/F3) Fig 3: Twitter Engagement by Year. Tweet count is represented by gray bars, like count is represented by the blue line, and retweet count is represented by the pink line. In each of the study years, the highest volume of FGM/C specific tweets occurred on February 6, International Day of Zero Tolerance for Female Genital Mutilation, representing 4.8% of the entire dataset. The average daily tweet volume on this date was 16.7 times higher than the daily average. The terms that were used to refer to FGM/C remained fairly stable across the years studied. In addition to female genital mutilation or FGM, cutting (4.3%), female circumcision (2.2%), excision (0.1%), and alteration (<0.1%) were commonly used terms for this practice. The words most commonly found in tweet text from 2015-2020 included “endfgm,” “circumcision,” “child,” and “news’ (Fig 4).’ Locations were often referenced, including the UK, Nigeria, Michigan, Kenya and Egypt. “Muslim,” “Islam,” and “Sharia” were also among the most commonly used words in the tweet text. ![Fig 4:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/07/15/2022.07.14.22277640/F4.medium.gif) [Fig 4:](http://medrxiv.org/content/early/2022/07/15/2022.07.14.22277640/F4) Fig 4: Most Prevalent Terms Used in Tweets in 2020 Despite similarity in commonly referenced terms, topics identified using topic modeling varied across years (Table 2). Overall, Islam and the International Day of Zero Tolerance for Female Genital Mutilation were the most common topics identified. Both topics were present in all six years of analysis. Activism was the next most persistent topic, occurring in each year after 2015. Comparisons between FGM/C and male circumcision arose in 2017 and were present for every subsequent year. Conversations regarding the legality of FGM/C were identified in four years (2015, 2016, 2018, and 2019). View this table: [Table 2.](http://medrxiv.org/content/early/2022/07/15/2022.07.14.22277640/T2) Table 2. Topics Identified within FGM/C Tweets by Year In 2017, 2018, 2019, and 2020, a topic emerged that put FGM/C in a category with other human rights issues specific to women and girls (“acid attacks,” “honor killing,” “gang rape,” and “child marriage”). In Table 2, this topic is referred to as “evils of the other.” Tweets associated with these topics are often anti-immigrant and Islamophobic. Education around FGM/C was a topic present from 2015-2017, but it was not present from 2018-2020. This topic includes terms that promote FGM/C awareness such as “speak,” “question” and “believe.” FGM/C as a culturally significant practice was a topic identified across three years: 2015, 2016 and 2018. Other themes identified across multiple years included medical risks (2015, 2019), human rights (2018, 2020), and feminism (2017, 2020). A number of topics could be linked to specific events, such as the implementation of stricter laws against FGM/C in Eritrea (2015),27 The Gambia banning FGM/C (2015),28 Egypt’s parliament approving stringent penalties for FGM/C (2016),29 a doctor in Michigan, USA being charged with performing FGM/C (2017),30,31 and Sudan outlawing FGM/C (2020).32,33 In 2020, COVID-19 emerged as a theme that was correlated with FGM/C discussions. ### User engagement On average, original tweets received 3.86 retweets (standard deviation (SD)=53.88) and all tweets received an average of 3.49 favorites (SD=93.90). Using the full dataset, the random forest model performed better for predicting user engagement, with an 86.3% accuracy (F1: 0.8621) compared to 73.0% in the SVM model (F1: 0.7440). Results from the random forest model suggest that factors predicting engagement were stable across time (Fig 5). Number of followers was consistently the first or second most important predictor, with the highest mean decrease in Gini score in 2015 and 2017 (S1 Table). Longer tweet length was the most important predictor in 2016 and 2018-2020. Variables such as the following count, number of total tweets, and whether the user had been verified, were also important predictors of whether a tweet would garner a high number of retweets. The presence of common words for FGM/C in the tweet text were of relatively little importance in the model. The model accuracy generally increased in later years. ![Fig 5.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/07/15/2022.07.14.22277640/F5.medium.gif) [Fig 5.](http://medrxiv.org/content/early/2022/07/15/2022.07.14.22277640/F5) Fig 5. Mean Decrease Gini Score by Tweet and User Characteristics ## Discussion In this study, we aimed to characterize discussions of FGM/C on the social media platform, Twitter, from 2015 to 2020. In general, we found that discussion about FGM/C has not changed significantly over time. However, there were differences in the number of newly engaged users over the years. In 2017, 83.7% of users joined FGM/C discussions for the first time. While tweet count steadily decreased after 2017, retweet and like counts remained well above pre-2017 levels. This may suggest that although fewer original ideas about FGM/C were circulating post-2017, users were more familiar with the topic and more likely to retweet other voices. Major countries where conversation was concentrated remained consistent; however, the country with the highest volume of users shifted from the UK to the United States in 2017, until Nigeria and Kenya became the top countries in 2020. We identify substantial increases in conversation related to five news stories in the study period: stricter laws against FGM/C in Eritrea (2015), The Gambia banning FGM/C (2015), Egypt’s parliament approving stringent penalties for FGM/C (2016), a doctor in Michigan, USA charged with performing FGM/C (2017), and Sudan outlawing FGM/C (2020). Islam as a topic was identified across all years and “Muslim,” “Islam,” and “Sharia” were among the most common words in tweet text. These findings suggest that users often associated FGM/C with Islam, despite FGM/C occurring across religions. Our results suggest that a substantial contingent of the conversation happening about FGM/C on Twitter (in English) is advocating for an end to FGM/C. The hashtag “endfgm” was the most common unique word identified in tweet text. Each year in the study period, we saw a substantial surge in tweets for International Day of Zero Tolerance for FGM, a 16.7-fold increase over the daily average. This suggests that observing specific days when FGM/C is recognized globally can increase awareness since individuals are likely to engage in conversation and advocacy on such days. Activism, education, feminism, and human rights were persistent topics that arose in the data across years. Another significant portion of the conversation used FGM/C as a rhetorical tool to associate Islam with what we have termed “evils of the other,” a new topic which arose in 2017 and connected FGM/C to other practices such as child marriage, acid attacks, female infanticide, and gang rape. This shift coincides with a 2017 increase in the proportion of users in the US engaging in FGM/C conversations. “MAGA, “Trump,” and “conservative” were three of the most common words in Twitter user profiles of people tweeting about FGM/C, suggesting a strong voice from conservative Trump supporters in the FGM/C conversation. FGM/C sentiment that connects the practice closely with other phenomena that are considered “of the other” in the West may further stigmatize people who have undergone FGM/C by painting “narratives of victimhood”.34 These findings have substantive implications for public health communication and practice. First, on English speaking Twitter, the term FGM was most frequently used to describe the practice. Communication about FGM/C should contain the term female genital mutilation or FGM to align with common usage. Second, endfgm was the single most common word identified in our dataset. Use of this hashtag can connect public health communication with the greater FGM/C advocacy conversation. Third, given that user verification was the best predictor of engagement, verified accounts have a particularly large role to play in engaging the public in education about FGM/C. In addition, these results suggest that the conversation about FGM/C is increasingly politicized in English speaking contexts, particularly in the UK and US, as seen by the strong conservative voice in the conversation. Providers and advocates who serve patients who have undergone FGM/C should practice cultural humility and be informed about the potential stigmatization of FGM/C in the current sociopolitical moment. Finally, in public health communication about FGM/C, specific emphasis should be placed on supporting survivors and uplifting their voices. One major limitation of this work is that it is restricted to conversations happening about FGM/C on Twitter. Twitter users are not representative of the global public, and we have limited information on demographic characteristics of users. Conversations offline or on different social media sites may vary from the findings here. Further, the data are not definitively representative of all conversations or users. Though tweets were collected from users around the world, we only analyze discourse among English language tweets. Tweets about FGM/C were identified based on presence of certain terms, so we may overlook conversations about FGM/C that do not use these terms, particularly terms for FGM/C in languages other than English. Lastly, topic models were run separately for each year of data. As such, the models are not directly comparable and may contain slightly different identified terms. Despite these limitations, this study uses a large sample size to characterize conversations around this important public health topic. With over a million original tweets posted between 2015 and 2020, these data span a wide range of populations and conversations. It is the first study to our knowledge to evaluate FGM/C related social media discussions using machine learning methods. Though some surveys have been conducted about public perception about FGM/C, many of these surveys used direct questioning. Past studies have indicated that direct questioning about FGM/C, particularly among people who have been engaged in anti-FGM/C related programming, may lead to misreporting due to social desirability bias.35 Social media platforms such as Twitter have substantial potential to study sensitive issues like FGM/C, as they do not employ direct questioning, but rather observe ongoing conversations. Future studies should explore what proportion of social media conversations about FGM/C are from people immediately affected by the practice. This work may also address how discussion of FGM/C is impacted by events (e.g., media, news coverage, or celebrity posts). There is room to explore in greater qualitative detail how discourse varies by country, and whether negative discourse can be linked, on an aggregate level, to stress or negative health outcomes. Given the usage of such platforms for sharing health information and misinformation, it is important to understand how discussion about topics such as FGM/C are impacted by misinformation and political discourse. With additional research, public health practitioners, non-governmental organizations, and governments can educate and design targeted interventions to reach communities and countries where the practice is ongoing. These analyses add to a growing body of work that uses social media conversations to characterize stigmatized or misunderstood issues. Using Twitter data allows us to keep a finger on the pulse of public discourse to understand perceptions, develop public health communications, and hone more effective interventions.36 ## Data Availability We provide datasets containing tweet IDs for each of the six years in the dataset in a repository available here: https://github.com/graybabbs/fgmctwitter/ Original tweet text and user metadata reported in this study cannot be deposited in a public repository because of Twitter's data sharing policy. Tweet IDs can be used to retrieve original tweet data via Twitter’s public application programming interface (API). [https://github.com/graybabbs/fgmctwitter/](https://github.com/graybabbs/fgmctwitter/) ## Supporting information captions **S1 Table. Ranked Importance of Tweet and User Characteristics in Predicting High Retweets in Random Forest Model**. The importance is ranked ordinally. The factor listed as “1” is the first most influential factor in engagement, the factor listed as “2” is the second most important, and so on. * Received July 14, 2022. * Revision received July 14, 2022. * Accepted July 15, 2022. * © 2022, Posted by Cold Spring Harbor Laboratory This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available for use under a CC0 license ## References 1. 1.World Health Organization. Female genital mutilation. Published January 21, 2022. Accessed March 25, 2022. [https://www.who.int/news-room/fact-sheets/detail/female-genital-mutilation](https://www.who.int/news-room/fact-sheets/detail/female-genital-mutilation) 2. 2.United Nations Children’s Fund. Female Genital Mutilation/Cutting: A Global Concern. Published online February 2016. Accessed March 27, 2022. [https://data.unicef.org/resources/female-genital-mutilationcutting-global-concern/](https://data.unicef.org/resources/female-genital-mutilationcutting-global-concern/) 3. 3.Sussman N. After School in Brooklyn, West African Girls Share Memories of a Painful Ritual. The New York Times. [https://www.nytimes.com/2011/04/26/nyregion/brooklyn-girls-from-west-africa-recall-genital-cutting.html](https://www.nytimes.com/2011/04/26/nyregion/brooklyn-girls-from-west-africa-recall-genital-cutting.html). Published April 26, 2011. Accessed April 12, 2022. 4. 4.Touiba N. Female Genital Mutilation. In: Women’s Rights, Human Rights: International Feminist Perspectives. Routledge; 1995:224–237. 5. 5.Hayford SR, Trinitapoli J. Religious Differences in Female Genital Cutting: A Case Study from Burkina Faso. J Sci Study Relig. 2011;50(2):252–271. Accessed May 19, 2022. [https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4064295/](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4064295/) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21969936&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F07%2F15%2F2022.07.14.22277640.atom) 6. 6.Setegn T, Lakew Y, Deribe K. Geographic Variation and Factors Associated with Female Genital Mutilation among Reproductive Age Women in Ethiopia: A National Population Based Survey. PLOS ONE. 2016;11(1):e0145329. doi:10.1371/journal.pone.0145329 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0145329&link_type=DOI) 7. 7.Leye E, Deblonde J, García-Añón J, et al. An analysis of the implementation of laws with regard to female genital mutilation in Europe. Crime Law Soc Change. 2007;47(1):1–31. doi:10.1007/s10611-007-9055-7 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10611-007-9055-7&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000247094100001&link_type=ISI) 8. 8.World Health Organization, Department of Reproductive Health and Research. Eliminating Female Genital Mutilation: An Interagency Statement.; 2008. Accessed March 27, 2022. [http://www.who.int/reproductivehealth/publications/fgm/9789241596442/en/](http://www.who.int/reproductivehealth/publications/fgm/9789241596442/en/) 9. 9.Berg RC, Underland V, Odgaard-Jensen J, Fretheim A, Vist GE. Effects of female genital cutting on physical health outcomes: a systematic review and meta-analysis. BMJ Open. 2014;4(11):e006316. doi:10.1136/bmjopen-2014-006316 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMjoiNC8xMS9lMDA2MzE2IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjIvMDcvMTUvMjAyMi4wNy4xNC4yMjI3NzY0MC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 10. 10.Abdalla SM, Galea S. Is female genital mutilation/cutting associated with adverse mental health consequences? A systematic review of the evidence. BMJ Glob Health. 2019;4(4):e001553. doi:10.1136/bmjgh-2019-001553 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiYm1qZ2giO3M6NToicmVzaWQiO3M6MTE6IjQvNC9lMDAxNTUzIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjIvMDcvMTUvMjAyMi4wNy4xNC4yMjI3NzY0MC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 11. 11.O’Neill S, Pallitto C. The Consequences of Female Genital Mutilation on Psycho-Social Well-Being: A Systematic Review of Qualitative Research. Qual Health Res. 2021;31(9):1738–1750. doi:10.1177/10497323211001862 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/10497323211001862&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F07%2F15%2F2022.07.14.22277640.atom) 12. 12.Ahlberg BM, Jylkäs E, Krantz I. Gendered construction of sexual risks: implications for safer sex among young people in Kenya and Sweden. Reprod Health Matters. 2001;9(17):26–36. doi:10.1016/S0968-8080(01)90005-9 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0968-8080(01)90005-9&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=11468843&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F07%2F15%2F2022.07.14.22277640.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000170034700004&link_type=ISI) 13. 13.Kahn S. “You see, one day they cut”: The evolution, expression, and consequences of resistance for women who oppose female genital cutting. J Hum Behav Soc Environ. 2016;26(7-8):622–635. doi:10.1080/10911359.2016.1238805 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/10911359.2016.1238805&link_type=DOI) 14. 14.Parikh N, Saruchera Y, Liao LM. It is a problem and it is not a problem: Dilemmatic talk of the psychological effects of female genital cutting. J Health Psychol. 2020;25(12):1917–1929. doi:10.1177/1359105318781904 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/1359105318781904&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=29939086&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F07%2F15%2F2022.07.14.22277640.atom) 15. 15.Jordal M, Griffin G, Sigurjonsson H. ‘I want what every other woman has’: reasons for wanting clitoral reconstructive surgery after female genital cutting –a qualitative study from Sweden. Cult Health Sex. 2019;21(6):701–716. doi:10.1080/13691058.2018.1510980 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/13691058.2018.1510980&link_type=DOI) 16. 16.Balsamo D, Bajardi P, Salomone A, Schifanella R. Patterns of Routes of Administration and Drug Tampering for Nonmedical Opioid Consumption: Data Mining and Content Analysis of Reddit Discussions. J Med Internet Res. 2021;23(1):e21212. doi:10.2196/21212 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2196/21212&link_type=DOI) 17. 17.Wekerle C, Vakili N, Stewart SH, Black T. The utility of Twitter as a tool for increasing reach of research on sexual violence. Child Abuse Negl. 2018;85:220–228. doi:10.1016/j.chiabu.2018.04.019 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.chiabu.2018.04.019&link_type=DOI) 18. 18.Chua AYK, Banerjee S. The topic of terrorism on Yahoo! Answers: questions, answers and users’ anonymity. Aslib J Inf Manag. 2020;72(1):1–16. doi:10.1108/AJIM-08-2019-0204 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1108/AJIM-08-2019-0204&link_type=DOI) 19. 19.Cesare N, Oladeji O, Ferryman K, et al. Discussions of miscarriage and preterm births on Twitter. Paediatr Perinat Epidemiol. 2020;34(5):544–552. doi:10.1111/ppe.12622 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/ppe.12622&link_type=DOI) 20. 20.Ucar T, Culpan M, Caskurlu T, Karaman Mİ, Silay MS. The activity and discussion points of #Circumcision through Twitter; a microblogging platform. Int J Impot Res. 2018;30(5):249–252. doi:10.1038/s41443-018-0058-y [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41443-018-0058-y&link_type=DOI) 21. 21.Wondwossen Fantaye A, Konkle AT. Social media representation of female genital cutting: A YouTube analysis. Womens Health Lond Engl. 2020;16:1745506520949732. doi:10.1177/1745506520949732 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/1745506520949732&link_type=DOI) 22. 22.Blei DM, Lafferty JD. A correlated topic model of Science. Ann Appl Stat. 2007;1(1):17–35. doi:10.1214/07-AOAS114 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1214/07-AOAS114&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000261050400002&link_type=ISI) 23. 23.Lafferty J, Blei D. Correlated Topic Models. In: Advances in Neural Information Processing Systems. Vol 18. MIT Press; 2005. Accessed April 12, 2022. [https://proceedings.neurips.cc/paper/2005/hash/9e82757e9a1c12cb710ad680db11f6f1-Abstract.html](https://proceedings.neurips.cc/paper/2005/hash/9e82757e9a1c12cb710ad680db11f6f1-Abstract.html) 24. 24.Markham A. Fabrication as Ethical Practice. Inf Commun Soc. 2012;15(3):334–353. doi:10.1080/1369118X.2011.641993 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/1369118X.2011.641993&link_type=DOI) 25. 25.Dahllöf M. Automatic prediction of gender, political affiliation, and age in Swedish politicians from the wording of their speeches—A comparative study of classifiability. Lit Linguist Comput. 2012;27(2):139–153. doi:10.1093/llc/fqs010 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/llc/fqs010&link_type=DOI) 26. 26.Cesare N, Grant C, Nsoesie E. Detection of User Demographics on Social Media: A Review of Methods and Recommendations for Best Practices. Published online February 6, 2017. [https://www.semanticscholar.org/paper/Detection-of-User-Demographics-on-Social-Media%3A-A-Cesare-Grant/43b55cc08eba13fb309e77a1033da0ad60bd7a5e](https://www.semanticscholar.org/paper/Detection-of-User-Demographics-on-Social-Media%3A-A-Cesare-Grant/43b55cc08eba13fb309e77a1033da0ad60bd7a5e) 27. 27.28 Too Many. Eritrea: The Law and FGM. Thomas Reuters Foundation; 2018. [https://www.28toomany.org/static/media/uploads/Law%20Reports/eritrea\_law\_report\_v1\_(july\_2018).pdf](https://www.28toomany.org/static/media/uploads/Law%20Reports/eritrea\_law\_report_v1_(july_2018).pdf) 28. 28.Lyons K. The Gambia bans female genital mutilation. The Guardian. [https://www.theguardian.com/society/2015/nov/24/the-gambia-bans-female-genital-mutilation](https://www.theguardian.com/society/2015/nov/24/the-gambia-bans-female-genital-mutilation). Published November 24, 2015. Accessed March 3, 2022. 29. 29.Human Rights Watch. Egypt: New Penalties for Female Genital Mutilation. Human Rights Watch News. Published September 9, 2016. Accessed March 3, 2022. [https://www.hrw.org/news/2016/09/09/egypt-new-penalties-female-genital-mutilation](https://www.hrw.org/news/2016/09/09/egypt-new-penalties-female-genital-mutilation) 30. 30.Kennedy M. Michigan Doctor Charged With Performing Female Genital Mutilation On Girls. NPR. [https://www.npr.org/sections/thetwo-way/2017/04/14/523917425/michigan-doctor-charged-with-performing-female-genital-mutilation-on-girls](https://www.npr.org/sections/thetwo-way/2017/04/14/523917425/michigan-doctor-charged-with-performing-female-genital-mutilation-on-girls). Published April 14, 2017. Accessed March 3, 2022. 31. 31.Swaine J. Michigan doctor charged with carrying out female genital mutilation. The Guardian. [https://www.theguardian.com/us-news/2017/apr/13/michigan-doctor-charged-female-genital-mutilation-fgm](https://www.theguardian.com/us-news/2017/apr/13/michigan-doctor-charged-female-genital-mutilation-fgm). Published April 13, 2017. Accessed March 3, 2022. 32. 32.United Nations. Sudan bans female genital mutilation, UNICEF vows to help support new law. UN News. Published May 2, 2020. Accessed March 3, 2022. [https://news.un.org/en/story/2020/05/1063122](https://news.un.org/en/story/2020/05/1063122) 33. 33.Walsh D. In a Victory for Women in Sudan, Female Genital Mutilation Is Outlawed. The New York Times. [https://www.nytimes.com/2020/04/30/world/africa/sudan-outlaws-female-genital-mutilation-.html](https://www.nytimes.com/2020/04/30/world/africa/sudan-outlaws-female-genital-mutilation-.html). Published April 30, 2020. Accessed March 3, 2022. 34. 34.Momoh C. Female Genital Mutilation. CRC Press; 2005. 35. 35.De Cao E, Lutz C. Sensitive Survey Questions: Measuring Attitudes Regarding Female Genital Cutting Through a List Experiment. Oxf Bull Econ Stat. 2018;80(5):871–892. doi:10.1111/obes.12228 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/obes.12228&link_type=DOI) 36. 36.Sinnenberg L, Buttenheim AM, Padrez K, Mancheno C, Ungar L, Merchant RM. Twitter as a Tool for Health Research: A Systematic Review. Am J Public Health. 2017;107(1):e1–e8. doi:10.2105/AJPH.2016.303512 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2105/AJPH.2017.303882&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F07%2F15%2F2022.07.14.22277640.atom)