GCM Publication Database

Researchers complete hundreds of Group Concept Mapping studies each year using the groupwisdom™ and Global MAX™ platforms. Many articles about those studies are published in peer-reviewed journals and other reputable publications. Concept Systems releases a monthly Publication Spotlight newsletter to highlight representative Group Concept Mapping (GCM) publications. This GCM Publication Database includes publications from the Spotlight that were published since 2012 as well as previous publications that are foundational to the Group Concept Mapping methodology. The publications include studies that utilized either The Concept System® Global MAX™ or groupwisdom™ web-based data collection and analysis platforms.

To receive the Publication Spotlight, contact Concept Systems using the form below the Database. New to GCM? Join our free introductory webinar.

Topic:

Authors:

Year:

Title:

Journal:

DOI:

Lead Author Org:

Search Abstract:

Topic	Authors	Year	Title	Journal	DOI Link	PDF Link	Lead Author Org	Abstract
Addictions	Wallace, L. S., Wexler, R. K., Miser, W. F., McDougle, L., & Haddox, J. D.	2013	Development and validation of the Patient Opioid Education Measure.	Journal of Pain Research	https://doi.org/10.2147/JPR.S50715	https://www.dovepress.com/getfile.php?fileID=17386	Ohio State University	Background: Although there are screening tools to aid clinicians in assessing the risk of opioid misuse, an instrument to assess opioid-related knowledge is not currently available. The purpose of this study was to develop a content-valid, understandable, readable, and reliable Patient Opioid Education Measure (POEM). Methods: Using concept mapping, clinicians caring for patients with chronic pain participated in brainstorming, sorting, and rating need-to-know information for patients prescribed opioids. Concept mapping analyses identified seven clusters addressing knowledge and expectations associated with opioid use, including medicolegal issues, prescribing policies, safe use and handling, expected outcomes, side effects, pharmacology, and warnings. Results: The 49-item POEM was verbally administered to 83 patients (average age 51.3 ± 9.8 years, 77.1% female, 47.1% African American) taking opioids for chronic nonmalignant pain. Patients averaged in total 63.9% ± 14.3% (range 23%–91%) correct responses on the POEM. The POEM demonstrated substantial test-retest reliability (interclass correlation coefficient 0.87). The POEM had a mean readability Lexile (L) score of 805.9 ± 257.3 L (equivalent to approximately a US fifth grade reading level), with individual items ranging from 280 L to 1370 L. Conclusion: The POEM shows promise for rapidly identifying patients' opioid-related knowledge gaps and expectations. Correcting misunderstandings and gaps could result in safer use of opioids in a clinical care setting.
Addictions	Lloyd, M. H., Johnson, T., & Brook, J.	2014	Illuminating the black box from within: Stakeholder perspectives on family drug court best practices.	Journal of Social Work Practice in the Addictions	https://doi.org/10.1080/1533256X.2014.958492		University of Kansas	This article describes a mixed-methods, concept mapping study in an urban family drug court (FDC) designed to identify keys to FDC success from stakeholders’ perspectives. Participating FDC team members and clients developed a set of items they deemed integral to an FDC, thematically clustered the items, and then rated their relative importance. Using these data, cluster analysis and multidimensional scaling generated 6 themes perceived as contributing to positive outcomes. Resultant concept maps revealed that, compared to team members, clients view relational aspects of the FDC as more important. The findings point to implications for future research and social work practice.
Addictions	Delaware Behavioral Health Consortium.	2018	Behavioral Health Consortium: Three-year action plan.	Office of the Delaware Lieutenant Governor, New Castle, DE.		https://ltgov.delaware.gov/wp-content/uploads/sites/27/2018/05/delaware_bhc_threeyearactionplan_2018.pdf	Office of the Delaware Lieutenant Governor	The formation of the Delaware Behavioral Health Consortium was first proposed by Governor John Carney in his Action Plan for Delaware, and signed into law on July 16, 2017. The Consortium, created by the passage of Senate Bill 111 under the leadership of Lt. Governor Hall-Long, Senator Townsend, and Representative David Bentz, was formed to tackle Delaware’s challenging and complex issues around addiction and mental health. In Delaware, like in many states across the nation, the statistics paint a troubling reality. Over 30,000 adults, 9,000 adolescents, and more than 82 percent of our prison population struggle with mental illness or substance use disorder. Nationally, 11 is the average age of onset of a behavioral health disorder, and 22.5 percent of the general population are struggling with mental illness. Unfortunately, far too many Delawareans do not seek treatment, do not know where to turn for help, or do not have the resources available to get the help they need. PURPOSE: Since the first meeting in October 2017, the Consortium has focused on creating a streamlined approach to improving Delaware’s behavioral health system by tying together the numerous public and nonprofit bodies, efforts, initiatives, and commissions that are currently in place and creating both short-term and long-term strategies to save lives and expand access to services. The 25-member Consortium and multiple stakeholders have met a total of five times and conducted a series of statewide community listening forums, which will be referenced in greater detail throughout this report. The Consortium, through a number of public meetings and focus-group settings, has worked with the local community to identify the most pressing issues currently facing the state in the behavioral health arena. NEXT STEPS: Within this first report, a multiyear strategy will be outlined, which highlights the need to combat addiction, increase integration of services, develop a strong workforce pipeline, eliminate the stigma of behavioral health, and prevent future Delawareans from struggling with addiction and a lack of needed services. The Consortium members are dedicated to this work and are eager to recommend a plan of action that will focus on systemic change, improved quality integration, and the continued evaluation of outcomes and improvement to Delaware’s behavioral health system.
Addictions	Guilcher, S. J. T., Cadel, L., Everall, A. C., Wiese, J. L., Hamilton-Wright, S., Salmon, C. C., & Matheson, F. I.	2019	Factors related to screening for problem gambling among healthcare and social service providers in Ontario, Canada: A concept mapping study.	Health and Social Care in the community	https://doi.org/10.1111/hsc.12909		University of Toronto	Problem gambling is a major public health concern, especially among persons who are precariously housed, living in poverty or have complex health and social needs. Problem gambling has been connected to negative health and social outcomes; however, current healthcare services rarely screen for problem gambling. With support from community partners, the purpose of this study was to understand factors related to screening for problem gambling. Concept mapping, a mixed-method approach driven by participatory involvement, was conducted with healthcare and social service providers from Ontario, Canada in 2019. Three phases were conducted with participants either in-person or online: Brainstorming, Sorting/Rating and Mapping. Brainstorming sessions were conducted to generate statements, guided by the focal prompt: “If you were directed to routinely screen for problem gambling, what would help you do this in your daily practice?” Participants sorted statements into categories and rated them based on their importance and feasibility. A mapping session was conducted with participants to co-create visual representations of the data. Thirty participants took part in the in-person or online concept mapping sessions. During the brainstorming sessions, participants generated 213 statements, which the research team condensed into a final list of 45 statements. Participants decided that the five-cluster map best represented these 45 statements and labelled the five clusters: (a) top level (macro), (b) screening tool, (c) staff skills and training, (d) screening, and (e) team resources and support. Staff skills and training was rated as the most important and the most realistic cluster to implement, while screening was rated relatively as the least important when compared to the other clusters. Team resources and support was rated relatively as the least realistic cluster. By identifying the needs of healthcare and social service providers, this study co-developed actionable suggestions that will assist providers in routinely screening for problem gambling.
Addictions	Urbanoski, K., Pauly, B., Inglis, D., Cameron, F., Haddad, T., Phillips, J., Phillips, P., Rosen, C., Schlotter, G., Hartney, E., & Wallace, B.	2020	Defining culturally safe primary care for people who use substances: a participatory concept mapping study.	BMC Health Services Research	https://doi.org/10.1186/s12913-020-05915-x	https://bmchealthservres.biomedcentral.com/track/pdf/10.1186/s12913-020-05915-x.pdf#:~:text=Using%20a%20participatory%20research%20approach%2C%20we%20applied%20the,phases%20of%20the%20research%20and%20led%20data%20collection.	University of Victoria	People who use substances experience high levels of substance-related stigma, both within and outside of health care settings, which can prevent people from help-seeking and contribute further to health inequities. Recognizing and respecting how political, social, economic, and historical conditions influence health and health care, cultural safety, with origins in addressing Indigenous racism, is a potential strategy for mitigating stigma and marginalization in health care. Using a participatory research approach, we applied the concept of cultural safety to develop a model of safe primary care from the perspective of people who use substances. Methods: People who use or used substances were involved in all phases of the research and led data collection. Study participants (n = 75) were 42.5 years old on average; half identified as female and one quarter as Indigenous. All were currently using or had previous experience with substances (alcohol and/or other drugs) and were recruited through two local peer-run support agencies. Concept mapping with hierarchical cluster analysis was used to develop the model of safe primary care, with data collected over three rounds of focus groups. Results: Participants identified 73 unique statements to complete the focus prompt: "I would feel safe going to the doctor if …" The final model consisted of 8 clusters that cover a wide range of topics, from being treated with respect and not being red-flagged for substance use, to preserving confidentiality, advocacy for good care and systems change, and appropriate accommodations for anxiety and the effects of poverty and criminalization. Conclusions: Developing a definition of safe care (from the patient perspective) is the necessary first step in creating space for positive interactions and, in turn, improve care processes. This model provides numerous concrete suggestions for providers, as well as serving as starting point for the development of interventions designed to foster system change. Keywords: Canada; Community based participatory research; Concept mapping; Cultural safety; Primary care; Stigma; Substance use.
Addictions	B. Pauly, J. McCal, F. Cameron, H. Stuart, H. Hobbs, G. Sullivan, C. Ranger, K. Urbanoski	2022	A concept mapping study of service user design of safer supply as an alternative to the illicit drug market	International Journal of Drug Policy	https://doi.org/10.1016/j.drugpo.2022.103849	https://www.sciencedirect.com/science/article/pii/S0955395922002651/pdfft?md5=6cfe3ea5e0ba54183841b69c05983a8b&pid=1-s2.0-S0955395922002651-main.pdf	University of Victoria	Background Within North America and worldwide, drug-related overdoses have increased dramatically over the past decade. COVID-19 escalated the need for a safer supply of illicit substances to reduce overdoses with hopes of replacing substances obtained from the illicit drug market. Drug users 1 should be at the centre of program and policy decisions related to the development and implementation of safer supply. Yet, there is little empirical research that conceptualizes effective safer supply from their perspectives. Method Within a community based participatory approach to research, we conducted a concept mapping study to foreground the perspectives of drug users and develop a conceptual model of effective safer supply. Our team was composed of researchers from a local drug user organization, a local harm reduction organization, and academic researchers. The focused prompt developed by the team was: “Safe supply would work well if…” Sixty-three drug users participated in three rounds of focus groups as part of the concept mapping process, involving brainstorming, sorting, rating and naming of themes. Results The concept mapping process resulted in six clusters of statements: 1) Right dose and right drugs for me; 2) Safe, positive and welcoming spaces; 4) I am treated with respect; 5) I can easily get my safer supply; and 6) Helps me function and improves my quality of life (as defined by me). The statements within each cluster describe key components central to an effective model of safer supply as defined by drug users. Conclusion The results of this study provide insights into key components of effective safer supply to inform planning and evaluation of future safer supply programs informed by drug user perspectives.
Addictions - Tobacco/Nicotine	Soule, E. K., Nasim, A., & Rosas, S.	2016	Adverse effects of electronic cigarette use: A concept mapping approach.	Nicotine & Tobacco Research	https://doi.org/10.1093/ntr/ntv246	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5896831/pdf/ntv246.pdf	Virginia Commonwealth University	Electronic cigarette (ECIG) use has grown rapidly in popularity within a short period of time. As ECIG products continue to evolve and more individuals begin using ECIGs, it is important to understand the potential adverse effects that are associated with ECIG use. The purpose of this study was to examine and describe the acute adverse effects associated with ECIG use. Methods: This study used an integrated, mixed-method participatory approach called concept mapping (CM). Experienced ECIG users (n = 85) provided statements that answered the focus prompt "A specific negative or unpleasant effect (ie, physical or psychological) that I have experienced either during or immediately after using an electronic cigarette device is…" in an online program. Participants sorted these statements into piles of common themes and rated each statement. Using multidimensional scaling and hierarchical cluster analysis, a concept map of the adverse effects statements was created. Results: Participants generated 79 statements that completed the focus prompt and were retained by researchers. Analysis generated a map containing five clusters that characterized perceived adverse effects of ECIG use: Stigma, Worry/Guilt, Addiction Signs, Physical Effects, and Device/Vapor Problems. Conclusions: ECIG use is associated with adverse effects that should be monitored as ECIGs continue to grow in popularity. If ECIGs are to be regulated, policies should be created that minimize the likelihood of user identified adverse effects. Implications: This article provides a list of adverse effects reported by experienced ECIG users. This article organizes these effects into a conceptual model that may be useful for better understanding the adverse outcomes associated with ECIG use. These identified adverse effects may be useful for health professionals and policy makers. Health professionals should be aware of potential negative health effects that may be associated with ECIG use and policy makers could design ECIG regulations that minimize the risk of the adverse effects reported by ECIG users in this study.
Addictions - Tobacco/Nicotine	Soule, E. K., Rosas, S. R., & Nasim, A.	2016	Reasons for electronic cigarette use beyond cigarette smoking cessation: A concept mapping approach.	Addictive Behaviors	https://doi.org/10.1016/j.addbeh.2016.01.008	http://www.sciencedirect.com/science/article/pii/S030646031630017X	Virginia Commonwealth University	Electronic cigarettes (ECIGs) continue to grow in popularity, however, limited research has examined reasons for ECIG use. Methods: This study used an integrated, mixed-method participatory research approach called concept mapping (CM) to characterize and describe adults' reasons for using ECIGs. A total of 108 adults completed a multi-module online CM study that consisted of brainstorming statements about their reasons for ECIG use, sorting each statement into conceptually similar categories, and then rating each statement based on whether it represented a reason why they have used an ECIG in the past month. Results: Participants brainstormed a total of 125 unique statements related to their reasons for ECIG use. Multivariate analyses generated a map revealing 11, interrelated components or domains that characterized their reasons for use. Importantly, reasons related to Cessation Methods, Perceived Health Benefits, Private Regard, Convenience and Conscientiousness were rated significantly higher than other categories/types of reasons related to ECIG use (p < .05). There also were significant model differences in participants' endorsement of reasons based on their demography and ECIG behaviors. Conclusions: This study shows that ECIG users are motivated to use ECIGs for many reasons. ECIG regulations should address these reasons for ECIG use in addition to smoking cessation.
Addictions - Tobacco/Nicotine	Soule, E. K., Lopez, A. A., Guy, M. C., & Cobb, C. O.	2016	Reasons for using flavored liquids among electronic cigarette users: A concept mapping study.	Drug and Alcohol Dependence	https://doi.org/10.1016/j.drugalcdep.2016.07.007	https://www.ncbi.nlm.nih.gov/pmc/articles/pmid/27460860/	Virginia Commonwealth University	Background: Electronic cigarettes (ECIGs) aerosolize liquids often containing flavorants for inhalation. Few studies have examined the role of flavors in ECIG use. This study's purpose was to examine reasons for flavored ECIG use using a mixed-method approach, concept mapping (CM). Methods: Forty-six past 30-day adult ECIG users recruited from vape forums/conferences completed three online CM tasks. Participants brainstormed responses to a prompt: "A specific reason I use flavored e-liquid in my electronic cigarette product is…". The final 107 brainstormed statements were sorted by participants into groups of similar content. Participants rated each statement on a 7-point scale (1-Definitely NOT a reason to 7-Definitely a reason) based on a prompt: "This is a specific reason why I used flavored e-liquid in my electronic cigarette product in the past month." A cluster map was generated from participants' sorting and ratings using CM statistical software. Cluster mean ratings were compared. Results: Analysis revealed five clusters of reasons for flavored ECIG use including Increased Satisfaction/Enjoyment, Better Feel/Taste than Cigarettes, Variety/Customization, Food Craving Suppression, and Social Impacts. Statements in the Increased Satisfaction/Enjoyment and Better Feel/Taste than Cigarettes clusters were rated significantly higher than statements from other clusters (ps<0.05). Some statements indicated flavors were perceived as masking agents for nicotine or other bad tastes associated with cigarette smoking making ECIG use more palatable. Conclusions: Flavored ECIGs are used for many reasons. Some statements suggested flavors may increase the rewarding and possible addictive effects of ECIGs. These results support continued examination of the role of flavors and ECIG use behaviors. Keywords: Concept mapping; Electronic cigarettes; Flavors; Mixed methods.
Addictions - Tobacco/Nicotine	Soule, E. K., Maloney, S. F., Guy, M. C., Eissenberg, T., & Fagan, P.	2017	User identified positive outcome expectancies of electronic cigarette use: A concept mapping study.	Psychology of Addictive Behaviors	https://doi.org/10.1037/adb0000263	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5422116/pdf/nihms-849873.pdf	Virginia Commonwealth University	Electronic cigarette (ECIG) use is growing in popularity, however, little is known about the perceived positive outcomes of ECIG use. This study used concept mapping (CM) to examine positive ECIG outcome expectancies. Sixty-three past 30-day ECIG users (38.1% female) between the ages of 18 and 64 (M = 37.8, SD = 13.3) completed a CM module. In an online program, participants provided statements that completed a prompt: “A specific positive, enjoyable, or exciting effect (i.e., physical or psychological) that I have experienced WHILE USING or IMMEDIATELY AFTER USING an electronic cigarette/electronic vaping device is…”. Participants (n = 35) sorted 123 statements into “piles” of similar content and rated (n = 43) each statement on a 7-point scale (1-Definitely NOT a positive effect to 7-Definitely a positive effect). A cluster map was created using data from the sorting task and analysis indicated a seven cluster model of positive ECIG use outcome expectancies: Therapeutic/Affect Regulation, High/Euphoria, Sensation Enjoyment, Perceived Health Effects, Benefits of Decreased Cigarette Use, Convenience, and Social Impacts. The Perceived Health Effects cluster was rated highest, though all mean ratings were greater than 4.69. Mean cluster ratings were compared and females, younger adults, past 30-day cigarette smokers, users of more “advanced” ECIG devices, and non-lifetime (less than 100 lifetime cigarettes) participants rated certain clusters higher than comparison groups (ps < 0.05). ECIG users associate positive outcomes with ECIG use. ECIG outcome expectancies may affect product appeal and tobacco use behaviors and should be examined further to inform regulatory policies.
Addictions - Tobacco/Nicotine	Soule, E. K., Maloney, S. F., Guy, M. C., Eissenberg, T., & Fagan, P.	2018	User-identified electronic cigarette behavioral strategies and device characteristics for cigarette smoking reduction.	Addictive Behaviors	https://doi.org/10.1016/j.addbeh.2017.12.010		Virginia Commonwealth University	Background: There is limited evidence on how cigarette smokers use electronic cigarettes (ECIGs) for smoking cessation and reduction. This study used concept mapping, a participatory mixed-methods research approach, to identify ECIG use behaviors and device characteristics perceived to be associated with cigarette smoking cessation or reduction. Methods: Current ECIG users aged 18-64 were recruited from seven cities selected randomly from U.S. census tract regions. Participants were invited to complete concept mapping tasks: brainstorming, sorting and rating (n=72). During brainstorming, participants generated statements in response to a focus prompt ("A SPECIFIC WAY I HAVE USED electronic cigarettes to reduce my cigarette smoking or a SPECIFIC WAY electronic cigarettes help me reduce my cigarette smoking is…") and then sorted and rated the statements. Multidimensional scaling and hierarchical cluster analyses were used to generate a cluster map that was interpreted by the research team. Results: Eight thematic clusters were identified: Convenience, Perceived Health Effects, Ease of Use, Versatility and Variety, Advantages of ECIGs over Cigarettes, Cigarette Substitutability, Reducing Harms to Self and Others, and Social Benefits. Participants generated several statements that related to specific behavioral strategies used when using ECIGs for smoking reduction/complete switching behaviors such as making rapid transitions from smoking to ECIG use or using certain ECIG liquids or devices. Former smokers rated the Perceived Health Effects cluster and several behavioral strategy statements higher than current smokers. Conclusions: These results help to identify ECIG use behaviors and characteristics perceived by ECIG users to aid in cigarette smoking cessation or reduction. Keywords: Concept mapping; Electronic cigarettes; Perceptions; Smoking cessation; Smoking reduction.
Addictions - Tobacco/Nicotine	Daoud, N., Jung, Y. E., Muhammad, A. S., Weinstein, R., Qaadny, A., Ghattas, F., Khatib, M., & Grotto, I.	2018	Facilitators and barriers to smoking cessation among minority men using the behavioral-ecological model and Behavior Change Wheel: A concept mapping study.	PLOS One	https://doi.org/10.1371/journal.pone.0204657	https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0204657&type=printable	Ben-Gurion University of the Negev	Universal smoking cessation strategies are not always successful for minorities, among whom smoking is highly prevalent despite high intention to quit. This study identifies facilitators for smoking cessation, as perceived by minority male smokers, that can inform a culturally appropriate national plan for smoking prevention and cessation. Methods: We conducted in 2013 a three-stage study among Arab minority male current and former smokers (ages 18–64) in Israel, among whom smoking is very high: first, a Concept Mapping (CM) study with 102 and 202 participants in the brainstorming, and sorting and rating phases respectively. Second, we assigned clusters identified in the CM study to contingency levels using the Behavioral Ecological Model (BEM). Third, we classified clusters into intervention functions and policies using the Behavior Change Wheel (BCW). Findings: The CM study revealed 58 barriers and facilitators for smoking prevention and cessation that were sorted into 11 clusters by the participants. These clusters were analogous to four BEM level contingency of smoking (social, institutional, community and individual). We classified it into two main policy categories, based on the BCW: 1- restructuring the socio-political environment of smoking through affirmative government's policies towards Arab minority in Israel, and 2-developing a culturally appropriate plan for smoking cessation in Arab local authorities including: raising awareness about tobacco hazards; enforcing anti-smoking laws; strengthening community institutional action; providing smoking cessation services; considering raising prices for tobacco products, addressing psychological sources of smoking in Arab men. Conclusions: Our study revealed barriers, facilitators and contingencies of smoking prevention and cessation with two main policy action items among the Arab minority in Israel: changing the socio-political environment of smoking, and developing a culturally appropriate smoking prevention and cessation national plan. Our study framework can inform policies and culturally appropriate interventions for smoking prevention and cessation in other minorities.
Addictions - Tobacco/Nicotine	Breland, A., Balster, R. L., Cobb, C., Fagan, P., Foulds, J., Koch, J. R., Lipato, T., Saliba, N., Shihadeh, A., Shumei, S., & Eissenberg, T.	2019	Answering questions about electronic cigarettes using a multidisciplinary model.	American Psychologist	https://doi.org/10.1037/amp0000426	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6450402/	Virginia Commonwealth University	Electronic cigarettes (ECIGs) are a relatively new class of tobacco products and a subject of much debate for scientists and policymakers worldwide. Objective data that address the ECIG risk/benefit ratio for individual and public health are needed, and addressing this need requires a multidisciplinary approach that spans several areas of psychology as well as chemistry, toxicant inhalation, and physiology. This multidisciplinary approach would benefit from methods that are reliable, valid, and swift. For this reason, we formed a multidisciplinary team to develop methods that could answer questions about ECIGs and other potential modified risk tobacco products. Our team includes scientists with expertise in psychology (clinical, community, and experimental) and other disciplines including aerosol research, analytical chemistry, biostatistics, engineering, internal medicine, and public health. The psychologists on our team keep other members focused on factors that influence individual behavior, and other team members keep the psychologists aware of other issues, such as product design. Critically, all team members are willing to extend their interests beyond the boundaries of their discipline to collaborate effectively with the shared goal of producing the rigorous science needed to inform empirically-based tobacco policy. In addition, our trainees gain valuable knowledge from these collaborations and learn that other disciplines are accessible, exciting, and enhance their own research. Multidisciplinary work presents challenges: learning other scientists’ languages and staying focused on our core mission. Overall, our multidisciplinary team has led to several major findings that inform the scientific, regulatory, and public health communities about ECIGs and their effects. Keywords: electronic cigarettes, multidisciplinary, team
Addictions - Tobacco/Nicotine	Hiler, M., Spindle, T. R., Dick, D., Eissenberg, T., Breland, A., & Soule, E.	2019	Reasons for transition from electronic cigarette use to cigarette smoking among young adult college students.	Journal of Adolescent Health	https://doi.org/10.1016%2Fj.jadohealth.2019.09.003	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6935466/pdf/nihms-1543328.pdf	Virginia Commonwealth University	Longitudinal studies indicate that e-cigarette use among youth and young adults is associated with cigarette smoking initiation. The purpose of this study was to identify reasons why non-smoking young adults transition from e-cigarette use to cigarette smoking. Methods: The study used concept mapping (CM), a mixed-method participatory approach. Fifty-five college students who endorsed initiation of e-cigarettes prior to cigarettes (lifetime e-cigarette uses ≥ 100 and ≥ 100 cigarettes in lifetime) completed at least one part of the study. In an online program, participants brainstormed (n = 54) statements describing reasons for transition from e-cigarette use to cigarette smoking, sorted statements (n = 46) into conceptually similar categories, and rated (n = 47) how true each statement was for them. Results: Participants generated 60 unique statements and multidimensional scaling analysis generated 8 thematic clusters characterizing reasons for transition which included: “Sharing with Others,” “Psychological Coping,” “Cigarette Appeal,” “Reinforcing Effects of Cigarettes,” “Accessibility,” “Social Influence,” “Vaping Stigma,” and “Vaping Deficiencies.” Participants rated “Sharing with Others” and “Psychological Coping” highest (most true) and “Vaping Deficiencies” lowest (least true). For college students, the ability to share cigarettes with peers, access cigarettes from peers, and smoking for stress/anxiety management were among the top reasons for transition. Conclusions: Results suggest that tailored prevention efforts aimed at reducing cigarette smoking uptake among college students who use tobacco as a means for psychological coping or social facilitation may be warranted. Further, regulatory decisions aimed at limiting cigarette appeal, reinforcing effects, and accessibility may be relevant to reducing transition. Keywords: electronic cigarette, tobacco use, cigarette smoking, young adults, college students, tobacco transition
Addictions - Tobacco/Nicotine	Soule, E. K., Chaiton, M., Zhang, B., Hiler, M. M., Schwartz, R., Cohen, J. E., & Eissenberg, T.	2019	Menthol cigarette smoker reactions to an implemented menthol cigarette ban.	Tobacco Regulatory Science	https://doi.org/10.18001/TRS.5.1.5		East Carolina University	Objective: We examined menthol cigarette smokers' reactions to Ontario's menthol cigarette ban. Methods: In April 2017, past-year adult menthol cigarette smokers from Ontario, Canada (N = 67; 64.2% women) participated in an online study. Participants generated statements describing their reactions to the ban. Researchers reviewed statements continuously until reaching content saturation, and then removed duplicate statements. Participants sorted the final 79 statements by content similarity and rated each statement from 1 (Definitely NOT true) to 7 (Definitely true). Multidimensional scaling of sorting data generated a cluster map and mean cluster ratings were compared. Results: Seven statement clusters describing reactions to the menthol ban were generated: thoughts about the ban, perceiving the ban as ineffective, emotional reactions to the ban, smoking non-menthol cigarettes, smoking cessation or reduction, alternative menthol cigarette purchasing behaviors, and alternative tobacco use behaviors. Participants rated the thoughts about the ban cluster highest (most true) and alternative tobacco use behaviors cluster lowest (least true). Participants who smoked menthol cigarettes before the ban every day or most days rated clusters higher than pre-ban occasional or rare menthol smokers. Conclusions: Banning menthol cigarettes resulted in reactions including negative feelings about the ban, smoking cessation attempts, and behaviors to find menthol cigarette alternatives.
Addictions - Tobacco/Nicotine	Soule, E. K., Lee, J. G. L., Egan, K. L., Bode, K. M., Desrosiers, A. C., Guy, M C., Breland, A., & Fagan, P.	2020	“I cannot live without my vape”: Electronic cigarette user-identified indicators of vaping dependence.	Drug and Alcohol Dependence	https://doi.org/10.1016/j.drugalcdep.2020.107886	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7330178/pdf/nihms-1556877.pdf	East Carolina University	Limited research has examined indicators of electronic cigarette (ECIG) dependence. Researchers have adapted ECIG dependence measures from cigarette smoking dependence measures, but few have examined unique aspects of ECIG dependence. This study used concept mapping, a mixed-methods approach to examine ECIG user-identified indicators of ECIG dependence. In 2019, we recruited current ECIG users (n = 75; 52.9% women; mean age = 33.2, SD = 9.9) from 25 states to complete an online study. Participants completed a brief survey and brainstormed statements (n=216) completing the prompt: “Something specific that makes me think I am addicted to using my electronic cigarette/vaping device is…” After duplicate content was removed, participants sorted the final list of 93 statements by content similarity and rated statements on how true statements were for them (1 – Definitely NOT true to 7 – Definitely true). Multidimensional scaling analysis identified ECIG dependence thematic clusters. Results: We identified ten themes: Craving, Negative Affect, Vaping as a Necessity, Therapeutic Effects, Preparedness, Attachment to Device, Impact on Daily Activity, Physical Withdrawal Symptoms, Monetary Cost, and Shame or Embarrassment. Those who had higher ECIG dependence scores and those who reported more frequent ECIG use had higher mean cluster ratings than those with lower ECIG dependence scores and who reported less frequent ECIG use. (ps<05). Conclusions: ECIG dependence has similarities to cigarette smoking dependence, but dependence indicators appear to be unique to ECIG use. Health professionals and the public should be aware of ECIG dependence risk and indicators. Keywords: electronic cigarettes, dependence
Addictions - Tobacco/Nicotine	Cui, Y., Dai, Z., Cohen, J. E., Rosas, S., Smith, K. C., Welding, K., & Czaplicki, L.	2022	Culturally specific health-related features on cigarette packs sold in China	Tobacco Control	https://doi.org/10.1136/tc-2022-057527	https://tobaccocontrol.bmj.com/content/tobaccocontrol/early/2022/08/25/tc-2022-057527.full.pdf	Johns Hopkins University	Background: China is the country with the highest burden of tobacco-caused disease. We characterised the extent to which cigarette pack marketing features (eg, imagery, text, pack color) could potentially mislead consumers by suggesting products are healthy. Methods: We used two methods: group concept mapping and content analysis. First, we used a group concept mapping approach to generate and sort Chinese consumer responses to an open-ended prompt asking what marketing features suggest a product is ‘healthy’ or ‘good for you’. Second, based on the concept mapping results, we developed a codebook of health-related features on cigarette packs that were relevant to the unique cultural context of product marketing in China. Two trained coders who were native Chinese speakers double-coded a sample of 1023 cigarette packs purchased in 2013 (wave 1) and 2017 (wave 2). We examined differences in the presence of features overall and over time. Results: Overall, 83.5% (n=854) of Chinese cigarette packs in our sample contained at least one ‘healthy’ or ‘good for you’ feature, and the presence of health-related features on packs remained constant between wave 1 (83.5%, n=354) and wave 2 (83.5%, n=500; p=1.00). Across both waves, the most common categories of culturally specific health features present related to recycling symbols, rare animal imagery, bright colours (eg, bright yellow) and botanical imagery (eg, bamboo, mint). Conclusion: Health-related features on cigarette packs sold in China are common. Enhanced policies to address tobacco packaging, labelling and branding could support and facilitate a reduction in the high tobacco burden in China.
Addictions - Tobacco/Nicotine	Soule, E. K., S. Mayne, Snipes, W., & Guy, M. C.	2020	Impacts of COVID-19 on electronic cigarette purchasing, use and related behaviors	International Journal of Environmental Research and Public Health	https://doi.org/10.3390/ijerph17186762	https://www.mdpi.com/1660-4601/17/18/6762/pdf?version=1600416379	Virginia Commonwealth University	COVID-19 has caused health impacts and disruptions globally. Electronic cigarette (ECIG) users may face additional impacts. This study examined impacts of COVID-19 on ECIG users. Methods: Concept mapping, a mixed-methods approach, was used to identify COVID-19 impacts on adult ECIG users. ECIG users (n = 93) provided statements completing a prompt: “A specific way Coronavirus/COVID-19 has affected my vaping/e-cigarette use, my vaping/e-cigarette related purchasing, or other vaping/e-cigarette related behaviors or issues is…”. Participants generated 85 unique statements, sorted statements into groups of similar content and rated each statement on how true they were. Multidimensional scaling and hierarchical cluster analysis identified thematic clusters. Mean cluster ratings were compared between sample subgroups. Results: Ten clusters were identified: Stocking up and Bulk Purchasing, Challenges in Obtaining ECIG Supplies, Alternative Purchasing Procedures, Increased ECIG use, Disruption of Routine and ECIG Use, Efforts to Decrease ECIG Use, Improving ECIG Skills, COVID-19 Health Concerns, Perceptions of ECIG Use and COVID-19, and COVID-19 Protection. More dependent ECIG users and dual users of ECIGs and cigarettes rated clusters higher than less dependent ECIG users and non-dual users. Conclusions: ECIG users may experience or perceive they face additional COVID-19 impacts, such as increased exposure, financial burdens, stress, and health risks. View Full-Text Keywords: electronic cigarettes; COVID-19; tobacco
Addictions - Tobacco/Nicotine	Soule, E. K., Bode, K. M., Desrosiers, A. C., Guy, M., Breland, A., & Fagan, P.	2020	User-Perceived Negative Respiratory Symptoms Associated with Electronic Cigarette Use.	Nicotine & tobacco research	https://doi.org/10.1093/ntr/ntaa179	https://academic.oup.com/ntr/article-pdf/22/Supplement_1/S45/34910707/ntaa179.pdf	East Carolina University and Medical Center	Electronic cigarettes (ECIGs) expose users to an aerosol containing chemicals, which could affect the respiratory system negatively. This study examined negative respiratory symptoms associated with ECIG use. Methods In 2019, adult current ECIG users from 24 US states who reported experiencing negative respiratory symptoms from ECIG use (n = 49; 44.9% women; mean age = 35.2, SD = 11.5) completed an online survey and brainstormed statements that completed the prompt: “A specific negative effect or symptom related to my breathing, nose, mouth, throat, or lungs that I have experienced from vaping/using my e-cigarette is...” Participants sorted the final list of 56 statements into groups of similar content and rated statements on how true they were for them. Multidimensional scaling analysis identified thematic clusters. Results Eight ECIG use respiratory symptom clusters identified in analysis included Mucus and Congestion, Fatigue, Throat Symptoms, Breathing Problems, Mouth Symptoms, Chest Symptoms, Illness Symptoms, and Nose and Sinus Symptoms. Highly rated (ie, most common) symptoms included dry throat or mouth, fatigue during physical activity, coughing, shortness of breath, excessive phlegm, and bad taste in mouth. Mean cluster ratings did not differ based on lifetime cigarette smoking status (100 lifetime cigarettes smoked), but current cigarette smokers (ie, dual users) rated the Fatigue, Breathing Problems, Mucus and Congestion, and Nose and Sinus Symptoms clusters higher than noncurrent cigarette smokers. Conclusions Participant-identified respiratory symptoms perceived to be ECIG related, many similar to cigarette smoking symptoms. Future research should assess if these symptoms are associated with other negative health outcomes. Implications ECIG use exposes users to chemicals that may have negative health impacts on the respiratory system. Limited research has examined the broad range of negative respiratory symptoms associated with e-cigarette use. This study identified that ECIG–cigarette users perceive their ECIG use to be associated with negative respiratory symptoms. Many e-cigarette user-reported negative respiratory symptoms are similar to those associated with cigarette smoking, though some appear unique to e-cigarette use. Future research should continue to monitor respiratory symptoms reported by ECIG users and whether these are associated with health outcomes over time.
Addictions - Tobacco/Nicotine	Soule, E. K., Dubray, J., Cohen J. E., Schwartz, R., Chaiton, M.	2021	Smoking cessation strategies used by former menthol cigarette smokers after a menthol ban	Addictive Behaviors	https://doi.org/10.1016/j.addbeh.2021.107046		East Carolina University	Menthol cigarettes were banned in Ontario, Canada on January 1st, 2017. We used concept mapping, a mixed-method approach, to describe how menthol cigarette smokers quit smoking after the Ontario menthol ban. Methods Pre-ban daily and non-daily menthol cigarette smokers who reported smoking abstinence 24 months after the ban (n = 62; 53.2% women; mean age = 43.6, SD = 12.5) generated statements describing reasons and strategies for smoking cessation/reduction after the menthol ban. Participants sorted a final list of 57 statements into groups of similar content and rated statements on how true each statement was for them and multidimensional scaling analysis identified thematic clusters. Results Six clusters were identified: Mental and Environment Changes, Direct Ban Impacts, Health Reasons, Cues to Action, Family and Friends, and Cessation Strategies. The highest rated statements (i.e., most true) suggested many participants were motivated to quit smoking before or after the ban and 30.7% of participants believed the menthol ban helped with smoking cessation. Some of the lowest rated statements included using nicotine replacement therapy products, medication (i.e., Champix), or other tobacco products suggesting these strategies were less common. Statement ratings suggested many smokers quit without using replacement products or medication, but modifying cognitions and avoiding smoking cues were common. Conclusions The menthol ban aided some menthol smokers to quit, while others reported the ban did not play a role in smoking cessation. These data suggest the menthol ban had direct and indirect effects on smoking reduction behavior. Campaigns supporting similar bans that target both types of effects will likely be most effective for smoking reduction.
Addictions - Tobacco/Nicotine	Soule, E.K.; Mayne, S.; Snipes, W.; Thomas, L.; Guy, M.C.; Breland, A.; Fagan, P.	2022	Electronic cigarette users’ reactions and responses to a hypothetical ban of flavoured electronic cigarette liquids	BMJ Open Access	https://doi.org/10.1136/tobaccocontrol-2022-057454	https://tobaccocontrol.bmj.com/content/tobaccocontrol/31/Suppl_3/s197.full.pdf	East Carolina University	Background: Regulations have been proposed to limit e-cigarette flavours, but limited research has examined potential impacts of such policies. This study examined adult e-cigarette users’ reactions to a hypothetical e-cigarette flavour ban. Methods: In 2019, a convenience sample of current e-cigarette users in the USA (n=81, 53.1% women, mean age=37.6, 59.3% dual users of cigarettes) completed an online concept mapping study. Participants provided statements describing anticipated reactions to a hypothetical policy in which only tobacco, menthol or unflavoured e-cigarettes were available for purchase. Seventy-one unique statements were generated. Participants sorted statements into thematic groups and rated statements on how likely they would be to have each reaction. Multidimensional scaling was used to identify thematic clusters of statements. Results: Twelve clusters were identified: negative reaction, take action against flavour limitation, youth prevention effectiveness perception, tolerance, acceptance, willingness to try new flavours, maintain vaping, reduce vaping, new flavours as vaping cessation transition, alternative sources for banned flavours, do-it- yourself mixing behaviours and alternative tobacco products. The highest rated cluster (negative reaction) described being angry or upset that flavours were banned, while the lowest rated clusters related to quitting/reducing e-cigarette use or switching to other tobacco products. Non-tobacco or non-menthol/mint flavoured e-cigarette users had higher ratings for clusters describing negative sentiment for the hypothetical policy. Conclusions: Some e-cigarette users may dislike an e-cigarette flavour ban; however, some e-cigarette users would likely be willing to use tobacco, menthol or unflavoured e-cigarette liquids with lower likelihood of quitting vaping or switching to other tobacco products.
Business and Marketing	Glenn, M. & Thorne, K.	2015	Does the purpose for using a service dog make a difference in the perceptions of what it takes to create successful outcomes in the workplace?	Journal of Applied Rehabilitation Counseling		https://connect.springerpub.com/content/sgrjarc/46/2/13	West Virginia University	The objective of this article is to determine if there are perceptual differences regarding the importance of elements deemed imperative for successful service dog partnerships in the workplace (Glenn, 2013) between those who have experience with dogs for mobility/stability and those for medical alert/response. Thirty individuals completed this online survey (mobility/stability: n = 18; medical alert/response: n = 12). Participants rated the importance of elements in response to the question, “How important to do you think this item is in the OVERALL process?” The mobility/stability group rated the Co-Worker Preparation and Legal Knowledge clusters as significantly more important than the medical alert/response group. This opens up a need for research on the unique needs of subgroups of the population of people using service dogs. Differences may exist because of the size of dogs and the issues around privacy for the person with the disability seeking accommodations on the job.
Business and Marketing	Glenn, M. K.	2015	Stakeholder perceptions of the need for research on elements of service dog partnerships in the workplace.	Rehabilitation Research, Policy, and Education	https://doi.org/10.1891/2168-6653.29.4.320		West Virginia University	Purpose: To examine the perceived need for research on elements of successful service dog partnerships in the workplace outlined by stakeholders in an exploratory study. Method: A structured mixed methods approach was used to gather ideas from people with service dogs, trainers, vocational rehabilitation counselors, and other health care professionals. Sixty-eight people participated in the process, from brainstorming elements (n = 24), sorting them into clusters (n = 10), rating the items for importance (n = 40), and need for research (n = 34). Among those rating research, most were service dog handlers (55%). Primarily, the group had experience with mobility/stability dogs (45%) or medical alert/response service dogs (35%). Results: Sixty-eight elements were brainstormed and rated according to need for research. The clusters Monitoring and Dog Preparation received the highest mean ratings in response to the question, What is your perception of the relative priority of conducting research on this item? All 68 elements were perceived to be in need of further research. Conclusion: The conclusion was that the elements established in this study should generate scholarly activity in the rehabilitation and disability research and service community with the intent of identifying promising practices related to the use of service dogs in the workplace by people with disabilities.
Business and Marketing	Henry, A. D., Laszlo, A., & Nicholson, J.	2015	What does it take to build an employment collaborative for people with disabilities?	Journal of Vocational Rehabilitation	https://doi.org/10.3233/JVR-150750		University of Massachusetts	Background: Collaboration among employment service providers has been suggested as one strategy for enhancing outcomes for people with disabilities. Yet, little research exists on the process of collaboration building or factors that contribute to effective collaboration among employment providers. Objective: We engaged partners of five Regional Employment Collaboratives (RECs) in Massachusetts to identify the critical elements needed to build and sustain an employment collaborative. Methods: We used concept mapping, a mixed-method approach that included brainstorming sessions during which REC partners generated statements in response to the research question – what does it take to build and sustain an employment collaborative? Partners sorted statements thematically and rated statements in terms of importance and challenge. Sorting and rating data were analyzed using multidimensional scaling and hierarchical cluster analysis. Results: The analysis yielded six “clusters” reflecting critical elements in building and sustaining a collaborative. Three elements, build trust and respect, do business differently and have effective structures and processes, are consistent with the literature on general collaborative building. The other three elements, address employer needs, engage job developers, and innovate strategically, reflect activities specific to an employment-focused collaborative. Conclusions: Collaboration is a complex and time-consuming undertaking, but holds promise as a way to enhance employment outcomes for people with disabilities. Keywords: Employment services, vocational rehabilitation, collaboration, concept mapping, people with disabilities
Business and Marketing	Cloutier, L. M., Cueille, S., & Recasens, G.	2016	Resource orchestration mechanisms and the growth of the very small enterprise (VSE) with entrepreneurial support. (Les mécanismes d’orchestration des ressources et la croissance de la jeune TPE accompagnée.)	Revue Internationale P.M.E.	https://doi.org/10.7202/1038340ar	https://www.erudit.org/fr/revues/ipme/2016-v29-n3-4-ipme02873/1038340ar.pdf	University of Quebec in Montreal	The literature on resource orchestration provides a process-based and complexity perspective for understanding the growth of the VSE with support. However, few studies have focused on the representations of entrepreneurial actors about the managerial and entrepreneurial actions which explain growth. Yet, finer knowledge about the mechanisms underlying the orchestration of resources would be useful to actors and entrepreneurial support professionals facing this challenge. To that end, this article proposes the use of critical realism which purpose is to develop a research design based on the Group Concept Mapping (GCM) as a bottom-up mixed methodological framework. The GCM method is used to produce intercase research representations to examine the conceptual representations shared by entrepreneurial actors owners of VSEs at the growth phase and evolving in distinct support systems ; one in Quebec (NQC = 25) and the other in France (NFR = 15). The intercase results presented in this article contribute in two ways to the theoretical concepts underpinning resource orchestration. First, four self-reinforcing growth-generating mechanisms are identified in line with the antecedents of growth. Second, conjectures formulated by retroduction to the theoretical notions contribute to an articulation of the resource orchestration framework for the VSE with support. Keywords: Enterprise growth, Entrepreneurial development, Resource orchestration, Critical realism, Group concept mapping
Business and Marketing	Cloutier, L. M., Cueille, S., & Recasens, G.	2017	Entrepreneurs’ perspectives on the structuring phase of the entrepreneurial team.	In C. Ben-Hafaïedh & T. M. Cooney (eds.), Research Handbook on Entrepreneurial Teams: Theory and Practice			University of Québec in Montréal	This chapter examines the problem of structuring entrepreneurial team development in small enterprises taken from the perspectives offered by a group of young entrepreneurs who have each faced such a challenge. In particular, the chapter will report on a shared representation (or collective) conceptual framework. For the purposes of this study, action-oriented clusters were identified using group concept mapping (GCM), a bottom-up mixed-method-based approach using primary data. The methodological approach taken and results obtained contribute to a deeper understanding of the scope and interrelationship of actions related to entrepreneurial team development. The results indicate that actions rated as the most important and feasible are related to the entrepreneur’s role. The results also report differences between relatively higher than average importance and relatively lower than average feasibility for clusters of actions related to the organizational and resource pool environments: team cohesion and spirit, organizational structuring, HR management, team leadership and evolution, and team competences development. Interestingly, team-oriented financial capital development included a set of actions rated as the lowest for both importance and feasibility. The findings startlingly highlight the balancing act entrepreneurs face at the structuring phase of the team development, which consists of taking actions to develop it from the resource pool environment versus the organizational environment.
Business and Marketing	Cloutier, L. M., Arcand, S., Laviolette, E. M., & Renard, L.	2018	Collective economic conceptualization of strategic actions by Quebec cidermakers: A mixed methods-based approach.	Journal of Wine Economics	https://doi.org/10.1017/jwe.2017.39		University of Quebec at Montreal	The objective of this article is to estimate the spatial structure of the collective economic conceptualization of strategic actions by cidermakers in Québec. It employs group concept mapping, a mixed methods–based approach. Given the limited research on the economic conceptualization of horizontal coordination for guiding collective strategic action orientations, this contribution is threefold: methodological, empirical, and practical. Methodologically, the results show the perspective of horizontally coordinated cidermakers and use statistical estimates and retroduction as an inference mode to produce and structure the concept map. Empirically, the spatial economic conceptualization consists of a concept map with seven strategic action clusters organized around the notions of product supply and demand and highlights tensions between individual and collective strategic actions. Practically, measures of relative importance and relative feasibility are obtained for each cluster on the map, and implications are discussed. (JEL Classifications: D02, L23, L26, L66, Q18)
Business and Marketing	Velonis, A. & Forst, L.	2018	Outreach to low-wage and precarious workers: Concept mapping for public health officers.	Journal of Occupational and Environmental Medicine	https://doi.org/10.1097/JOM.0000000000001462		University of Illinois at Chicago	Objective: To explore concept mapping (CM) as a participatory methodology that can be used by public health officials to strategize approaches to reducing health inequities among low wage workers and workers with unstable employment. Methods: In a workshop of 68 occupational health officers, mainly from government agencies, CM was demonstrated through gathering and prioritizing ideas for reaching underserved, at-risk working populations. Results: Prior to the workshop, occupational health officers generated 99 brainstormed ideas on how to reach underserved workers. These were reduced to 39 unique items, which workshop participants then sorted into themes and prioritized based on perceived effectiveness and feasibility. Twelve specific approaches covering enhanced surveillance methods, occupational safety and health (OSH) training, and partnering with employers, other agencies, and community groups were considered most actionable by occupational/public health officers to address the health of low-wage, and precarious workers. In a follow-up session 1 year later, a subset of participants discussed the findings. Conclusion: Concept mapping can be used to elucidate actionable approaches by government agencies to better address occupational health inequities experienced by low wage and precarious workers.
Business and Marketing	Berg, S., Cloutier, L. M., & Broring, S.	2018	Collective stakeholder representations and perceptions of drivers of biomass-based value chains.	Journal of Cleaner Production	https://doi.org/10.1016/j.jclepro.2018.07.304		University of Bonn	European Union (EU) policies aim to enable novel biomass-based value chains which require collaboration among their stakeholders. However little is known about how stakeholders collectively represent the scope and boundary of drivers that enhance or limit these novel biomass-based value chains. Thus, the objective of this article is to present the first comprehensive set of results about the collective representations and perceptions of novel biomass-based value chain drivers held by German stakeholders. These results were produced using Group Concept Mapping (GCM), a bottom-up and participatory mixed methods-based approach. The results include a multivariate estimated concept map comprising 54 drivers spatially distributed across eight interrelated clusters. The spatial organization of clusters on the concept map provides insights on their interrelatedness and conceptual configuration which reveal stakeholders’ concept breadth and depth of novel biomass value chains. Moreover, the relative importance and relative feasibility measures for each cluster of drivers were obtained. These measures indicate significant statistical differences between perceived relative importance and feasibility ratings. A discussion compares the results with available empirical evidence to further interpret the interrelatedness of the clusters, and provide additional insights regarding effective policy formulation for enabling novel biomass-based value chains.
Business and Marketing	Borge, L. & Broring, S.	2018	What affects technology transfer in emerging knowledge areas? A multi-stakeholder concept mapping study in the bioeconomy.	The Journal of Technology Transfer	https://doi.org/10.1007/s10961-018-9702-4	https://www.researchgate.net/profile/Laura-Borge-2/publication/328106820_What_affects_technology_transfer_in_emerging_knowledge_areas_A_multi-stakeholder_concept_mapping_study_in_the_bioeconomy/links/5bbc71d84585159e8d8f23d8/What-affects-technology-transfer-in-emerging-knowledge-areas-A-multi-stakeholder-concept-mapping-study-in-the-bioeconomy.pdf	University of Bonn	Technology transfer in emerging knowledge areas such as the bioeconomy is strongly challenged. The related challenges are attained to the differences in perceptions, objectives, values and motivations between academic scientists and firms stemming from different disciplines and industries. Group concept mapping, an exploratory and bottom-up participatory method that brings together stakeholders to represent their collective perceptions, was therefore applied to investigate challenges in technology transfer. Using this approach, this study is able to offer the first overview of factors affecting technology transfer in the bioeconomy through the aggregate representation of the perceptions of different stakeholder groups (i.e. academic scientists, technology transfer facilitators, and firms/entrepreneurs). These factors are visualized in form of maps by means of multidimensional scaling and hierarchical cluster analyses. Furthermore, a quantitative ranking of the factors is used to demonstrate the degree to which the importance of the perceived factors differs across stakeholder groups. Factors related to interdisciplinary collaborations and collaborations between academics and firms as well as those tied to financial issues or consumer acceptance are assigned the highest level of relative importance. However, these factors are also characterized by the lowest level of relative coherence across key stakeholders. Finally, managerial and policy recommendations for cultivating successful technology transfer in the context of other interdisciplinary and emerging knowledge areas are suggested.
Business and Marketing	Legget, J.	2018	Shared heritage, shared authority, shared accountability? Co-generating museum performance criteria as a means of embedding ‘shared authority.’	International Journal of Heritage Studies	https://doi.org/10.1080/13527258.2017.1413679		Auckland University	This New Zealand case study presents insights from the perspectives of Māori and non-Māori museum stakeholders. It aimed to understand which activities and responsibilities mattered to stakeholders, in order to develop more meaningful accountability for their shared heritage. Using a participatory mixed method, the research explored how museum stakeholders assess their museum’s performance. Māori and non-Māori generated, sorted and rated 'possible performance statements’. A cultural analysis, using proprietary software, produced concept maps which illustrate differently nuanced museum constructs with different relative importance for constituent elements. Pattern-matching revealed divergent priority accorded certain museum activities, but also commonalities. Both cultural groups prioritised factors not generally featured in compliance-driven approaches to accountability reporting. For Māori, greatest importance was placed on care of taonga (‘treasures’), Māori-specific practice and engagement with Māori, while collections and staff were the key assessment factors for non-Māori. Incorporating stakeholder perspectives in a museum performance framework provides opportunities to report performance on dimensions which matter to wider communities. Where shared authority is taken seriously and stakeholders are involved, accountability becomes meaningful. This collaborative approach to performance framework development offers a tool for embedding the realities of shared authority into planning and delivering the museum’s activities and responsibilities.
Business and Marketing	Pelletier, C. & Cloutier, L. M.	2019	Challenges of digital transformation in SMEs: Exploration of IT-related perceptions in a service ecosystem.	Proceedings of the 52nd Hawaii International Conference on System Sciences	https://doi.org/10.24251/HICSS.2019.597	https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/87893b19-f85d-4ab3-bc4e-9ad606fe6d9c/content	University of Quebec in Trois-Rivières	Supported by a service ecosystem that is increasingly immersed into the digital transformation, SMEs have access to turnkey IT applications, which may come free of charge but not free of concerns. Using the group concept mapping (GCM) as the methodological framework, a concept map was estimated for a group of entrepreneurs in SMEs. Six main themes were identified as conceptual representations. The perceptions of the three main actor groups which interact in the ecosystem (i.e. entrepreneurs, IT specialists, socioeconomic support professionals) were estimated and compared. The analysis of IT-related perceptions shows entrepreneurs tend to rank as relatively more important the IT evaluation support identified on the concept map rather than the nature of the digital strategy to be implemented when compared with IT specialists and socioeconomic professionals. The discussion highlights issues of perceptions which vary among these interacting actors, and stresses the need to develop a shared understanding of IT challenges in a service ecosystem.
Business and Marketing	Pelletier, C. & Cloutier, L. M.	2019	Conceptualising digital transformation in SMEs: An ecosystemic perspective.	Journal of Small Business and Enterprise Development	https://doi.org/10.1108/JSBED-05-2019-0144	https://www.researchgate.net/profile/Claudia-Pelletier/publication/337332963_Conceptualising_digital_transformation_in_SMEs_an_ecosystemic_perspective/links/5df7959fa6fdcc283724a039/Conceptualising-digital-transformation-in-SMEs-an-ecosystemic-perspective.pdf	University of Quebec in Trois-Rivières	Purpose: Supported by a service ecosystem that is increasingly immersed into digital transformation, small- and medium-sized enterprises (SMEs) have access to turnkey information technology (IT) applications, which may come free of charge but not free of concerns. The purpose of this paper is to explore a group conceptualisation and associated perceptions of IT issues within an ecosystem that includes three subgroup profiles: entrepreneurs, IT professionals and socioeconomic support professionals. Design/methodology/approach: Using group concept mapping, a bottom-up and participatory mixed methods-based approach, a concept map was estimated, based on a list of items, to define seven clusters pertaining to issues and challenges of adoption and use of turnkey IT applications in SMEs of less than 20 employees. Perceptions measures of relative importance and feasibility were obtained by subgroup profiles. Findings The relative importance and relative feasibility measures for the seven clusters indicate significant statistical differences in ratings among the subgroup profiles. A discussion on the importance of relational capital in addressing challenges of digital transformation in SMEs is developed. Originality/value: Results highlight signifiant differences concerning key dimensions in the adoption and use of IT from the perspective of three subgroup profiles of actors within the ecosystem. First, the results stress the need to develop a shared understanding of IT challenges. Second, they suggest policymakers could use these conceptual representations to further develop and strengthen the IT-related support agenda for SMEs, especially the smaller ones (e.g. training programs, business support and coaching initiatives, etc.).
Business and Marketing	Cloutier, L. M., Cueille, S., Recasens, G., & Rosas, S. R.	2019	Représentations conceptuelles par les acteurs entrepreneuriaux : apport des correspondances spatiales ascendantes.	Revue De L'Entrepreneuriat	https://doi.org/10.3917/entre.181.0073		University of Quebec in Montreal	La littérature en cognition entrepreneuriale de la croissance insiste sur le manque de connaissances permettant de comprendre ce phénomène. De plus, peu de travaux ont porté sur l’efficacité des dispositifs d’accompagnement dédiés à la croissance de la jeune TPE (Très Petite Entreprise). Pourtant, dans la pratique, des divergences de représentations collectives entre acteurs entrepreneuriaux au sujet des actions de croissance à mettre en œuvre menacent l’efficacité de ces dispositifs d’accompagnement. Une compréhension plus affinée des convergences et des divergences de représentations entre les entrepreneurs et les accompagnateurs, en ce qui concerne les actions à mettre en œuvre pour soutenir la croissance comme résultat d’un processus d’orchestration des ressources, serait pertinente pour guider les acteurs entrepreneuriaux faisant face à ce défi. Afin d’éclairer cette problématique, la cartographie des concepts en groupe (CCG) doublée d’une analyse de Procuste aléatoire ont été employées. Ce cadre méthodologique mixte et ascendant permet de déterminer empiriquement les représentations des entrepreneurs et des accompagnateurs en isolant leurs correspondances spatiales respectives. L’empirie permet ainsi de déterminer et de mesurer les convergences et les divergences de représentations des actions de croissance qu’entretiennent ces acteurs entrepreneuriaux. Un positionnement épistémologique en réalisme critique (RC) rend possible une contribution théorique en articulant les mécanismes générateurs (MG) de la croissance extraits des représentations des acteurs entrepreneuriaux. Concernant la contribution managériale de la recherche, des divergences de représentations ont été établies quant aux actions de croissance associées au soutien, au financement et à la gestion des risques.
Business and Marketing	Cloutier, L. M., Renard, L., & Arcand, S.	2019	Collective economic conceptualization of cider and wine routes by stakeholders.	Journal of Wine Economics	https://doi.org/10.1017/jwe.2019.27		University of Quebec at Montreal	The coherence and systemic strength of the collaborative process among thematic route stakeholders are key factors to economic success for individual businesses and regional economic development. The objective of this article is to identify the economic action set to rejuvenate the Cider Route and the Wine Route of the Montérégie region (Quebec, Canada). Group concept mapping is used to estimate the conceptualization and perceptions of stakeholders (cideries, wineries, tourism professionals, visitors) regarding the articulation of the action set. The contribution is threefold. Methodologically, the approach taken supports both the estimation of the concept map and associated perception measures. Empirically, eight action clusters are identified to articulate stakeholders’ “organizational” and “selling” dimensions of the routes. Practically, action priorities identified and feasibility constraints are helpful to target the capability development support needed by route stakeholders to collaborate. (JEL Classifications: D02, L23, L26, L66, Q18)
Business and Marketing	Homer, S., T.	2022	A case‐study approach to mapping Corporate Citizenship	Business and Society Review	https://doi.org/10.1111/basr.12280	https://www.researchgate.net/profile/Stephen-Homer-2/publication/362909324_A_case-study_approach_to_mapping_Corporate_Citizenship/links/6307099a5eed5e4bd119abd4/A-case-study-approach-to-mapping-Corporate-Citizenship.pdf	Sunway University	This explores what responsible business practice within the context of Malaysia, an Eastern collective society, diverging from the Western individualistic society where most Corporate Social Responsibility (CSR) research originates. A bottom-up approach was adopted, incorporating different stakeholder perspectives of a case-study firm, widely acknowledged for its CSR programs. Concept mapping method was selected because it is a structural conceptualization method designed to organize and represent ideas from an identified group adding structure to disorganized and subjective ideas. By using concept mapping all the various perspectives and ideas were brought together to create a single conceptualization. The findings from the concept mapping present 101 statements which produced seven clusters; Products & Services, Community Oriented, Stakeholder & Business Value, Employee Oriented, Legal & Ethical Responsibilities, Environmental & Social Oriented, and Philanthropic Oriented. These clusters covered the whole conceptual domain of Corporate Citizenship and demonstrated multiple CSR theories, including corporate sustainability, stakeholder concept, and shared value, were apparent, while also uncovering some unique aspects from the normative stakeholder perspective. The implications of this study suggest that while some aspects of globally institutionalized CSR are generically accepted, there are contextually specific aspects which need to be considered as these may contradict or conflict with the “global” standards.
Business and Marketing	Cui, Y., Dai, Z., Cohen, J. E., Rosas, S., Smith, K. C., Welding, K., & Czaplicki, L.	2022	Culturally specific health-related features on cigarette packs sold in China	Tobacco Control	https://doi.org/10.1136/tc-2022-057527	https://tobaccocontrol.bmj.com/content/tobaccocontrol/early/2022/08/25/tc-2022-057527.full.pdf	Johns Hopkins University	Background: China is the country with the highest burden of tobacco-caused disease. We characterised the extent to which cigarette pack marketing features (eg, imagery, text, pack color) could potentially mislead consumers by suggesting products are healthy. Methods: We used two methods: group concept mapping and content analysis. First, we used a group concept mapping approach to generate and sort Chinese consumer responses to an open-ended prompt asking what marketing features suggest a product is ‘healthy’ or ‘good for you’. Second, based on the concept mapping results, we developed a codebook of health-related features on cigarette packs that were relevant to the unique cultural context of product marketing in China. Two trained coders who were native Chinese speakers double-coded a sample of 1023 cigarette packs purchased in 2013 (wave 1) and 2017 (wave 2). We examined differences in the presence of features overall and over time. Results: Overall, 83.5% (n=854) of Chinese cigarette packs in our sample contained at least one ‘healthy’ or ‘good for you’ feature, and the presence of health-related features on packs remained constant between wave 1 (83.5%, n=354) and wave 2 (83.5%, n=500; p=1.00). Across both waves, the most common categories of culturally specific health features present related to recycling symbols, rare animal imagery, bright colours (eg, bright yellow) and botanical imagery (eg, bamboo, mint). Conclusion: Health-related features on cigarette packs sold in China are common. Enhanced policies to address tobacco packaging, labelling and branding could support and facilitate a reduction in the high tobacco burden in China.
Business and Marketing	Dulin, A., Mealy, R., Whittaker, S., Cardel, M., Wang, J., Risica, P. M., & Gans, K.	2022	Identifying Barriers to and Facilitators of Using a Mobile Fruit and Vegetable Market Intervention Delivered to Low-Income Housing Sites: A Concept Mapping Study.	Health Education & Behavior	https://doi.org/10.1177%2F1090198121998287	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8446086/pdf/nihms-1689822.pdf	Brown University	Mobile fruit and vegetable (F&V) markets may be a promising strategy to improve F&V intake among low-income and racial/ethnic minority groups. However, challenges remain in terms of maximizing the reach and utilization of such markets. Therefore, this study identifies perceived barriers to and facilitators of utilizing a mobile F&V market among residents who lived in low-income housing that received the markets. Specifically, this article reports the results of the follow-up acceptability study of the "Live Well, Viva Bien" (LWVB) intervention. Method: We conducted concept mapping with residents in housing communities that received the Fresh to You (FTY) markets. Participants generated, sorted, and rated statements concerning barriers to and facilitators of market use. We compared the rating data by residents' level of market utilization and created a map representing how statements clustered into conceptual themes. Results: We retained 66 unique participant-generated statements. Eight thematic clusters emerged; four pertained to barriers: financial/promotion, produce-related, scheduling/knowledge, and logistic/awareness barriers, and four related to facilitators: produce/staffing, promotion, accessibility, and multilevel market facilitators. There was a strong correlation in ratings between participants who more frequently versus less frequently shopped at the markets (r = 0.94). Conclusions: Participants identified financial barriers, market promotion, ease of market accessibility, produce variety and quality, and staffing as key factors influencing FTY market use. This study highlights the importance of identifying the perceived barriers to and facilitators of mobile F&V market use among target populations to inform future efforts to scale up such approaches. Keywords: diet; food access; intervention; low income; neighborhood; qualitative.
Business and Marketing	Maartje Henderikx, Jol Stoffers	2023	Digital transformation and middle managers’ leadership skills and behavior: a group concept mapping approach	Frontiers in Psychology	https://doi.org/10.3389/fpsyg.2023.1147002		Research Centre for Employability, Zuyd University of Applied Sciences, Sittard, Netherlands,	This study, with the aim to test theory in practice, used group concept mapping to develop a comprehensive conceptualization of middle managers’ leadership behaviors concerning digital transformation as a form of radical change. Participants were professionals in the largest public organization in the Netherlands (a police organization) who were dealing with digital transformation in their own practice and who enrolled in an education program on leadership and intelligence. Based on 94 unique statements, the participant-driven results revealed six thematically coherent clusters representing leadership skills and behaviors regarding improvement and results, digital technologies, cooperation, the self, change and ambivalence, and others. The stress value of 0.2234 indicated a good fit. Further analysis showed that clusters containing soft skills and people-oriented behaviors were considered the most important. These results can serve as input to support leadership development programs for middle managers to develop themselves into people-oriented, empowering leaders who can adapt their leadership approaches to fit and support change in general and technology-driven change in particular. Ultimately this will benefit their and their employees’ overall well-being at work. This study is the first to investigate middle managers’ leadership skills and behaviors in a large public organization that is entirely participant-driven.
Child & Adolescent Health	Minh, A., Patel, S., Bruce-Barrett, C., & O'Campo, P.	2015	Letting youths choose for themselves: Concept mapping as a participatory approach for program and service planning.	Family & Community Health	https://doi.org/10.1097/FCH.0000000000000060		University of British Columbia	Ensuring that the voices of youths are heard is key in creating services that align with the needs and goals of youths. Concept mapping, a participatory mixed-methods approach, was used to engage youths, families, and service providers in an assessment of service gaps facing youth in an underserviced neighborhood in Toronto, Canada. We describe 6 phases of concept mapping: preparation, brainstorming, sorting and rating, analysis, interpretation, and utilization. Results demonstrate that youths and service providers vary in their conceptualizations of youth service needs and priorities. Implications for service planning and for youth engagement in research are discussed.
Child & Adolescent Health	Baskin, M.L., Dulin-Keita, A., Thind, H., & Godsey, E.	2015	Social and cultural environment factors influencing physical activity among African-American adolescents.	Journal of Adolescent Health	https://doi.org/10.1016/j.jadohealth.2015.01.012	https://pubmed.ncbi.nlm.nih.gov/25907652/	University of Alabama at Birmingham	African-American youth are at high risk for physical inactivity. This study explored social and cultural environment facilitators of physical activity among 12- to 14-year-old African-American adolescents living in a metropolitan area in the Southeast. Methods: Youth (n = 51; 45% male) participated in brainstorming focus groups responding to the prompt, “What about your family, friends, and community, encourages you to be physically active?” In a second meeting, participants (n = 56; 37.5% male) sorted statements (n = 84) based on similarity in meaning and rated statements on relative importance. Statement groups and ratings were entered into The Concept System® Global MAX™ software where multidimensional scaling and hierarchical cluster analysis were used to create graphical representation of ideas. Finally, researchers named clusters according to the gestalt of grouped statements. Results: The total sample included 28.9% of youth with household incomes ≤$30,000 (area median income = $30,701), 29% who perceived themselves as overweight, and 14.5% who reported being active for 60+ minutes everyday. Nine clusters, in rank order, emerged as follows: access/availability of physical activity resources; family and friend support; physical activity with friends; physical activity with family members; inspiration to/from others; parental reinforcement; opportunities in daily routine; pressure from social networks; and seeing consequences of activity/inactivity. Themes analyzed by gender were very similar (r = .90); however, “pressure from social networks” was more important for girls than boys (r = .10). Conclusions: Clear patterns of social and cultural facilitators of physical activity are perceived by African-American adolescents. Interventions targeting this group may benefit by incorporating these themes.
Child & Adolescent Health	Dulin-Keita, A., Whittaker, S., Wynter, J., Kidanu, T. W., Chhay, C., Cardel, M. & Gans, K.	2016	Applying concept mapping methodology to identify the perceived risk and protective factors for childhood obesity among Southeast Asians.	Journal of Health Care for the Poor and Underserved	https://doi.org/10.1353/hpu.2016.0171	https://webcache.googleusercontent.com/search?q=cache:MlVfV9YBTe4J:https://chip.uconn.edu/wp-content/uploads/sites/1245/2019/05/Dulin-Keita-et-al-2016-Concept-Mapping.pdf	Johns Hopkins University	This study identifies Southeast Asian refugee parents' and grandparents' perceptions of the risk and protective factors for childhood obesity. Methods: We used a mixed methods approach (concept mapping) for data collection and analyses. Fifty-nine participants engaged in modified nominal group meetings where they generated statements about children's weight status and structuring meetings where they sorted statements into piles based on similarity and rated statements on relative importance. The Concept System® Global MAX™ software generated clusters of ideas, cluster ratings, and pattern matches. Results: Eleven clusters emerged. Participants rated "Healthy Food Changes Made within the School" and "Parent-related Physical Activity Factors" as most important, whereas "Neighborhood Built Features" was rated as the least important. Cambodian and Hmong participants agreed the most on cluster ratings of relative importance (r = 0.62). Conclusion: The study findings may be used to inform the development of culturally appropriate obesity prevention interventions for Southeast Asian refugee communities.
Child & Adolescent Health	Brown, J., Kapasi, A., Nowicki, E., Cleversey, K., & Salahadin, A.	2017	Caregivers of youth with a fetal alcohol spectrum disorder: Hopes for them as adults.	Advances in Neurodevelopmental Disorders	https://doi.org/10.1007/s41252-017-0030-8		University of Western Ontario	Caregivers of youth with a fetal alcohol spectrum disorder participated in telephone interviews about their hopes for their youths as adults. Interviews with 16 birth, adoptive, and foster parents, as well as with aunts and grandparents of children over the age of 10 years, were conducted. A total of 54 unique responses were made to the question “What do you want for your child as an adult?”. Participants independently grouped all responses into themes. The groupings were analyzed using multidimensional scaling and cluster analysis using The Concept System® Global MAX™ and resulted in four concepts. The concepts included the following: (a) education and employment, (b) positive relationships, (c) community integration, and (d) support services. The main differences between the participants’ experiences and the literature centered on different emphases on feelings relative to skills and on strengths relative to deficits.
Child & Adolescent Health	Yonas, M., Zuberi, A., Kasunic, A., Bamwine, P., Boddie, S., Tarp-Gilliam, S., & Wallace, J.	2017	Using concept mapping to explore and engage parent and youth residents of an economically underserved minority community around children's asthma.	Progress in Community Health Partnerships: Research, Education and Action	https://doi.org/10.1353/cpr.2017.0041	https://www.researchgate.net/profile/Anna-Kasunic-2/publication/322492987_Using_Concept_Mapping_to_Explore_and_Engage_Parent_and_Youth_Residents_of_an_Economically_Underserved_Minority_Community_around_Children%27s_Asthma/links/5b8fded9299bf114b7f66b6b/Using-Concept-Mapping-to-Explore-and-Engage-Parent-and-Youth-Residents-of-an-Economically-Underserved-Minority-Community-around-Childrens-Asthma.pdf?origin=publication_detail	The Pittsburgh Foundation	Background: Asthma continues to disproportionately impact children living in economically underserved urban neighborhoods, and contributes to persistent racial and economic disparities in health. Furthermore, asthma is often exacerbated by the presence of social and environmental factors that are prevalent in, and sometimes particular to, these communities. Objectives: The present study uses a community-based participatory research (CBPR) approach to explore and define the experience and issues around children's asthma in an economically underserved community. These findings will be used to inform the design of a community intervention. Methods: Through a community and academic partnership called Healthy Living, Healthy Learning, Healthy Lives (HL3), we engaged neighborhood youth and adult residents (N = 21) in a concept mapping activity to identify triggers and health care-related factors that influence children with asthma. Results: Findings highlight that the most important triggers of asthma included indoor and outdoor irritants and allergens, as well as violence and fear-related emotions. The most important factors perceived to influence the care of asthma included medical relievers such as asthma medication, appliances such as a humidifier, and supports for asthma like the school nurse. Differences between adults and youth perceptions of factors triggering and influencing asthma are highlighted. Conclusions: Engaging community residents as experts provided a deeper understanding of the issues around children's asthma in the community, which can contribute to the design of a more effective intervention.
Child & Adolescent Health	Wallace, C., Dale, F., Jones, G., O'Kane, J., Thomas, M., Wilson, L., & Pontin, D.	2018	Developing the health visitor concept of family resilience in Wales using group concept mapping.	Rural and Remote Health	https://doi.org/10.22605/RRH4604	https://www.rrh.org.au/journal/download/pdf/4604/	University of South Wales	Introduction: A health visitor's ability to assess and analyse aspects of family resilience in daily practice is essential to enable practitioners to support families and facilitate positive lifestyle choices, and improve child health and developmental outcomes. The purpose of this research was to undertake an in-depth exploration of the concept of family resilience as understood by health visitors in Wales and to develop a concept map. This knowledge has been used to develop the Family Resilience Assessment Instrument Tool (FRAIT). This is a standardised form of assessment, measuring instrument, guidance, training package and community of practice for use in health visitor daily practice. This article presents the first stage of the FRAIT research study, that of identifying the clusters within the concept map of what health visitors perceive as 'family resilience'. Methods: A structured Group Concept Mapping (GCM) methodology using Concept Systems' Global Max online software was used to gain a consensus of the understanding of the concept of family resilience from 62 invited health visitors practising across Wales. This is an integrated qualitative and quantitative approach to brainstorming, idea synthesis, idea sorting, idea rating and group analysis. GCM has six clear steps, with four steps described in the method: 'preparing for concept mapping', 'generating ideas', 'structuring the statements' and 'concept mapping analysis'. Steps 5 and 6, 'interpreting the maps' and 'utilisation', are considered in the results section. Results: Use of multi-dimensional scaling and hierarchical cluster analysis enabled point, cluster, rating and pattern matching maps to be presented to the study group. These were then interpreted, understood and consensus gained on how the concept of family resilience was constructed from both the study group and the health visitor participants. Family resilience understood by health visitors in Wales comprises five clusters: 'family health', 'responsive parenting', 'engagement', 'family support' and 'socioeconomic factors'. Each of the clusters has an identified number of underpinning statements from a total number of 117 statements. Conclusion: Family resilience as understood by health visitors is a multidimensional concept. Using online software such as The Concept System® Global MAX™ enabled health visitors working across Wales to achieve a consensus and generate the data in preparation for building FRAIT for use in their daily practice as required by Welsh Government policy. Keywords: Group Concept Mapping; Wales; health visiting; family resilience.
Child & Adolescent Health	Barnert, E. S., Coller, R. J., Nelson, B. B., Thompson, L. R., Klitzner, T. S., Szilagyi, M., Breck, A. M., & Chung, P. J.	2018	A healthy life for a child with medical complexity: 10 domains for conceptualizing health.	Pediatrics	https://doi.org/10.1542/peds.2018-0779	https://publications.aap.org/pediatrics/article/142/3/e20180779/38681/A-Healthy-Life-for-a-Child-With-Medical-Complexity	University of California, Los Angeles	Defining and measuring health for children with medical complexity (CMC) is poorly understood. We engaged a diverse national sample of stakeholder experts to generate and then synthesize a comprehensive list of health outcomes for CMC. Methods: With national snowball sampling of CMC caregiver, advocate, provider, researcher, and policy or health systems experts, we identified 182 invitees for group concept mapping (GCM), a rigorous mixed-methods approach. Respondents (n = 125) first completed Internet-based idea generation by providing unlimited short, free-text responses to the focus prompt, “A healthy life for a child or youth with medical complexity includes: ___.” The resulting 707 statements were reduced to 77 unique ideas. Participants sorted the ideas into clusters based on conceptual similarity and rated items on perceived importance and measurement feasibility. Responses were analyzed and mapped via GCM software. Results: The cluster map best fitting the data had 10 outcome domains: (1) basic needs, (2) inclusive education, (3) child social integration, (4) current child health-related quality of life, (5) long-term child and family self-sufficiency, (6) family social integration, (7) community system supports, (8) health care system supports, (9) a high-quality patient-centered medical home, and (10) family-centered care. Seventeen outcomes representing 8 of the 10 domains were rated as both important and feasible to measure (“go zone”). Conclusions: GCM identified a rich set of CMC outcome domains. Go-zone items provide an opportunity to test and implement measures that align with a broad view of health for CMC and potentially all children.
Child & Adolescent Health	Ageberg, E., Bunke, S., Lucander, K., Nilsen, P., & Donaldson, A.	2018	Facilitators to support the implementation of injury prevention training in youth handball: A concept mapping approach.	Scandinavian Journal of Medicine & Science in Sports	https://doi.org/10.1111/sms.13323	https://onlinelibrary.wiley.com/doi/epdf/10.1111/sms.13323	Lund University	There is a need for research to identify effective implementation strategies for injury prevention training within real-world community sports. The aim of this ecological participatory study was to identify facilitators, among stakeholders at multiple levels, that could help injury prevention training become part of regular training routines in youth team handball. Concept mapping, a mixed-method approach for qualitative data collection and quantitative data analysis, was used. Stakeholders (n = 196) of two community team handball clubs (29% players, 13% coaches, 38% caregivers, 11% club, district and national handball administrators, 9% unknown) participated in a brainstorming process. After the research team synthesized the 235 generated statements, 50 stakeholders (34% players, 22% coaches, 24% caregivers, 20% administrators) sorted 89 unique facilitator statements into clusters and rated them for importance and feasibility. Multidimensional scaling and hierarchical cluster analysis yielded five clusters (stress value 0.231): "Understanding and applying knowledge," "Education, knowledge, and consistency," "Set-up and exercises," "Inspiration, motivation, and routines," and "Club policy and expert collaboration." The cluster "Understanding and applying knowledge" had the highest mean importance (3.17 out of 4) and feasibility (2.93) ratings. The 32 statements rated as both highly important and feasible (Go-zone) indicate action is required at the individual (end-users) and organizational (policymakers) levels to implement injury prevention training. Results suggest that developing evidence-based context-specific injury prevention training, incorporating physiological, biomechanical and psychological components, and an associated context-specific implementation plan in partnership with all stakeholders should be a high priority to facilitate the implementation of injury prevention training in youth team handball. Keywords: adolescent; concept mapping; health plan implementation; preventive therapy; sports injuries; team ball sports.
Child & Adolescent Health	Donaldson, A., Callaghan, A., Bizzini, M., Jowett, A., Keyzer, P., & Nicholson, M.	2018	A concept mapping approach to identifying the barriers to implementing an evidence-based sports injury prevention program.	Injury Prevention	https://doi.org/10.1136/injuryprev-2017-042639	https://injuryprevention.bmj.com/content/25/4/244	La Trobe University	Understanding the barriers to programme use is important to facilitate implementation of injury prevention programmes in real-word settings. This study investigated the barriers to coaches of adolescent female soccer teams, in Victoria, Australia, implementing the evidence-based FIFA 11+ injury prevention programme. Methods: Concept mapping with data collected from 19 soccer coaches and administrators. Results: Brainstorming generated 65 statements as barriers to 11+ implementation. After the statements were synthesised and edited, participants sorted 59 statements into groups (mean, 6.2 groups; range, 3–10 groups). Multidimensional scaling and hierarchical cluster analysis identified a six-cluster solution: Lack of 11+ knowledge among coaches (15 statements), Lack of player enjoyment and engagement (14), Lack of link to football-related goals (11), Lack of facilities and resources (8), Lack of leadership (6) and Lack of time at training (5). Statements in the ‘Lack of 11+ knowledge among coaches’ cluster received the highest mean importance (3.67 out of 5) and feasibility for the Football Federation to address (3.20) rating. Statements in the ‘Lack of facilities and resources’ cluster received the lowest mean importance rating (2.23), while statements in the ‘Lack of time at training’ cluster received the lowest mean feasibility rating (2.19). Conclusions: A multistrategy, ecological approach to implementing the 11+—with specific attention paid to improving coach knowledge about the 11+ and how to implement it, linking the 11+ to the primary goal of soccer training, and organisational leadership—is required to improve the uptake of the 11+ among the targeted coaches.
Child & Adolescent Health	Beaupin, L. K., Uwazurike, O. C., & Hydeman, J. A.	2018	A roadmap to survivorship: Optimizing survivorship care plans for adolescent and young adult cancer survivors.	Journal of Adolescent and Young Adult Oncology	https://doi.org/10.1089/jayao.2018.0061		Johns Hopkins Medicine	Young adult cancer patients have complex medical and psychosocial needs throughout treatment. Once treatment ends, few young adult cancer survivors (YACS) receive adequate survivorship care. Many YACS do not continue with oncology care after treatment ends. The purpose of this study was to discover the views YACS held about survivorship care and to design age-appropriate survivorship care plans (SCPs). Methods: Twenty-seven YACS (n = 27) participated in a group discussion focusing on their post-treatment experience. The concept of SCPs was introduced and participants provided information on how their care was managed after the completion of their treatment, what factors played a role in their oncological follow-up care, and the potential utility of a SCP in the management of their follow-up survivorship care. SCPs were developed for each participant and feedback requested. Results: SCPs required 45–180 minutes to complete. Barriers to continued follow-up included: loss of health insurance, poor communication with their oncologist once treatment ended, and ongoing adjustment challenges to work, school, and home life. YACS requested more support for psychosocial issues post-treatment, and more information about long- and late-term side effects from treatment. Conclusions: Further research in the utility of SCPs among YACS is warranted as they may have a significant role for YACS. Information on long- and late-term side effects, follow-up care schedule, psychosocial support, and adolescent and young adult-specific resources must be clearly delineated in SCPs.
Child & Adolescent Health	Hiler, M., Spindle, T. R., Dick, D., eissenberg, T., Breland, A., & Soule, E.	2019	Reasons for transition from electronic cigarette use to cigarette smoking among young adult college students.	Journal of Adolescent Health	https://doi.org/10.1016/j.jadohealth.2019.09.003	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6935466/pdf/nihms-1543328.pdf	Virginia Commonwealth University	Purpose: Longitudinal studies indicate that e-cigarette use among youth and young adults is associated with cigarette smoking initiation. The purpose of this study was to identify reasons why non-smoking young adults transition from e-cigarette use to cigarette smoking. Methods: The study used concept mapping (CM), a mixed-method participatory approach. Fifty-five college students who endorsed initiation of e-cigarettes prior to cigarettes (lifetime e-cigarette uses ≥ 100 and ≥ 100 cigarettes in lifetime) completed at least one part of the study. In an online program, participants brainstormed (n = 54) statements describing reasons for transition from e-cigarette use to cigarette smoking, sorted statements (n = 46) into conceptually similar categories, and rated (n = 47) how true each statement was for them. Results: Participants generated 60 unique statements and multidimensional scaling analysis generated 8 thematic clusters characterizing reasons for transition which included: “Sharing with Others,” “Psychological Coping,” “Cigarette Appeal,” “Reinforcing Effects of Cigarettes,” “Accessibility,” “Social Influence,” “Vaping Stigma,” and “Vaping Deficiencies.” Participants rated “Sharing with Others” and “Psychological Coping” highest (most true) and “Vaping Deficiencies” lowest (least true). For college students, the ability to share cigarettes with peers, access cigarettes from peers, and smoking for stress/anxiety management were among the top reasons for transition. Conclusions: Results suggest that tailored prevention efforts aimed at reducing cigarette smoking uptake among college students who use tobacco as a means for psychological coping or social facilitation may be warranted. Further, regulatory decisions aimed at limiting cigarette appeal, reinforcing effects, and accessibility may be relevant to reducing transition. Keywords: electronic cigarette, tobacco use, cigarette smoking, young adults, college students, tobacco transition
Child & Adolescent Health	Dunlop, S., Lewis, N., Richardson, R., Thomas, S., Devonald-Morris, M., Pontin, D., & Wallace, C.	2019	Using group concept mapping to explore the complexities of managing children's care.	Nurse Researcher	https://doi.org/10.7748/nr.2020.e1696	https://www.researchgate.net/profile/Sue-Dunlop/publication/338629604_Using_group_concept_mapping_to_explore_the_complexities_of_managing_children%27s_care/links/5eb8f7034585152169c5821a/Using-group-concept-mapping-to-explore-the-complexities-of-managing-childrens-care.pdf?origin=publication_detail	University South Wales	Background: Children whose assessed health needs cannot be met by statutory and universal services may require bespoke packages of continuing care. A project management group was set up to design a study that would explore the complexities for a children's community nurse (CCN) of managing such packages. Methodology: Group concept mapping (GCM), a mixed quantitative/qualitative participant-centred methodology, was used to obtain consensus from 20 CCNs about the complexities inherent in managing such packages and to develop a concept map that illustrated the emerging conceptual framework. Discussion: The participants' ideas were written as statements and analysed. Core analysis of a square symmetrical matrix through multidimensional scaling and hierarchical cluster analysis was undertaken to produce a set of maps and reports. The final concept map was interpreted. It contained 99 statements organised into five conceptual clusters: 'education and training' (17 statements), 'risk and safety' (15 statements), 'continuing care process' (17 statements), 'relationships and boundaries' (22 statements) and 'working with families' (28 statements). Conclusion: CCNs used GCM to explore their roles and responsibilities when managing children's continuing care. Their resulting ideas were developed into a five-cluster conceptual framework that illustrated their views about the complexities of managing such care. Implications for practice: The emergent conceptual framework enables CCNs to explore their practice in relation to managing packages of care. Additionally, the framework will be used to design a CCN workforce planning instrument that will be useful to measure complexity in CCN caseloads. The GCM methodology could be used by other nursing teams who wish to develop their practice. Keywords: children; continuing care; management; mixed-methods; research; research methods; service evaluation; study design.
Child & Adolescent Health	Brown, J., Kapasi, A., Nowicki, E., & Cleversey, K.	2019	Expectations of youth with a fetal alcohol spectrum disorder in adulthood: Caregiver perspectives.	Journal on Developmental Disabilities		https://canfasd.ca/wp-content/uploads/publications/41028-JoDD-24-2-v11f-30-42-Brown-et-al.pdf	University of Western Ontario	There are limited data about adults who have fetal alcohol spectrum disorders (FASD). Caregivers of youth with FASD (N = 16) participated in telephone interviews that included the open-ended question, “What kind of adult life do you think they will have?” A total of 57 unique responses were made to the question. These responses were grouped together independ-ently by participants. Grouping data were analyzed using multidimensional scaling and cluster analysis. It is noteworthy that as well as highlighting concerns, participants also high- lighted youths’ assets and hope for them as adults. Caregivers’ concerns about the future needs of their youth mirrors the literature on needs and expectations of adults with FASD. This consistency reinforces the lack of research attention to adults’ needs from caregiver perspectives. Participants also revealeddeep concerns about their youth’s futures. Despite being committed to caregiving, caregivers indicated that they will not be able to do it well enough or long enough to keep their adult children from having serious problems.
Child & Adolescent Health	Hydeman, J. A., Uwazurike, O. C., Adeyemi, E. I., & Beaupin, L. K.	2019	Survivorship needs of adolescent and young adult cancer survivors: A concept mapping analysis.	Journal of Cancer Survivorship	https://doi.org/10.1007/s11764-018-0725-5		Roswell Park Comprehensive Cancer Center	Purpose: Adolescents and young adults (AYAs) with cancer are known to have complex medical and psychosocial needs throughout treatment; however, information is lacking about the challenges AYA survivors face after treatment has ended. Focus groups were conducted using a concept mapping framework to better understand the most important issues these patients face in transitioning to survivorship and how prepared they felt to face them. Methods: AYAs diagnosed between 18 and 39 years old and at least 2 years post-treatment participated in one of six focus groups based on age group and follow-up status. Using a concept mapping design, participants provided important issues during the transition to survivorship and appraised them on three core areas of interest. Results: Analyses revealed salient themes shared across age and follow-up group status, particularly related to the psychosocial, emotional, and cognitive effects of treatment. Differential concerns included those related to patients' developmental concerns-namely, finding a new identity, financial burden of treatment, and fertility concerns after treatment. Conclusions: AYA cancer survivors continue to have a myriad of issues beyond the immediate treatment phase. Despite a complex list of challenges, these issues largely remained unaddressed by their oncology provider and left patients feeling overwhelmingly ill-prepared to manage their transition to survivorship. Implications for cancer survivors: AYA cancer survivors have many unaddressed concerns as they transition out of active cancer treatment, largely related to developmental issues they are facing. Survivorship care for these patients would benefit from care planning that takes these unique concerns into account.
Child & Adolescent Health	Green, C., Walkup, J. T., Bostwick, S., & Trochim, W.	2019	Advancing the agenda in pediatric mental health education.	Pediatrics	https://doi.org/10.1542/peds.2018-2596	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6856785/pdf/PEDS_20182596.pdf	Cornell University	There is an urgent need to advance mental health (MH) education and/or training in pediatric residency programs, yet no consensus on how to achieve this. We created an operational framework from ideas provided by a diverse group of stakeholders on how to advance MH education. METHODS: Concept-mapping methodology was used, which involves brainstorming ideas by completing a focus prompt, sorting ideas into groups, and rating them for importance and feasibility. Multidimensional scaling and hierarchical cluster analysis grouped ideas into clusters. Average importance and feasibility were calculated for each statement and cluster and compared statistically in each cluster and between subgroups. RESULTS: Ninety-nine ideas were generated. Sorted ideas yielded a 7-cluster concept map: (1) modalities for MH training, (2) prioritization of MH, (3) systems-based practice, (4) self-awareness and/or relationship building, (5) training in clinical assessment of patients, (6) training in treatment, and (7) diagnosis-specific skills. Two hundred and sixteen participants rated ideas for importance and 209 for feasibility. Four clusters had a statistically significant difference between their importance and feasibility ratings (P < .001). Suburban and rural area respondents (versus urban) rated clusters higher in importance and feasibility (P < .004), trainees rated all clusters higher in feasibility than practicing clinicians, and MH professionals rated prioritization of MH higher in feasibility (3.42 vs 2.98; P < .001). CONCLUSIONS: This comprehensive set of ideas, especially those rated highly in both importance and feasibility, should inform curricular and policy initiatives. Differences between importance and feasibility may explain why there has been little progress in this field.
Child & Adolescent Health	Cook, K. & Bergeron, K.	2019	Using group concept mapping to engage a hard-to-reach population in research: Young adults with life-limiting conditions.	International Journal of Qualitative Methods	https://doi.org/10.1177%2F1609406919891315	https://journals.sagepub.com/doi/pdf/10.1177/1609406919891315	Athabasca University	Patient engagement strategies are used in community-based participatory research. A successful strategy requires that patients, researchers, and health-care providers collaborate to create meaningful outcomes. Hard-to-reach patient populations such as those living with complex physical or psychosocial conditions, who are geographically dispersed, or who are disadvantaged financially or socially, experience judgment, stigmatization, and marginalization within society and in the research process. Therefore, strategies are needed to better engage hard-to-reach populations in research. One strategy to engage this population is group concept mapping (GCM). This article illustrates how GCM was utilized to engage a hard-to-reach population of young adults (YAs) with life-limiting conditions (LLC), parents of YAs with LLC, and health and health and community experts. Study participants were involved in generating, analyzing, and interpreting data. Five attributes of GCM are outlined, and suggestions are made for how other researchers could use GCM to engage their hard-to-reach patient populations.
Child & Adolescent Health	Crooks, C. V., Smith, A. C. G., Robinson-Link, N., Orenstein, S., & Hoover, S.	2020	Psychosocial interventions in schools with newcomers: A structured conceptualization of system, design, and individual needs.	Children and Youth Services Review	https://doi.org/10.1016/j.childyouth.2020.104894	https://www.csmh.uwo.ca/docs/Crooks-Smith-RobinsonLink-Orenstein-Hoover-2020.pdf	Western University	Canada has recently welcomed an influx of refugees, many of whom experienced significant trauma and adversity before coming to Canada or during migration. Thousands of newcomer children and youth are now in Canadian schools, and many continue to struggle with symptoms of distress and trauma. During the spring of 2018, a pilot was conducted in two large Ontario school districts to evaluate the feasibility of a new 10-week manualized intervention (Supporting Transition Resilience of Newcomer Groups [STRONG]) developed to promote resilience and reduce distress among young newcomers. In the current study, stakeholders involved in the pilot (i.e., mental health clinicians, mental health leaders, developers of the STRONG program, and the evaluation team) participated in an online Group Concept Mapping (GCM) activity to document the groups' collective wisdom about developing and implementing appropriate programming for newcomer children and youth. Twenty-three stakeholders generated a list of considerations related to designing, implementing, and facilitating programs to promote resilience among newcomer children and youth, producing a total of 71 statements. Eighteen stakeholders then sorted the list of statements into meaningful categories. Through multidimensional scaling and hierarchical cluster analysis we identified five clusters of important considerations: (1) engage family and community; (2) take a whole school approach; (3) attend to group composition and setting; (4) make material accessible and age-appropriate; and, (5) address unique clinical issues. Theoretically, these clusters highlight the importance of considering individual needs, system considerations, and design considerations. Attention to these concepts will specifically help inform future iterations of the STRONG intervention. More broadly, these results identify important factors to consider for addressing the needs of newcomer children and youth in school settings.
Child & Adolescent Health	Lee, S. & Chun, J. S.	2020	Conceptualizing the Impacts of Cyberbullying Victimization among Korean Male Adolescents.	Children and Youth Services Review	https://doi.org/10.1016/j.childyouth.2020.105275		Ewha Womans University	This study aimed to explore and conceptualize the impacts of cyberbullying victimization as perceived by 47 Korean male adolescents using a mixed-methods, concept mapping approach. Concept mapping revealed six major impacts of cyberbullying victimization among Korean male adolescents: internalized problems (M = 3.97), externalized problems (M = 3.51), school and peer problems (M = 3.92), online problems (M = 3.84), seeking social support (M = 4.17), and avoidance (M = 3.49). Based on the results, the conceptual framework presented herein can be utilized to plan and develop assessment and intervention approaches with male adolescents experiencing cyberbullying victimization.
Child & Adolescent Health	Halberg, S. E., Visek, A. J., Blake, E. F., Essel, K. D., Sacheck, J., & Sylvetsky, A. C.	2021	SODA MAPS: A Framework for Understanding Caffeinated Sugary Drink Consumption Among Children.	Frontiers in Nutrition	https://doi.org/10.3389/fnut.2021.640531	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7988216/pdf/fnut-08-640531.pdf	George Washington University	Excess sugary drink (SD) consumption is associated with childhood obesity and development of cardiometabolic disease. In addition to having high added sugar content, many SDs also contain caffeine, which may further encourage excess SD consumption among children. The objective of this study was to develop a conceptual framework of children's caffeinated SD consumption using group concept mapping, an applied social research multimethodology that collectively harnesses qualitative and quantitative data from participants to generate a visual representation of their ideas and input. Children, 8–14 years old, who reported consuming ≥12 ounces of caffeinated SDs (e.g., sodas, sweet teas) per day were recruited throughout Washington, D.C. and invited to participate. Concept mapping included three participant-driven activities: (1) brainstorming (n = 51), during which children reported reasons for their SD consumption, from which 58 unique reasons were identified; (2) sorting (n = 70), during which children sorted each of the reported reasons into categories and named each category; and (3) rating (n = 74), during which children rated the influence of each reason on their own caffeinated SD consumption. Similarity matrices, multidimensional scaling, and hierarchical cluster analysis were used to generate concept maps (hereafter “SODA MAPS”), which display the 58 reasons organized within eight overarching clusters. Among these eight clusters, Taste and Feel, Something to Do, and Energy were rated as particularly influential. Children's caffeinated SD consumption is encouraged not only by the palatable taste and reported preferences for these beverages (e.g., Taste and Feel), but also by psychological (e.g., Mood and Focus), biological (e.g., Energy), social (e.g., Something to Do) and environmental reasons (e.g., Nothing Better Available). Thus, the SODA MAPS can inform the development of tailored, multi-level SD reduction interventions that incorporate strategies to address important and currently overlooked reasons for caffeinated SD consumption among children.
Child & Adolescent Health	Jonsson, F., Christianson, M., Wiklund, M., Hurtig, A. K., & Goicolea, I.	2021	Collective imaginaries of caring landscapes for rural youth: a concept mapping study in northern Sweden	BMC Public Health	https://doi.org/10.1186/s12889-021-12223-4	https://bmcpublichealth.biomedcentral.com/counter/pdf/10.1186/s12889-021-12223-4.pdf	Umeå University	In the current study, the approach of ‘utopia as method’ was combined with the concept ‘landscapes of care’ to explore collective imaginaries of caring landscapes in relation to young people living in rural northern Sweden, while focusing specifically on what such landscapes should ideally look like, and how various strategies could help to realise the visions. Methods: The research was conducted using a modified concept mapping methodology comprising three phases of data collection and analysis. This facilitated the integration of tacit knowledge and utopian visions of young people, professionals and policymakers living and working in various parts of northern Sweden. Results: The results indicated that caring landscapes should: ‘provide services responsive to young people’s wishes and needs’, ‘be organised around values of safety, equity and youth participation’, and ‘rework metro-centredness’ in order to care for, with and about rural youth. Conclusions: The findings can be viewed as an imaginary reconstitution of communities in rural northern Sweden, but also as hypothetical building blocks to be used for developing caring landscapes and a ‘good countryside’ where young people have the possibility to live a good life in decent health. Northern Sweden, Rural, Youth, Landscapes of care, Utopia as method, Concept mapping
Child & Adolescent Health	Daniela, F. B., Shoshana, C., Lucia, B., Richard, K., Marlou, K. L. A., Zuzana, D. V.	2022	Desirable but not feasible: Measures and interventions to promote early childhood health and development in marginalized Roma communities in Slovakia		https://doi.org/10.3389/fpubh.2022.942550	https://www.frontiersin.org/articles/10.3389/fpubh.2022.942550/pdf	PJ Safarik University	Roma are the largest and most disadvantaged ethnic minority in Europe often facing generational poverty, and limited access to education, employment, housing, and various types of services. Despite many international and national initiatives, children from marginalized Roma communities face multiple risks and are being disadvantaged as early as from conception onward. We, therefore, aimed to identify measures and/or interventions targeting equity in early childhood health and development in marginalized Roma communities which implementation is considered to be urgent but not feasible. We used a group concept mapping approach—a participatory mixed research method—and involved 40 experts and professionals from research, policy and practice. From 90 measures and interventions proposed to achieve early childhood equity for children from marginalized Roma communities, 23 measures were identified as urgent but not feasible. These concerned particularly measures and interventions targeting living conditions (including access to income, access to housing, and basic infrastructure for families) and public resources for instrumental support (covering mainly topics related to financial and institutional frameworks). Our results reflect the most pressing issues in the area of equality, inclusion and participation of Roma and expose barriers to implementation which are likely to arise from public and political discourses perpetrating a negative image of Roma, constructing them as less deserving. Measures to overcome persistent prejudices against Roma need to be implemented along with the measures targeting equity in early childhood health and development.
Child & Adolescent Health	Hodgkinson, E.L.; McKenzie, A.; & Johnson, L.	2023	Evaluating the Impact of a Paediatric Burn Club for Children and Families Using Group Concept Mapping	European Burn Journal.	https://doi.org/10.3390/ebj4020019	https://www.mdpi.com/2673-1991/4/2/19/pdf?version=1683712779	NHS Foundation Trust	Access to burn camps and clubs is cited as an essential element for children following a burn injury. In the Northern Regional Burns Service, this takes the form of a club run by a multidisciplinary team, offering residential camps and family day trips. In this service evaluation, Group Concept Mapping was used to evaluate the perception of the club by staff, children and families. Opportunistic sampling was used to seek responses to the following prompts: “The challenges for children and families after a burn injury are…” and “The role of The Grafters Club is…”. The results indicate that participants perceived the club to be effective at addressing body image and confidence issues for the children but highlighted an unmet parental expectation that the club would also facilitate the sharing of experiences, normalisation of emotional reactions, and processing of guilt and other psychological distress for parents. When taken concurrently with pre-existing evidence in the literature base, it is proposed that a club model of psychosocial support for children and families could provide an accessible and informal opportunity for parental support that may be less subject to barriers perceived with traditional formal psychological support. burn care; burn camps; group concept mapping; burn rehabilitation
Child & Adolescent Health	Webber, S, Kloster, H, Shadman, KA, Kelly, M, Sklansky, D, Coller, RJ.	2023	Domains of professional fulfillment for pediatric hospital medicine: A concept mapping study.	J Hosp Med.	https://doi.org/10.1002/jhm.13119	https://shmpublications.onlinelibrary.wiley.com/doi/epdf/10.1002/jhm.13119	University of Wisconsin	Background: We know little about how pediatric hospital medicine (PHM) physicians conceptualize their professional fulfillment (PF). The objective of this study was to determine how PHM physicians conceptualize PF. Objective The objective of this study was to determine how PHM physicians conceptualize PF. Methods We performed a single-site group concept mapping (GCM) study to create a stakeholder-informed model of PHM PF. We followed established GCM steps. For brainstorming, PHM physicians responded to a prompt to generate ideas describing the concept of PHM PF. Next, PHM physicians sorted the ideas based on conceptual relatedness and ranked them on importance. Responses were analyzed to create point cluster maps where each idea represented one point, and point proximity illustrated how often ideas were sorted together. Using an iterative and consensus-driven approach, we selected a cluster map best representing the ideas. Mean rating scores for all the items in each cluster were calculated. Results Sixteen PHM physicians identified 90 unique ideas related to PHM PF. The final cluster map described nine domains for PHM PF: (1) work personal-fit, (2) people-centered climate, (3) divisional cohesion and collaboration, (4) supportive and growth-oriented environment, (5) feeling valued and respected, (6) confidence, contribution, and credibility, (7) meaningful teaching and mentoring, (8) meaningful clinical work, and (9) structures to facilitate effective patient care. The domains with the highest and lowest importance ratings were divisional cohesion and collaboration and meaningful teaching and mentoring. Conclusion Domains of PF for PHM physicians extend beyond existing PF models, particularly the importance of teaching and mentoring.
Child & Adolescent Health	S Napier-Raman, SZ Hossain, E Mpofu, MJ Lee…	2023	Sexual and reproductive health and rights decision-making among Australian migrant and refugee youth: a group concept mapping study	Culture, Health & Sexuality	https://doi.org/10.1080/13691058.2023.2275303	https://www.tandfonline.com/doi/epdf/10.1080/13691058.2023.2275303?needAccess=true	The University of Sydney	Sexual and reproductive health (SRH) is a human right. Young people, particularly from marginalised groups such as migrant and refugees, are vulnerable to compromised sexual and reproductive health and rights. In this study, we aimed to identify socioecological factors influencing migrant and refugee youth SRH decision-making and compare perspectives of youth with key stakeholders. Data were collected using Group Concept Mapping (GCM), a mixed-methods participatory approach. Participants included migrant and refugee young people, aged 16–26 from Western Sydney (n = 55), and key stakeholders comprising clinicians, service providers and researchers (n = 13). GCM involved participants brainstorming statements about how migrant and refugee youth make SRH decisions. Participants then sorted statements into groups based on similarity, and rated statements on importance and impact. Multidimensional scaling and hierarchical cluster analysis were used to cluster statements into concept maps that represented participants’ perspectives. The resulting maps comprised six clusters representing main concepts informing decision-making. The most important clusters were ‘healthy relationships’ and ‘safe-sex practices’. Youth rated healthy relationships more important than stakeholders did. This study reveals factors informing migrant and refugee youth’s decision-making. Future policy should go beyond biomedical constructions of SRH to incorporate emotional and relational factors, which young people consider to be equally important and beneficial to their agency.
Children & Youth Development	Smith, A. C. G. & Crooks, C. V.	2022	Youth-identified Considerations for Programming to Support Newcomers’ Healthy Development: A Group Concept Mapping Study	Child & Youth Care Forum	https://doi.org/10.1007/s10566-022-09695-9	https://link.springer.com/content/pdf/10.1007/s10566-022-09695-9.pdf	Western University	There is a well-documented need for more responsive promotion and prevention programming for young immigrants and refugees in the context of mental health and healthy development. Incorporating the voice of newcomers in the development of promotion and prevention efforts could assist in producing culturally-relevant materials and improve program outcomes. Objective: Our goal was to utilize youth voice to identify considerations for developing programming to support newcomer youths’ healthy development. Methods: We employed mixed methods and analyzed data using concept mapping. A total of 37 newcomers between the ages of 14 and 22 participated in focus groups to share their ideas for creating programming that would focus on relationships and well-being. Relevant responses were collated, cleaned, and generated into unique statements, and then sorted individually by 26 youth into thematically similar categories. We used multidimensional scaling and hierarchal cluster analysis to produce a concept map. Results: Six concepts, in rank order of importance, emerged as follows: create a space for sharing; discuss relational issues; teach strategies for adjusting to a new country; teach wellness skills; have feel-good activities; and plan for diversity. Conclusions: Participants’ lived experience and their own attendance in programming at newcomer organizations assisted them in brainstorming what types of activities, topics, and skills would be helpful for other newcomer youth, as well as considerations for facilitators implementing such programming. Promotion and prevention efforts intended for newcomer youth may benefit by incorporating ideas from the concept map.
Children & Youth Development	Johnson, T.	2012	Mapping the critical service needs of adolescent children of prisoners.	Social Work in Public Health	https://doi.org/10.1080/19371918.2012.629905		University of Kansas	This study explores the service needs of adolescent children of prisoners by collecting information directly from the youth. The conceptual and empirical literature focused on children of prisoners generally attempts to describe or understand the effects of parental incarceration on prisoners' offspring but frequently fails to include data gathered directly from youth or include their voices in the litany of suggested programs and services. This study employed concept mapping technology to investigate the service needs of 14 adolescent children of prisoners living in an urban city in the Midwest. The findings revealed perceptions of unmet physical, emotional, psychological, and social needs divided into six thematic clusters. The findings also suggest that a single-service focus such as mentoring or tutoring may fail to meet the multiple and varied needs that these youth identified, especially those related to basic care such as food and clothing. Participants were asked to rate the themes on importance, and data suggest a high level of consistency between young women and young men. Strength-based solutions were then identified from the data to meet the needs of these youth.
Children & Youth Development	Noyes-Grosser, D. M., Rosas, S. R., Goldman, A., Elbaum, B., Romanczyk, R., & Callahan, E. H.	2013	Conceptualizing child and family outcomes of early intervention services for children with ASD and their families.	Journal of Early Intervention	https://doi.org/10.1177/1053815114551415	https://www.researchgate.net/profile/Raymond-Romanczyk/publication/273708724_Conceptualizing_Child_and_Family_Outcomes_of_Early_Intervention_Services_for_Children_With_ASD_and_Their_Families/links/567ac4aa08ae1e63f1df67be/Conceptualizing-Child-and-Family-Outcomes-of-Early-Intervention-Services-for-Children-With-ASD-and-Their-Families.pdf?origin=publication_detail	New York State Department of Health	State early intervention programs (EIPs) have been encouraged to develop and implement comprehensive outcomes measurement systems. As the number of children with autism spectrum disorders (ASD) and their families receiving services in state EIPs increases, disability-specific outcomes data are needed to better understand issues of access, costs, and benefits. The New York State Early Intervention Program (NYSEIP) used concept mapping with parent and professional stakeholders to define child and family outcomes expected from early intervention services for children with ASD and their families. Stakeholders generated more than 700 statements (synthesized to 105), then individually sorted (17 parents, 39 professionals) these statements into categories. Stakeholders rated each outcome on importance (20 parents, 48 professionals) and likelihood (18 parents, 46 professionals) that EIP services will yield a positive impact. The aggregated sort data were subjected to two separate sets of multivariate statistical analyses, producing an 11-cluster map of professionals' conceptualization and a 7-cluster map of parent/family members' conceptualization of the outcomes. Possible explanations for the parent/professional differences are discussed. The results will be used as part of ongoing efforts to develop a comprehensive evaluation system for state Part C EIPs that is grounded in stakeholders' perspectives on expected outcomes for children and families.
Children & Youth Development	Miller, J.J. & Collins-Camargo, C.	2015	Success on their own terms: Youths' perspectives on successful foster care.	Journal of Public Child Welfare	https://doi.org/10.1080/15548732.2015.1089813		University of Kentucky	Foster care is an integral component of the child welfare system. However, little is known about factors germane to conceptualizing successful foster care. This study utilized Concept Mapping (CM) to delineate a conceptual domain for what success in foster care means from the perspective of those most impacted: foster youth. CM couples multi-dimensional scaling with hierarchical cluster analyses to form factors relevant to an area of study. Pictorial representations of the data were generated using The Concept System® Global MAX™ software. Results indicate that youth conceptualize success based on several distinct domains. The final analyses yielded a multi-cluster solution, or Concept Map.
Children & Youth Development	Miller, J.J. & Jones, B.	2015	Using concept mapping as a planning tool: Child welfare citizen review panels.	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2015.08.001		University of Kentucky	Citizen Review Panels (CRPs) are groups of citizen volunteers authorized by U.S. federal law to examine state child welfare agencies. These groups inspect policies and practices related to child protection responsibilities and are tasked with making recommendations for systemic improvement. Despite the federal mandate for each state to develop a CRP and the potential of these groups to positively impact child welfare practices, there is a dearth in the literature related to CRPs. Consequently, planning and evaluation processes of these groups vary widely. This study reports on the use of concept mapping (CM) to outline a framework for planning and subsequently evaluating the CRP in one southeastern state. CM is a mixed-method research approach that uses multi-dimensional scaling and hierarchical cluster analyses to explore an area of study. Through these analyses, the method creates visual depictions of conceptual relationships between ideas. Data yielded a seven cluster concept map that CRP members (N = 36) utilized for planning processes, and subsequently for developing an internal evaluation tool. Results from this study offer a unifying framework by which CRPs, and similar groups in other areas can utilize for planning and evaluation purposes. After a review of pertinent literature on CRPs, this article explicates CM processes utilized in this study, describes results, discusses lessons learned, and outlines apposite areas for future CRP research.
Children & Youth Development	Minh, A., Patel, S., Bruce-Barrett, C., & O'Campo, P.	2015	Letting youths choose for themselves: Concept mapping as a participatory approach for program and service planning.	Family & Community Health	https://doi.org/10.1097/FCH.0000000000000060		University of British Columbia	Ensuring that the voices of youths are heard is key in creating services that align with the needs and goals of youths. Concept mapping, a participatory mixed-methods approach, was used to engage youths, families, and service providers in an assessment of service gaps facing youth in an underserviced neighborhood in Toronto, Canada. We describe 6 phases of concept mapping: preparation, brainstorming, sorting and rating, analysis, interpretation, and utilization. Results demonstrate that youths and service providers vary in their conceptualizations of youth service needs and priorities. Implications for service planning and for youth engagement in research are discussed.
Children & Youth Development	Visek, A. J., Achrati, S. M., Mannix, H., McDonnell, K., Harris, B. S., & Dipietro, L.	2015	The fun integration theory: Towards sustaining children and adolescents sport participation.	Journal of Physical Activity and Health	https://doi.org/10.1123/jpah.2013-0180	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4201634/pdf/nihms621228.pdf	George Washington University	Background: Children cite ‘fun’ as the primary reason for participation in organized sport and its absence as the number one reason for youth sport attrition. Therefore, the purpose of this study was to develop a theoretical framework of fun using a novel mixed-method assessment of participants in sport (FUN MAPS) via concept mapping. Methods: Youth soccer players (n = 142), coaches (n = 37), and parents (n = 57) were stratified by age, sex, and competition level and contributed their “fun” ideas through: (a) qualitative brainstorming, identifying all of the things that make playing sports fun for players; (b) sorting of ideas; and (c) rating each idea on its importance, frequency, and feasibility. Results: The FUN MAPS identify the four fundamental tenets of fun in youth sport within 11 fun-dimensions composed of 81 specific fun-determinants, while also establishing the youth sport ethos. Conclusion: The FUN MAPS provide pictorial evidence-based blueprints for the fun integration theory (FIT), which is a multi-theoretical, multidimensional, and stakeholder derived framework that can be used to maximize fun for children and adolescents in order to promote and sustain an active and healthy lifestyle through sport.
Children & Youth Development	Miller, J. J., Chih, M. Y., & Washington, E.	2016	Conceptualizing a mobile app for foster youth transitioning to adulthood: A mixed-method approach.	Journal of Technology in Human Services	https://doi.org/10.1080/15228835.2015.1108260		University of Kentucky	Despite the promise of mobile smartphone applications (apps) in addressing challenges faced by foster youth transitioning to adulthood, the literature is devoid of conceptual frameworks for the development of these apps. This article documents the process of using Concept Mapping to delineate a conceptual framework germane to developing an app to assist youth transitioning from foster care to adulthood, and explore differences in development priority areas among participants. Participant data was collected via qualitative brainstorming sessions, and analyzed using multidimensional scaling and hierarchical cluster analysis. This article explicates findings from this study, discusses implications, and identifies apposite areas for future research.
Children & Youth Development	Burgos, M., Al-Adeimi, M., & Brown, J.	2016	Protective factors of family life for immigrant youth.	Child and Adolescent Social Work Journal	https://doi.org/10.1007/s10560-016-0462-4		University of Alberta	The purpose of the study was to identify the positive aspects and strengths experienced by newcomer youth within their home environments. Youth between the ages of 15 and 18 years old who immigrated within the previous 2 years and were living in a medium-sized Canadian city were interviewed. Group interviews were conducted with participants at a local community centre. Analysis of the data was completed using concept mapping (Trochim, 1989) which included multidimensional scaling and cluster analysis. Similar to the literature, results indicated that newcomer youth felt secure and experienced positive familial connections. Youth viewed their families as a source of support, while also acknowledging their need for autonomy. Differences between study results and the literature were found in relation to family rules and integration with Canadian culture. Implications of the findings are discussed within a counseling framework for mental health practitioners to better understand the protective resources of resilience available to newcomer youth. Keywords: Youth, Family, Immigration, Protective factors
Children & Youth Development	Goldman, A. W., Mulford, C. & Blachman-Demner, D.	2016	Advancing our approach to teen dating violence: A youth and professional defined framework of teen dating relationships.	Psychology of Violence	https://doi.org/10.1037/a0039849		Cornell University	Objective: Little research has considered how well assumptions about teen dating relationships that guide teen dating violence (TDV) work actually align with youth perspective and experience. This study aimed to better understand areas of convergence and divergence in how youth and adult professionals conceptualize and define teen dating relationships to more fully inform TDV research, programming, and policy. Method: Group Concept Mapping, an inductive, participatory approach-was used to capture, compare, and visually represent perspectives of teen dating relationships across samples of teens ages 14 to 18 (N = 147), young adults ages 19 to 22 (N = 81), and adult professionals (N = 76). Researchers conducted subsequent facilitated discussions with these 3 groups. Results: A single concept map coauthored by youth and professionals described teen dating relationships using 100 ideas, 9 higher-order constructs, and 2 conceptual dimensions. Across groups, substantial agreement emerged on the characteristics of teen dating and their interrelationships. Participants conceptualized dating relationships as multidimensional, consisting of a range of behaviors, emotions, and cognitions that vary in their frequency and desirability. Relationships were also characterized by temporally oriented phases that can shape teens' perceptions of their dating experiences. Conclusion: The findings suggest that professionals are studying TDV and developing related programming from a conceptual basis that comports with youth dating experience. Nevertheless, the complexity of teen dating presents a need for researchers and practitioners to expand their focus to more effectively address the social and behavioral processes through which TDV unfolds. Efforts should more holistically consider relevant aspects of dating relationships, including the confluence of healthy and unhealthy characteristics with emotional, cognitive, and behavioral components. (PsycINFO Database Record
Children & Youth Development	Miller, J. J., Benner, K., Pope, N., Dumas, T., Damron, L. J., Segress, M., Slone, M., Thrasher, S., & Niu, C.	2017	Conceptualizing effective foster parent mentor programs: A participatory planning process.	Children and Youth Services Review	https://doi.org/10.1016/j.childyouth.2017.01.004		University of Kentucky	Mentor programs have been recognized as an integral tool in the child welfare services array. However, there are few conceptual frameworks for planning and developing mentor programs for a key constituency group: foster parents. This study employed Concept Mapping (CM) with a convenience sample of 59 foster parents in one southeastern state. CM is a participatory, mixed-method research approach that utilizes non-metric multidimensional scaling and hierarchical cluster analyses to analyze qualitative data. As a result, pictorial representations of the data are generated. Results yielded seven (7) distinct clusters: Ongoing Supports, Matching Practices, and Program Evaluation, among others. Participants viewed the Recruitment cluster as most pertinent and most important for mentor programs. Contrariwise, Program Evaluation and Matching clusters were viewed as least feasible and least important, respectively. After a review of pertinent literature, this paper explicates CM methodology as applied to the current study, reports results, and discusses lessons learned as they apply to child welfare research and practice.
Children & Youth Development	Miller, J. J., Benner, K., Kheibari, A., & Washington, E.	2017	Conceptualizing on-campus support programs for collegiate foster youth and alumni: A plan for action.	Children and Youth Services Review	https://doi.org/10.1016/j.childyouth.2017.10.028		University of Kentucky	Increasingly, post-secondary education institutions are implementing supplemental support programs to assist foster youth and alumni (i.e., those formerly in foster care) matriculating into higher education. Despite the promise of these academic support programs in helping young people achieve their educational goals, the empirical educational research literature related to these support programs is nominal. This study employed Concept Mapping (CM) with a convenience sample of 51 foster youth/alumni in one southeastern state to explicate a conceptual framework for the development of campus supports for collegiate foster youth/alumni, and examine priority areas (e.g., importance and feasibility). CM is a mixed-method research approach that employs non-metric multidimensional scaling and hierarchical cluster analyses to analyze qualitative data. As a result, visual representations of the data are computed. The final cluster map yielded an eight cluster solution: Campus Awareness, Advocacy, Data Tracking, Pre-College Supports, Fostering Family Connections, Academic Financing, Campus Life, and Peer/Mentor Supports. Foster youth/alumni in this study perceived the Pre-College Supports cluster as most feasible, while the Advocacy cluster was rated at the least feasible. The Academic Financing cluster was rated as the most important; the Campus Life cluster was rated as the least important. After a review of pertinent literature, this paper explicates CM methodology as applied to the current study, reports results, and discusses lessons learned as they apply to child welfare research and practice.
Children & Youth Development	Miller, J. J. & Dioh-Donohue, J.	2017	Mapping the needs of kinship providers: A mixed-method examination.	Grandfamilies: The Contemporary Journal of Research, Practice and Policy		https://scholarworks.wmich.edu/cgi/viewcontent.cgi?article=1044&context=grandfamilies	University of Kentucky	This study utilized Concept Mapping (CM) to examine the needs of 105 kinship caregivers in one southeastern state, and to examine priority differences in conceptualization by placement type (formal vs. informal). CM is a mixed-method research methodology that employs multidimensional scaling and hierarchical cluster analyses to examine relationships among sets of data. Results indicate that kinship providers conceptualize needs via an eight-cluster solution, or concept map. As well, data suggest key priority differences between informal and formal caregivers in areas of financial, legal, and public outreach needs. After a brief review of literature about kinship care, this paper will explain results from the study, discuss findings in relation to previous works about kinship, and explicate practice, policy, education, and research implications derived from study findings.
Children & Youth Development	Miller, J. J., Benner, K., Thrasher, S., Pope, N., Dumas, T., Damron, L. J., Segress, M., & Niu, C.	2017	Planning a mentorship initiative for foster parents: Does gender matter?	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2017.05.009		University of Kentucky	Despite the use of mentoring programs in fields such as business, career training, and youth development, little is known about how mentoring can be used to train and support new foster parents. This paper describes how Concept Mapping was used with current foster parents to develop a conceptual framework suitable to plan a foster parent mentor program. A secondary aim of this study was to explore priority differences in the conceptualization by self-reported gender (foster mothers vs. foster fathers). Participant data was collected via three qualitative brainstorming sessions, and analyzed using non-metric multidimensional scaling and hierarchical cluster analysis. Findings indicate that foster parents participating in this study conceptualized effective mentor programs via a seven cluster solution. Study results also showed no significant differences in cluster ratings by gender. Implications for practice and program planning are identified, as well as areas for future research.
Children & Youth Development	O'Connor, T. M., Masse, L.C., Tu, A. W., Watts, A. W., Hughes, S. O., Beaucramp, M. R., Baranowski, T., Pham, T., Berge, J. M., Fiese, B., Golley, R. K., Hingle, M., Kremers, S. P. J., Rhee, K. E., Skouteris, J. H., & Vaughn, A.	2017	Food parenting practices for 5 to 12 year old children: A concept map analysis of parenting and nutrition experts input.	International Journal of Behavioral Nutrition and Physical Activity	https://doi.org/10.1186/s12966-017-0572-1	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5594481/pdf/12966_2017_Article_572.pdf	Baylor College of Medicine	Background: Parents are an important influence on children's dietary intake and eating behaviors. However, the lack of a conceptual framework and inconsistent assessment of food parenting practices limits our understanding of which food parenting practices are most influential on children. The aim of this study was to develop a food parenting practice conceptual framework using systematic approaches of literature reviews and expert input. Method: A previously completed systematic review of food parenting practice instruments and a qualitative study of parents informed the development of a food parenting practice item bank consisting of 3632 food parenting practice items. The original item bank was further reduced to 110 key food parenting concepts using binning and winnowing techniques. A panel of 32 experts in parenting and nutrition were invited to sort the food parenting practice concepts into categories that reflected their perceptions of a food parenting practice conceptual framework. Multi-dimensional scaling produced a point map of the sorted concepts and hierarchical cluster analysis identified potential solutions. Subjective modifications were used to identify two potential solutions, with additional feedback from the expert panel requested. Results: The experts came from 8 countries and 25 participated in the sorting and 23 provided additional feedback. A parsimonious and a comprehensive concept map were developed based on the clustering of the food parenting practice constructs. The parsimonious concept map contained 7 constructs, while the comprehensive concept map contained 17 constructs and was informed by a previously published content map for food parenting practices. Most of the experts (52%) preferred the comprehensive concept map, while 35% preferred to present both solutions. Conclusion: The comprehensive food parenting practice conceptual map will provide the basis for developing a calibrated Item Response Modeling (IRM) item bank that can be used with computerized adaptive testing. Such an item bank will allow for more consistency in measuring food parenting practices across studies to better assess the impact of food parenting practices on child outcomes and the effect of interventions that target parents as agents of change. Keywords: Child; Concept mapping; Family; Food; Measurement; Nutrition; Parenting; Parenting practices.
Children & Youth Development	Dare, L. & Nowicki, E.	2018	Beliefs about educational acceleration: Students in inclusive classes conceptualize benefits, feelings, and barriers.	The Journal of Educational Research	https://doi.org/10.1080/00220671.2018.1440368		University of Western Ontario	For high-ability students to develop their full potential, they require evidence-based interventions tailored to their exceptional needs. Educational acceleration has proven effective with many high-ability students, but educators sometimes express concerns about social issues, and such concerns may block access to accelerative interventions. Despite these concerns, little is known about students' thoughts on placing high-ability students with older classmates. In this study, we used group concept mapping methodology to investigate students' beliefs about grade-based acceleration. Sixth-, seventh-, and eighth-grade students in inclusive classes generated ideas about acceleration, and then sorted and rated a synthesized list of factors to consider when deciding about acceleration. Using multidimensional scaling and hierarchical cluster analysis, the authors identified five key concepts in the structured data: (a) better for the fast learner, (b) concerns of moving up, (c) benefits for others (d) potential barriers to acceptance, and (e) uncomfortable feelings. Practical implications are discussed.
Children & Youth Development	Miller, J. J., Duron, J. F., Donohue-Dioh, J., & Geiger, J. M.	2018	Conceptualizing effective legal representation for Foster youth: A group concept mapping study.	Children & Youth Services Review	https://doi.org/10.1016/j.childyouth.2018.06.031		University of Kentucky	Whilst there is broad consensus that foster youth embroiled in dependency court proceedings related to child maltreatment are entitled to effective representation, few studies have examined this phenomenon. This study used Group Concept Mapping (GCM) with a sample of 31 foster youth and alumni to explicate a conceptual framework for effective legal representation. GCM is an integrated, mixed-method research approach that utilizes non-metric multidimensional scaling and hierarchical cluster analyses to analyze qualitative data. As a result, pictorial illustration of the data are generated. Results indicate that youth conceptualized effective legal representation via six unique clusters: Legal Skills, Foster Care Knowledge, Youth/Attorney Relationship, Attitude About Foster Care, Contact, and Communication. Additionally, participants viewed the Communication cluster as most important and feasible, when compared to other clusters in the final solution. Conversely, statements in the Legal Skills cluster were rated the least important and the Foster Care Knowledge was rated least feasible. Data indicates the need for a more wholistic approach to viewing effective legal representation. Findings suggest explicit attention to training about legal approaches and youth/alumni engagement. As well, data provide foundational aspects on which to build future research in this area.
Children & Youth Development	Burgos, M., Al-Adeimi, M., & Brown, J.	2018	Needs of newcomer youth.	Child and Adolescent Social Work Journal	https://doi.org/10.1007/s10560-018-0571-3		University of Alberta	The journey following migration for adolescent youth can consist of psychosocial and sociocultural difficulties with acculturating and integrating into the new host society. The family unit, however, has been identified to be a source of strength and wellbeing for youth during the integration process. This study explores factors that are suggested to make the home environment more supportive after migration. Newcomer youth between 15 and 18 years of age within a medium-sized Canadian city, living in Canada for no more than 2 years were interviewed in a group setting. Mixed methods were utilized and collected data was analyzed using concept mapping. Participants stated wanting more positive feedback from and increased communication with parents, in addition to having a home that is more open and welcoming to friends. The needs of youth can be sourced in the effects of the migrant journey and acculturation process. By improving the degrees of understanding, warmth, communication and cultural integration in the home, youth and their families can develop a greater sense of cohesion which can assist with supporting their migrant experience. Implications for practitioners working with newcomer youth and their families are provided, in addition to research and policy-related implications.
Children & Youth Development	Visek, A. J., Mannix, H., Chandran, A., Cleary, S. D., McDonnell, K., & DiPietro, L.	2018	Perceived importance of the fun integration theory’s factors and determinants: A comparison among players, parents, and coaches.	International Journal of Sports Science & Coaching	https://doi.org/10.1177/1747954118798057	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6779170/pdf/nihms-1024511.pdf	George Washington University	Conceptualized by youth soccer players, parents, and coaches, the fun integration theory’s FUN MAPS identify 11 fun-factors and 81 fun-determinants. The purpose of this study was to conduct a secondary analysis of those data to explore the extent to which the parents (responsible for supporting) and the coaches (tasked with delivering soccer programs) perceived importance of the factors and determinants were congruent with the players’ self-reported importance. We produced pattern-match displays and go-zone displays, which are innovative, visual representations of group comparisons that are unique to concept-mapping methods, to determine the overall consensus between the groups, in addition to identifying exact points of agreement and disagreement. Results indicated congruence between parents and players was extraordinarily high (r = 0.89–0.93) and significantly more congruent than coaches and players (r = 0.75–0.84). Results also indicated consensus was significantly lower among adolescent players and coaches (r = 0.66–0.71) compared to younger players and coaches (r = 0.77–0.90). Disparities in the perceived importance of specific fun-factors and fun-determinants between groups are discussed. In addition, transformative learning theory is introduced as an immersive approach to developing fun schemas consistent with the youth athletes’ fun ethos that will enable coaches to be athlete-centric when creating fun, positive sport experiences for youth.
Children & Youth Development	Brown, J., Kapasi, A., Nowicki, E., & Cleversey, K.	2019	Expectations of youth with a fetal alcohol spectrum disorder in adulthood: Caregiver perspectives.	Journal on Developmental Disabilities		https://canfasd.ca/wp-content/uploads/publications/41028-JoDD-24-2-v11f-30-42-Brown-et-al.pdf	University of Western Ontario	There are limited data about adults who have fetal alcohol spectrum disorders (FASD). Caregivers of youth with FASD (N = 16) participated in telephone interviews that included the open-ended question, “What kind of adult life do you think they will have?” A total of 57 unique responses were made to the question. These responses were grouped together independ-ently by participants. Grouping data were analyzed using multidimensional scaling and cluster analysis. It is noteworthy that as well as highlighting concerns, participants also high- lighted youths’ assets and hope for them as adults. Caregivers’ concerns about the future needs of their youth mirrors the literature on needs and expectations of adults with FASD. This consistency reinforces the lack of research attention to adults’ needs from caregiver perspectives. Participants also revealeddeep concerns about their youth’s futures. Despite being committed to caregiving, caregivers indicated that they will not be able to do it well enough or long enough to keep their adult children from having serious problems.
Children & Youth Development	Dipeolu, A., Cook-Cottone, C., Lee, G. K., Donnelly, J. P., Janikowski, T. P., Reynolds, A. L., Boling, T.	2019	A concept map of campers' perceptions of camp experience: Implications for the practice of family counseling.	The Family Journal	https://doi.org/10.1177/1066480716628566		University at Buffalo	Camp programs are a popular medium for providing children and adolescents with opportunities for growth and development. Specialized camps may provide powerful contextual support for campers with disabilities and families with limited resources, but knowledge of what constitutes an effective camp experience is limited. Further, family counseling practice principles seem relevant to camp programming, but research is absent in this area. Present study applied concept mapping to capture the quantitative and qualitative dimensions of 173 campers’ experiences to examine its implications for the practice of family counseling. Seven thematic concepts emerged consistent with previous research confirming the positive and transformative nature of camp. The current study advances the knowledge base of camp programming for family counselors and helps improve future family counseling practice and research.
Children & Youth Development	Crooks, C. V., Smith, A. C. G., Robinson-Link, N., Orenstein, S., & Hoover, S.	2020	Psychosocial interventions in schools with newcomers: A structured conceptualization of system, design, and individual needs.	Children and Youth Services Review	https://doi.org/10.1016/j.childyouth.2020.104894	https://www.csmh.uwo.ca/docs/Crooks-Smith-RobinsonLink-Orenstein-Hoover-2020.pdf	Western University	Canada has recently welcomed an influx of refugees, many of whom experienced significant trauma and adversity before coming to Canada or during migration. Thousands of newcomer children and youth are now in Canadian schools, and many continue to struggle with symptoms of distress and trauma. During the spring of 2018, a pilot was conducted in two large Ontario school districts to evaluate the feasibility of a new 10-week manualized intervention (Supporting Transition Resilience of Newcomer Groups [STRONG]) developed to promote resilience and reduce distress among young newcomers. In the current study, stakeholders involved in the pilot (i.e., mental health clinicians, mental health leaders, developers of the STRONG program, and the evaluation team) participated in an online Group Concept Mapping (GCM) activity to document the groups' collective wisdom about developing and implementing appropriate programming for newcomer children and youth. Twenty-three stakeholders generated a list of considerations related to designing, implementing, and facilitating programs to promote resilience among newcomer children and youth, producing a total of 71 statements. Eighteen stakeholders then sorted the list of statements into meaningful categories. Through multidimensional scaling and hierarchical cluster analysis we identified five clusters of important considerations: (1) engage family and community; (2) take a whole school approach; (3) attend to group composition and setting; (4) make material accessible and age-appropriate; and, (5) address unique clinical issues. Theoretically, these clusters highlight the importance of considering individual needs, system considerations, and design considerations. Attention to these concepts will specifically help inform future iterations of the STRONG intervention. More broadly, these results identify important factors to consider for addressing the needs of newcomer children and youth in school settings.
Children & Youth Development	Valenti, M., & Celedonia, K., L.	2020	Trust is Essential: Identifying Trust Building Techniques from Youth Providers across the Service Array.	Children and Youth Services Review	https://doi.org/10.1016/j.childyouth.2020.105295		Pressley Ridge	Past research has identified that a sense of mutual trust between providers and youths may be the most significant component of a strong working relationship. Service providers who successfully develop trust with youths they serve may achieve more desirable outcomes than providers who are unable to create a trusting relationship. This study used Group Concept Mapping to solicit the techniques and skills real providers use to build trust with youth across a diverse service array. Providers then rated each technique on importance for building trust, as well as their direct experience with the technique in practice. Results identified five overarching categories of trust building mechanisms service providers use across the child welfare spectrum. These findings can help provider organizations to focus training and supervisory efforts to help staff to build and maintain trusting relationships with youth.
Children & Youth Development	van Bon-Martens, van der Maas, A., Sekreve, A., Hautvast, S., Klaassen, E., Kennis, M., van Kempen, M., Wijsbroek, S., & Branje, S.	2020	Opgaven voor de Utrechtse jeugd: Resultaten van een concept mapping procedure.	Utrecht University Repository		https://dspace.library.uu.nl/bitstream/handle/1874/392124/Opgaven_voor_de_Utrechtse_jeugd.pdf?sequence=1&isAllowed=y	Netherlands Institute of Mental Health and Addiction	Voor het opstellen van een gezamenlijke strategische agenda voor de Utrechtse jeugd is de methode van group concept mapping gebruikt. Dit is een beslissingsondersteunende methode voor planning en evaluatie bij samenwerkingsprojecten rondom een complex onderwerp. De methode van group concept mapping verloopt gestructureerd in zes vaste stappen: 1) bepalen brainstormfocus en deelnemers, 2) genereren opvattingen, 3) structureren opvattingen, 4) grafische representatie, 5) interpretatie, en 6) implementatie. De concept map geeft een overzicht van de thema’s, opgaven en kansen in hun onderlinge samenhang voor de zorg voor jeugd in Utrecht als het gaat om gezond, veilig en kansrijk opgroeien en opvoeden. Daarmee biedt de methode een basis om met elkaar tot een herijking van de huidige strategische agenda van de AWTJ Utrecht te komen.
Children & Youth Development	Visek, A. J., Mannix, H., Chandran, A., Cleary, S. D., McDonnell, K. A., & DiPietro, L.	2020	Toward Understanding Youth Athletes' Fun Priorities: An Investigation of Sex, Age and Levels of Play.	Women in Sport and Physical Activity Journal	http://dx.doi.org/10.1123/wspaj.2018-0004		George Washington University	Colloquial conjecture asserts perceptions of difference in what is more or less important to youth athletes based on binary categorization, such as sex (girls vs. boys), age (younger vs. older), and level of competitive play (recreational vs. travel). The fun integration theory’s FUN MAPS, which identify 11 fun-factors comprised of 81 fun-determinants, offers a robust framework from which to test these conceptions related to fun. Therefore, the purposes of this study were to scientifically explore: (a) the extent to which soccer players’ prioritization of the 11 fun-factors and 81 fun-determinants were consistent with the gender differences hypothesis or the gender similarities hypothesis, and (b) how their fun priorities evolved as a function of their age and level of play. Players’ ( n = 141) data were selected from the larger database that originally informed the conceptualization of the fun integration theory’s FUN MAPS. Following selection, innovative pattern match displays and go-zone displays were produced to identify discrete points of consensus and discordance between groups. Regardless of sex, age, or level of play, results indicated extraordinarily high consensus among the players’ reported importance of the fun-factors ( r = .90–.97) and fun-determinants ( r = .92–.93), which were consistently grouped within strata of primary, secondary, and tertiary importance. Overall, results were consistent with the gender similarities hypothesis, thereby providing the first data to dispel common conceptions about what is most fun with respect to sex, in addition to age and level of play, in a sample of youth soccer players.
Children & Youth Development	Washington-Nortey, P. M., & Serpell, Z.	2021	Parental expectations for children with intellectual disability or autism in Ghana and Zambia: A concept mapping study.	Research in Developmental Disabilities	https://doi.org/10.1016/j.ridd.2021.103989		Virginia Commonwealth University	Parent expectations have an important impact on children's outcomes. Despite a wealth of research on the familial experience of children with disabilities in African countries, very few studies have examined expectations these children's parents hold for them. Aims: This study explores parental expectations for children with intellectual disability, or autism and assesses their perceived importance and likelihood of attainment. Methods and procedures: Concept mapping methodology with focus groups comprised of parents of children with intellectual disability or autism were employed. Outcomes and results: Results revealed several expectation themes: independence, acceptance and inclusion, public awareness, education, governmental assistance, resources, and healthcare. Whereas some expectations were congruent with themes in the broader literature, nuances within themes reflected cultural and societal conditions. Themes unique to each country also emerged, and importance and likelihood ratings revealed some cultural variation across the two countries. Expectations and the value placed on them differ across countries. Implications: This study represents an important first step in efforts to understand the developmental contexts of children with disabilities on the African continent. Findings inform future research and potential strategies for policy and practice.
Children & Youth Development	Chun, J., Lee, S. & Kim, J.	2021	Conceptualizing the Protective Factors of Cyberbullying Victimization in Korean Adolescents.	School Mental Health	https://doi.org/10.1007/s12310-021-09422-0	https://link.springer.com/content/pdf/10.1007/s12310-021-09422-0.pdf	Ewha Womans University	This study conceptualized the protective factors for cyberbullying victimization as perceived by 43 Korean adolescents and explored gender differences in such conceptualizations using concept mapping method, a mixed-methods approach. Concept mapping revealed six major protective factors against cyberbullying victimization: ‘supportive relationships’ (M = 3.75, SD = 0.39), ‘school’s interest in cyberbullying’ (M = 3.58, SD = 0.11), ‘personal traits’ (M = 3.57, SD = 0.22), ‘reporting and monitoring system’ (M = 3.51, SD = 0.36), ‘education and help-seeking’ (M = 3.38, SD = 0.31), and ‘personal traits in online behavior’ (M = 3.30, SD = 0.60). Overall, the ‘supportive relationships’ cluster received the highest ratings from both male and female participants. Moreover, pattern matching by gender revealed lack of agreement (r = 0.54). In particular, male participants gave higher ratings to the ‘personal traits’ cluster, whereas female participants perceived ‘education and help-seeking’ to be a more important cluster than their counterparts. These results suggest that school-based intervention strategies can be used to improve supportive relationships, personal traits, netiquette, and awareness of online behaviors. At the institutional level, an automatic reporting and monitoring system and more school-linked cyberbullying laws could be implemented.
Children & Youth Development	Chovan, S., Filakovska Bobakova, D., Bosakova, L. et al.	2022	How to make healthy early childhood development more likely in marginalized Roma communities: a concept mapping approach.	International journal for equity in health	https://doi.org/10.1186/s12939-022-01637-0	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8962123/pdf/12939_2022_Article_1637.pdf	PJ Safarik University	This study aims to assess which measures could improve the healthy early childhood development of children from marginalized Roma communities and to identify priority measures. Methods: Concept mapping approach was used, using mixed methods. In total 54 professionals, including social workers, educators, health care providers, municipality representatives, and project managers participated in our study. Results: Four distinct clusters of measures targeting living conditions, public resources, healthcare and community interventions, and 27 individual priority measures of highest urgency and feasibility were identified. The cluster 'Targeting living conditions', was rated as the most urgent but least feasible, whereas the cluster 'Targeting health care', was considered least urgent but most feasible. Among the 27 priority measures, 'Planning parenthood' and 'Scaling up existing projects' had the highest priority. Conclusion: Our results reflect the public and political discourse and indicate significant barriers to implementation. Reducing inequalities in early childhood needs to be addressed through coordinated efforts. Keywords: Early childhood development; Inequalities; Marginalized Roma communities.
Children & Youth Development	Smith, A. C. G. & Crooks, C. V.	2022	Youth-identified Considerations for Programming to Support Newcomers’ Healthy Development: A Group Concept Mapping Study	Child & Youth Care Forum	https://doi.org/10.1007/s10566-022-09695-9	https://link.springer.com/content/pdf/10.1007/s10566-022-09695-9.pdf	Western University	There is a well-documented need for more responsive promotion and prevention programming for young immigrants and refugees in the context of mental health and healthy development. Incorporating the voice of newcomers in the development of promotion and prevention efforts could assist in producing culturally-relevant materials and improve program outcomes. Objective: Our goal was to utilize youth voice to identify considerations for developing programming to support newcomer youths’ healthy development. Methods: We employed mixed methods and analyzed data using concept mapping. A total of 37 newcomers between the ages of 14 and 22 participated in focus groups to share their ideas for creating programming that would focus on relationships and well-being. Relevant responses were collated, cleaned, and generated into unique statements, and then sorted individually by 26 youth into thematically similar categories. We used multidimensional scaling and hierarchal cluster analysis to produce a concept map. Results: Six concepts, in rank order of importance, emerged as follows: create a space for sharing; discuss relational issues; teach strategies for adjusting to a new country; teach wellness skills; have feel-good activities; and plan for diversity. Conclusions: Participants’ lived experience and their own attendance in programming at newcomer organizations assisted them in brainstorming what types of activities, topics, and skills would be helpful for other newcomer youth, as well as considerations for facilitators implementing such programming. Promotion and prevention efforts intended for newcomer youth may benefit by incorporating ideas from the concept map.
Children & Youth Development	Cox, M., Urban, J. B., Lich, K. H., Wells, R., & Lawrence, C. N.	2022	A Multi-Stakeholder Perspective on Factors Affecting Successful Transition to Adulthood for Youth with Severe Emotional Disturbances		https://doi.org/10.1007/s10560-022-00898-6	https://link.springer.com/content/pdf/10.1007/s10560-022-00898-6.pdf?pdf=button	Montclair State University	This study elicited the perspectives of youth, caregivers, service providers and researchers to explore how communities can best support the transition to adulthood for youth ages 16–21 with mental health and functional impairments, who are at risk of disconnecting from health and human services. Framed by Relational Systems Evaluation (RSE) and Positive Youth Development (PYD), our study demonstrates the importance of engagement with youth experts. Group Concept Mapping (GCM), a collaborative multiphase mixed-methods approach, was used as a systematic process for participants to make meaning of qualitative data using multidimensional scaling and hierarchical cluster analysis (Kane and Trochim in Concept mapping for planning and evaluation, Sage Publications Inc., Thousand Oaks, 2007). Across all participant groups, Life Skills were perceived as highly important and highly feasible for a successful transition to adulthood. However, Positive Social Support & Connectedness were viewed as less important and less feasible by all groups. When examined closely, youth perspectives differed from caregiver and provider perspectives in the factors they prioritized and deemed feasible. Our findings have implications for community mental health services and positive youth development program practitioners.
Children & Youth Development	S Kuschke, S Moodie, K Kirubalingam, R O'Hagan…	2023	Parents' Perceptions of the Factors Influencing the Uptake of Remote Pediatric Hearing Aid Support: Development of a Conceptual Framework	JMIR Pediatrics and Parenting	https://doi.org/10.2196/47358	https://pediatrics.jmir.org/2023/1/e47358/PDF	hearX	Background: To achieve effective integration of virtual care into family-centered audiology practices, participatory research methods, including parents as vital participants in the delivery of pediatric audiology care, should be considered. A better understanding of the barriers and facilitators influencing the adoption of virtual care for families is warranted. Objective: This study aimed to develop a conceptual framework of the factors perceived to influence the adoption of remote pediatric hearing aid support among the parents of children with hearing loss. Methods: A total of 12 parents of children who wear hearing aids, between the ages of 0-17 years, were recruited to participate in group or individual interviews as part of the 6-step participatory-based concept mapping (CM) process. Data collection was specific to parents in a Canadian context. Analyses included multidimensional scaling and hierarchical cluster analysis. Results: The CM process resulted in 6 main themes, displayed in a cluster map according to their order of importance. These themes include access to timely, consistent care; technology considerations; convenience; child engagement; cost; and partnership considerations. Key underlying statements and subthemes are highlighted per theme. Conclusions: Findings from this study demonstrate the use of CM in participatory research with parents and as part of a family-centered care model. Future research should aim to investigate the factors that influence the uptake of remote hearing aid support in different contexts, for example, in low- to middle-income countries versus those in high-income countries.
Children & Youth Development	Washington-Nortey, M., Anum, A., Serpell, Z. et al.	2023	Expectations for Children with Autism Spectrum Disorders or Intellectual Disabilities in Ghana: A Comparison Between Service Providers and Parents	J Autism Dev Disord	https://doi.org/10.1007/s10803-023-06073-9	https://link.springer.com/content/pdf/10.1007/s10803-023-06073-9.pdf?pdf=button%20sticky		Little is known about care providers’ expectations for children with autism spectrum disorders (ASD) and intellectual disabilities (ID) in Ghana. This study used group concept mapping (n = 9) and a quantitative survey (n = 128) to explore and compare service providers’ and parents’ expectations for children with ASD or ID. Data were analyzed using hierarchical clustering procedures and Multivariate Analysis of Variance (MANOVA). Concept mapping results revealed several expectation clusters, including independence, love and acceptance, equal social rights and opportunities, and professional and caregiver training. MANOVA results revealed significant differences between parents, teachers, and healthcare providers in their perceptions of the importance and likelihood of a child achieving these expectations. Results are discussed in reference to the cultural context, and implications are outlined.
Chronic Disease Research	Wheeler, F. C., Anderson, L. A., Boddie-Willis, C., Price, P. H., & Kane, M.	2005	The role of state public health agencies in addressing less prevalent chronic conditions.	Preventing Chronic Disease		https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1364521/pdf/PCD23A12.pdf	Association of State and Territorial Chronic Disease Program Directors	State-based chronic disease programs typically focus on the most prevalent chronic conditions, such as cancer, diabetes, and cardiovascular disease, but interest in less prevalent chronic conditions (LPCCs), such as epilepsy, is growing. In our study, we examined the perceived roles of state health departments in addressing LPCCs and used this information to develop recommendations for state health departments that are considering developing LPCCs programs. We also compared the identified state health department roles for LPCCs with roles related to healthy aging, as well as to the essential elements of existing state-based chronic disease programs, to determine whether future LPCCs programs would have any unique requirements. Methods Participants used concept-mapping techniques to generate a set of 100 statements on steps that state health departments could take to address LPCCs. The participants sorted and rated each statement according to importance and feasibility. We used a sequence of multivariate statistical analyses to generate a series of maps, or clusters, and rating graphics. We reviewed the findings and produced recommendations for state health departments. We used a similar process to examine roles of state health departments in addressing healthy aging. Results The participants grouped the LPCCs statements into nine clusters, which they rated as moderately feasible and important. The healthy aging statements were grouped into eight clusters. Clusters for LPCCs and healthy aging were similar. We also compared LPCCs clusters and the essential elements of existing state-based chronic disease programs and found that they were similar. Conclusion The similarities between LPCCs clusters and essential elements of existing state-based chronic disease programs highlight an important point. State health departments that are considering establishing LPCCs programs should use strategies that have already been used by other public health agencies to develop chronic disease prevention and control programs.
Chronic Disease Research	Ahmad, F., Mahmood, S., Pietkiewicz, I., McDonald, L., & Ginsburg, O.	2012	Concept mapping with South Asian immigrant women: Barriers to mammography and solutions.	Journal of Immigrant and Minority Health	https://doi.org/10.1007/s10903-011-9472-7		University of Toronto	Despite benefits of screening mammography, many South Asian (SA) immigrant women in Canada remain under screened. We aimed to elicit their experiences and beliefs about barriers to mammography and possible solutions. SA immigrant women aged 50 years or over were eligible if they never had a mammogram or had one more than 3 years ago. We employed the participatory mixed-method approach of Concept Mapping. Sixty women participated with a mean age of 58 years. Participants brainstormed 150 items which were consolidated into 67 items. After sorting and rating, cluster analysis revealed eight clusters of barriers on knowledge, fear, language and transportation, access to mammogram center, access to doctor, beliefs and practices, self-care, and family dependence. Participants discussed possible solutions, and emphasized out-reach models to address knowledge gaps and issues of language and transportation. One example was a community-based shuttle bus to screening centres, hosted by trained co-ethnic workers. The results are discussed to enhance the socio-cultural sensitivity of breast screening programs.
Chronic Disease Research	Vinson, C. A.	2014	Using concept mapping to develop a conceptual framework for creating virtual communities of practice to translate Cancer research into practice.	Preventing Chronic Disease	https://doi.org/10.5888/pcd11.130280	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4008948/pdf/PCD-11-E68.pdf	Centers for Disease Control and Prevention	Introduction: Translating government-funded cancer research into clinical practice can be accomplished via virtual communities of practice that include key players in the process: researchers, health care practitioners, and intermediaries. This study, conducted from November 2012 through January 2013, examined issues that key stakeholders believed should be addressed to create and sustain government-sponsored virtual communities of practice to integrate cancer control research, practice, and policy and demonstrates how concept mapping can be used to present relevant issues. Methods: Key stakeholders brainstormed statements describing what is needed to create and sustain virtual communities of practice for moving cancer control research into practice. Participants rated them on importance and feasibility, selected most relevant statements, and sorted them into clusters. I used concept mapping to examine the issues identified and multidimensional scaling analyses to create a 2-dimensional conceptual map of the statement clusters. Results: Participants selected 70 statements and sorted them into 9 major clusters related to creating and sustaining virtual communities of practice: 1) standardization of best practices, 2) external validity, 3) funding and resources, 4) social learning and collaboration, 5) cooperation, 6) partnerships, 7) inclusiveness, 8) social determinants and cultural competency, and 9) preparing the environment. Researchers, health care practitioners, and intermediaries were in relative agreement regarding issues of importance for creating these communities. Conclusion: Virtual communities of practice can be created to address the needs of researchers, health care practitioners, and intermediaries by using input from these key stakeholders. Increasing linkages between these subgroups can improve the translation of research into practice. Similarities and differences between groups can provide valuable information to assist the government in developing virtual communities of practice.
Chronic Disease Research	Willis, C., Kernoghan, A., Riley, B., Popp, J., Best, A., & Milward, H. B.	2015	Outcomes of interorganizational networks in Canada for chronic disease prevention: Insights from a concept mapping study, 2015.	Preventing Chronic Disease	https://doi.org/10.5888/pcd12.150297	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4655481/pdf/PCD-12-E199.pdf	University of Waterloo	Introduction: We conducted a mixed methods study from June 2014 to March 2015 to assess the perspectives of stakeholders in networks that adopt a population approach for chronic disease prevention (CDP). The purpose of the study was to identify important and feasible outcome measures for monitoring network performance. Methods: Participants from CDP networks in Canada completed an online concept mapping exercise, which was followed by interviews with network stakeholders to further understand the findings. Results Nine concepts were considered important outcomes of CDP networks: enhanced learning, improved use of resources, enhanced or increased relationships, improved collaborative action, network cohesion, improved system outcomes, improved population health outcomes, improved practice and policy planning, and improved intersectoral engagement. Three themes emerged from participant interviews related to measurement of the identified concepts: the methodological difficulties in measuring network outcomes, the dynamic nature of network evolution and function and implications for outcome assessment, and the challenge of measuring multisectoral engagement in CDP networks. Conclusion: Results from this study provide initial insights into concepts that can be used to describe the outcomes of networks for CDP and may offer foundations for strengthening network outcome-monitoring strategies and methodologies.
Chronic Disease Research	Iwelunmor, J., Blackstone, S., Gyamfi, J., Airhihenbuwa, C., Plange-Rhule, J., Tayo, B., Adanu, R. M. K., & Ogedegbe, G.	2015	A concept mapping study of physicians' perceptions of factors influencing management and control of hypertension in Sub-Saharan Africa.	International Journal of Hypertension	https://doi.org/10.1155/2015/412804	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4621343/pdf/IJHY2015-412804.pdf	University of Illinois, Urbana-Champaign	Hypertension, once a rare problem in Sub-Saharan Africa (SSA), is predicted to be a major cause of death by 2020 with mortality rates as high as 75%. However, comprehensive knowledge of provider-level factors that influence optimal management is limited. The objective of the current study was to discover physicians' perceptions of factors influencing optimal management and control of hypertension in SSA. Twelve physicians attending the Cardiovascular Research Training (CaRT) Institute at the University of Ghana, College of Health Sciences, were invited to complete a concept mapping process that included brainstorming the factors influencing optimal management and control of hypertension in patients, sorting and organizing the factors into similar domains, and rating the importance and feasibility of efforts to address these factors. The highest ranked important and feasible factors include helping patients accept their condition and availability of adequate equipment to enable the provision of needed care. The findings suggest that patient self-efficacy and support, physician-related factors, policy factors, and economic factors are important aspects that must be addressed to achieve optimal hypertension management. Given the work demands identified by physicians, future research should investigate cost-effective strategies of shifting physician responsibilities to well-trained no-physician clinicians in order to improve hypertension management.
Chronic Disease Research	Mills, S. L., Bergeron, K., & Perez, G.	2015	Using concept mapping to develop a strategy for self-management support for underserved populations living with chronic conditions, British Columbia, August 2013-June 2014.	Preventing Chronic Disease	https://doi.org/10.5888/pcd12.150183	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4599068/pdf/PCD-12-E173.pdf	University of British Columbia	Self-management support (SMS) is an essential component of public health approaches to chronic conditions. Given increasing concerns about health equity, the needs of diverse populations must be considered. This study examined potential solutions for addressing the gaps in self-management support initiatives for underserved populations. Methods: Stakeholders representing government, nongovernment organizations, Aboriginal communities, health authorities, medical practices, and research institutions generated, sorted, and rated ideas on what could be done to improve self-management support for underserved populations. Concept mapping was used to facilitate the collection and organization of the data and to generate conceptual maps. Results: Participants generated 92 ideas that were sorted into 11 clusters (foster partnerships, promote integrated community care, enhance health care provider training, shift government policy, support community development, increase community education, enable client engagement, incorporate client support systems, recognize client capacity, tailor self-management support programs, and develop client skills, training, and tools) and grouped into system, community, and individual levels within a partnership framework. Conclusion: The strategy can stimulate public health dialogue and be a roadmap for developing SMS initiatives. It has the potential to address SMS and chronic condition inequities in underserved populations in several ways: 1) by targeting populations that have greater inequities, 2) by advocating for shifts in government policies that create and perpetuate inequities, 3) by promoting partnerships that may increase the number of SMS initiatives for underserved groups, and 4) by promoting training and engagement that increase the relevance, uptake, and overall effectiveness of SMS.
Chronic Disease Research	Weinstein, L. C., LaNoue, M., Hurley, K., Sifri, R., & Myers, R.	2015	Using concept mapping to explore barriers and facilitators to breast cancer screening in formerly homeless women with serious mental illness.	Journal of Health Care for the Poor and Underserved	https://doi.org/10.1353/hpu.2015.0104		Thomas Jefferson University	Women with serious mental illness (SMI) have disproportionately worse breast cancer profiles than those of other women. The purpose of this project was to examine barriers to and facilitators of breast cancer screening, specifically in formerly homeless women with SMI using the participatory methodology of concept mapping. A series of three concept mapping focus groups were held with 27 women over the age of 40 with a diagnosis of a SMI who live in supportive housing programs, and with 16 housing program staff. Data from the focus groups were combined through multidimensional scaling to create a visual cluster map. Barriers and facilitators to mammography screening generated by the participants clustered into eight categories. Participants rated addressing educational issues as most important and feasible. Interventions designed to improve mammogram screening in this population should address patients' perception of personal risk and should target education and support systems as modifiable factors.
Chronic Disease Research	Goldman, A. W., Burmeister, Y., Cesnulevicius, K., Herbert, M., Kane, M., Lescheid, D., McCaffrey, T., Schultz, M., Seilheimer, B., Smit, A., St. Laurent III, G., Berman, B.	2015	Bioregulatory systems medicine: An innovative approach to integrating the science of molecular networks, inflammation, and systems biology with the patient's autoregulatory capacity?	Frontiers in Physiology: Systems Biology	https://doi.org/10.3389/fphys.2015.00225	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4541032/	Cornell University	Bioregulatory systems medicine (BrSM) is a paradigm that aims to advance current medical practices. The basic scientific and clinical tenets of this approach embrace an interconnected picture of human health, supported largely by recent advances in systems biology and genomics, and focus on the implications of multi-scale interconnectivity for improving therapeutic approaches to disease. This article introduces the formal incorporation of these scientific and clinical elements into a cohesive theoretical model of the BrSM approach. The authors review this integrated body of knowledge and discuss how the emergent conceptual model offers the medical field a new avenue for extending the armamentarium of current treatment and healthcare, with the ultimate goal of improving population health.
Chronic Disease Research	Blackstone, S., Iwelunmor, J., Plange-Rhule, J., Gyamfi, J., Quakyi, N. K., Ntim, M., & Ogedegbe, G.	2017	Sustaining nurse-led task-shifting strategies for hypertension control: A concept mapping study to inform evidence-based practice.	Worldviews on Evidence-based Nursing	https://doi.org/10.1111/wvn.12230		University of Illinois Urbana-Champaign	Background: The use of task-shifting is an increasingly widespread delivery approach for health interventions targeting prevention, treatment, and control of hypertension in adults living in sub-Saharan Africa (SSA). Addressing a gap in the literature, this research examined the sustainability of an ongoing task-shifting strategy for hypertension (TASSH) from the perspectives of community health nurses (CHNs) implementing the program. Methods: We used concept-mapping, a mixed-methods participatory approach to understand CHNs' perceptions of barriers and enablers to sustaining a task-shifting program. Participants responded to focal prompts, eliciting statements regarding perceived barriers and enablers to sustaining TASSH, and then rated these ideas based on importance to the research questions and feasibility to address. Twenty-eight community health nurses (21 women, 7 men) from the Ashanti region of Ghana completed the concept-mapping process. Results: Factors influencing sustainability were grouped into five categories: Limited Drug Supply, Financial Support, Provision of Primary Health Care, Personnel Training, and Patient-Provider Communication. The limited supply of antihypertensive medication was considered by CHNs as the most important item to address, while providing training for intervention personnel was considered most feasible to address. Linking evidence to action: This study's findings highlight the importance of examining nurses' perceptions of factors likely to influence the sustainability of evidence-based, task-shifting interventions. Nurses' perceptions can guide the widespread uptake and dissemination of these interventions in resource-limited settings. Keywords: Ghana; community health nurses; hypertension; stakeholder analysis; task-shifting.
Chronic Disease Research	van Engen-Verheul, M. M., Peek, N., Haafkens, J. A., Joukes, E., Vroman, T., Jaspers, M. W. M., & de Keizer, N. F.	2017	What is needed to implement a web-based audit and feedback intervention with outreach visits to improve care quality: A concept mapping study among cardiac rehabilitation teams.	International Journal of Medical Informatics	https://doi.org/10.1016/j.ijmedinf.2016.10.003	https://isiarticles.com/bundles/Article/pre/pdf/81708.pdf	University of Amsterdam	Introduction: Evidence on successful quality improvement (QI) in health care requires quantitative infor- mation from randomized clinical trials (RCTs) on the effectiveness of QI interventions, but also qualitative information from professionals to understand factors influencing QI implementation. Objective: Using a structured qualitative approach, concept mapping, this study determines factors iden- tified by cardiac rehabilitation (CR) teams on what is needed to successfully implement a web-based audit and feedback (A&F) intervention with outreach visits to improve the quality of CR care. Methods: Participants included 49 CR professionals from 18 Dutch CR centres who had worked with the A&F system during a RCT. In three focus group sessions participants formulated statements on factors needed to implement QI successfully. Subsequently, participants rated all statements for importance and feasibility and grouped them thematically. Multi dimensional scaling was used to produce a final concept map. Results: Forty-two unique statements were formulated and grouped into five thematic clusters in the concept map. The cluster with the highest importance was QI team commitment, followed by organisa- tional readiness, presence of an adequate A&F system, access to an external quality assessor, and future use and functionalities of the A&F system. Conclusion: Concept mapping appeared efficient and useful to understand contextual factors influencing QI implementation as perceived by healthcare teams. While presence of a web-based A&F system and external quality assessor were seen as instrumental for gaining insight into performance and formulating QI actions, QI team commitment and organisational readiness were perceived as essential to actually implement and carry out these actions. These two sociotechnical factors should be taken into account when implementing and evaluating the success of QI implementations in future research
Chronic Disease Research	Stankov, I., Howard, N. J., Daniel, M., & Cargo, M.	2017	Policy, research and residents' perspectives on built environments implicated in heart disease: A concept mapping approach.	International Journal of Environmental Research and Public Health	https://doi.org/10.3390/ijerph14020170	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5334724/pdf/ijerph-14-00170.pdf	Drexel University	An underrepresentation of stakeholder perspectives within urban health research arguably limits our understanding of what is a multi-dimensional and complex relationship between the built environment and health. By engaging a wide range of stakeholders using a participatory concept mapping approach, this study aimed to achieve a more holistic and nuanced understanding of the built environments shaping disease risk, specifically cardiometabolic risk (CMR). Moreover, this study aimed to ascertain the importance and changeability of identified environments through government action. Through the concept mapping process, community members, researchers, government and non-government stakeholders collectively identified eleven clusters encompassing 102 built environmental domains related to CMR, a number of which are underrepresented within the literature. Among the identified built environments, open space, public transportation and pedestrian environments were highlighted as key targets for policy intervention. Whilst there was substantive convergence in stakeholder groups’ perspectives concerning the built environment and CMR, there were disparities in the level of importance government stakeholders and community members respectively assigned to pedestrian environments and street connectivity. These findings support the role of participatory methods in strengthening how urban health issues are understood and in affording novel insights into points of action for public health and policy intervention.
Chronic Disease Research	Nielsen, K. T., Klokker, L., Guidetti, S., & Waehrens, E. E.	2018	Identifying, organizing and prioritizing ideas on how to enhance ADL ability.	Scandinavian Journal of Occupational Therapy	https://doi.org/10.1080/11038128.2018.1424235		University College of Northern Denmark	There is a need to develop evidence-based occupational therapy programs aiming at enhancing the ability to perform Activities of Daily Living (ADL) among persons living with chronic conditions. Information from different sources is to be integrated in the development process. Thus, it is necessary to engage both occupational therapists and persons living with chronic conditions in suggesting ideas on how to enhance the ADL ability. Objective: To identify, organize and prioritize ideas on how to enhance ability to perform ADL in persons with chronic conditions. Material and method: Group Concept Mapping, involving brainstorming, sorting, labeling, rating and validation of ideas, was applied among persons with chronic conditions (n = ≤ 18) and occupational therapists (n = ≤ 23). Multidimensional scaling analysis and cluster analyzes were applied. Results: 149 ideas were identified and organized into seven clusters related to applying new adaptational strategies, personal factors, social surroundings and relevant services and opportunities. Each cluster contained ideas of high priority to persons with chronic conditions and/or occupational therapists. Conclusion: A span of highly relevant themes, illustrated the complexity of enhancing ADL ability. This should be considered in the development of interventions aiming at enhancing ADL ability in persons with chronic conditions.
Chronic Disease Research	Rainey, L., van der Waal, D., Donnelly, L. S., Evans, D. G., Wengstrom, Y., & Broeders, M.	2018	Women's decision-making regarding risk-stratified breast cancer screening and prevention from the perspective of international healthcare professionals.	PLOS One	https://doi.org/10.1371/journal.pone.0197772	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5983562/pdf/pone.0197772.pdf	Radboud University	Introduction: Increased knowledge of breast cancer risk factors may enable a paradigm shift from one-size-fits-all breast cancer screening to screening and subsequent prevention guided by a woman’s individual risk of breast cancer. Professionals will play a key role in informing women about this new personalised screening and prevention programme. Therefore, it is essential to explore professionals’ views of the acceptability of this new programme, since this may affect shared decision-making. Methods: Professionals from three European countries (the Netherlands, United Kingdom, and Sweden) participated in digital concept mapping, a systematic mixed methods approach used to explore complex multidimensional constructs. Results: Across the three countries, professionals prioritised the following five themes which may impact decision-making from the perspective of eligible women: (1) Anxiety/worry; (2) Proactive approach; (3) Reassurance; (4) Lack of knowledge; and (5) Organisation of risk assessment and feedback. Furthermore, Dutch and British professionals expressed concerns regarding the acceptability of a heterogeneous screening policy, suggesting women will question their risk feedback and assigned pathway of care. Swedish professionals emphasised the potential impact of the programme on family relations. Conclusions: The perspectives of Dutch, British, and Swedish professionals of women’s decision-making regarding personalised breast cancer screening and prevention generally appear in line with women’s own views of acceptability as previously reported. This will facilitate shared decision-making. However, concerns regarding potential consequences of this new programme for screening outcomes and organisation need to be addressed, since this may affect how professionals communicate the programme to eligible women.
Chronic Disease Research	Phad, A., Johnston, S., Tabak, R. G., Mazzucca, S., & Haire-Joshu, D.	2019	Developing priorities to achieve health equity through diabetes translation research: A concept mapping study.	BMJ Open Diabetes Research & Care	https://doi.org/10.1136/bmjdrc-2019-000851	https://drc.bmj.com/content/bmjdrc/7/1/e000851.full.pdf	Washington University in St. Louis	Introduction: The goal of diabetes translation research is to advance research into practice and ensure equitable benefit from scientific evidence. This study uses concept mapping to inform and refine future directions of diabetes translation research with the goal of achieving health equity in diabetes prevention and control. Research design and methods: This study used concept mapping and input from a national network of diabetes researchers and public health practitioners. Concept mapping is a mixed-method, participant-based process. First, participants generated statements by responding to a focus prompt (“To eliminate disparities and achieve health equity in the prevention and treatment of diabetes, research should…”). Participants then sorted statements by conceptual similarity and rated each statement on importance and feasibility (Likert scale of 1–5). A cluster map was created using multidimensional scaling and hierarchical cluster analysis; statements were plotted by average importance and feasibility. Results: Ten clusters were identified containing between 6 and 12 statements from 95 total generated statements. The ranges of average importance and feasibility ratings for clusters were fairly high and narrow (3.62–4.09; 3.10–3.93, respectively). Clusters with the most statements in the “go-zone” quadrant (above average importance/feasibility) were community and partner engagement (n=7), dissemination and implementation principles (n=4), and enrichment and capacity building (n=4). Clusters with the most statements in the “innovative-targets” quadrant (above average importance, below average feasibility) included next generation interventions (n=6), policy approaches (n=4), and interventions for specific populations (n=4). Conclusions: This study created a framework of 10 priority areas to guide current and future efforts in diabetes translation research to achieve health equity. Themes rated as highly important and feasible provide the basis to evaluate current research support. Future efforts should explore how to best support innovative-targets, those rated highly important but less feasible. This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Chronic Disease Research	Antoniou, T., Mishra, S., Matheson, F., Smith-Merrill, D., Challacombe, L., Rowe, J., DiCenso, A. M., Kouyoumdjian, G. G., Wobeser, W., Kendall, C., Loutfy, M., Tsang, J., Kanee, L., & Strike, C.	2019	Using concept mapping to inform the development of a transitional reintegration intervention program for formerly incarcerated people with HIV.	BMC Health Services Research	https://doi.org/10.1186/s12913-019-4595-y	https://bmchealthservres.biomedcentral.com/track/pdf/10.1186/s12913-019-4595-y.pdf	University of Toronto	Accessing HIV-related care is challenging for formerly incarcerated people with HIV. Interventions informed by the perspectives of these individuals could facilitate engagement with care and address competing priorities that may act as barriers to this process. Methods We used concept mapping to identify and prioritize the main obstacles to engaging with HIV-related care following prison release. In brainstorming sessions, formerly incarcerated people with HIV generated responses to a focused prompt regarding the main barriers to reengaging with care. These were consolidated in 35 statements. Next, participants sorted the consolidated list of responses into groups and rated each from lowest to highest in terms of its importance and feasibility of being addressed. We used cluster analysis to generate concept maps that were interpreted with participants. Results Overall, 39 participants participated in brainstorming sessions, among whom 18 returned for rating and sorting. Following analysis, a seven-cluster map was generated, with participants rating the ‘Practical Considerations’ (e.g. lack of transportation from prison) and ‘Survival Needs’ (e.g. securing housing and food) clusters as most important. Although ratings were generally similar between women and men, women assigned greater importance to barriers related to reconnecting with children. Conclusions Using concept mapping, we worked with formerly incarcerated people with HIV to identify and prioritize key challenges related to accessing health and social services following prison release. Transitional intervention programs should include programs and processes that address meeting basic subsistence needs and overcoming logistical barriers related to community re-entry.
Chronic Disease Research	Bacci, E. D., Coyne, K. S., Poon, J. L., Harris, L., & Boscoe, A. N.	2019	Understanding side effects of therapy for myasthenia gravis and their impact on daily life.	BMC Neurology	https://doi.org/10.1186/s12883-019-1573-2	https://bmcneurol.biomedcentral.com/track/pdf/10.1186/s12883-019-1573-2.pdf	Patient-Centered Research, Evidera	Myasthenia gravis (MG) is a chronic, autoimmune, neuromuscular junction disorder characterized by varying degrees of weakness of the skeletal muscles of the body [1]. Published prevalence estimates of MG vary widely; the Myasthenia Gravis Foundation of America (MGFA) suggests the prevalence of MG to be approximately 14 to 20 per 100,000, or at least 35,000 to 60,000 individuals in the United States (US) [2]. The presentation of MG includes fluctuating, and fatigable weakness of various muscle groups. This muscle weakness increases during periods of activity and improves after periods of rest. Muscles that control eye and eyelid movement, facial expression, chewing, talking, and swallowing can be affected, in addition to those that control breathing and neck and limb movements [3] Currently there is no cure for MG, but various traditional therapies, including acetylcholinesterase inhibitors and immunomodulating therapies (corticosteroids, azathioprine, and mycophenolate mofetil) allow most patients to live productive lives with a normal life expectancy. However, these therapies are associated with side effects that can deter patients from their use, such as nausea, vomiting, gastrointestinal (GI) upset, increased risk of infection, weight gain, or liver damage [4]. Given the side effect profile of traditional therapies, new targeted therapies have been developed. The first, eculizumab, a terminal complement inhibitor, was recently approved by the Food and Drug Administration (FDA), European Commission, and The Ministry of Health, Labor, and Welfare in Japan in 2017. Unsatisfactory treatment outcomes with traditional MG therapies also contribute to poor adherence, with 23% of patients reporting poor treatment compliance [5]. Despite this, information on the precise nature, duration, and severity of these side effects from the patient perspective is scarce. Furthermore, the impact of these side effects on patient health-related quality of life (HRQOL), daily life, and adherence to treatment is not clearly understood. The objectives of this study were to characterize patient experiences with side effects for traditional MG treatments, and to understand the impact of the side effects on patients’ HRQOL, daily life, and adherence to therapy.
Chronic Disease Research	Kane, M., Royer-Barnett, J., & Alongi, J.	2019	Core competencies for chronic disease prevention practice.	Preventing Chronic Disease	https://doi.org/10.5888/pcd16.190101	https://europepmc.org/backend/ptpmcrender.fcgi?accid=PMC6824146&blobtype=pdf	Concept Systems, Inc.	Chronic disease prevention practice is an important specialization within public health and health care that connects chronic conditions, causes, prevention tactics, and population-based health promotion modalities. Required competencies for successful chronic disease prevention and health promotion encompass leadership, epidemiology, program practice, and evaluation, among others. In 2007, the National Association of Chronic Disease Directors (NACDD) developed and codified the Core Chronic Disease Prevention Competencies (Competencies), a standard set of competencies for professionals in chronic disease prevention and control. NACDD also devised support tools to assist individuals and managers in increasing capacity and opportunities for member growth, thereby benefitting the agencies they serve. In revisiting the Competencies in 2015 through 2018, the NACDD Professional Development Committee reviewed uses, conducted member surveys, polled NACDD councils, and produced recommendations. The goal of this process was to recognize rapid changes in the environments, practices, and characteristics that affect chronic disease prevention, both at the population level and for individual groups at risk during the past 10 years. In addition, opportunities existed to benefit from the changes in technology that have increased demands on health professionals, who as a result have had to adapt to these changes. We worked with the NACDD Learning and Professional Development Committee and reviewed learning offerings, other related competency sets, and tools for performance assessment. The results of the review include a final set of Competencies and subcompetencies, a guide to using the competencies, and a fully integrated interactive assessment tool used by individuals, managers, and teams. Going forward, NACDD's strategic focus includes a regular review of the Competencies and building chronic disease learning assets.
Chronic Disease Research	Dulin, A. J., Earnshaw, V. A., Dale, S. K., Carey, M. P., & Fava J. L.	2020	A Concept Mapping Study to Understand Multilevel Resilience Resources Among African American/Black Adults Living with HIV in the Southern United States.	AIDS and Behavior	https://doi.org/10.1007/s10461-020-03042-6		Brown University	Resilience may help people living with HIV (PLWH) overcome adversities to disease management. This study identifies multilevel resilience resources among African American/Black (AA/B) PLWH and examines whether resilience resources differ by demographics and neighborhood risk environments. We recruited participants and conducted concept mapping at two clinics in the southeastern United States. Concept Mapping incorporates qualitative and quantitative methods to represent participant-generated concepts via two-dimensional maps. Eligible participants had to attend ≥ 75% of their scheduled clinic appointments and did not have ≥ 2 consecutive detectable HIV-1 viral load measurements in the past 2 years. Of the 85 AA/B PLWH who were invited, forty-eight participated. Twelve resilience resource clusters emerged-five individual, two interpersonal, two organizational/policy and three neighborhood level clusters. There were strong correlations in cluster ratings for demographic and neighborhood risk environment comparison groups (r ≥ 0.89). These findings could inform development of theories, measures and interventions for AA/B PLWH. Keywords: Health equity; Mixed methods and HIV; Multilevel; Neighborhood; Resilience.
Chronic Disease Research	Chakraborty, A., Howard, N., J., Daniel, M., Chong, A., Slavin, N., Brown, A., & Cargo, M.	2021	Prioritizing Built Environmental Factors to Tackle Chronic and Infectious Diseases in Remote Northern Territory (NT) Communities of Australia: A Concept Mapping Study.	International Journal of Environmental Research and Public Health	https://doi.org/10.3390/ijerph18105178	https://mdpi-res.com/d_attachment/ijerph/ijerph-18-05178/article_deploy/ijerph-18-05178.pdf?version=1620903757	University of South Australia	High prevalence of chronic and infectious diseases in Indigenous populations is a major public health concern both in global and Australian contexts. Limited research has examined the role of built environments in relation to Indigenous health in remote Australia. This study engaged stakeholders to understand their perceptions of the influence of built environmental factors on chronic and infectious diseases in remote Northern Territory (NT) communities. A preliminary set of 1120 built environmental indicators were systematically identified and classified using an Indigenous Indicator Classification System. The public and environmental health workforce was engaged to consolidate the classified indicators (n = 84), and then sort and rate the consolidated indicators based on their experience with living and working in remote NT communities. Sorting of the indicators resulted in a concept map with nine built environmental domains. Essential services and Facilities for health/safety were the highest ranked domains for both chronic and infectious diseases. Within these domains, adequate housing infrastructure, water supply, drainage system, reliable sewerage and power infrastructure, and access to health services were identified as the most important contributors to the development of these diseases. The findings highlight the features of community environments amenable to public health and social policy actions that could be targeted to help reduce prevalence of chronic and infectious diseases.
Chronic Disease Research	Hvidt, N.C., Nielsen, K.T., Kørup, A.,K., et al	2022	What is spiritual care? Professional perspectives on the concept of spiritual care identified through group concept mapping	BMJ Open	https://doi.org/10.1136/bmjopen-2020-042142	https://bmjopen.bmj.com/content/bmjopen/10/12/e042142.full.pdf	University of Southern Denmark	Objectives: The overall study aim was to synthesise understandings and experiences regarding the concept of spiritual care (SC). More specifically, to identify, organise and prioritise experiences with the way SC is conceived and practised by professionals in research and the clinic. Design: Group concept mapping (GCM). Setting: The study was conducted within a university setting in Denmark. Participants: Researchers, students and clinicians working with SC on a daily basis in the clinic and/or through research participated in brainstorming (n=15), sorting (n=15), rating and validation (n=13). Results: Applying GCM, ideas were identified, organised and prioritised online. A total of 192 unique ideas of SC were identified and organised into six clusters. The results were discussed and interpreted at a validation meeting. Based on input from the validation meeting a conceptual model was developed. The model highlights three overall themes: (1) ‘SC as an integral but overlooked aspect of healthcare’ containing the two clusters SC as a part of healthcare and perceived significance; (2) ‘delivering SC’ containing the three clusters quality in attitude and action, relationship and help and support, and finally (3) ‘the role of spirituality’ containing a single cluster. Conclusion: Because spirituality is predominantly seen as a fundamental aspect of each individual human being, particularly important during suffering, SC should be an integral aspect of healthcare, although it is challenging to handle. SC involves paying attention to patients’ values and beliefs, requires adequate skills and is realised in a relationship between healthcare professional and patient founded on trust and confidence.
Chronic Disease Research	Randall, J. & Miller, J. J.	2022	A conceptual framework of the psychosocial elements that should be assessed in candidates for hematopoietic cell transplant: Social workers’ and psychologists’ perspectives,	Journal of Psychosocial Oncology	https://doi.org/10.1080/07347332.2022.2104677		University of Louisville	The aim of this work was to explicate a conceptual framework of psychosocial elements assessed in candidates for hematopoietic cell transplant (HCT) and to explore differences in the conceptualization based on the use of risk rating scales in clinical practice. Methods: Concept mapping is a mixed methods participatory approach to elicit and organize the ideas of a group of stakeholders and produce a composite conceptual framework. Participants were social workers and psychologists with experience assessing HCT candidates. Results: Participants brainstormed 114 psychosocial elements and conceptualized them into 12 distinct clusters: Transplant Mindset, Support System, Caregiver, Lodging and Transportation, Financial and Legal, Work, Demographic Characteristics, Mental Health, Communication, Educational and Resource Needs, Physical Functioning, and Cognition. Participants who used risk rating scales did not prioritize the importance of the clusters differently than those who did not. Conclusions: The conceptualization converges and diverges with the literature. Divergences are of particular interest since the perspectives of practicing psychosocial professionals have been largely absent from the literature. The conceptual framework can guide psychosocial providers in assessing patients. Assessing the caregiver is a high priority, as is evaluating the patient’s mental health and mindset about transplant.
Chronic Disease Research	Slade, A. L., O'Hara, M. E., Quinn, D., Marley, L., Griffith, S.	2022	Living with a left ventricular assist device	The Journal of heart and lung transplantation	https://doi.org/10.1371/journal.pone.0273108	https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0273108&type=printable	University of Birmingham	Left ventricular assist device (LVAD) implantation significantly impacts on a recipient’s symptoms and quality of life. Capturing their experiences and post implant journey is an important part of clinical practice, research and device design evolution. Patient reported outcome measures (PROMs) are a useful tool for capturing that experience. However, patient reported outcome measures need to reflect recipients’ experiences. Discussions with a patient partner group found that none of the frequently used cardiology PROMs captured their unique experiences. Aims To capture the experiences and important issues for LVAD recipients. Develop a conceptual map of domains and items that should be reflected in patient reported outcomes. Methods Group concept mapping (GCM) web-based software was used to remotely capture and structure recipients’ experiences across a wide geographical area. GCM is a semi-quantitative mixed method consisting of 3 stages: item generation, item sorting and rating (importance, relevance and frequency). Patient partners were involved in all aspects of the study design and development. Results 18 LVAD recipients consented to take part. 101 statements were generated and multi-dimensional scaling, and hierarchical cluster analysis identified 9 clusters. Cluster themes included: Activities, Partner/family support, Travel, Mental wellbeing, Equipment and clothing, Physical and cognitive limitations, LVAD Restrictions, LVAD Challenges and positive impact of the LVAD (LVAD Positives). LVAD Positives were scored highest across all the rating variables, e.g., frequency (2.85), relevance (2.44) and importance (2.21). Other domains rated high for importance included physical and cognitive limitations (2.19), LVAD restrictions (2.11), Partner/family support (2.02), and Equipment and clothing (2.01). Conclusion Online GCM software facilitated the inclusion of geographically dispersed recipients and provided useful insights into the experiences of LVAD recipients. The conceptual framework identifies important domains and items that should be prioritised and included in patient reported outcomes in future research, LVAD design evolution, and clinical practice.
Chronic Disease Research	Aarons, G. A., Reede, K., Nadia A., Sam-Agudu, Vorkoper, S., and Sturke, R.	2022	Implementation determinants and mechanisms for the prevention and treatment of adolescent HIV in sub-Saharan Africa: concept mapping of the NIH Fogarty International Center Adolescent HIV Implementation Science Alliance (AHISA) initiative	Implement Sci Community		https://link.springer.com/content/pdf/10.1186/s43058-021-00156-3.pdf	University of California San Diego	Introduction: Adolescent HIV prevention and treatment is a high priority for youth healthcare in sub-Saharan Africa. Methods: This study employed concept mapping to identify factors that impact the implementation of HIV prevention and intervention programs for adolescents in sub-Saharan Africa. Key stakeholders including researchers, policymakers, and non-governmental organization (NGO) personnel constituting membership of the NIH-sponsored Adolescent HIV Prevention and Treatment Implementation Science Alliance responded to the question: "In your experience, what factors have facilitated or hindered implementation of evidence-based HIV prevention or treatment for adolescents in sub-Saharan Africa?" Participants generated statements in response to the focus question, sorted them into thematically relevant groups, and rated each statement on its importance and changeability. Results: Through data analyses and participant feedback, 15 distinct themes were derived. "Workforce/Workflow" and "HIV Stigma and Adolescent Development" were rated highest for importance, and "Threshold Conditions for Treatment" and "Structure of Implementation Efforts" were rated most changeable. Conclusions: Understanding implementation science determinants and mechanisms can facilitate the uptake of successful implementation and sustainment strategies for the prevention and treatment of HIV in a given context. We placed determinants and mechanisms within the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to provide greater contextual integration with broader theories in implementation science. Implementers across multiple disciplines can use these findings to improve the scale-up of evidence-based practices for adolescent HIV prevention and treatment in sub-Saharan Africa. Implementation approaches that consider the determinants and mechanisms identified in this study and integrated in implementation frameworks will likely have utility for other health conditions and contexts. Keywords: Adolescent; Africa; Concept mapping; EPIS framework; HIV; Implementation science; Sustainment.
Chronic Disease Research	Simões Corrêa Galendi J, Siefen A-C, Moretti DM, Yeo SY, Grüll H, Bratke G, Morganti AG, Bazzocchi A, Gasperini C, De Felice F, Blanco Sequeiros R, Huhtala M, Nijholt IM, Boomsma MF, Bos C, Verkooijen HM, Müller D, Stock S	2023	Factors Influencing the Adoption of Magnetic Resonance-Guided High-Intensity Focused Ultrasound for Painful Bone Metastases in Europe, A Group Concept …		https://doi.org/10.3390/ijerph20021084	https://www.mdpi.com/1660-4601/20/2/1084/pdf?version=1673591118	University of Cologne, Germany	Magnetic resonance imaging-guided high-intensity focused ultrasound (MR-HIFU) is an innovative treatment for patients with painful bone metastases. The adoption of MR-HIFU will be influenced by several factors beyond its effectiveness. To identify contextual factors affecting the adoption of MR-HIFU, we conducted a group concept mapping (GCM) study in four European countries. The GCM was conducted in two phases. First, the participants brainstormed statements guided by the focus prompt “One factor that may influence the uptake of MR-HIFU in clinical practice is...”. Second, the participants sorted statements into categories and rated the statements according to their importance and changeability. To generate a concept map, multidimensional scaling and cluster analysis were conducted, and average ratings for each (cluster of) factors were calculated. Forty-five participants contributed to phase I and/or II (56% overall participation rate). The resulting concept map comprises 49 factors, organized in 12 clusters: “competitive treatments”, “physicians’ attitudes”, “alignment of resources”, “logistics and workflow”, “technical disadvantages”, “radiotherapy as first-line therapy”, “aggregating knowledge and improving awareness”, “clinical effectiveness”, “patients’ preferences”, “reimbursement”, “cost-effectiveness” and “hospital costs”. The factors identified echo those from the literature, but their relevance and interrelationship are case-specific. Besides evidence on clinical effectiveness, contextual factors from 10 other clusters should be addressed to support adoption of MR-HIFU. MR-HIFU; bone metastases; cancer pain; implementation science; diffusion of innovation; group concept mapping
Community Wellness	Burke, J. G., O’Campo, P., Peak, G. L., Gielen, A. C., McDonnell, K. A., & Trochim, W.	2005	An introduction to concept mapping as a participatory public health research methodology.	Qualitative Health Research	https://doi.org/10.1177/1049732305278876	https://www.researchgate.net/profile/Karen-Mcdonnell-3/publication/7503263_An_Introduction_to_Concept_Mapping_as_a_Participatory_Public_Health_Research_Method/links/0fcfd51030894e4da0000000/An-Introduction-to-Concept-Mapping-as-a-Participatory-Public-Health-Research-Method.pdf?origin=publication_detail	University of Pittsburgh	In this article, the authors introduce concept mapping as a useful participatory research method for public health researchers interested in generating hypotheses and developing theory. The authors first provide an overview of concept mapping, which combines qualitative approaches with quantitative analytical tools to produce visual displays of the relationship between ideas. Then, they present an illustrative research application of the method to the exploration of women’s perceptions of the relationship between residential neighborhood factors and intimate partner violence experiences. They give attention to the data collection and analysis procedures and to demonstrating the intricacies of using concept mapping for public health research purposes. Finally, the article concludes with a discussion of the unique contributions and challenges associated with concept mapping.
Community Wellness	Miller, J.J., Rhema, S., Faul, A., D'Ambrosio, J., Yankeelov, P., Amer, R., & Clark, R.	2012	Strength in process: Using concept mapping to inform community coalition development.	Journal of Community Practice	https://doi.org/10.1080/10705422.2012.736074		University of Louisville	This study reports on the use of Concept Mapping to delineate a conceptual framework germane to the planning and initial formation of tri-county rural diabetes coalition in a southeast US community. The focus of the tricounty coalition is to reduce diabetes-related inequalities in vulnerable populations. After a review of pertinent literature on community coalitions, this article explicates Concept Mapping processes utilized to plan and organize the formation of a coalition, offers analyses of the results, and discusses implications for current and future practices pertaining to community coalition work.
Community Wellness	Kasehagen, L. J., Brandert, K., Nickol, B., Gatere, M, Hanson, P., Bambace, J., Beam, R., Chao, S. M., Clark, C. L., Hepburn, C. Y., Jocson, M. A. L., Jones, M., & McManus, P.	2014	Application of a mixed methods approach to identify community-level solutions to decrease racial disparities in infant mortality.	Journal of Racial and Ethnic Health Disparities	https://doi.org/10.1007/s40615-014-0008-4	https://www.researchgate.net/profile/Laurin-Kasehagen/publication/269355079_Application_of_a_Mixed_Methods_Approach_to_Identify_Community-Level_Solutions_to_Decrease_Racial_Disparities_in_Infant_Mortality/links/56f1322308aec9e096b3143f/Application-of-a-Mixed-Methods-Approach-to-Identify-Community-Level-Solutions-to-Decrease-Racial-Disparities-in-Infant-Mortality.pdf	Centers for Disease Control and Prevention	This study aimed to identify community-level actions to decrease racial disparities in infant mortality (IM). Design Six urban multidisciplinary teams generated ideas for decreasing racial disparities in IM using a mixed methods concept mapping approach. Participants rated each idea as to its necessity and action potential and grouped ideas by theme. A cluster analysis produced a series of visual representations, showing relationships between the identified actions and the clustering of actions into themes. Multidimensional scaling techniques were used to produce analyses describing the necessity of and action potential for implementing the proposed ideas. Participants identified actions communities could take to decrease racial disparities in IM and suggested applications of the knowledge gained from the mapping process. Results: Participants produced a total of 128 actions, within 11 thematic clusters, for decreasing racial disparities in IM. The thematic clusters contained a range of elements designed to promote knowledge and understanding of the relationship between health and racism; improve educational systems and community opportunities; facilitate community-driven health promotion, marketing, and research; improve health services for women; address physical and social environments that impact community health; prioritize resource allocation of community-based services; institutionalize strategies that promote equity across all systems; and create and support legislation and policies that address social determinants of health. Correlation coefficients of the clusters ranged from 0.17 to 0.90. Average necessity ratings ranged from 2.17 to 3.73; average action potential ratings ranged from 1.64 to 3.61. Conclusion: Findings suggest that thematic clusters with high action potential usually represented ongoing community activities or actions communities could easily initiate. Community size, existing programs, partnerships, policies, and influential advocates were among the factors cited affecting feasibility of implementation. Clusters with lower action potential require broader, longer term, policy, institutional or system-wide changes, and significant resources. High necessity clusters often contained actions perceived as essential for change, but sometimes outside of a community’s control. Participants identified a number of practical actions that were considered to hold potential for individual, community, and institutional changes which could result in decreasing racial disparities in IM.
Community Wellness	Walker, R. E., Jones, J. R., & Burke, J. G.	2014	Concept mapping for community perceptions.	Integrated and Engaged Approaches	https://doi.org/10.1891/9780826198785.0007			Within the field of community health, concept mapping has been used successfully with diverse groups of stakeholders, ranging from adolescent school children to health care providers to community neighborhood residents; it has also been used to address a variety of community health topics, ranging from pregnancy outcomes to school violence. Concept mapping is a process that traditionally involves six steps: preparation, generation, structuring, representation, interpretation, and utilization. This chapter provides the process and guidance related to how concept mapping can be used in person with participants. It also presents an illustrative example of food access that is a multifaceted public health concern that, like many other complex public health problems, requires a social ecological approach to be successfully addressed. Concept mapping is a method that bridges the strengths of qualitative and quantitative techniques to generate hypotheses and theory around complex public health topics.
Community Wellness	Frerichs, L., Kim, M., Dave, G., Cheney, A., Lich, K. H., Jones, J., Young, T. L., Cene, C., W., Varma, D. S., Schaal, J., Black, A., Striley, C. W., Vassar, S., Sullivan, G., Cottler, L. B., Brown, A., Burker, J. G., Corbie-Smith, G.	2016	Stakeholder perspectives on creating and maintaining trust in community-academic research partnerships.	Health Education & Behavior	https://doi.org/10.1177/1090198116648291	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6051524/pdf/nihms980873.pdf	University of North Carolina at Chapel Hill	Community–academic research partnerships aim to build stakeholder trust in order to improve the reach and translation of health research, but there is limited empirical research regarding effective ways to build trust. This multisite study was launched to identify similarities and differences among stakeholders’ perspectives of antecedents to trust in research partnerships. In 2013–2014, we conducted a mixed-methods concept mapping study with participants from three major stakeholder groups who identified and rated the importance of different antecedents of trust on a 5-point Likert-type scale. Study participants were community members (n = 66), health care providers (n = 38), and academic researchers (n = 44). All stakeholder groups rated “authentic communication” and “reciprocal relationships” the highest in importance. Community members rated “communication/methodology to resolve problems” (M = 4.23, SD = 0.58) significantly higher than academic researchers (M = 3.87, SD = 0.67) and health care providers (M = 3.89, SD = 0.62; p < .01) and had different perspectives regarding the importance of issues related to “sustainability.” The importance of communication and relationships across stakeholders indicates the importance of colearning processes that involve the exchange of knowledge and skills. The differences uncovered suggest specific areas where attention and skill building may be needed to improve trust within partnerships. More research on how partnerships can improve communication specific to problem solving and sustainability is merited. Keywords: collaboration, community-based participatory research, translational research, trust
Community Wellness	Chandra, A., Acosta, J., Carman, K. G., Dubowitz, T., Leviton, L., Martin, L. T., Miller, C., Nelson, C., Orleans, T., Tait, M., Trujillo, M., Towe, V., Yeung, D., & Ploug, A. L.	2016	Building a National Culture of Health: Background, Action Framework, Measures, and Next Steps.	Santa Monica, CA: RAND Corporation.		https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5568157/?report=printable	RAND Corporation	Because health is a function of more than medical care, solutions to U.S. health problems must encompass more than reforms to health care systems. But those working to improve health, well-being, and equity still too often find themselves traveling on parallel paths that rarely intersect. In 2013, the Robert Wood Johnson Foundation (RWJF) embarked on a pioneering effort to advance a Culture of Health initiative. A Culture of Health places well-being at the center of every aspect of life, with the goal of enabling everyone in our diverse society to lead healthier lives, now and for generations to come. To put this vision into action, RWJF worked with RAND to develop an action framework that identifies how the nation will work toward achieving these outcomes. This article provides background on the development of this action framework. The Culture of Health action framework is designed around four action areas and one outcome area. Action areas are the core areas in which investment and activity are needed: (1) making health a shared value; (2) fostering cross-sector collaboration to improve well-being; (3) creating healthier, more equitable communities; and (4) strengthening integration of health services and systems. Each action area contains a set of drivers indicating where the United States needs to accelerate change and a set of measures illustrating places for progress. Within the primary Culture of Health outcome---improved population health, well-being, and equity---the authors identified three outcome areas: enhanced individual and community well-being, managed chronic disease and reduced toxic stress, and reduced health care costs. Keywords: Chronic Diseases and Conditions; Community Health; Health Behaviors; Health Care Costs; Health Interventions; Health and Wellness Promotion; Health-related Quality Of Life; United States.
Community Wellness	Dulin-Keita, A., Hannon, L., Buys, D., Casazza, K., & Clay, O. J.	2016	Surrounding community residents' expectations of HOPE VI for their community, health and physical activity.	Journal of Community Practice	https://doi.org/10.1080/10705422.2015.1129005	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5029852/pdf/nihms-779588.pdf	Brown University	Using a community-engaged participatory research approach, this study identified surrounding community residents' expectations for how a HOPE VI housing initiative might affect their community and individual health and physical activity. Fifty-nine women and men engaged in concept mapping, which is a mixed methods approach, where participants generate, sort, and rate ideas. Participants generated 197 unique statements. Thirteen thematic clusters related to expected changes for the community, health and physical activity emerged. Residents' rated 'Increased Pride in the Neighborhood' and 'Increased Safety' as the most important factors related to HOPE VI whereas 'Drawbacks of HOPE VI' was rated as least important. This research provides insight into the potential impacts of housing initiatives from the perspective of those most affected by such initiatives. The findings also highlight environmental changes as potential mechanisms that may improve residents' perceptions of the community and encourage healthy lifestyles. Keywords: African American; community engaged research; concept mapping; housing policy; mixed-methods.
Community Wellness	Stack-Cutler, H., Schnirer, L., & Dare, L.	2017	Engaging populations living with vulnerable conditions in community-based research: A concept mapping approach to understanding positive practices.	Journal of Community Psychology	https://doi.org/10.1002/jcop.21880		University of Alberta	The goal of this research is to identify positive practices used when conducting community-based research with people living with vulnerable conditions. Community-based research practitioners who participated in the research included 37 researchers, community partners, program planners, and government employees, working in health, human services, children and youth, and education sectors. Concept mapping, a participatory stakeholder-driven process, was used to generate a framework of how community-based research practitioners responded to the complex environments of people living with vulnerable conditions when conducting research. Respondents generated positive practices, determined relationships among practices, and rated practices on frequency of use and perceived effectiveness. This study revealed 7 clusters of positive practices: ethical practices, participant supports, social accountability, community involvement, language competence, financial compensation, and project management.
Community Wellness	Yonas, M., Zuberi, A., Kasunic, A., Bamwine, P., Boddie, S., Tarp-Gilliam, S., & Wallace, J.	2017	Using concept mapping to explore and engage parent and youth residents of an economically underserved minority community around children's asthma.	Progress in Community Health Partnerships: Research, Education and Action	https://doi.org/10.1353/cpr.2017.0041	https://www.researchgate.net/profile/Anna-Kasunic-2/publication/322492987_Using_Concept_Mapping_to_Explore_and_Engage_Parent_and_Youth_Residents_of_an_Economically_Underserved_Minority_Community_around_Children%27s_Asthma/links/5b8fded9299bf114b7f66b6b/Using-Concept-Mapping-to-Explore-and-Engage-Parent-and-Youth-Residents-of-an-Economically-Underserved-Minority-Community-around-Childrens-Asthma.pdf?origin=publication_detail	The Pittsburgh Foundation	Background: Asthma continues to disproportionately impact children living in economically underserved urban neighborhoods, and contributes to persistent racial and economic disparities in health. Furthermore, asthma is often exacerbated by the presence of social and environmental factors that are prevalent in, and sometimes particular to, these communities. Objectives: The present study uses a community-based participatory research (CBPR) approach to explore and define the experience and issues around children's asthma in an economically underserved community. These findings will be used to inform the design of a community intervention. Methods: Through a community and academic partnership called Healthy Living, Healthy Learning, Healthy Lives (HL3), we engaged neighborhood youth and adult residents (N = 21) in a concept mapping activity to identify triggers and health care-related factors that influence children with asthma. Results: Findings highlight that the most important triggers of asthma included indoor and outdoor irritants and allergens, as well as violence and fear-related emotions. The most important factors perceived to influence the care of asthma included medical relievers such as asthma medication, appliances such as a humidifier, and supports for asthma like the school nurse. Differences between adults and youth perceptions of factors triggering and influencing asthma are highlighted. Conclusions: Engaging community residents as experts provided a deeper understanding of the issues around children's asthma in the community, which can contribute to the design of a more effective intervention.
Community Wellness	Hanzen, G., van Nispen, R. M. A., van der Putten, A. A. J., & Weninge, A.	2017	Participation of adults with visual and severe or profound intellectual disabilities: Definition and operationalization.	Research in Developmental Disabilities	https://doi.org/10.1016/j.ridd.2016.12.017		Royal Dutch Visio	The available opinions regarding participation do not appear to be applicable to adults with visual and severe or profound intellectual disabilities (VSPID). Because a clear definition and operationalization are lacking, it is difficult for support professionals to give meaning to participation for adults with VSPID. Aims: The purpose of the present study was to develop a definition and operationalization of the concept of participation of adults with VSPID. Methods: Parents or family members, professionals, and experts participated in an online concept mapping procedure. This procedure includes generating statements, clustering them, and rating their importance. The data were analyzed quantitatively using multidimensional scaling and qualitatively with triangulation. Results: A total of 53 participants generated 319 statements of which 125 were clustered and rated. The final cluster map of the statements contained seven clusters: (1) Experience and discover; (2) Inclusion; (3) Involvement; (4) Leisure and recreation; (5) Communication and being understood; (6) Social relations; and (7) Self-management and autonomy. The average importance rating of the statements varied from 6.49 to 8.95. A definition of participation of this population was developed which included these seven clusters. Conclusions: The combination of the developed definition, the clusters, and the statements in these clusters, derived from the perceptions of parents or family members, professionals, and experts, can be employed to operationalize the construct of participation of adults with VSPID. This operationalization supports professionals in their ability to give meaning to participation in these adults. Future research will focus on using the operationalization as a checklist of participation for adults with VSPID. Keywords: Concept mapping; Participation; Severe or profound intellectual disabilities; Visual disability.
Community Wellness	Pauly, B., Martin, W., Perkin, K., van Roode, T., Kwan, A., Patterson, T., Tong, S., Prescott, C., Wallace, B., Hancock, T., & MacDonald, M.	2018	Critical considerations for the practical utility of health equity tools: A concept mapping study.	International Journal for Equity in Health	https://doi.org/10.1186/s12939-018-0764-6	https://equityhealthj.biomedcentral.com/track/pdf/10.1186/s12939-018-0764-6.pdf	University of Victoria	Background: Promoting health equity within health systems is a priority and challenge worldwide. Health equity tools have been identified as one strategy for integrating health equity considerations into health systems. Although there has been a proliferation of health equity tools, there has been limited attention to evaluating these tools for their practicality and thus their likelihood for uptake. Methods: Within the context of a large program of research, the Equity Lens in Public Health (ELPH), we conducted a concept mapping study to identify key elements and themes related to public health leaders and practitioners’ views about what makes a health equity tool practical and useful. Concept mapping is a participatory mixed-method approach to generating ideas and concepts to address a common concern. Participants brainstormed responses to the prompt “To be useful, a health equity tool should…” After participants sorted responses into groups based on similarity and rated them for importance and feasibility, the statements were analyzed using multidimensional scaling, then grouped using cluster analysis. Pattern matching graphs were constructed to illustrate the relationship between the importance and feasibility of statements, and go-zone maps were created to guide subsequent action. Results: The process resulted in 67 unique statements that were grouped into six clusters: 1) Evaluation for Improvement; 2) User Friendliness; 3) Explicit Theoretical Background; 4) Templates and Tools 5) Equity Competencies; and 6) Nothing about Me without Me- Client Engaged. The result was a set of concepts and themes describing participants’ views of the practicality and usefulness of health equity tools. Conclusions: These thematic clusters highlight the importance of user friendliness and having user guides, templates and resources to enhance use of equity tools. Furthermore, participants’ indicated that practicality was not enough for a tool to be useful. In addition to practical characteristics of the tool, a useful tool is one that encourages and supports the development of practitioner competencies to engage in equity work including critical reflections on power and institutional culture as well as strategies for the involvement of community members impacted by health inequities in program planning and delivery. The results of this study will be used to inform the development of practical criteria to assess health equity tools for application in public health.
Community Wellness	Salvador, J. G., Altschul, D., Rosas, S. R., Goldman, A. W., & Feldstein Ewing, S. W.	2018	Use of concept mapping to support evidence-based practice implementation improvement in rural areas.	Journal of Rural Mental Health	https://doi.org/10.1037/rmh0000086		University of New Mexico	Limited research exists on what rural provider agency staff and state-level leadership agree are key factors affecting implementation of evidence-based practices (EBPs) for substance abuse in rural areas. Lack of communication and agreement about barriers can lead to stagnation in making the difficult practice and policy changes that are required to improve implementation. Given this problem, the authors conducted concept mapping with rural provider agency staff and state level agency staff who worked in substance use disorder prevention, treatment, or recovery to develop a shared understanding of the critical factors affecting the implementation of EBPs in a rural state. This resulted in identifying 10 key areas for improvement and the relative importance of each area. This study describes the collaborative process of concept mapping and its impact on state efforts to improve EBP implementation in rural areas.
Community Wellness	Mehdipanah, R., Ramirez, J., Abedin, S., & Brown, S. F.	2018	Housing discrimination and health: Understanding potential linking pathways using a mixed-methods approach.	Social Sciences	https://doi.org/10.3390/socsci7100194	https://www.mdpi.com/2076-0760/7/10/194/pdf	University of Michigan	Few studies have examined the impact of housing discrimination on health. This study explores potential pathways linking housing discrimination and health using concept mapping, a mixed-method approach. Participants included employees from twenty Fair Housing Organizations nationwide who participated in two online sessions, brainstorming, and structuring. Responses were generated representing biological, social, economic, and physical connections between housing discrimination and health. Using hierarchical cluster analysis, five clusters were identified: (1) Access and barriers; (2) Opportunities for growth; (3) Neighborhood and communities; (4) Physical effects of housing discrimination; and (5) Mental health. Clusters 1 (4.09) and 2 (4.08) were rated as most important for health, while clusters 2 (3.93) and 3 (3.90) were rated as most frequently occurring. These findings add to the limited evidence connecting housing discrimination to health and highlight the need for studies focusing on the long-term health effects of housing discrimination on individuals and neighborhoods.
Community Wellness	Skempes, D., Melvin, J., von Groote, P., Stucki, G., & Bickenbach, J.	2018	Using concept mapping to develop a human rights based indicator framework to assess country efforts to strengthen rehabilitation provision and policy: The Rehabilitation System Diagnosis and Dialogue framework (RESYST).	Globalization and Health	https://doi.org/10.1186/s12992-018-0410-5		University of Lucerne	Background: Rehabilitation is crucial for the realization of the right to health and a proper concern of global health. Yet, reliable information to guide rehabilitation service planning is unavailable in many countries in part due to the lack of appropriate indicators. To ensure universal health coverage and meet the central imperative of “leaving no one behind” countries must be able to assess key aspects of rehabilitation policy and provision and monitor how they have discharged their human rights responsibilities towards those most disadvantaged, including people with disability. This article describes the process of developing an expert guided indicator framework to assess governments’ efforts and progress in strengthening rehabilitation in line with the Convention on the Rights of Persons with Disabilities. Methods: A systems methodology - concept mapping - was used to capture, aggregate and confirm the knowledge of diverse stakeholders on measures thought to be useful for monitoring the implementation of the Convention with respect to health related rehabilitation. Fifty-six individuals generated a list of 107 indicators through online brainstorming which were subsequently sorted by 37 experts from the original panel into non overlapping categories. Forty-one participants rated the indicators for importance and feasibility. Multivariate statistical techniques where used to explore patterns and themes in the data and create the indicators’ organizing framework which was verified and interpreted by a select number of participants. Results: A concept map of 11 clusters of indicators emerged from the analysis grouped into three broader themes: Governance and Leadership (3 clusters); Service Delivery, Financing and Oversight (6 clusters); and Human Resources (2 clusters). The indicator framework was comprehensive and well aligned with the Convention. On average, there was a moderately positive correlation between importance and feasibility of the indicators (r = .58) with experts prioritizing the indicators contained in the clusters of the Governance and Leadership domain. Two of the most important indicators arose from the Service Delivery, Financing and Oversight domain and reflect the need to monitor unmet needs and barriers in access to rehabilitation. In total, 59 indicators achieved above average score for importance and comprised the two–tiered priority set of indicators. Conclusion: Concept mapping was successful in generating a shared model that enables a system’s view of the most critical legal, policy and programmatic factors that must be addressed when assessing country efforts to reform, upscale and improve rehabilitation services. The Rehabilitation Systems Diagnosis and Dialogue framework provides a data driven basis for the development of standardized data collection tools to facilitate comparative analysis of rehabilitation systems. Despite agreement on the importance and feasibility of 59 indicators, further research is needed to appraise the applicability and utility of the indicators and secure a realistic assessment of rehabilitation systems.
Community Wellness	Velonis, A. J., Molnar, A., Lee-Foon, N., Rahim, A., Boushel, M., & O'Campo, P.	2018	"One program that could improve health in this neighbourhood is ___?" using concept mapping to engage communities as part of a health and human services needs assessment.	BMC Health Services Research	https://doi.org/10.1186/s12913-018-2936-x		University of Illinois at Chicago	This paper presents the findings of a rapid needs assessment conducted at the request of the local health authority responsible for health care services, the Toronto Central Local Health Integration Network (Ontario, Canada), to inform health and social service planning. Methods We utilized concept mapping methodology to facilitate engagement with diverse stakeholders–more than 300 community members and service providers–with a focus on hard to reach populations. Key informant interviews with service providers were used to augment findings. Results: Participants identified 48 unique services or service approaches they believed would improve the health of residents in the area, including those addressing health care, mental health and addictions, youth, families, people experiencing homelessness, seniors, general social services, and services targeting specific populations. While service providers consistently identified a critical need for mental health and addiction services, community members placed greater importance on the social determinants of health including access to housing, job placement supports and training and service accessibility. Both groups agreed that services and programs for seniors and people experiencing homelessness would be highly important. Conclusion: Our study provides a unique example of using concept mapping as a tool to aid a rapid service gap analysis and community engagement in a metropolitan area. The findings also reinforce the importance of working cross-sectorally, using a Health in All Policies approach when planning services for underserved populations.
Community Wellness	Mulderij, L. S., Verkooijen, K. T., Koelen, M. A., & Wagemakers, A.	2019	De werkzame elementen van een gecombineerde leefstijlinterventie voor mensen met een lage sociaaleconomische status. Een concept mapping-caseonderzoek. [The active elements of a combined lifestyle intervention for people with a low socio-economic status. A concept mapping case study.]	TSG - Tijdschrift voor gezondheidswetenschappen	https://doi.org/10.1007/s12508-019-00243-w	https://link.springer.com/content/pdf/10.1007/s12508-019-00243-w.pdf	Wageningen University	Health inequalities still exist between people with a low socioeconomic status (SES) and people with a high SES. Combined lifestyle interventions (CLIs) could benefit the health of people with a low SES. However, it is unclear which CLI elements are effective for this group. Therefore, this study aimed to determine the effective elements X‑Fittt 2.0, a CLI for people with a low SES. Nine professionals and one participant of X‑Fittt 2.0 participated in a concept mapping (CM) process to develop an overview of the effective elements of X‑Fittt 2.0. CM consists of six steps: preparing, brainstorming, clustering, scoring, analysing, and discussing and interpreting. This process resulted in 72 effective elements, grouped in nine clusters, focused on monitoring (12), internal (7) and external (4) collaborations, structure and guidance (10), agreements with participants (5), sports options in the first 12 weeks (10), the sports environment (10), recruitment strategies (5) and the preconditions for X‑Fittt 2.0 (9). These results provide a valuable first overview of effective elements of CLIs for people with a low SES.
Community Wellness	Nielsen, K. T., Klokker, L., Guidetti, S., & Waehrens, E. E.	2019	At identificere, organisere og prioritere ideer til, hvordan evnen til almindelig daglig levevis (ADL) kan forbedres.	Ergoterapeutuddannelsen	https://doi.org/10.17896/UCN.perspektiv.n6.353	https://journals.ucn.dk/index.php/perspektiv/article/view/353/334	University of Southern Denmark	Baggrund: Der er behov for at udvikle evidensbaserede ergoterapeutiske interventioner, der sigter mod at forbedre evnen til at udføre almindelig daglig levevis (ADL) for personer med kroniske tilstande. I udviklingsprocessen bør forskellige former for information inddrages, herunder ergoterapeuters kliniske erfaringer samt klienternes præferencer. Formål: At identificere, organisere og prioritere idéer til, hvordan ADL-evnen kan forbedres for personer, der lever med kroniske tilstande. Metode: Group concept mapping blev anvendt, og følgende faser indgik i processen: brainstorming, sortering og prioritering, generering af cluster rating map, validering af cluster rating map og udvikling af konceptuel model. Deltagerne var personer med kroniske tilstande (n = ≤18) og ergoterapeuter (n = ≤23). Konklusion: Der blev identificeret forskellige temaer, i forhold til hvordan ADL-evnen kan forbedres for personer med kroniske tilstande. Temaerne spænder bredt og illustrerer derved kompleksiteten i at løse ADL-problemer. Personer med kroniske tilstande og ergoterapeuter har forskellige prioriteter, i forhold til hvordan ADL-problemer løses. Derfor er det vigtigt, at ergoterapeuter i daglig praksis involverer klienter i beslutninger om mulige løsninger. Ligeledes er det vigtigt, at både ergoterapeuter og klienter involveres i udvikling af interventioner.
Community Wellness	Velonis, A. J., Hebert-Beirne, J., Conroy, L. M., Hernandez, M., Castaneda, D., & Forst, L.	2019	Impact of precarious work on neighborhood health: Concept mapping by a community/academic partnership.	American Journal of Industrial Medicine	https://doi.org/10.1002/ajim.23055		University of Illinois at Chicago	As part of community-based participatory research (CBPR) examining precarious employment and community health, academic, and community researchers used concept mapping to explore how residents in two high hardship neighborhoods perceive the impact of work on health. Methods Between January and May 2017, 292 individuals who lived or worked in two contiguous Chicago neighborhoods were engaged in brainstorming, sorting, and rating activities. Multidimensional scaling and hierarchical cluster analysis were applied, and findings were interpreted by a community-academic partnership. Results Brainstorming resulted in 55 unique ways that work impacts health, each of which was rated on its perceived impact on health and prevalence in the neighborhood. Four major themes emerged: Healthy Aspects of Work, Systemic/Structural Injustices, Lack of Control/Exploitation, and Psychological/Physical Stress, which was a multidimensional, cross-cutting theme. Conclusion These findings provide critical insight into community perceptions of the mechanisms by which work influences health, providing a basis for community-driven, sustainable, work-focused interventions that promote community health.
Community Wellness	Cargo, M., Potaka-Osborne, G., Cvitanovic, L., Warner, L., Clarke, S., Judd, J., Chakraborty, A., & Boulton, A.	2019	Strategies to support culturally safe health and wellbeing evaluations in Indigenous settings in Australia and New Zealand: A concept mapping study.	International Journal for Equity in Health	https://doi.org/10.1186/s12939-019-1094-z	https://equityhealthj.biomedcentral.com/track/pdf/10.1186/s12939-019-1094-z.pdf	University of Canberra	In recent decades, financial investment has been made in health-related programs and services to overcome inequities and improve Indigenous people's wellbeing in Australia and New Zealand. Despite policies aiming to 'close the gap', limited evaluation evidence has informed evidence-based policy and practice. Indigenous leaders have called for evaluation stakeholders to align their practices with Indigenous approaches. Methods: This study aimed to strengthen culturally safe evaluation practice in Indigenous settings by engaging evaluation stakeholders, in both countries, in a participatory concept mapping study. Concept maps for each country were generated from multi-dimensional scaling and hierarchical cluster analysis. Results: The 12-cluster Australia map identifies four cluster regions: An Evaluation Approach that Honours Community; Respect and Reciprocity; Core Heart of the Evaluation; and Cultural Integrity of the Evaluation. The 11-cluster New Zealand map identifies four cluster regions: Authentic Evaluation Practice; Building Māori Evaluation Expertise; Integrity in Māori Evaluation; and Putting Community First. Both maps highlight the importance of cultural integrity in evaluation. Differences include the distinctiveness of the 'Respecting Language Protocols' concept in the Australia map in contrast to language being embedded within the cluster of 'Knowing Yourself as an Evaluator in a Māori Evaluation Context' in the New Zealand map. Participant ratings highlight the importance of all clusters with some relatively more difficult to achieve, in practice. Notably, the 'Funding Responsive to Community Needs and Priorities' and 'Translating Evaluation Findings to Benefit Community' clusters were rated the least achievable, in Australia. The 'Conduct of the Evaluation' and the 'Prioritising Māori Interests' clusters were rated as least achievable in New Zealand. In both countries, clusters of strategies related to commissioning were deemed least achievable. Conclusions: The results suggest that the commissioning of evaluation is crucial as it sets the stage for whether evaluations: reflect Indigenous interests, are planned in ways that align with Indigenous ways of working and are translated to benefit Indigenous communities Identified strategies align with health promotion principles and relational accountability values of Indigenous approaches to research. These findings may be relevant to the commissioning and conduct of Indigenous health program evaluations in developed nations. Keywords: Aboriginal and Torres Strait islander; Commissioning; Concept mapping; Cultural safety; Evaluation; Health promotion; Indigenous; Māori.
Community Wellness	Kading, M. L., Gonzalez, M. B., Herman, K. A., Gonzalez, J., & Walls, M. L.	2019	Living a good way of life: Perspectives from American Indian and First Nation Young Adults.	American Journal of Community Psychology	https://doi.org/10.1002/ajcp.12372	https://www.ncbi.nlm.nih.gov/pmc/articles/pmid/31486101/	College of St. Scholastica	In this study, we respond to calls for strengths-based Indigenous research by highlighting American Indian and First Nations (Anishinaabe) perspectives on wellness. We engaged with Anishinaabe community members by using an iterative, collaborative Group Concept Mapping methodology to define strengths from a within-culture lens. Participants (n = 13) shared what it means to live a good way of life/have wellness for Anishinaabe young adults, ranked/sorted their ideas, and shared their understanding of the map. Results were represented by nine clusters of wellness, which addressed aspects of self-care, self-determination, actualization, community connectedness, traditional knowledge, responsibility to family, compassionate respect toward others, enculturation, and connectedness with earth/ancestors. The clusters were interrelated, primarily in the relationship between self-care and focus on others. The results are interpreted by the authors and Anishinaabe community members though the use of the Seven Grandfather Teachings, which provide a framework for understanding Anishinaabe wellness. The Seven Grandfather Teachings include Honesty (Gwayakwaadiziwin), Respect (Manaadendamowin), Humility (Dabaadendiziwin), Love (Zaagi'idiwin), Wisdom (Nibwaakaawin), Bravery/Courage (Aakode'ewin), and Truth (Debwewin).
Community Wellness	McNeish, R., Walker, C., Massey, O., & Tran, Q.	2020	Using concept mapping to operationalize mental well-being for men and boys.	American Journal of Community Psychology	https://doi.org/10.1002/ajcp.12419		University of South Florida	A primary purpose of many prevention-oriented interventions is to improve the general well-being and quality of life for individuals and their communities. Unfortunately, well-being is often poorly defined, with definitions embracing related issues of quality of life, happiness, and physical health. Mental well-being as a concept is also poorly defined, particularly for different population groups. As part of a larger study to assess community-level prevention efforts aimed at men and boys, a participatory approach was used to operationalize mental well-being from a male-centered, community-based perspective using concept mapping. A set of 96 statements perceived as important aspects of mental well-being for men and boys were developed and sorted by 90 participants from the study communities. The 8-cluster solution was selected as the most parsimonious and the best conceptual fit in relation to the mental well-being concept, namely, positive self-worth, supportive community, community connections, positive masculinity, responsive institutions, strong social connection, dignity and respect, and safety. These eight clusters of mental well-being, which were classified into two overarching domains of socio-environmental and emotional well-being, can provide a basis by which to assess community-based programs aimed at this population. Keywords: Community Prevention; Concept mapping; Men and boys; Mental Well-being; Mental health.
Community Wellness	Felx, A., Kane, M., Corbière, M., & Lesage, A.	2020	Using group concept mapping to develop a conceptual model of housing and community-based residential settings for adults with severe mental illness.	Front Psychiatry	https://doi.org/10.3389/fpsyt.2020.00430	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7319103/pdf/fpsyt-11-00430.pdf	University of Montreal	Background: Most existing conceptual models of residential environments and housing programs were developed over a decade ago or lack comprehensiveness. The attributes to be used to describe housing programs with adequate specification remain unclear including the attributes that mediate service user outcomes. In this study, group concept mapping was used to develop a conceptual model of housing and community-based residential settings for adults with severe mental illness based on stakeholder perceptions and values. Methods: Participants were selected through purposive sampling and included service users, family members, staff working in residential facilities, mental health workers and managers. Participants (n=221) generated 1,382 statements describing attributes of housing and community-based residential settings for adults with severe mental illness (99% saturation). Thematic content analysis was conducted to analyze the statements and create a list of 140 selected statements. Participants then rated (n=416) and sorted into categories (n=73) the selected statements. Descriptive statistics were computed for each statement relative importance. Multidimensional scaling and hierarchical cluster analysis were used to produce the conceptual model (maps). Stakeholders (n=12) were also involved in the interpretation of the maps. Results: The findings show overall concordance between stakeholders in relation to statements perceived importance (rating) and the statements inter-relationships (sorting). The stress value of 0.23 indicates that the two-dimensional solution of the multidimensional scaling analysis fits the data set (goodness of fit). The final conceptualization includes 12 clusters: (1) A balanced and healthy housing system; (2) Quality and management practices (facility/local level); (3) Physical external environment; (4) Services tailored to needs and preferences; (5) Services and interventions provided (linkage); (6) Equality, policies and availability of activities; (7) Organizational structure and staff qualities; (8) Services and interventions (learning skills); (9) Services and interventions (daily living support); (10) Personal space and right to privacy; (11) Physical interior environment; (12) Respect, functioning and atmosphere. Conclusion: The results illustrate the multifaceted and multilevel nature of community-based residential settings through a visual representation. They articulate a number of attributes, clusters and dimensions that could be included in a common conceptual model of community-based residential settings and housing for adults with severe mental illness. Keywords: community-based residential settings; concept mapping; conceptualization; housing; mental health services; mixed-method approach; supported/supportive housing.
Community Wellness	Rachele, J., Wiesel, I., van Holstein, E., Feretopoulos, V., de Vries, T., Green, C., & Bicknell, E.	2020	Feasibility and the care-full just city: Overlaps and contrasts in the views of people with disability and local government officers on social inclusion.	Cities	https://doi.org/10.1016/j.cities.2020.102650	https://vuir.vu.edu.au/40679/1/CoM_GCM_FinalAccepted.pdf	University of Melbourne	In this paper we consider how ‘feasibility’ considerations in urban policymaking fit within wider theories of the care-full just city. Specifically, we consider practical ways to bring together what people with disability consider the most important initiatives to enhance their social inclusion in the city, and the perceptions of local government officers about what initiatives are feasible to implement in the context of complex urban governance structures. While feasibility and care-full justice might appear incompatible, we argue that notions of responsibility, competence, resourcing and action are all integral to both ‘feasibility’ and the care-full just city. This discussion is informed by empirical data from a research project undertaken in the City of Melbourne, Australia, following a mixed-method approach called group concept mapping. We organised a series of structured workshops with people with physical and mobility, sensory, intellectual, and psychosocial disabilities, and with government staff, disability advocates, and academics to collect ideas on how to enhance social inclusion for people with disability in the City of Melbourne, and to rate the importance and feasibility of those ideas.
Community Wellness	Donohue-Dioh, J., Otis, M., Miller, J. J., Sossou, M. A., delaTorres, C., & Lawson, T.	2020	Survivors' conceptualizations of human trafficking prevention; An exploratory study.	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2020.101873		University of Houston-ClearLake	The purpose of this study was to explicate a conceptual framework for the prevention of human trafficking from the perspective of those most impacted: human trafficking survivors. In doing so establishing an empirical foundation for human trafficking prevention research. To achieve this aim, researchers employed Group Concept Mapping (GCM). GCM is an integrated, mixed-method, research design that analyzes qualitative data via quantitative approaches, namely multidimensional scaling and hierarchical cluster analyses. All participants (N = 35) identified as human trafficking survivors from one of four states in the United States. Results indicate that survivors in this sample conceptualize prevention via a 10-cluster solution. Furthermore survivors rated the cluster on Education and Awareness (9) as the most Important (4.60), as well as the most Feasible (4.28). This paper will review extant literature related to human trafficking, explicate results from this study, and discuss pragmatic prevention implications related to findings.
Community Wellness	Puid-Barrachina, V., Malmusi, D., Artazcoz, L., Bartoll, X., Clotet, E., Cortes-Franch, I., Ventura, L., Daban, F., Diez, E., & Borrell, C.	2020	How does a targeted active labour market program impact on the well-being of the unemployed? A concept mapping study on Barcelona “Employment in the Neighbourhoods.”	BMC public health	https://doi.org/10.1186/s12889-020-8441-2	https://bmcpublichealth.biomedcentral.com/track/pdf/10.1186/s12889-020-8441-2.pdf	Public Health Organization in Barcelona	The "Employment in the neighbourhoods" program is an innovative, tailor-made Active Labour Market Program that has been implemented in 12 neighbourhoods in Barcelona (Spain). Its goal is to get people from deprived, high-unemployment neighbourhoods back to work. The aim of this study was to describe the effects of the program on participants' quality of life, and identify the mechanisms underlying these effects, according to their own perception and the perception of technical staff who assisted them. Methods: We used Concept Mapping, a mixed methods approach combining qualitative and quantitative analysis, to develop a conceptual map of the participants' and technical staffs' perceptions about changes in the participants' quality of life. Data collection occurred within the generation and structuring steps where participants brainstormed answers to a focus question, and then rated and sorted the responses. To create maps, we used Concept Systems Incorporated The Concept System® Global MAX™ software, which conducted two main forms of analysis, a multidimensional scaling analysis, and a hierarchical cluster analysis. Results: Study participants reported several positive effects on mental health and emotional wellbeing, including self-esteem and empowerment, and considered that this was achieved through strengthened social networks, skills acquisition, emotional coaching, and personalized technical assistance. They also described some negative impacts, mainly related to the labour market situation. We observed marked gender differences in the discourses of program participants. Conclusions: The results obtained have allowed us to identify different perceived effects and mechanisms by which the "Employment in the Neighbourhoods" Active Labour Market Programme can influence quality of life of participants from the most deprived areas of Barcelona. Keywords: Active labour market programs; Barcelona City (Spain); Concept mapping; Deprived neighbourhoods; Gender; Quality of life; Unemployment.
Community Wellness	Swick, Z., Baker, E., Elliott, M., & Zelicoff, A.	2020	The Cascadia Subduction Zone earthquake: Will emergency managers be willing and able to report to work?	Natural Hazards	https://doi.org/10.1007/s11069-020-04005-9	https://link.springer.com/content/pdf/10.1007/s11069-020-04005-9.pdf	Idaho State University	This study examines the factors that are likely to influence emergency managers’ willingness and ability to report to work after a catastrophic event using the Cascadia Subduction Zone earthquake threat as an example. The population approached for participation in this study was state-level emergency managers in Oregon and Washington, the areas anticipated to be the most impacted by the Cascadia Subduction Zone earthquake. Concept mapping was utilized to elucidate factors influencing emergency managers’ ability and willingness to report to work following a catastrophic earthquake, as well as to identify specific strategies for addressing these factors to facilitate reporting to work. The six-step concept mapping process (i.e., preparation, generation, structuring, representation, interpretation, and utilization) is a structured and integrated mixed-method process that employs both qualitative and quantitative components to gather ideas and concepts of participants, and subsequently produces visual representation of these ideas and concepts through multivariate statistical methods (Caracelli and Green in Eval Program Plan 12(1):45–52, 1993; Kane and Trochim in Concept mapping for planning and evaluation, Sage Publications, Thousand Oaks, 2007). Results influence across a wide range of the levels of the ecological framework for both ability (transit barriers and infrastructure impacts, family/pet health and safety, social support and preparedness, work-related influences, personal health and resources, professional obligations, and location) and willingness (family/community preparedness and safety, emergency management responsibility and professionalism, motivation to come to work, transit barriers and infrastructure impacts, professional contribution, physical and mental health, worksite operations: structure and process, family first, personal contribution and history).
Community Wellness	Lebow-Skelley, E., Yelton, S., Janssen, B., Erdei, E., & Pearson, M. A.	2020	Identifying Issues and Priorities in Reporting Back Environmental Health Data.	International Journal of Environmental Research and Public Health	https://doi.org/10.3390/ijerph17186742	https://mdpi-res.com/d_attachment/ijerph/ijerph-17-06742/article_deploy/ijerph-17-06742-v2.pdf?version=1600326055	Emory University	Experts recommend reporting environmental exposure results back to research participants and communities, yet environmental health researchers need further guidance to improve the practice of reporting back. We present the results of a workshop developed to identify pertinent issues and areas for action in reporting back environmental health research results. Thirty-five attendees participated, brainstorming responses to the prompt: "What are some specific issues that are relevant to reporting back research results to individuals or the larger community?", and then grouping responses by similarity and rating their importance. Based on a combined theoretical foundation of grounded theory and qualitative content analysis, we used concept mapping to develop a collective understanding of the issues. Visual maps of the participants' responses were created using nonmetric multidimensional scaling and hierarchical cluster analysis. The resulting concept map provided a spatial depiction of five issue areas: Effective Communication Strategies, Community Knowledge and Concerns, Uncertainty, Empowering Action, and Institutional Review and Oversight (listed from highest to lowest rating). Through these efforts, we disentangled the complex issues affecting how and whether environmental health research results are reported back to participants and communities, by identifying five distinct themes to guide recommendations and action. Engaging community partners in the process of reporting back emerged as a unifying global theme, which could improve how researchers report back research results by understanding community context to develop effective communication methods and address uncertainty, the ability to act, and institutional concerns about beneficence and justice. Keywords: community engagement; concept mapping; environmental health; research report-back.
Community Wellness	Washington-Nortey, P. M., & Serpell, Z.	2021	Parental expectations for children with intellectual disability or autism in Ghana and Zambia: A concept mapping study.	Research in Developmental Disabilities	https://doi.org/10.1016/j.ridd.2021.103989		Virginia Commonwealth University	Parent expectations have an important impact on children's outcomes. Despite a wealth of research on the familial experience of children with disabilities in African countries, very few studies have examined expectations these children's parents hold for them. Aims: This study explores parental expectations for children with intellectual disability, or autism and assesses their perceived importance and likelihood of attainment. Methods and procedures: Concept mapping methodology with focus groups comprised of parents of children with intellectual disability or autism were employed. Outcomes and results: Results revealed several expectation themes: independence, acceptance and inclusion, public awareness, education, governmental assistance, resources, and healthcare. Whereas some expectations were congruent with themes in the broader literature, nuances within themes reflected cultural and societal conditions. Themes unique to each country also emerged, and importance and likelihood ratings revealed some cultural variation across the two countries. Expectations and the value placed on them differ across countries. Implications: This study represents an important first step in efforts to understand the developmental contexts of children with disabilities on the African continent. Findings inform future research and potential strategies for policy and practice.
Community Wellness	Mahabir, D., O’Campo, P., Lofters, A., Shankardass, K., Salmon, C., & Muntaner, C.	2021	Classism and Everyday Racism as Experienced by Racialized Health Care Users: A Concept Mapping Study.	International Journal of Health Services	https://doi.org/10.1177%2F00207314211014782	https://journals.sagepub.com/doi/pdf/10.1177/00207314211014782	University of Toronto	In Toronto, Canada, 51.5 % of the population are members of racialized groups. Systemic labor market racism has resulted in an overrepresentation of racialized groups in low-income and precarious jobs, a racialization of poverty, and poor health. Yet, the health care system is structured around a model of service delivery and policies that fail to consider unequal power social relations or racism. This study examines how racialized health care users experience classism and everyday racism in the health care setting and whether these experiences differ within stratifications such as social class, gender, and immigration status. A concept mapping design was used to identify mechanisms of classism and everyday racism. For the rating activity, 41 participants identified as racialized health care users. The data analysis was completed using concept systems software. Racialized health care users reported "race"/ethnic-based discrimination as moderate to high and socioeconomic position-/social class-based discrimination as moderate in importance for the challenges experienced when receiving health care; differences within stratifications were also identified. To improve access to services and quality of care, antiracist policies that focus on unequal power social relations and a broader systems thinking are needed to address institutional racism within the health care system. Keywords: classism; concept mapping; everyday racism; health care; institutional racism policy; social class; socioeconomic position.
Community Wellness	Mourits, K., van der Velden, K., & Molleman, G.	2021	The perceptions and priorities of professionals in health and social welfare and city planning for creating a healthy living environment: a concept mapping study.	BMC public health	https://doi.org/10.1186/s12889-021-11151-7	https://bmcpublichealth.biomedcentral.com/track/pdf/10.1186/s12889-021-11151-7.pdf	Radboud University	It is helpful for collaboration if professionals from the field of health and social welfare and the field of city planning are aware of each other’s concepts of what a healthy living environment entails and what its components are. This study examined perceptions about creating a healthy living environment of professionals from these two fields, as well as the differences between them. Methods: We recruited 95 professionals from Nijmegen, the Netherlands who worked in the fields of health, social welfare and city planning in governmental and non-governmental capacities. We used the concept mapping method to collect and analyse their thoughts on healthy living environments. Participants first submitted statements on this subject in a brainstorming session, using an online mapping tool. Then they sorted these statements and rated them on priorities and opportunities within urban planning processes. Results: During the brainstorm, 43 professionals generated 136 statements. After the elimination of duplicates, 92 statements were individually sorted by 32 professionals. Concept mapping software was used to create an overall map, in which the statements were sorted into ten clusters. Each of these clusters represented one of the main features of a healthy living environments. After 36 participants rated these statements, it emerged that professionals from both fields agreed on priorities and opportunities for the clusters ‘Spatial quality’ and ‘Conducive to exercise’. Professionals also agreed on which three clusters had the fewest priorities and possibilities (‘Promotes personal wellbeing’, ‘Encourages healthy choices’, ‘Conducive to social connections’). Conclusion: We found that professionals in health and social welfare and city planning have similar views concerning the most and least important features of a healthy living environment in urban planning process. This could indicate that the differences between the two fields may be more nuanced and specific than previously thought. This knowledge offers perspectives for professionals to strengthen their collaboration and to come to a joint result in urban planning projects.
Community Wellness	Ivana Svobodova, Daniela Filakovska Bobakova, Lucia Bosakova & Zuzana Dankulincova Veselska	2021	How to improve access to health care for Roma living in social exclusion: a concept mapping study.	International journal for equity in health	https://doi.org/10.1186/s12939-021-01396-4	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7881662/pdf/12939_2021_Article_1396.pdf	Olomouc University	Half of the people living in social exclusion in the Czech Republic are of Roma origin. The worse health of Roma could be partly explained by numerous barriers to accessing health care. Therefore, our study aimed to explore the perceptions of various stakeholders and experts who may have an impact on the inclusion of Roma and/or their access to health care on how to improve health care access for Roma living in social exclusion in the Czech Republic. Methods: We conducted a concept mapping study and obtained data from 32 participants from health and social services, policymakers and others who were involved in different study phases (brainstorming, sorting, rating, interpretation). Results: Out of 64 proposed measures sorted into six distinct clusters, 20 were rated as the most urgent and the most feasible and should be implemented with a priority to improve access to health care for Roma living in social exclusion. The proposed measures covered various topics, such as education and awareness of the target group as well as education and supervision of helping professionals, strengthening capacities and streamlining the health care system, health promotion and associated services and increasing the local and financial accessibility of health care. Overall, measures concerning the education and supervision of helping professionals were rated as both the most urgent and the most feasible. Individual priority measures targeted, for example, the health needs assessment of Roma living in social exclusion to set up interventions or to include topics such as participation, empowerment, cultural competence and communication training in the curricula of health care and helping professionals in postgraduate and continuing studies. Conclusions: Stakeholders proposed a set of relevant and acceptable measures that may help improve access to health care for Roma living in social exclusion. The way they rated the proposed measures reflects both the current unfavourable mainstream and public discourse concerning Roma living in social exclusion and the most acute policy issues identified by several European and national bodies. Keywords: Health care access, Vulnerable population, Roma, Ethnicity, Policies, Interventions, Concept mapping, Czech Republic
Community Wellness	McBeath, B., Franks, O., Delormier, T., Périllat-Amédée, S., McComber, A., Abigosis, T., Leafe, D., Macaulay, A., & Lévesque, L.	2021	Reflecting on the use of Concept Mapping as a Method for Community-Led Analysis of Talking Circles	Turtle Island Journal of Indigenous Health	https://doi.org/10.33137/tijih.v1i2.36171	https://jps.library.utoronto.ca/index.php/tijih/article/view/36171/28706	Queen's University	Indigenous peoples' active involvement in and ownership of research involving their communities are imperative to ensure that community values are prioritized and that research fosters self-determination of Indigenous health. To share our reflections about how concept mapping can be useful within the context of research with First Nations communities. Three First Nations communities participating in the Kahnawà:ke Schools Diabetes Prevention Project Community Mobilization Training (CMT) engaged in Concept Mapping (Kane & Trochim, 2007). Community Research Assistants provided testimonials about the process. The strengths of using concept mapping within this project align with the current literature that highlights it is very adaptable to Indigenous contexts, allows for high levels of engagement throughout the entire research process from design to dissemination, and thus strengthens ownership of the research project among community members. Concept mapping is relevant and useful for research with First Nations communities.
Community Wellness	Simonds, T. S. J, Appleget, C., Cook, Timothy. Fussell, R., Philippe, K., Rödlach, A. & SVD R. Rosales S. J.	2023	Understanding the Latino/a student experience in Catholic high schools in a United States diocese		https://doi.org/10.1080/19422539.2022.2164005	https://www.tandfonline.com/doi/epdf/10.1080/19422539.2022.2164005?needAccess=true&role=button	Creighton University	Our multi-disciplinary research team explored the experiences and concerns of Latino/a students and their parents related to being welcomed and included in Catholic high schools in a United States diocese. We collected both qualitative and quantitative data in order to create a fuller picture of Latino/a experiences in these high schools. We make recommendations based on our findings to advance the scholarship on best practices for including students of new demographic groups in Catholic high schools with a specific focus on welcoming and including Latino and Latina students in Catholic high schools.
Counseling and Mental Wellness	Noyes-Grosser, D. M., Rosas, S. R., Goldman, A., Elbaum, B., Romanczyk, R., & Callahan, E. H.	2013	Conceptualizing child and family outcomes of early intervention services for children with ASD and their families.	Journal of Early Intervention	https://doi.org/10.1177/1053815114551415	https://www.researchgate.net/profile/Raymond-Romanczyk/publication/273708724_Conceptualizing_Child_and_Family_Outcomes_of_Early_Intervention_Services_for_Children_With_ASD_and_Their_Families/links/567ac4aa08ae1e63f1df67be/Conceptualizing-Child-and-Family-Outcomes-of-Early-Intervention-Services-for-Children-With-ASD-and-Their-Families.pdf?origin=publication_detail	New York State Department of Health	State early intervention programs (EIPs) have been encouraged to develop and implement comprehensive outcomes measurement systems. As the number of children with autism spectrum disorders (ASD) and their families receiving services in state EIPs increases, disability-specific outcomes data are needed to better understand issues of access, costs, and benefits. The New York State Early Intervention Program (NYSEIP) used concept mapping with parent and professional stakeholders to define child and family outcomes expected from early intervention services for children with ASD and their families. Stakeholders generated more than 700 statements (synthesized to 105), then individually sorted (17 parents, 39 professionals) these statements into categories. Stakeholders rated each outcome on importance (20 parents, 48 professionals) and likelihood (18 parents, 46 professionals) that EIP services will yield a positive impact. The aggregated sort data were subjected to two separate sets of multivariate statistical analyses, producing an 11-cluster map of professionals' conceptualization and a 7-cluster map of parent/family members' conceptualization of the outcomes. Possible explanations for the parent/professional differences are discussed. The results will be used as part of ongoing efforts to develop a comprehensive evaluation system for state Part C EIPs that is grounded in stakeholders' perspectives on expected outcomes for children and families.
Counseling and Mental Wellness	Felx, A., Kane, M., Corbiere, M., & Lesage, A.	2014	La cartographie de concepts: Une representation visuelle et spatiale pour decrire les ressources residentielles en sante mentale.	Methodes Qualitatives, Quantitatives et Mixtes			University of Montreal	La méthode est la pierre angulaire de la recherche appliquée en sciences humaines, sociales et de la santé, car c’est elle qui balise le chemin qu’emprunte le chercheur pour réaliser ses travaux. Elle doit soutenir le processus de réflexion en fonction du contexte dans lequel s’inscrit un projet, soit tenir compte de la question de recherche, du phénomène et de la population à l’étude. Dans un monde de la recherche de plus en plus décloisonné et vaste, il devient nécessaire de disposer d’une perspective englobante, capable d’intégrer les apports de diverses approches méthodologiques tout en reconnaissant leurs particularités. Le présent ouvrage, en évitant le traditionnel clivage entre méthodes qualitatives et quantitatives, présente 30 devis ou analyses de recherche, dont l’étude de cas, la théorisation ancrée, la revue de littérature systématique, l’essai randomisé, le groupe de discussion focalisée, les analyses multiniveaux, la modélisation par équations structurelles et les approches participatives. Cette nouvelle édition est également enrichie de chapitres portant sur l’examen de la portée, la méta-review des écrits, l’analyse de puissance, l’analyse d’agrégats géographiques, les algorithmes d’apprentissage automatique ou statistique, la modélisation de type Rasch et les enquêtes en ligne. Tout au long du manuel, des ponts sont établis entre les méthodes de recherche qualitatives, quantitatives et mixtes afin de mettre en lumière leurs points communs et leurs articulations. Leurs applications concrètes permettront également au lecteur (étudiant, chercheur, professeur ou intervenant) de reproduire le cheminement méthodologique tracé par les auteurs. eISBN: 978-2-7605-5140-4
Counseling and Mental Wellness	Byers, K., Johnson, T., Davis-Groves, S., Byrnes, K., & McDonald, T.	2014	Elevating stakeholder voice: Considering parent priorities in model development for community mental health center services.	Children and Youth Services Review	https://doi.org/10.1016/j.childyouth.2014.05.009	https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0221807&type=printable	University of Kansas	Peer-support services, including Parent Support and Training, have traditionally subscribed to a strict definition of what it means to qualify as a peer, and therefore as a provider of these services. This article examines views of peer and non-peer stakeholders in Kansas CMHCs on additional characteristics of “peer-ness.” The findings of this analysis result in a call for a broadening of the definition of “peer” in order to creatively meet the needs of families in the current service climate while still providing support for upholding the family-driven paradigm that brought about inclusion of parent voice in the treatment process—a hallmark of the PST service.
Counseling and Mental Wellness	Goorden, M., Willemsen, E. M. C., Bouwmans-Frijters, C. A. M., Busschbach, J. J. V., Noomx, M. J., van der Feltz-Cornelis, C. M., Uyl-de Groot, C. A., & Hakkaart-van Roijen, L.	2017	Developing a decision tool to identify patients with personality disorders in need of highly specialized care.	BMC Psychiatry	https://doi.org/10.1186/s12888-017-1460-6		Erasmus University Rotterdam	Current guidelines recommend referral to highly specialized care for patients with severe personality disorders. However, criteria for allocation to highly specialized care are not clearly defined. The aim of the present study was to develop a decision tool that can support clinicians to identify patients with a personality disorder in need of highly specialized care.
Counseling and Mental Wellness	Beckers, T., Koekkoek, B., Hutschemaekers, G., & Tiemens, B.	2018	Potential predictive factors for successful referral from specialist mental-health services to less intensive treatment: A concept mapping study.	PLOS One	https://doi.org/10.1371/journal.pone.0199668	https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0199668&type=printable	University of Applied Sciences	Referring patients from specialist mental-health services (provided by multiple healthcare service providers and aimed at relieving symptoms of mental illness) to less intensive care (provided by a nurse or psychologist in cooperation with a general practitioner and aimed at improving quality of life) is feasible from the perspective of patients, service providers, and mental-health services. However, it is unclear which patients are most suitable for referral to less intensive care. In this study, we used concept mapping to identify factors that might determine whether a referral from specialist mental services to less intensive care might be successful. Participants (N = 34) were recruited from different parts of the Netherlands and included general practitioners, peer workers, community mental-health nurses, and social workers from several services who were based in different neighborhoods. The participants generated 54 statements (31 after clean-up), which were sorted into five clusters and rated on their expected ability to predict successful referral. Ordered from highest to lowest on expected predictive value, the clusters of factors were: Patient characteristics, patients’ informal support system, patients’ social situation, organization of services, and service provider related factors. The ordering was the same for all of the service providers, except that general practitioners expected the organization of services to be the most predictive. The ordering of the clusters is mostly consistent with existing knowledge about recovery during mental healthcare. In order to further improve the number of successful referrals from specialist mental-health services to less intensive care, a prospective prediction study is needed.
Counseling and Mental Wellness	van Krugten, F. C. W., Goorden, M., van Balkom, A. J. L. M., Spijker, J., Brouwer, W. B. F., & Hakkaart-van Roijen, L.	2018	Indicators to facilitate the early identification of patients with major depressive disorder in need of highly specialized care: A concept mapping study.	Depression and Anxiety	https://doi.org/10.1002/da.22741	https://onlinelibrary.wiley.com/doi/epdf/10.1002/da.22741	Erasmus University Rotterdam	Early identification of the subgroup of patients with major depressive disorder (MDD) in need of highly specialized care could enhance personalized intervention. This, in turn, may reduce the number of treatment steps needed to achieve and sustain an adequate treatment response. The aim of this study was to identify patient-related indicators that could facilitate the early identification of the subgroup of patients with MDD in need of highly specialized care.
Counseling and Mental Wellness	Brown, J., Wiendels, S., & Eyre, V.	2019	Social justice competencies for counselling and psychotherapy: Perceptions of experienced practitioners and implications for contemporary practice.	Counseling & Psychotherapy Research	https://doi.org/10.1002/capr.12247		Western University	The purpose of the present study was to identify social justice competencies from the perspective of psychotherapists engaged in therapeutic practice. Twenty‐five therapists were asked, "What social justice competencies do psychotherapists need?" Responses were analysed using the concept mapping method. Nine participants grouped all unique interview responses into groups. Multidimensional scaling and cluster analysis were applied. The six competency areas identified included community activism, political influence on clinical work, critical consciousness, social responsibility, self‐awareness and personal style. The results were compared and contrasted with the literature. Considerable overlap was noted. The main differences concerned the need for collaboration as an advocacy tactic, as well as local knowledge about the pressing social issues affecting members of the community within which one practices.
Counseling and Mental Wellness	Van Slingerland, K. J., Durand-Bush, N., Bradley, L., Goldfield, G., Archambault, R., Smith, D., Edwards, C., Delenardo, S., Taylor, S., Werthner, P., & Kentta, G.	2019	Canadian Centre for Mental Health and Sport (CCMHS) position statement: Principles of mental health in competitive and high-performance sport.	Canadian Journal of Sport Medicine	https://doi.org/10.1097/JSM.0000000000000665		University of Ottawa	The brave decision made by many Canadian athletes to share their experience with mental illness has fed a growing dialogue surrounding mental health in competitive and high-performance sport. To affect real change for individuals, sport culture must change to meet demands for psychologically safe, supportive, and accepting sport environments. This position statement addresses mental health in competitive and high-performance sport in Canada, presenting solutions to current challenges and laying a foundation for a unified address of mental health by the Canadian sport community. The paper emerged from the first phase of a multidisciplinary Participatory Action Research (PAR) project, in which a sport-focused mental health care model housed within the Canadian Centre for Mental Health and Sport (CCMHS) is currently being designed, implemented, and evaluated by a team of 20 stakeholders, in collaboration with several community partners and advisors.
Counseling and Mental Wellness	Van Slingerland, K. J., & Durand-Bush, N.	2019	Collaboratively designing the Canadian Centre for Mental Health and Sport (CCMHS) using Group Concept Mapping.	Journal of Applied Sport Psychology	https://doi.org/10.1080/10413200.2019.1704938		University of Ottawa	Mental health researchers and practitioners alike have recognized that there are special considerations and challenges involved in diagnosing and treating mental illnesses in athletes. However, very few clinical psychologists and psychiatrists in Canada specialize in sport, representing a significant gap in mental health care service provision for this population. In this study, a group of expert sport and mental health stakeholders (n = 17) employed a Participatory Action Research approach to design a specialized sport-focused mental health care model integrated within the Canadian Centre for Mental Health in Sport (CCMHS). Stakeholders engaged in focus group discussions to perform an environmental scan of the Canadian sport and mental health care contexts that laid the foundation for a Group Concept Mapping (GCM) exercise. Using the Concepts Systems software, stakeholders individually produced statements that described the elements to include in a sport-specific mental health care model implemented within the CCMHS. A total of 106 unique statements were organized into 6 themed clusters, focusing on: (1) service delivery [40 statements], (2) communications and promotion [20 statements], (3) business, policy, and operations [19 statements], (4) partnerships [9 statements], (5) research [6 statements], and (6) education and training [6 statements]. These findings were operationalized to establish a sport-centered mental health care model and the CCMHS itself - the first Centre of its kind in Canada. GCM is seldom used to conduct sport research, thus the validity and reliability of this methodology was assessed. Lay Summary: In this study, 17 sport and mental health expert stakeholders participated in group concept mapping to design a sport-focused mental health care delivery model. The group produced 106 unique statements that were organized into six strategic priority areas and operationalized to establish the Canadian Centre for Mental Health and Sport.
Counseling and Mental Wellness	Van Slingerland, K. J., Durand-Bush, N., & Kentta, G.	2019	The Acceptability and Appropriateness of a Collaborative, Sport-Centered Mental Health Service Delivery Model for Competitive, and High-Performance Athletes.	Frontiers in Sports and Active Living	https://doi.org/10.3389/fspor.2021.686374	https://www.researchgate.net/profile/Krista-Van-Slingerland/publication/338004869_Collaboratively_Designing_the_Canadian_Centre_for_Mental_Health_and_Sport_CCMHS_Using_Group_Concept_Mapping/links/5e55568692851cefa1c2fa28/Collaboratively-Designing-the-Canadian-Centre-for-Mental-Health-and-Sport-CCMHS-Using-Group-Concept-Mapping.pdf?origin=publication_detail	University of Ottawa	The purpose of this study was to evaluate the acceptability and appropriateness of a sport-centered, collaborative mental health service delivery model implemented within the Canadian Center for Mental Health and Sport (CCMHS) over a period of 16 months. The study is situated within a larger Participatory Action Research (PAR) project to design, implement and evaluate the CCMHS. Primary data were collected from CCMHS practitioners (n = 10) and service-users (n = 6) through semi-structured interviews, as well as from CCMHS stakeholders (n = 13) during a project meeting, captured via meeting minutes. Secondary data derived from documents (e.g., clinical, policy, procedural; n = 48) created by the CCMHS team (i.e., practitioners, stakeholders, board of directors) during the Implementation Phase of the project were reviewed and analyzed to triangulate the primary data. The Framework Method was used to organize, integrate and interpret the dataset. Overall, results indicate that both practitioners and service-users found the model to be both acceptable and appropriate. In particular, practitioners' knowledge and experience working in sport, a robust intake process carried out by a centralized Care Coordinator, and the ease and flexibility afforded by virtual care delivery significantly contributed to positive perceptions of the model. Some challenges associated with interprofessional collaboration and mental health care costs were highlighted and perceived as potentially hindering the model's acceptability and appropriateness.
Counseling and Mental Wellness	Hager, K., Kading, M., O'Donnell, C., Yapel, A., MacDonald, D., Albee, J. N., Nash, C., Renier, C., Dean, K., & Schneiderhan, M.	2019	Bridging community mental health and primary care to improve medication monitoring and outcomes for patients with mental illness taking second-generation antipsychotics - HDC/DFMC bridge project, Phase 1: Group concept mapping.	The Primary Care Companion for CNS Disorders	https://doi.org/10.4088/PCC.19m02452	http://www.psychiatrist.com/pcc/bridging-mental-health-and-primary-care-to-improve-outcomes-for-patients-taking-sgas	University of Minnesota	Objective: Patients with severe mental illness often lack care coordination between primary care and mental health providers. Siloed patient care across separate health care systems can negatively impact quality and safety of patient care. The purpose of the project discussed in this article is to effectively engage stakeholders from separate primary care and mental health organizations to develop an ideal cross-organization communication system to improve metabolic monitoring for their comanaged patients prescribed second-generation antipsychotics (SGAs).
Counseling and Mental Wellness	C. Wentick, M. Huijbers Et al	2019	Enhancing shared decision making about discontinuation of antidepressant medication: a concept-mapping study in primary and secondary mental health care.	British Journal of General Practice	https://doi.org/10.3399/bjgp19X706001	https://bjgp.org/content/bjgp/69/688/e777.full.pdf	Radboud University	The apparent rise of antidepressant use seems to be explained to a large extent by an increase in long-term use. Both professionals and patients appear reluctant to discontinue antidepressant medication (ADM). It is not known what factors determine this reluctance. Aim: This study aimed to identify factors that enable the shared decision-making process about discontinuation of ADM between long-term users and their GPs. Design and setting Concept-mapping study of a purposive sample of both patients and professionals from primary and secondary mental health care in the Netherlands. Method Concept mapping was used to conceptualise and structure the topics relevant to the discontinuation process from the perspective of both patients and professionals. Participants generated topics in brainstorming sessions and subsequently prioritised and sorted them. Multidimensional scaling and hierarchical cluster analyses were used for the cluster topics. Results Thirty-seven patients and 27 professionals generated 50 separate topics. Hierarchical cluster analysis revealed six clusters of topics: ‘Process of discontinuation’, ‘Expectations’, ‘Professional guidance’, ‘Current use’, ‘Environment’, and ‘Side effects’. Patients and professionals came up with largely similar topics. Nevertheless, a difference was found between these groups regarding the perceived importance of professional guidance. Conclusion This study yielded an informed selection of the topics that seem most important to discuss when considering whether to discontinue ADM. As perspectives of both patients and professionals were combined, the topics may provide patients and GPs with a broader and more balanced scope of factors to consider, and thus facilitate a better shared decision-making process. Keywords: antidepressive agents, decision making, deprescriptions, general practice
Counseling and Mental Wellness	Caarls, P. J., van Schijndel, M. A., van den Berk, G., Boenink, A. D., Boerman, D., Lijmer, J. G., Honig, M., Terra, A., Thijs, J., Verwey, J. A., van Waarde, J. A., van Wijngaarden, J., van Busschbach, J. J., & MPU Study Group.	2019	Factors influencing the admission decision for Medical Psychiatry Units: A concept mapping approach.	PLOS One	https://doi.org/10.1371/journal.pone.0221807	https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0221807&type=printable	Erasmus Medical Center	Medical Psychiatry Units (MPUs), also known as Complexity Intervention Units (CIUs), provide care for complex patients suffering from both psychiatric and physical disorders. Because there is no consensus on the indications for admission to an MPU, daily practice and effectiveness research are hampered. This study therefore used a concept mapping approach to investigate which organizational and medical factors determine the decision to admit a patient to an MPU.
Counseling and Mental Wellness	Green, C., Walkup, J. T., Bostwick, S., & Trochim, W.	2019	Advancing the agenda in pediatric mental health education.	Pediatrics	https://doi.org/10.1542/peds.2018-2596	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6856785/pdf/PEDS_20182596.pdf	Cornell University	There is an urgent need to advance mental health (MH) education and/or training in pediatric residency programs, yet no consensus on how to achieve this. We created an operational framework from ideas provided by a diverse group of stakeholders on how to advance MH education. METHODS: Concept-mapping methodology was used, which involves brainstorming ideas by completing a focus prompt, sorting ideas into groups, and rating them for importance and feasibility. Multidimensional scaling and hierarchical cluster analysis grouped ideas into clusters. Average importance and feasibility were calculated for each statement and cluster and compared statistically in each cluster and between subgroups. RESULTS: Ninety-nine ideas were generated. Sorted ideas yielded a 7-cluster concept map: (1) modalities for MH training, (2) prioritization of MH, (3) systems-based practice, (4) self-awareness and/or relationship building, (5) training in clinical assessment of patients, (6) training in treatment, and (7) diagnosis-specific skills. Two hundred and sixteen participants rated ideas for importance and 209 for feasibility. Four clusters had a statistically significant difference between their importance and feasibility ratings (P < .001). Suburban and rural area respondents (versus urban) rated clusters higher in importance and feasibility (P < .004), trainees rated all clusters higher in feasibility than practicing clinicians, and MH professionals rated prioritization of MH higher in feasibility (3.42 vs 2.98; P < .001). CONCLUSIONS: This comprehensive set of ideas, especially those rated highly in both importance and feasibility, should inform curricular and policy initiatives. Differences between importance and feasibility may explain why there has been little progress in this field.
Counseling and Mental Wellness	Wallace, C., Elliott, M., Thomas, S., Davies-McIntosh, E., Beese, S., Roberts, G., Ruddle, N., Groves, K., Rees, S., & Pontin, D..	2020	Using consensus methods to develop a Social Prescribing Learning Needs Framework for practitioners in Wales.	Perspect Public Health	https://doi.org/10.1177/1757913919897946		University of South Wales	Social prescribing is being widely implemented in Wales, but there is no consensus on the necessary learning, training and education needs for people delivering social prescribing. The purpose of the study was to develop an education and training needs conceptual framework for social prescribers in Wales, which could be used by commissioners and providers for the development of social prescribing curricula. Methods: This study used two consensus methods. First, Group Concept Mapping using The Concept System® Global MAX™ software which identified the important and available learning needs of 18 (n = 18) geographically spread social prescribing practitioners. Second, a world café style workshop asked 85 (n = 85) social prescribers to identify when training and support would be most appropriate and valuable in developing their role and skills. Results: A Social Prescribing Learning Needs Framework was developed identifying important learning needs and their availability across a timeline from induction onwards. This was conceptualised from a group concept mapping cluster map and go-zone report. The map comprises five clusters of statements (compassion, interpersonal relationships, socioeconomic disadvantage, networking and monitoring data) from the original 120 statements of learning needs identified by participants. The Go-Zone report displayed how each learning need was rated by participants on scales of importance and availability. A large number of training needs (45%) that were identified as important, are not currently available to social prescribers. All training needs were placed within the first year of the social prescriber working timeline, with 39% placed in an induction period. Conclusion: The use of two different consensus methods enabled social prescribers geographically spread across Wales to engage with the study. The Social Prescribing Learning Needs Framework will be used to inform the commissioning and decommissioning of training for people delivering social prescribing in Wales.
Counseling and Mental Wellness	McNeish, R., Walker, C., Massey, O., & Tran, Q.	2020	Using concept mapping to operationalize mental well-being for men and boys.	American Journal of Community Psychology	https://doi.org/10.1002/ajcp.12419		University of South Florida	A primary purpose of many prevention-oriented interventions is to improve the general well-being and quality of life for individuals and their communities. Unfortunately, well-being is often poorly defined, with definitions embracing related issues of quality of life, happiness, and physical health. Mental well-being as a concept is also poorly defined, particularly for different population groups. As part of a larger study to assess community-level prevention efforts aimed at men and boys, a participatory approach was used to operationalize mental well-being from a male-centered, community-based perspective using concept mapping. A set of 96 statements perceived as important aspects of mental well-being for men and boys were developed and sorted by 90 participants from the study communities. The 8-cluster solution was selected as the most parsimonious and the best conceptual fit in relation to the mental well-being concept, namely, positive self-worth, supportive community, community connections, positive masculinity, responsive institutions, strong social connection, dignity and respect, and safety. These eight clusters of mental well-being, which were classified into two overarching domains of socio-environmental and emotional well-being, can provide a basis by which to assess community-based programs aimed at this population. Keywords: Community Prevention; Concept mapping; Men and boys; Mental Well-being; Mental health.
Counseling and Mental Wellness	Walker, D. C., Heiss, S., Donahue, J. M., & Brooks, J. M.	2020	Practitioners' perspectives on ethical issues within the treatment of eating disorders: Results from a concept mapping study.	International Journal of Eating Disorders	https://doi.org/10.1002/eat.23381		Union College	Treating patients with eating disorders (EDs) is associated with an array of ethical concerns, including balancing patients' health and autonomy, access to care, and use of harm-reduction versus recovery-oriented treatment models. The primary aim of the current study is to gain a better understanding of ethical issues faced by ED practitioners by using a concept mapping, or Q-sort, approach. Method: A total of 12 practitioners completed the brainstorming phase and generated statements regarding ethical issues they faced while treating patients with EDs. A subsequent 38 practitioners completed a sorting task, where they created and labeled piles, into which they grouped each statement. Of those 38 participants, 30 rated both the frequency with which they encountered each ethical issue and its impact on patient care. Results: A total of six clusters emerged: Insufficient Level of Care, Lack of Evidence-Based Practice, Insurance Barriers, Family Involvement, Patient Autonomy, and Limited Access to Expertise. Lack of Evidence-Based Practice, Insurance Barriers, and Insufficient Level of Care was the most frequent problem faced by ED practitioners, whereas Insurance Barriers and Patient Autonomy had the greatest impact. Discussion: Findings outline frequent and impactful areas of ethical concern that arise when treating patients diagnosed with EDs. Practitioners most commonly reported that patient- and insurance-driven factors limited patient access to appropriate care. Regulations supporting the provision of evidence-based care should be emphasized in public health policy and advocacy efforts, given their impact in limiting the delivery of adequate patient care. Keywords: Q-sort; concept mapping; eating disorder treatment; eating disorders; ethics.
Counseling and Mental Wellness	Adams, L. B., Baxter, S., Lightfoot, A. F., Gottfredson, N., Golin, C., Jackson, L. C., Tabron, J., Corbie-Smith, G., & Powell, W.	2021	Refining Black men’s depression measurement using participatory approaches: a concept mapping study.	BMC public health	https://doi.org/10.1186/s12889-021-11137-5	https://bmcpublichealth.biomedcentral.com/track/pdf/10.1186/s12889-021-11137-5.pdf	University of North Carolina at Chapel Hill	Despite cumulative socioeconomic disadvantage and risk factors, Black Americans have a lower prevalence of depression than whites. Given the emerging focus of depression as a public mental health crisis, culturally informed depression measures and scale development techniques are needed to better alleviate the mental health burden of socially marginalized populations. Yet, for Black men, race- and gender-related factors that position emotional vulnerability as a sign of weakness, may potentially mask the timely identification of mental health needs in this population. Thus, we address these gaps by employing a stakeholder-driven, community-engaged process for understanding Black men's depression experience. Methods: We use concept mapping, a structured mixed methods approach, to determine how stakeholders of Black men's health conceptualize their depressive symptoms. Thirty-six stakeholders participated in a three-phase concept mapping study conducted in 2018. Three separate stakeholder groups were engaged for this study, including Black men, Black women, and primary care providers. Results: Participants generated 68 characteristics of Black men's depression which were reflected within five conceptual clusters: (1) physical states; (2) emotional states; (3) diminished drive; (4) internal conflicts; (5) communication with others; and (6) social pressures. Using a content analysis approach, we found that items comprising the "social pressures" cluster were not reflected in any common depression scales. Conclusions: Findings from this study illustrate the similar and divergent pathways in which Black men express depressed mood. Furthermore, concept mapping results also yield a novel opportunity for culturally informed scale development in future research. Keywords: Black men; Concept mapping; Depression; Measurement; Mental health.
Counseling and Mental Wellness	King, R. U., Este, D. C., Yohani, S., Duhaney, P., McFarlane, C., & Liu J. K. K.	2022	Actions needed to promote health equity and the mental health of Canada's Black refugees	Ethnicity & Health	https://doi.org/10.1080/13557858.2021.1955092	https://www.tandfonline.com/doi/pdf/10.1080/13557858.2021.1955092?needAccess=true	University of Calgary	Objectives: The overall goal was to synthesize knowledge on actions that need to be taken to promote health equity and the mental health of Black refugees in Canada. Design: Group concept mapping systems were applied to generate and organize action-oriented statements related to the different social determinants of health. A total of 174 participants from the cities of Calgary and Edmonton with experience working with Black Canadians participated in four focus groups: (a) 2 focus groups that engaged 123 participants in brainstorming 84 statements guided by the following focus prompt: ‘A specific action that would improve the mental health equity of Black refugees living in Canada is … ’ and (b) 2 focus groups of 51 participants who sorted the generated statements and rated them by order of ‘importance’ and ‘ideas seen in action.’ Data was further computed and analysed by the research team and a select advisory group from the participants. Results: A 10-cluster map generated included the following clusters: (1) promoting cultural identity, (2) promoting ways of knowing, (3) addressing discrimination and racism, (4) addressing the criminalization of Black Canadians, (5) investing in employment for equity, (6) promoting equity in housing, (7) facilitating self-determination, (8) improving (public) services, (9) promoting appropriate and culturally relevant mental health services, and (10) working with and addressing faith and belief related issues. Clusters 4 and 9 ranked as the most important clusters in promoting health equity and the mental health of Black Canadians. Conclusions: Addressing the criminalization of Black Canadians through a range of rehumanizing interventions at institutional levels will provide a platform from which they can participate and engage others in developing appropriate and culturally relevant mental health services. Keywords: Black Canadians; appropriate and culturally relevant mental health services; criminalization; health equity; mental health promotion.
Counseling and Mental Wellness	J Brown, M Lengyel	2022	Psychotherapists' efforts to increase awareness of social privilege	Counselling and Psychotherapy Research.	https://doi.org/10.1002/capr.12539		Western University	Understanding the role of privilege in systemic oppression positions psychotherapists to engage in culturally oriented practice. Twenty-five practising psychotherapists were asked: ‘How can psychotherapists increase their awareness of social privilege?’ Participants sorted 68 unique responses into six concepts. The concepts included: make yourself uncomfortable; embrace humility; learn from the community; involvement in social action; seek critical knowledge; and find like-minded others in the profession. Recommendations for student training are offered.
Counseling and Mental Wellness	Robinson, L., J., H., V., Butler, & K., L., Hackett	2023	Identifying and prioritising the key components of a Quality Improvement Network for allied health professionals and psychological therapists: a group concept …		http://dx.doi.org/10.1136/bmjoq-2022-002039	https://bmjopenquality.bmj.com/content/bmjqir/12/1/e002039.full.pdf	NHS Trust, UK	Abstract Introduction Despite growing enthusiasm for quality improvement (QI), the complexities of modern healthcare continue to create gaps in our ability to consistently deliver the most effective and efficient care for patients, and improvement activities often fail to achieve widespread uptake even when there is robust evidence of their benefits. Methods We undertook a novel, mixed methods evaluation and planning project using group concept mapping (GCM) methodology to identify and prioritise the ways in which our recently established Quality Improvement Network (QIN) could support allied health professionals, psychological therapists and administrative staff in their daily work to improve patient outcomes and experience. Mid-level leaders across our therapy services department contributed towards a statement generation activity and individually sorted these statements into themes. Each statement was rated for perceived importance and current success. Multidimensional scaling and hierarchical cluster analysis were applied to the sorted data to produce themed clusters of ideas within concept maps. Priority values were applied to these maps to identify key areas for future QIN activity. Results Overall, 34 participants took part in ideas generation, 20 in sorting and 30 in the rating activity. A five-item cluster map was agreed on, containing the following named clusters: data support; practical skills and training; time and resources; embedding a QI culture; and sharing ideas and working together. Statements contained within each of the five clusters highlight the importance of supporting a range of activities spanning the technical and human aspects of QI at an individual, group/team, organisation and wider systems level. Conclusion GCM provided a structured and systematic approach for identifying the perceived support needs of allied health professionals, psychological therapists and administrative support staff in relation to QI. The findings from this project provide a useful benchmark from which to track targeted QI support in an applied healthcare setting.
Counseling and Mental Wellness	Lokman, S., van Oorsouw, W. M. W. J., Didden, R., & Embregts, P. J. C. M.	2022	Setting up a new team of support staff for people with mild intellectual disability or borderline intellectual functioning and severe challenging behaviour: A concept mapping study.	Journal of Applied Research in Intellectual Disabilities	https://doi.org/10.1111/jar.13023	https://onlinelibrary.wiley.com/doi/epdf/10.1111/jar.13023	Tilburg University	Background: Studies about teams of staff supporting people with intellectual disability have focused on team performance of existing teams. This study aimed to examine important factors in the process of setting up a new team of support staff. Specifically, we considered the process for a team that supports service users with mild intellectual disability or borderline intellectual functioning who display severe challenging behaviour from the orthopedagogical perspective (i.e., with a focus on contextual factors). Method: Three participant groups (service users, support staff, and professionals supporting a team) participated in a concept mapping procedure, including generating statements in interviews and focus groups, sorting, and rating. An expert group interpreted the results. Results: Important factors to one or more groups were: service users and support staff getting acquainted early, team safety, social support, a shared vision, and a positive reputation of the new home. Conclusions: Four core outcomes were addressed that may help service organisations to provide an environment matching the needs of service users who show severe challenging behaviour from the start.
Counseling and Mental Wellness	de Wit, W., Roeg, D. & Embregts, P.J.C.M.	2023	Using Concept Mapping to Explore the Perspectives of People with Mild to Borderline Intellectual Disabilities Toward Sexual Health	Sex Disabil	https://doi.org/10.1007/s11195-023-09796-w	https://link.springer.com/article/10.1007/s11195-023-09796-w	Tilburg University	People with mild to borderline intellectual disabilities face many barriers toward their sexual health. To promote sexual health and overcome these barriers, they need individualized forms of sexuality support and education. To align sexuality support and education insight is needed on their understanding of sexual health. The current paper aims to provide greater insight in what sexual health consists of according to people with mild to borderline intellectual disabilities. Nine people with a mild to borderline intellectual disability participated in a concept mapping procedure, consisting of brainstorming, sorting, and ranking the statements. The resulting clusters and concept map were interpreted by an expert group. Analysis resulted in five clusters which participants considered important for their sexual health. According to people with mild to borderline intellectual disability cluster pertaining to romantic relationships and sexual socialization were the most important. These were followed by clusters on sexual health and lastly sexual selfhood. These results have implications for the development of sexuality support and education, as well as further research.
Counseling and Mental Wellness	Kersten, M. C. O., Frielink, N., Weggeman, M., & Embregts, P.	2023	Incoming professionals' perspectives on the application of new knowledge in care organisations for people with intellectual disabilities: a concept mapping study	International Journal of Developmental Disabilities	https://doi.org/10.1080/20473869.2023.2216033	https://www.tandfonline.com/doi/epdf/10.1080/20473869.2023.2216033?needAccess=true&role=button	Tilburg University	Within care organisations for people with intellectual disabilities, numerous strategies are employed to stimulate the application of new knowledge, and professionals play a key role in this process. Consequently, gaining insight into professionals’ perspectives on how to encourage the application of new knowledge is vital, especially in the case of incoming professionals. They have a stronger need for new knowledge due to having acquired only a limited knowledge base about intellectual disabilities in their education. Therefore, this study focused on the incoming professionals’ perspectives on factors stimulating application of new knowledge within the care and support for people with intellectual disabilities.
Counseling and Mental Wellness	C van Genk, D Roeg, M van Vugt, J van Weeghel…	2023	What are important ingredients for Intensive Home Support for people with severe mental illness according to experts? A concept mapping approach	Front. Psychiatry	https://doi.org/10.3389/fpsyt.2023.1156235	https://www.frontiersin.org/articles/10.3389/fpsyt.2023.1156235/pdf	Tilburg University	Background: For the last four decades, there has been a shift in mental healthcare toward more rehabilitation and following a more humanistic and comprehensive vision on recovery for persons with severe mental illness (SMI). Consequently, many community-based mental healthcare programs and services have been developed internationally. Currently, community mental healthcare is still under development, with a focus on further inclusion of persons with enduring mental health problems. In this review, we aim to provide a comprehensive overview of existing and upcoming community mental healthcare approaches to discover the current vision on the ingredients of community mental healthcare. Methods: We conducted a scoping review by systematically searching four databases, supplemented with the results of Research Rabbit, a hand-search in reference lists and 10 volumes of two leading journals. We included studies on adults with SMI focusing on stimulating independent living, integrated care, recovery, and social inclusion published in English between January 2011 and December 2022 in peer-reviewed journals. Results: The search resulted in 56 papers that met the inclusion criteria. Thematic analysis revealed ingredients in 12 areas: multidisciplinary teams; collaboration within and outside the organization; attention to several aspects of health; supporting full citizenship; attention to the recovery of daily life; collaboration with the social network; tailored support; well-trained staff; using digital technologies; housing and living environment; sustainable policies and funding; and reciprocity in relationships. Conclusion: We found 12 areas of ingredients, including some innovative topics about reciprocity and sustainable policies and funding. There is much attention to individual ingredients for good community-based mental healthcare, but very little is known about their integration and implementation in contemporary, fragmented mental healthcare services. For future studies, we recommend more empirical research on community mental healthcare, as well as further investigation(s) from the social service perspective, and solid research on general terminology about SMI and outpatient support.
Developing Countries	Haafkens, J., Blomstedt, Y, Eriksson, M., Becher, H., Ramroth, H., & Kinsman, J.	2014	Training needs for research in health inequities among health and demographic researchers from eight African and Asian countries.	BMC public health	https://doi.org/10.1186/1471-2458-14-1254	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4295281/pdf/12889_2014_Article_7373.pdf	University of Amsterdam	To support equity focussed public health policy in low and middle income countries, more evidence and analysis of the social determinants of health inequalities is needed. This requires specific know how among researchers. The INDEPTH Training and Research Centres of Excellence (INTREC) collaboration will develop and provide training on the social determinants of health approach for health researchers from the International Network for the Demographic Evaluation of Populations and Their Health in Low- and Middle-Income Countries (INDEPTH) in Africa and Asia. To identify learning needs among the potential target group, this qualitative study explored what INDEPTH researchers from Ghana, Tanzania, South Africa, Kenya, Indonesia, India, Vietnam, and Bangladesh feel that they want to learn to be able to conduct research on the causes of health inequalities in their country. Methods: Using an inductive method, online concept-mapping, participants were asked to generate statements in response to the question what background knowledge they would need to conduct research on the causes of health inequalities in their country, to sort those statements into thematic groups, and to rate them in terms of how important it would be for the INTREC program to offer instruction on each of the statements. Statistical techniques were used to structure statements into a thematic cluster map and average importance ratings of statements/clusters were calculated. Results: Of the 150 invited researchers, 82 participated in the study: 54 from Africa; 28 from Asia. Participants generated 59 statements and sorted them into 6 broader thematic clusters: “assessing health inequalities”; “research design and methods”; “research and policy”; “demography and health inequalities”; “social determinants of health” and “interventions”. African participants assigned the highest importance to further training on methods for assessing health inequalities. Asian participants assigned the highest importance to training on research and policy. Conclusion: The identified thematic clusters and statements provide a detailed understanding of what INDEPTH researchers want to learn in order to be able to conduct research on the social determinants of health inequalities. This offers a framework for developing capacity building programs in this emerging field of public health research. Keywords: Social determinants of health, Capacity building, Research personnel, Africa, Asia
Developing Countries	Iwelunmor, J., Blackstone, S., Gyamfi, J., Airhihenbuwa, C., Plange-Rhule, J., Tayo, B., Adanu, R. M. K., & Ogedegbe, G.	2015	A concept mapping study of physicians' perceptions of factors influencing management and control of hypertension in Sub-Saharan Africa.	International Journal of Hypertension	https://doi.org/10.1155/2015/412804	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4621343/pdf/IJHY2015-412804.pdf	University of Illinois, Urbana-Champaign	Hypertension, once a rare problem in Sub-Saharan Africa (SSA), is predicted to be a major cause of death by 2020 with mortality rates as high as 75%. However, comprehensive knowledge of provider-level factors that influence optimal management is limited. The objective of the current study was to discover physicians' perceptions of factors influencing optimal management and control of hypertension in SSA. Twelve physicians attending the Cardiovascular Research Training (CaRT) Institute at the University of Ghana, College of Health Sciences, were invited to complete a concept mapping process that included brainstorming the factors influencing optimal management and control of hypertension in patients, sorting and organizing the factors into similar domains, and rating the importance and feasibility of efforts to address these factors. The highest ranked important and feasible factors include helping patients accept their condition and availability of adequate equipment to enable the provision of needed care. The findings suggest that patient self-efficacy and support, physician-related factors, policy factors, and economic factors are important aspects that must be addressed to achieve optimal hypertension management. Given the work demands identified by physicians, future research should investigate cost-effective strategies of shifting physician responsibilities to well-trained no-physician clinicians in order to improve hypertension management.
Developing Countries	Hernandez, A. R., Hurtig, A. K., Dahlblom, K., & San Sebastian, M.	2015	Integrating views on support for mid-level health worker performance: A concept mapping study with regional health system actors in rural Guatemala.	International Journal for Equity in Health	https://doi.org/10.1186/s12939-015-0225-4	https://equityhealthj.biomedcentral.com/track/pdf/10.1186/s12939-015-0225-4.pdf	Umeå University	Introduction: Mid-level health workers are on the front-lines in underserved areas in many LMICs, and their performance is critical for improving the health of vulnerable populations. However, improving performance in low-resource settings is complex and highly dependent on the organizational context of local health systems. This study aims to examine the views of actors from different levels of a regional health system in Guatemala on actions to support the performance of auxiliary nurses, a cadre of mid-level health workers with a prominent role in public sector service delivery. A concept mapping study was carried out to develop an integrated view on organizational support and identify locally relevant strategies for strengthening performance. Methods: A total of 93 regional and district managers, and primary and secondary care health workers participated in generating ideas on actions needed to support auxiliary nurses' performance. Ideas were consolidated into 30 action items, which were structured through sorting and rating exercises, involving a total of 135 of managers and health workers. Maps depicting participants' integrated views on domains of action and dynamics in sub-groups' interests were generated using a sequence of multivariate statistical analyses, and interpreted by regional managers. Results: The combined input of health system actors provided a multi-faceted view of actions needed to support performance, which were organized in six domains, including: Communication and coordination, Tools to orient work, Organizational climate of support, Motivation through recognition, Professional development and Skills development. The nature of relationships across hierarchical levels was identified as a cross-cutting theme. Pattern matching and go-zone maps indicated directions for action based on areas of consensus and difference across sub-groups of actors. Conclusions: This study indicates that auxiliary nurses' performance is interconnected with the performance of other health system actors who require support, including managers and community-level collaborators. Organizational climate is critical for making auxiliary nurses feel supported, and greater attention to improving the quality of hierarchical relationships is needed in LMIC settings. The participatory nature of the concept-mapping process enabled health system actors to collaborate in co-production of context-specific knowledge needed to guide efforts to strengthen performance in a vulnerable region.
Developing Countries	Butterfield, A. K., Tafesse, M., & Moxley, D. P.	2016	International higher education partnerships: Concept mapping of the processes and outcomes of USAID-funded projects in Ethiopia.	Social Development Issues		https://www.researchgate.net/profile/Alice-Butterfield/publication/305775754_International_Higher_Education_Partnerships_Concept_mapping_of_the_processes_and_outcomes_of_USAID_funded_projects_in_Ethiopia/links/57a7a34208ae455e8546cdef/International-Higher-Education-Partnerships-Concept-mapping-of-the-processes-and-outcomes-of-USAID-funded-projects-in-Ethiopia.pdf?origin=publication_detail	University of Illinois at Chicago	There is little systematic research on the processes and outcomes of international higher education partnerships (IHEPs) the focus of which is institutional capacity building. The authors employ concept mapping methodology to examine eight international higher education partnerships between Ethiopian universities and ones in the United States, which were funded by USAID through Higher Education for Development between 1998 and 2005. The concept mapping process reveals institutional capacity development and sustainability as important qualities of successful IHEPs. Eight clusters were statistically transformed into three broad categories: Reform and Staff Development, Research and Fundraising, and Mutual Benefits.
Developing Countries	Aarons, G. A., Sommerfeld, D. H., Chi, B. H., Ezeanolue, E. E., Sturke, R., Guay, L., & Siberry, G. K.	2016	Concept mapping of PMTCT implementation challenges and solutions across 6 sub-Saharan African countries in the NIH-PEPFAR PMTCT Implementation Science Alliance.	JAIDS	https://doi.org/10.1097/QAI.0000000000001064	https://journals.lww.com/jaids/_layouts/15/oaks.journals/downloadpdf.aspx?trckng_src_pg=ArticleViewer&an=00126334-201608011-00016	University of California, San Diego	Objective: Although tremendous gains have been made to reduce mother-to-child HIV transmission (MTCT) globally, evidence-based practice implementation remains inconsistent in sub-Saharan Africa. We sought to identify the key domains for effective prevention of MTCT (PMTCT) implementation, using a participatory mixed-methods approach. Methods: Participants were members of the NIH-PEPFAR PMTCT Implementation Science Alliance (ISA), a platform of researchers, public-health practitioners, policymakers, and donors supported through NIH/PEPFAR. We used concept mapping to identify priority areas for PMTCT implementation science. Participants responded to the focus question: "In your experience, what factors have facilitated or hindered implementation of PMTCT interventions?" Responses were consolidated into discrete statements, grouped together based on similarity, and rated for importance, changeability, and extent to which ISA participation enhanced the capacity to influence/change the factor. Results: Using multidimensional scaling and cluster analysis, we identified 12 key domains of PMTCT implementation. Two domains (Governmental Commitment and Data Measurement & Collection) were consistently ranked at or near the top for overall importance, perceived changeability, and enhanced ability to address through ISA participation. Discussion: Through a stakeholder-based, participatory approach, we identified key domains for that should be considered for future PMTCT implementation research in sub-Saharan Africa.
Developing Countries	Becerril-Montekio, V., Alcalde-Rabanal, J., Darney, B. G., & Orozco-Nunez, E.	2016	Using systematized tacit knowledge to prioritize implementation challenges in existing maternal health programs: Implications for the post MDG era.	Health Policy and Planning	https://doi.org/10.1093/heapol/czw033	https://academic.oup.com/heapol/article/31/8/1031/2198184?login=false	National Institute of Public Health of Mexico	Strategic priority setting and implementation of strategies to reduce maternal mortality are key to the post Millennium Development Goal (MDG) 2015 agenda. This article highlights the feasibility and the advantages of using a systematized tacit knowledge approach, using data from maternal health program personnel, to identify local challenges to implementing policies and programs to inform the post MDG era. Communities of practice, conceived as groups of people sharing professional interests, experiences and knowledge, were formed with diverse health personnel implementing maternal health programs in Mexico and Nicaragua. Participants attended several workshops and developed different online activities aiming to strengthen their capacities to acquire, analyze, adapt and apply research results and to systematize their experience and knowledge of the actual implementation of these programs. Concept mapping, a general method designed to organize and depict the ideas of a group on a particular topic, was used to manage, discuss and systematize their tacit knowledge about implementation problems of the programs they work in. Using a special online concept mapping platform, participants prioritized implementation problems by sorting them in conceptual clusters and rating their importance and feasibility of solution. Two hundred and thirty-one participants from three communities of practice in each country registered on the online concept mapping platform and 200 people satisfactorily completed the sorting and rating activities. Participants further discussed these results to prioritize the implementation problems of maternal health programs. Our main finding was a great similarity between the Mexican and the Nicaraguan general results highlighting the importance and the feasibility of solution of implementation problems related to the quality of healthcare. The use of rigorously organized tacit knowledge of health personnel proved to be a feasible and useful tool for prioritization to inform implementation priorities in the post MDG agenda.
Developing Countries	Giambrone, C. A., Cook-Cottone, C. P., & Klein, J. E.	2018	The Africa yoga project and wellbeing: A concept map of students' perceptions.	Applied Psychology: Health and Well-Being	https://doi.org/10.1111/aphw.12124	https://iaap-journals.onlinelibrary.wiley.com/doi/epdf/10.1111/aphw.12124	State University of New York at Buffalo	Background: Concept mapping methodology was used to explore the perceived impact of practicing yoga with the Africa Yoga Project (AYP)-an organisation created to increase health and well-being by providing community-based yoga classes throughout Kenya. AYP's mission fit with theoretical models of well-being is discussed. Anecdotal evidence and initial qualitative research suggested the AYP meaningfully impacted adult students. Methods: Of the hundreds of AYP's adult students, 56 and 82 students participated in Phases I and II, respectively. Phase I brainstorming resulted in 94 student-generated statements about their perceived change. Phase II participants sorted and rated statements in terms of importance. Multidimensional scaling and hierarchical cluster analysis of sort data was utilised to map and group statements into clusters. Results: Based on statistical and interpretive criteria, a five-cluster solution with the following concepts was identified as the best model of students' change: Personal Growth; Interpersonal Effectiveness (lowest importance); Physical and Social Benefits; Emotional Resiliency; and Improved Self-Concept (highest importance). Conclusions: Overall, students reported positive perceptions of the AYP. Additional research is needed to quantify students' change, and to compare the AYP outcomes to those of other programs aimed at poverty-related stress reduction and well-being.
Developing Countries	Zegbe, E. M., Montekio, V. B., & Rabanal, J. A.	2018	Conocimientos tácito y explícito: análisis comparativo de la priorización de problemas de salud materna en México (Tacit and explicit knowledge: comparative analysis of the prioritization of maternal health problems in Mexico).	Gaceta Sanitaria	https://doi.org/10.1016/j.gaceta.2017.04.006	https://www.scielosp.org/pdf/gs/2018.v32n3/251-261/es	National Institute of Public Health of Mexico	Resumen Objetivo: Identificar coincidencias y diferencias en la identificación y la priorización de problemas de los servicios de salud materna en México, desde las perspectivas del conocimiento tácito y el conocimiento explícito, que ofrezcan evidencias que contribuyan a alcanzar los Objetivos de Desarrollo Sostenible. Método Estudio mixto, realizado en tres etapas: 1) sistematización de problemas de los servicios de atención a la salud materna identificados por el conocimiento tácito (derivado de la experiencia profesional); 2) identificación de problemas de los servicios de atención a la salud materna en América Latina abordados por el conocimiento explícito (publicaciones científicas); 3) comparación de problemas identificados por los conocimientos tácito y explícito. Resultados Los principales problemas identificados según el conocimiento tácito están vinculados con la mala calidad de la atención, mientras que aquellos mayormente abordados por el conocimiento explícito se refieren a barreras de acceso a la atención en los servicios de salud. Aproximadamente el 70% de los problemas identificados en el conocimiento tácito son señalados en el conocimiento explícito. Paralelamente, el 70% de los problemas identificados en la literatura también son considerados por el conocimiento tácito. No obstante, al comparar los problemas uno a uno no se encuentran similitudes estadísticamente significativas entre ambos enfoques. Conclusiones El estudio mostró que la identificación de problemas en los servicios de atención a la salud materna por el conocimiento tácito y por el conocimiento explícito es medianamente comparable, según el índice de comparabilidad utilizado, y subraya el interés de integrar ambos abordajes a fin de mejorar la priorización y la toma de decisiones hacia los Objetivos de Desarrollo Sostenible. Abstract Objective To identify coincidences and differences in the identification and prioritization of maternal healthcare service problems in Mexico based on the perspective of tacit knowledge and explicit knowledge that may offer evidence that can contribute to attaining the Sustainable Development Goals. Methods Mixed study performed in three stages: 1) systematization of maternal healthcare service problems identified by tacit knowledge (derived from professional experience); 2) identification of maternal healthcare service problems in Latin America addressed by explicit knowledge (scientific publications); 3) comparison between the problems identified by tacit and explicit knowledge. Results The main problems of maternal health services identified by tacit knowledge are related to poor quality of care, while the predominant problems studied in the scientific literature are related to access barriers to health services. Approximately, 70% of the problems identified by tacit knowledge are also mentioned in the explicit knowledge. Conversely, 70% of the problems identified in the literature are also considered by tacit knowledge. Nevertheless, when looking at the problems taken one by one, no statistically significant similarities were found. Conclusions The study discovered that the identification of maternal health service problems by tacit knowledge and explicit knowledge is fairly comparable, according to the comparability index used in the study, and highlights the interest of integrating both approaches in order to improve prioritization and decision making towards the Sustainable Development Goals.
Developing Countries	Nuampa, S., Tilokskulchai, F., Patil, C. L., Sinsuksai, N., & Phahuwatanakorn, W.	2018	Factors related to exclusive breastfeeding at six month in Thai adolescent mothers: An application of concept mapping.	Maternal & Child Nutrition	https://doi.org/10.1111/mcn.12714	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7198966/pdf/MCN-15-e12714.pdf	Mahidol University	The advantages of exclusive breastfeeding for the first 6 months are well‐known. Unfortunately, adolescent mothers have lower rates of breastfeeding exclusivity and shorter duration of breastfeeding. There is limited evidence regarding exclusive breastfeeding determinants in adolescent mothers. The purpose of this study was to obtain adolescent mother‐generated factors related to exclusive breastfeeding at 6 months. A mixed‐methods design was conducted through concept mapping. Thirty adolescent mothers aged 15–19 years who had wide range of exclusive breastfeeding experiences brainstormed about specific factors. They then sorted and rated the statements into key clusters. Finally, half of the participants were involved in the interpretation of the mapping results and the creation of pathway diagrams. Data were analysed by multivariate statistics in the The Concept System® Global MAX™ program. The results showed that the adolescent mothers brainstormed about 104 statements on the factors related to exclusive breastfeeding at 6 months. These factors can be categorized into the following six key clusters: (a) breastfeeding advantages; (b) facilitating factors and necessary skills; (c) promotion and support needed; (d) community and social influence; (e) internal and external barriers; and (f) key problems in families. The pattern matching provided understanding of how key clusters are important to successful breastfeeding through comparing three groups of exclusive breastfeeding durations. Finally, the relationships of the stated factors were drawn in pathway diagrams. Exclusive breastfeeding experiences among Thai adolescent mothers showed complexity involving multilevel influences of social systems. The promotion of optimal breastfeeding should recognize the influences of both personal and environmental factors.
Developing Countries	Thepha, T., Marais, D., Bell, J., & Muangpin, S.	2019	Concept mapping to reach consensus on a three‐year six‐month EBF strategy model to improve the six‐month EBF rate in Northeast Thailand.	Maternal & Child Nutrition	https://doi.org/10.1111/mcn.12823	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6851995/pdf/MCN-15-e12823.pdf	Khon Kaen University	In implementation research, it is essential to involve all stakeholders in the development of complex interventions to ensure that the proposed intervention strategy is relevant and acceptable to the target area and group. The aim of this study was to involve stakeholders in conceptualising, developing, and prioritising a feasible intervention strategy to improve the 6‐month exclusive breastfeeding rate in North‐east Thailand. Concept mapping was used in a purposive sample including health care volunteers, health care professionals, and community leaders. During the first meeting, stakeholders (n = 22) expressed the generation of feasible interventions. During the second meeting, participants (n = 21) were asked to individually rate the feasibility of each intervention and to group them into relevant categories to enable multidimensional scaling and hierarchical cluster analysis. The outputs of analysis included the intervention list, cluster list, point map, point rating map, cluster map, and cluster rating map. All of these were shared with stakeholders (n = 17) during the third meeting to reach consensus on an intervention model. The final proposed intervention strategy included 15 feasible interventions in five clusters: health care services, community services, and education packages for parents, family members, and communities. These interventions were prioritised for implementation over a 3‐year period. Once the feasibility of each intervention is established, the proposed model could be implemented and incorporated into local health policy. After assessing intervention effectiveness, each intervention could be scaled up to other middle‐income countries to help improve overall maternal and child survival.
Developing Countries	Homer, S., T.	2022	A case‐study approach to mapping Corporate Citizenship	Business and Society Review	https://doi.org/10.1111/basr.12280	https://www.researchgate.net/profile/Stephen-Homer-2/publication/362909324_A_case-study_approach_to_mapping_Corporate_Citizenship/links/6307099a5eed5e4bd119abd4/A-case-study-approach-to-mapping-Corporate-Citizenship.pdf	Sunway University	This explores what responsible business practice within the context of Malaysia, an Eastern collective society, diverging from the Western individualistic society where most Corporate Social Responsibility (CSR) research originates. A bottom-up approach was adopted, incorporating different stakeholder perspectives of a case-study firm, widely acknowledged for its CSR programs. Concept mapping method was selected because it is a structural conceptualization method designed to organize and represent ideas from an identified group adding structure to disorganized and subjective ideas. By using concept mapping all the various perspectives and ideas were brought together to create a single conceptualization. The findings from the concept mapping present 101 statements which produced seven clusters; Products & Services, Community Oriented, Stakeholder & Business Value, Employee Oriented, Legal & Ethical Responsibilities, Environmental & Social Oriented, and Philanthropic Oriented. These clusters covered the whole conceptual domain of Corporate Citizenship and demonstrated multiple CSR theories, including corporate sustainability, stakeholder concept, and shared value, were apparent, while also uncovering some unique aspects from the normative stakeholder perspective. The implications of this study suggest that while some aspects of globally institutionalized CSR are generically accepted, there are contextually specific aspects which need to be considered as these may contradict or conflict with the “global” standards.
Developing Countries	Wong, K.W., Khor, K.S. & Homer, S.T.	2023	Perception of smart sustainable cities: a conceptual framework development using group concept mapping method	Asia-Pacific Journal of Regional Science	https://doi.org/10.1007/s41685-023-00293-8	https://link.springer.com/article/10.1007/s41685-023-00293-8	Sunway Business School	A bottom-up approach was adopted to conceptualise a smart sustainable city through the perspective of stakeholders living in Sunway City Kuala Lumpur, Malaysia, touted as a smart sustainable city. The group concept mapping method allows the collection of the city stakeholder views and translation of these views into a framework through five steps: create statements, sort statements, multidimensional scaling, hierarchical cluster analysis and label clusters. This process generated 80 statements that compose a smart sustainable city, creating a conceptual framework of eight dimensions: green environment, township planning, community-friendly township, utilities management, waste management, smart transportation, digitalisation and technology. A validation stage using a confirmatory composite analysis with a reduced statement list of 40 items and 297 participants was also conducted. These results demonstrated that the stakeholders prioritised non-technical features, such as clean air, clean water and community activities over the need to adopt digital features. New features such as urban agriculture, co-living and others were rated less important, implying that new concepts may require strong community participation and support for implementation from the city authorities. The main contribution of this study is the bottom-up approach using group concept mapping, contrary to the traditional top-down approach, offering a novel method for the conceptualising process.
Developing Countries	Azupogo, U. W., Dassah, E. & Bisung, E.	2023	Promoting safe and inclusive water and sanitation services for students with physical disabilities in primary schools: a concept mapping study in Ghana	Journal of Water, Sanitation and Hygiene for Development	https://doi.org/10.2166/washdev.2023.029	https://iwaponline.com/washdev/article-pdf/doi/10.2166/washdev.2023.029/1222292/washdev2023029.pdf	Queen’s University	Improving water, sanitation, and hygiene (WASH) services in schools is crucial to providing inclusive environments for all children to thrive. Particularly for children with disabilities, the school environment can serve as a barrier to their access to and use of WASH facilities. This paper examines strategies and programs needed to promote safe and inclusive WASH services for students with physical disabilities in primary schools in Ghana. We recruited 22 stakeholders from the Upper West Region of Ghana to complete an online concept mapping exercise. Participants identified eight themes for promoting safe and inclusive access to WASH services for students with physical disabilities. These themes included ‘building special schools,’ ‘guidance services,’ ‘ensuring non-discrimination and fair treatment,’ ‘additional programs for PWDs,’ ‘local government interventions,’ ‘public sensitization,’ ‘teacher training,’ and ‘supervision.’ These findings can assist stakeholders in identifying strategies and prioritising programs in the short run to improve WASH among students with physical disabilities.
Developing Countries	C. Jardim PT, Dias JM, Grande AJ, Veras AB, Ferri ÉK, Quadros FAA, et al.	2023	Co-developing a health promotion programme for indigenous youths in Brazil: A concept mapping report		https://doi.org/10.1371/journal.pone.0269653	https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0269653&type=printable		Latin America and the Caribbean Region are home to about 42 million Indigenous people, with about 900,000 living in Brazil. The little routinely collected population-level data from Indigenous communities in the region available shows stark inequities in health and well-being. There are 305 Indigenous ethnic groups, speaking 274 languages, spread across the remote national territory, who have endured long-lasting inequities related to poverty, poor health, and limited access to health care. Malnutrition and mental health are key concerns for young people. Building on our Indigenous communities-academic partnerships over the last two decades, we collaborated with young people from the Terena Indigenous ethnic group, village leaders, teachers, parents, and local health practitioners from the Polo Base (community health centres) to obtain their perspectives on important and feasible actions for a youth health promotion programme. Methods The report was conducted in the Tereré Village in Mato Grosso do Sul. Concept mapping, a participatory mixed method approach, was conducted in 7 workshops, 15 adults and 40 youths aged 9–17 years. Art-based concept mapping was used with 9 to 11 years old children (N = 20). Concept systems software was used to create concept maps, which were finalised during the workshops. Focused prompts related to factors that may influence the health and happiness of youths. The participatory method gave Terena youths a significant voice in shaping an agenda that can improve their health. Results Terena youths identified priority actions that clustered under ‘Family’, ‘School’, ‘Education’, ‘Socio-economic circumstances’, ‘Respect’ and ‘Sport’ in response to protecting happiness; and ‘Nutrition pattern’, ‘Physical activity’, ‘Local environment’, and ‘Well-being’ in response to having a healthy body. Through the participatory lens of concept mapping, youths articulated the interconnectedness of priority actions across these clusters such that behaviours (e.g. Nutrition pattern, drinking water, physical activity) and aspirations (being able to read, to have a good job) were recognised to be dependent on a wider ecology of factors (e.g. loss of eco-systems, parent-child relationships, student- teacher relationships, parental unemployment). In response to developing youth health, Terena adults suggested priority actions that clustered under ‘Relationships’, ‘Health issues’, ‘Prevention at Polo Base’, ‘Access to health care’, ‘Communication with young people’, ‘Community life’, ‘Raising awareness’ and ‘School support’. Their priorities reflected the need for structural transformative actions (e.g. Polo Base and school staff working together) and for embedding actions to protect Indigenous culture (e.g. integrating their cultural knowledge into training programmes). Conclusions Concept maps of Indigenous youths emphasised the need for a health promotion programme that engages with the structural and social determinants of health to protect their happiness and health, whilst those of adults emphasised the need to address specific health issues through preventative care via a school-Polo Base collaboration. Investment in a co-developed school-Polo-Base health promotion programme, with intersectoral engagement, has potential for making Indigenous health systems responsive to the inequalities of youth health, to yield dividends for healthy ageing trajectories as well as for the health of the next generation.
Developing Countries	Sawyer, A.N.; Combs, M.; Clark, V.; Soule, E.K.; Lee, J.G.L.; Breland, A.B. Reactions to a Hypothetical Menthol Cigarette Ban among Sexual- and Gender-Minoritized Communities	2023	Reactions to a Hypothetical Menthol Cigarette Ban among Sexual-and Gender-Minoritized Communities: A Concept Mapping Study		https://doi.org/10.3390/ijerph20053891	https://www.mdpi.com/1660-4601/20/5/3891/pdf?version=1677145033		Background Latin America and the Caribbean Region are home to about 42 million Indigenous people, with about 900,000 living in Brazil. The little routinely collected population-level data from Indigenous communities in the region available shows stark inequities in health and well-being. There are 305 Indigenous ethnic groups, speaking 274 languages, spread across the remote national territory, who have endured long-lasting inequities related to poverty, poor health, and limited access to health care. Malnutrition and mental health are key concerns for young people. Building on our Indigenous communities-academic partnerships over the last two decades, we collaborated with young people from the Terena Indigenous ethnic group, village leaders, teachers, parents, and local health practitioners from the Polo Base (community health centres) to obtain their perspectives on important and feasible actions for a youth health promotion programme. Methods The report was conducted in the Tereré Village in Mato Grosso do Sul. Concept mapping, a participatory mixed method approach, was conducted in 7 workshops, 15 adults and 40 youths aged 9–17 years. Art-based concept mapping was used with 9 to 11 years old children (N = 20). Concept systems software was used to create concept maps, which were finalised during the workshops. Focused prompts related to factors that may influence the health and happiness of youths. The participatory method gave Terena youths a significant voice in shaping an agenda that can improve their health. Results Terena youths identified priority actions that clustered under ‘Family’, ‘School’, ‘Education’, ‘Socio-economic circumstances’, ‘Respect’ and ‘Sport’ in response to protecting happiness; and ‘Nutrition pattern’, ‘Physical activity’, ‘Local environment’, and ‘Well-being’ in response to having a healthy body. Through the participatory lens of concept mapping, youths articulated the interconnectedness of priority actions across these clusters such that behaviours (e.g. Nutrition pattern, drinking water, physical activity) and aspirations (being able to read, to have a good job) were recognised to be dependent on a wider ecology of factors (e.g. loss of eco-systems, parent-child relationships, student- teacher relationships, parental unemployment). In response to developing youth health, Terena adults suggested priority actions that clustered under ‘Relationships’, ‘Health issues’, ‘Prevention at Polo Base’, ‘Access to health care’, ‘Communication with young people’, ‘Community life’, ‘Raising awareness’ and ‘School support’. Their priorities reflected the need for structural transformative actions (e.g. Polo Base and school staff working together) and for embedding actions to protect Indigenous culture (e.g. integrating their cultural knowledge into training programmes). Conclusions Concept maps of Indigenous youths emphasised the need for a health promotion programme that engages with the structural and social determinants of health to protect their happiness and health, whilst those of adults emphasised the need to address specific health issues through preventative care via a school-Polo Base collaboration. Investment in a co-developed school-Polo-Base health promotion programme, with intersectoral engagement, has potential for making Indigenous health systems responsive to the inequalities of youth health, to yield dividends for healthy ageing trajectories as well as for the health of the next generation.
Diversity, Equity and Inclusion	J Brown, M Lengyel	2022	Psychotherapists' efforts to increase awareness of social privilege	Counselling and Psychotherapy Research.	https://doi.org/10.1002/capr.12539		Western University	Understanding the role of privilege in systemic oppression positions psychotherapists to engage in culturally oriented practice. Twenty-five practising psychotherapists were asked: ‘How can psychotherapists increase their awareness of social privilege?’ Participants sorted 68 unique responses into six concepts. The concepts included: make yourself uncomfortable; embrace humility; learn from the community; involvement in social action; seek critical knowledge; and find like-minded others in the profession. Recommendations for student training are offered.
Diversity, Equity and Inclusion	Migrantes Unidos, Adriano Udani, Maria Torres Wedding, Ángel Flores Fontanez, Sara John & Allie Seleyman	2023	Envisioning a world without prisons: group concept mapping as a collective strategy for justice and dignity	Politics, Groups, and Identities	https://doi.org/10.1080/21565503.2023.2266721	https://www.tandfonline.com/doi/epdf/10.1080/21565503.2023.2266721?needAccess=true	University of Missouri, Department of Political Science	People with lived experiences of violence have minimal opportunities to address policies that affect them, which poses challenges to producing relevant results beyond academia. In this paper, we ask: in what ways can groups formulate a collective plan to address policy decisions that harm them? We used a framework called group concept mapping (GCM) with Central American and Mexican asylum seekers (named Migrantes Unidos), who are committed to ending the use of ankle monitors and other forms of detention in immigration enforcement. They identified distinct actions and group values, providing mutual support to each other, developing leadership skills, and receiving strength and knowledge to navigate the immigration system as top priorities. Our field work also showed how GCM participation led to actual subsequent political activism. Our results uncover new attitudes and ideas that add more depth to immigrant political behavior and advocacy. While our results demonstrate that GCM is a useful method to center voices of impacted community members’ ideas for change, we also argued that academics and their partners must value reciprocity regardless of the method or framework chosen to answer empirical questions.
Diversity, Equity and Inclusion	C Finnigan, J Brown, M Al‐Adeimi	2023	Adjustment challenges faced by Yazidi youth refugees in Canada	Children & Society	https://doi.org/10.1111/chso.12801	https://onlinelibrary.wiley.com/doi/epdf/10.1111/chso.12801	Western University	Resettlement to a new country is a period of adjustment for all youth refugees, especially for highly traumatized groups of refugees, such as the Yazidi population. This study explores adjustment challenges faced by Yazidi youth refugees in Canada using group concept mapping. 12 Yazidi youth participated. Seven concepts represent the statements, including family stress and adjustment, the experience of instability and fear, navigating the differences between countries, starting over, getting used to school, the impact of war and my discomfort. The findings from this study were compared and contrasted with the existing literature.
Elder Care	Hanson, H. M., Schiller, C., Winters, M., Sims-Gould, J., Clarke, P. Curran, E., Donaldson, M. G., Pitman, B., Scott, V., McKay, H. A., & Ashe, M. C.	2013	Concept mapping applied to the intersection between older adults' outdoor walking and the built and social environments.	Preventive Medicine	https://doi.org/10.1016/j.ypmed.2013.08.023	https://www.sciencedirect.com/science/article/pii/S0091743513003150/pdfft?md5=828f98f9aad5677926122d974bc049fc&pid=1-s2.0-S0091743513003150-main.pdf	University of British Columbia	Objective: For older adults, the ability to navigate walking routes in the outdoor environment allows them to remain active and socially engaged, facilitating community participation and independence. In order to enhance outdoor walking, it is important to understand the interaction of older adults within their local environments and the influence of broader stakeholder priorities that impact these environments. Thus, we aimed to synthesize perspectives from stakeholders to identify elements of the built and social environments that influence older adults' ability to walk outdoors. Method We applied a concept mapping approach with the input of diverse stakeholders (N = 75) from British Columbia, Canada in 2012. Results: A seven-cluster map best represented areas that influence older adults' outdoor walking. Priority areas identified included sidewalks, crosswalks, and neighborhood features. Conclusion Individual perceptions and elements of the built and social environments intersect to influence walking behaviors, although targeted studies that address this area are needed.
Elder Care	Alzheimer's Association & Centers for Disease Control and Prevention.	2013	The healthy brain initiative: The public health road map for state and national partnerships, 2013-2018.	Alzheimer's Association		http://www.alz.org/publichealth/downloads/2013-roadmap.pdf	Alzheimer's Association	The Healthy Brain Initiative’s (HBI) State and Local Public Health Partnerships to Address Dementia, The 2018-2023 Road Map[PDF – 337 KB] charts a course for state and local public health agencies and their partners. The Road Map prepares all communities to act quickly and strategically by stimulating changes in policies, systems, and environments. Alignment of HBI Road Map actions with Essential Services of Public Health ensures that initiatives to address Alzheimer’s can be incorporated easily and efficiently into existing public health initiatives.
Elder Care	Anderson, L. A., Slonim, A., I. H., Yen, Jones, D. L., Allen, P., Hunter, R. H., Goins, R. T., Leith, K. H., Rosenberg, D., Satariano, W. A., & McPhillips-Tangum, C.	2014	Developing a framework and priorities to promote mobility among older adults.	Health Education & Behavior	https://doi.org/10.1177/1090198114537492	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4447193/pdf/nihms692465.pdf	Centers for Disease Control and Prevention	Mobility, broadly defined as movement in all of its forms from ambulation to transportation, is critical to supporting optimal aging. This article describes two projects to develop a framework and a set of priority actions designed to promote mobility among community-dwelling older adults. Project 1 involved a concept-mapping process to solicit and organize action items into domains from a broad group of stakeholders to create the framework. Concept mapping uses qualitative group processes with multivariate statistical analysis to represent the ideas visually through maps. A snowball technique was used to identify stakeholders (n = 211). A 12-member steering committee developed a focus prompt, "One specific action that can lead to positive change in mobility for older adults in the United States is..." Project 2 included a Delphi technique (n = 43) with three iterations to prioritize four to six items using results from the concept mapping rating process. Project 1 resulted in 102 items across nine domains (Research to Practice, Independence and Engagement, Built Environment and Safety, Transportation, Policy, Housing and Accessibility, Community Supports, Training, and Coordinated Action). The number of items ranged from 6 to 18 per domain. Project 2 resulted in agreement on four items that reflect the importance of promoting environmental strategies through collaborative initiatives aimed at planning and best practices focusing on environmental enhancements or transit, training of professionals, and integration of mobility into state and local public health plans. These findings can be applied to support coordinated, multidisciplinary research and practice to promote mobility among older adults. Keywords: Delphi; concept mapping; environmental strategies; health education; mobility; older adults.
Elder Care	Anderson, L., A. & Egge, R.	2014	Expanding efforts to address Alzheimer's disease: The healthy brain initiative.	Alzheimer's & Dementia	https://doi.org/10.1016/j.jalz.2014.05.1748	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4443789/	Centers for Disease Control and Prevention	The growing burden of Alzheimer's disease underscores the importance of enhancing current public health efforts to address dementia. Public health organizations and entities have substantial opportunities to contribute to efforts underway and to add innovations to the field. The Alzheimer's Association and the Centers for Disease Control and Prevention worked with a 15-member leadership committee and hundreds of stakeholders to create The Healthy Brain Initiative: The Public Health Road Map for State and National Partnerships, 2013-2018 (Road Map). The actions in the Road Map provide a foundation for the public health community to anticipate and respond to emerging innovations and developments. It will be a challenge to harness the increasingly complex nature of public- and private-sector collaborations. We must strengthen the capacity of public health agencies, leverage partnerships, and find new ways to integrate cognitive functioning into public health efforts. Keywords: Alzheimer's disease; Healthy Brain Initiative; Public health partnerships; Road Map.
Elder Care	Iris, M. A.	2017	Short-form elder self-neglect assessment.	Springer Publishing Company			Northwestern University	This chapter describes the development of the Short-Form Elder Self-Neglect Assessment (SF-ESNA) and presents findings from its use by practitioners in the field of self-neglect assessment and intervention. The SF-ESNA includes 12 indicators of self-neglect relating to physical and psychosocial aspects of self-neglect, and 13 indicators related to environmental and personal living conditions. Results of the assessment confirmed that elder self-neglect stemming from personal behaviors and psychosocial characteristics is more common, as compared to self-neglect involving inadequate or deplorable environmental and personal living conditions. This suggests that self-neglect conditions may progress over time, from self-care deficits to more severe housing conditions. In addition, investigators noted cognitive impairments and mental health problems in over half of the 50 older adults suffering from self-neglect. Those scoring high on the SF-ESNA were more likely to have some type of cognitive impairment or mental illness as compared to those with lower scores.
Elder Care	Stolk-Vos, A. C., van de Klundert, J. J., Maijers, N., Zijlmans, B. L. M., & Busschbach, J. J. V.	2017	Multi-stakeholder perspectives in defining health-services quality in cataract care.	International Journal for Quality in Health Care	https://doi.org/10.1093/intqhc/mzx048	https://academic.oup.com/intqhc/article/29/4/470/3814293?login=false	Erasmus University	Objective: To develop a method to define a multi-stakeholder perspective on health-service quality that enables the expression of differences in systematically identified stakeholders' perspectives, and to pilot the approach for cataract care. Design: Mixed-method study between 2014 and 2015. Setting: Cataract care in the Netherlands. Participants: Stakeholder representatives. Intervention(s): We first identified and classified stakeholders using stakeholder theory. Participants established a multi-stakeholder perspective on quality of cataract care using concept mapping, this yielded a cluster map based on multivariate statistical analyses. Consensus-based quality dimensions were subsequently defined in a plenary stakeholder session. Main outcome measure(s): Stakeholders and multi-stakeholder perspective on health-service quality. Results: Our analysis identified seven definitive stakeholders, as follows: the Dutch Ophthalmology Society, ophthalmologists, general practitioners, optometrists, health insurers, hospitals and private clinics. Patients, as dependent stakeholders, were considered to lack power by other stakeholders; hence, they were not classified as definitive stakeholders. Overall, 18 stakeholders representing ophthalmologists, general practitioners, optometrists, health insurers, hospitals, private clinics, patients, patient federations and the Dutch Healthcare Institute sorted 125 systematically collected indicators into the seven following clusters: patient centeredness and accessibility, interpersonal conduct and expectations, experienced outcome, clinical outcome, process and structure, medical technical acting and safety. Importance scores from stakeholders directly involved in the cataract service delivery process correlated strongly, as did scores from stakeholders not directly involved in this process. Conclusions: Using a case study on cataract care, the proposed methods enable different views among stakeholders concerning quality dimensions to be systematically revealed, and the stakeholders jointly agreed on these dimensions. The methods helped to unify different quality definitions and facilitated operationalisation of quality measurement in a way that was accepted by relevant stakeholders. Keywords: cataract; community-based participatory research; concept formation; quality indicators; quality of healthcare.
Elder Care	Bennett, R. J., Laplante-Levesque, A., Meyer, C. J., & Eikelboom, R. H.	2018	Exploring hearing aid problems: Perspectives of hearing aid owners and clinicians.	Ear and Hearing	https://doi.org/10.1097/AUD.0000000000000477		University of Western Australia	Objectives: To gather perspectives of hearing aid owners and hearing healthcare clinicians with regard to problems that arise after hearing aid fitting and use these perspectives to generate a conceptual framework to gain a better understanding of these problems. Design: Participants included a group of 17 hearing aid owners and a group of 21 hearing healthcare clinicians; data collection occurred separately for each group. Participants each attended two group sessions in Perth, Western Australia, wherein they: (1) generated statements describing the problems associated with hearing aids and (2) grouped and rated the statements to identify key themes. Concept mapping was used to generate a conceptual framework. Results: Participants identified four concepts regarding hearing aid problems as follows: (1) hearing aid management; (2) hearing aid sound quality and performance; (3) feelings, thoughts, and behaviors; and (4) information and training. While hearing aid owners and clinicians generated similar results regarding the concepts derived, the clinicians reported that the problems identified had a greater negative impact on hearing aid success than did hearing aid owners. Conclusions: The magnitude and diversity of hearing aid problems identified in this study highlight the ongoing challenges that hearing aid owners face and suggest that current processes for hearing aid fitting can be improved. Problems relating to hearing aid management were most often deemed to have the greatest impact on hearing aid success and be the most preventable/solvable, and thus are a good starting point when addressing hearing aid-related problems.
Elder Care	Bennett, R. J., Meyer, C. J., Eikelboom, R. H., & Atlas, M. D.	2018	Investigating the knowledge, skills, and tasks required for hearing aid management: Perspectives of clinicians and hearing aid owners.	American Journal of Audiology	https://doi.org/10.1044/2017_AJA-17-0059	https://pubs.asha.org/doi/pdf/10.1044/2017_AJA-17-0059	University of Western Australia	Purpose: The purpose of this study is to identify hearing aid owners' and clinicians' opinions of the knowledge, skills, and tasks required for hearing aid management and the importance of each of these to overall success with hearing aids. Method: Concept mapping techniques were used to identify key themes, wherein participants generated, sorted, and rated the importance of statements in response to the question "What must hearing aid owners do in order to use, handle, manage, maintain, and care for their hearing aids?" Twenty-four hearing aid owners (56 to 91 years of age; 54.2% men, 45.8% women) and 22 clinicians (32 to 69 years of age; 9.1% men, 90.9% women) participated. Result: Participants identified 111 unique items describing hearing aid management within 6 concepts: (a) "Daily Hearing Aid Use," (b) "Hearing Aid Maintenance and Repairs," (c) "Learning to Come to Terms with Hearing Aids," (d) "Communication Strategies," (e) "Working With Your Clinician," and (f) "Advanced Hearing Aid Knowledge." Clinicians' opinions of the importance of each statement varied only slightly from the opinions of the hearing aid owner group. Hearing aid owners indicated that all 6 concepts were of similar importance, whereas clinicians indicated that the concept "Advanced Hearing Aid Knowledge" was significantly less important than the other 5 concepts. Conclusion: The results highlight the magnitude of information and skill required to optimally manage hearing aids. Clinical recommendations are made to improve hearing aid handling education and skill acquisition.
Elder Care	Willging, C. E., Sommerfeld, D. H., Jaramillo, E. T., Lujan, E., Bly, R. S., Debenport, E. K., Verney, S. P., & Lujan, R.	2018	Improving Native American elder access to and use of health care through effective health system navigation.	BMC Health Services Research	https://doi.org/10.1186/s12913-018-3182-y	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6006994/pdf/12913_2018_Article_3182.pdf	University of New Mexico	Background: Public insurance reforms of the past two decades have failed to substantively address the healthcare needs of American Indians in general, let alone the particular needs of American Indian elders, ages 55 years and older. Historically, this population is more likely to be uninsured and to suffer from greater morbidities, poorer health outcomes and quality of life, and lower life expectancies compared to all other United States aging populations, representing a neglected group within the healthcare system. Despite the pervasive belief that the Indian Health Service will address all their health-related needs, American Indian elders are negatively affected by gaps in insurance and lack of access to health care. While the 2010 Patient Protection and Affordable Care Act included provisions to ameliorate disparities for American Indians, its future is uncertain. In this context, American Indian elders with variable health literacy must navigate a complex and unstable healthcare system, regardless of where they seek care. Methods This community-driven study features a mixed-method, participatory design to examine help-seeking behavior and healthcare experiences of American Indian elders in New Mexico, in order to develop and evaluate a tailored intervention to enhance knowledge of, access to, and use of insurance and available services to reduce healthcare disparities. This study includes qualitative and quantitative interviews combined with concept mapping and focus groups with American Indian elders and other key stakeholders. Discussion: The information gathered will generate new practical knowledge, grounded in actual perspectives of American Indian elders and other relevant stakeholders, to improve healthcare practices and policies for a population that has been largely excluded from national and state discussions of healthcare reform. Study data will inform development and evaluation of culturally tailored programming to enhance understanding and facilitate negotiation of the changing landscape of health care by American Indian elders. This work will fill a gap in research on public insurance initiatives, which do not typically focus on this population, and will offer a replicable model for enhancing the effects of such initiatives on other underserved groups affected by healthcare inequities.
Elder Care	Bennett, R. J., Meyer, C. J., Eikelboom, R. H., & Atlas, M. D.	2018	Evaluating hearing aid management: Development of the hearing aid skills and knowledge inventory (HASKI).	American Journal of Audiology	https://doi.org/10.1044/2018_AJA-18-0050	https://pubs.asha.org/doi/pdf/10.1044/2018_AJA-18-0050	The University of Western Australia	Although hearing health care clinicians provide training on hearing aid handling and management as part of the rehabilitation program, clinical studies suggest that the level of management skill demonstrated by hearing aid owners is low. In the absence of a comprehensive clinical survey to identify these shortfalls in clinical training, the objective of this study was to develop and report the psychometric properties of the Hearing Aid Skills and Knowledge Inventory (HASKI: a self-administered version and a clinician-administered version). The HASKI evaluates the knowledge and skills required for hearing aid management. A secondary aim was to report the prevalence of hearing aid management difficulties in an Australian population. Method The development of the HASKI and the investigation of its psychometric properties in a prospective convenience cohort of 518 adult hearing aid owners, ranging in age from 18 to 97 years (M = 71 years, SD = 14), 60% male, 38% female, and 2% undisclosed, recruited from 7 hearing clinics across Australia, were used. Results The HASKI (both the self-administered and clinician administered) demonstrated high internal consistency, interdimensional relationships, construct validity, test–retest reliability, interobserver reliability, and criterion validity. A range of aptitudes were observed from low to full competency, with 99% of participants indicating difficulty with at least 1 item on the survey. Conclusions The Hearing Aid Skills and Knowledge Inventories are valid and reliable measures of hearing aid handling and management skills with good potential for use in clinical settings. Hearing aid management is an area of difficulty for the majority of hearing aid owners, indicating the need for clinicians to improve the efficacy of hearing aid management training delivered.
Elder Care	Berman, R. L., Iris, M., Conrad, K. J., & Robinson, C.	2018	Validation of the MedUseQ: A self-administered Screener for older adults to assess medication use problems.	Journal of Pharmacy Practice	https://doi.org/10.1177/0897190018766789		CJE SeniorLife	Background: Older adults taking multiple prescription and nonprescription drugs are at risk for medication use problems, yet there are few brief, self-administered screening tools designed specifically for them. Objective: The study objective was to develop and validate a patient-centered screener for community-dwelling older adults. Methods: In phase 1, a convenience sample of 57 stakeholders (older adults, pharmacists, nurses, and physicians) participated in concept mapping, using The Concept System® Global MAX™, to identify items for a questionnaire. In phase 2, a 40-item questionnaire was tested with a convenience sample of 377 adults and a 24-item version was tested with 306 older adults, aged 55 and older, using Rasch methodology. In phase 3, stakeholder focus groups provided feedback on the format of questionnaire materials and recommended strategies for addressing problems. Results: The concept map contained 72 statements organized into 6 conceptual clusters or domains. The 24-item screener was unidimensional. Cronbach's alpha was .87, person reliability was acceptable (.74), and item reliability was high (.96). Conclusion: The MedUseQ is a validated, patient-centered tool targeting older adults that can be used to assess a wide range of medication use problems in clinical and community settings and to identify areas for education, intervention, or further assessment.
Elder Care	Busija, L., Cinelli, R., Toombs, M. R., Easton, C., Hampton, R., Holdsworth, K., Macleod, A., Nicholson, G. C., Nasir, B. F., Sanders, K. M., & McCabe, M. P.	2018	The role of elders in the wellbeing of a contemporary Australian indigenous community.	The Gerontologist	https://doi.org/10.1093/geront/gny140	https://academic.oup.com/gerontologist/article-pdf/60/3/513/32991122/gny140.pdf	Australian Catholic University	Background and objectives: Traditional Elders are integral to the social structure of Australian Indigenous communities. Due to progressive loss of traditional way of life, however, the role of Elders has been eroding. This study aims to develop a conceptual model of the role of Elders in an Australian Indigenous community, with the goal of attaining strategies to strengthen the role of Elders. Research design and methods: The study, conducted in a regional Indigenous community in Australia, adopted a community-based participatory approach. Design and focus of the project were informed by a community forum (Yarning Circle). One-on-one semistructured interviews and focus groups with community members were conducted by Indigenous researchers. Group concept mapping (GCM) was applied to elicit major themes in qualitative data, from the point of view of community members, and to derive a conceptual model of the role of Elders. Results: Fifty members of the Indigenous community took part in interviews and focus groups. The participants' median age was 45 years (range 18-76 years); 31 (62%) were female. An additional 24 Indigenous community members took part in the data sorting task of GCM. GCM identified seven major aspects of the role of Elders, including Community relations, Passing down the knowledge, Dealing with racism and oppression, Building a better resourced community, Intergenerational connectedness, Safeguarding our identity, and Caring for our youth. Discussion and implications: Elders fulfill many important roles in contemporary Indigenous communities. Our results can be used to assist the community to codesign a program to increase community wellbeing.
Elder Care	Bennett, R. J., Laplante-Levesque, A., & Eikelboom, R. H.	2019	How do hearing aid owners respond to hearing aid problems?	Ear and Hearing	https://doi.org/10.1097/AUD.0000000000000595		University of Western Australia	Although hearing aids can improve hearing and communication, problems that arise following the acquisition of hearing aids can result in their disuse. This study aimed to gather perspectives of hearing aid owners and hearing health care clinicians about how hearing aid owners respond to problems that arise following hearing aid fitting, and then use these perspectives to generate a conceptual framework to better understand these responses. Methods: Seventeen hearing aid owners and 21 hearing health care clinicians generated, sorted, and rated statements regarding how hearing aid owners respond to problems associated with hearing aid use. Concept mapping was used to identify key themes and to develop a conceptual framework. Results: Participants identified four concepts regarding how hearing aid owners respond to problems associated with hearing aids: (1) Seeking External Help; (2) Problem Solving; (3) Putting Up with Problems; and (4) Negative Emotional Response. Participants described behaviors of the clinician and significant others that influenced their decision to seek help for hearing aid problems. Participants recognized that these behaviors could either have a helpful or unhelpful impact. Conclusions: Despite the ongoing support offered to clients after they acquire hearing aids, they are hesitant to seek help from their clinician and instead engage in a myriad of helpful and unhelpful behaviors in response to problems that arise with their hearing aid. Previous positive or negative experiences with the clinic, clinician, or significant other influenced these actions, highlighting the influential role of these individuals' in the success of the rehabilitation program. The data generated from this study suggests that clinicians could improve hearing aid problem resolution by providing technical and emotional support, including to significant others, and promoting client empowerment and self-management.
Elder Care	Bennett, R. J., Conway, N., Fletcher, S., & Barr, C.	2020	The role of the general practitioner in managing age-related hearing loss: perspecitives of general practitioners, patients and practice staff.	BMC Family Practice	https://doi.org/10.1186/s12875-020-01157-2	https://europepmc.org/backend/ptpmcrender.fcgi?accid=PMC7226944&blobtype=pdf	University of Melbourne	For people with hearing loss, the General Practitioner (GP) can play an instrumental role in early detection of hearing loss as well as guiding appropriate and timely choices for addressing hearing concerns. The aim of this study was to generate a conceptual framework for understanding the role of the GP in managing age-related hearing loss. Methods: Concept mapping techniques were used to gather the perspectives of GPs (n = 8), adults with hearing loss (n = 22), and professionals working with GPs (n = 5), in Australia. Participants generated statements describing the role of the GP in managing age-related hearing loss, and then grouped the statements to identify key themes, via an online portal. Results: Ninety-eight items describing the role of the GP in managing age-related hearing loss were identified across six concepts: 1) Determine - Diagnose - Discuss, 2) Ask - Assess - Act, 3) Know - Refer - Coordinate, 4) Inform - Advise - Partner, 5) Educate - Strategise - Encourage, 6) Reassure - Support - Empower. Conclusions: The role of the GP in managing age-related hearing loss is multifaceted and requires partnership that motivates and empowers patients' to overcome their hearing concerns. Enlisting the help of Practice Nurses, Practice Managers and local audiologists could help GPs improve their hearing loss detection and intervention rates.
Elder Care	Piedra, L. M., Ridings, J., Howe, M., Smith, J. L., O'Brien, C., Howard, A., & Conrad, K. J.	2020	Stakeholders' Ideas About Positive Aging for Latinos: A Conceptual Map.	Journal of applied gerontology : the official journal of the Southern Gerontological Society	https://doi.org/10.1177/0733464820935749	https://www.researchgate.net/profile/Lissette-Piedra/publication/342786925_Stakeholders%27_Ideas_About_Positive_Aging_for_Latinos_A_Conceptual_Map/links/61f99b201e98d168d7e61a5d/Stakeholders-Ideas-About-Positive-Aging-for-Latinos-A-Conceptual-Map.pdf?origin=publication_detail	University of Illinois at Urbana–Champaign	Few studies explore the differences between diverse stakeholders' understandings of what constitutes "positive aging" for Latino older adults. To address this gap, we worked with a 20-member steering committee (SC) of community stakeholders to collect concept mapping data from 38 scholars and community workers. We generated 90 statements related to positive aging from the literature and produced concept maps based on four different stakeholder groups' ratings of them. All stakeholders prioritized "Financial Security," but scholars marked "Spirituality" as least important whereas community workers rated it second highest. The design of programs for Latino older adults should reflect such differences. Keywords: Hispanics; mixed methods; social work; successful aging.
Elder Care	Mehdipanah, R., Briceño, E. M., Gonzales, X., F., Heeringa, S., G., Levine, D., A., Langa, K., M., Garcia, N., Longoria, R., & Morgenstern L., B.	2021	Dementia care needs for individuals and caregivers among Mexican Americans and non-Hispanic Whites.	Aging & Mental Health	https://doi.org/10.1080/13607863.2021.1925222		University of Michigan	Mexican Americans (MA) are more likely to have cognitive impairment and dementia (CID), be diagnosed at an earlier age and live with CID longer, compared to non-Hispanic Whites (NHW). While studies have examined unmet needs of individuals with CID and their caregivers, few have focused on MA populations in the U.S. This paper examines the needs of community-residing individuals with CID and their caregivers in Nueces County, Texas, a county with one of the largest MA populations in the U.S., while exploring ethnic differences in needs identified. Using concept mapping, a mixed-method approach, qualitative input on perceived needs by informal caregivers and health professionals was collected. Participants then sorted and rated perceived needs. Using this information, multidimensional scaling and cluster analyses were conducted to map the relationship between perceived needs and determine their importance and priority. Five clusters were derived for caregivers and four for the health professionals. Themes across both caregivers and health professionals highlighted the need for specialized and team-based medical care, caregiver support and training, along with socio-economic and physical needs that help with day-to-day care of individuals with CID. Among caregivers, MA rated financial resources as more important and of higher priority compared to NHW. The health professionals' perspectives were aligned with those of all caregivers. By understanding the needs of caregivers and individuals with CID, we can help families deal with this disease and let caregivers thrive. This is especially important for minority populations like MAs. Keywords: Mixed methods; ethnic minorities; informal caregiving.
Elder Care	Laustsen, C., E., Westergren, A., Petersson, P., & Haak, M.	2021	Conceptualizing researchers’ perspectives on involving professionals in research: a group concept mapping study.	Health Research Policy and Systems	https://doi.org/10.1186/s12961-021-00685-2	https://health-policy-systems.biomedcentral.com/track/pdf/10.1186/s12961-021-00685-2.pdf	Kristianstad University	Researchers have shown an increased interest in involving professionals from outside academia in research projects. Professionals are often involved in research on ageing and health when the purpose is to address the gap between research and practice. However, there is a need to acquire more knowledge about what the involvement might lead to by exploring researchers’ experiences of involving professionals in research on ageing and health and developing conceptual areas. Therefore, the aim of this study was to identify conceptual areas of professionals’ involvement in research on ageing and health, from the perspective of researchers themselves. Methods Group concept mapping, a participatory and mixed method, was used to conceptualize areas. Researchers with experience of involving professionals in research projects on ageing and health participated in qualitative data collection through brainstorming sessions (n = 26), and by sorting statements (n = 27). They then took part in quantitative data collection, where they rated statements according to how much a statement strengthened research (n = 26) and strengthened practice (n = 24). Data were analysed using multidimensional scaling analysis and hierarchical cluster analysis. In addition, a qualitative analysis of the latent meaning of the cluster map was conducted. Results: Analysis of the sorting stage generated five clusters illustrating conceptual areas of professionals’ involvement in research projects on ageing and health. The five clusters are as follows: complex collaboration throughout the research process; adaptation of research to different stakeholders, mutual learning through partnership; applicable and sustainable knowledge; legitimate research on ageing and health. The qualitative latent meaning of the cluster map showed two themes: the process of involvement and the outcome of involvement. A positive strong correlation (0.87) was found between the rating of strengthened research and practice. Conclusions: This study reveals conceptual areas on a comprehensive and illustrative map which contributes to the understanding of professionals’ involvement in research on ageing and health. A conceptual basis for further studies is offered, where the aim is to investigate the processes and outcomes entailed in involving professionals in research on ageing and health. The study also contributes to the development of instruments and theories for optimizing the involvement of professionals in research.
Elder Care	Laustsen, C. E., Petersson, P., Westergren, A., & Haak, M.	2021	Involvement of professionals in research: knowledge integration, development of practice, and challenges: a group concept mapping study.	Health Research Policy and Systems	https://doi.org/10.1186/s12961-021-00763-5	https://health-policy-systems.biomedcentral.com/track/pdf/10.1186/s12961-021-00763-5.pdf	Kristianstad University	Research and practice are often considered as two different worlds with different values, which causes a gap between them. Involving professionals such as practitioners, managers, decision-makers, and policy-makers in research on ageing and health might address the gap between research and practice, strengthen the healthcare system, and increase older people’s possibilities for healthy ageing. The aim of this study was to conceptualize professionals’ involvement in research on ageing and health from the perspective of the professionals themselves. Methods: A mixed method called group concept mapping was used. Professionals with experience being involved in research on ageing and health participated in qualitative data collection through brainstorming sessions (n = 29) and by sorting statements (n = 29). Afterwards, they participated in a quantitative data collection by rating statements according to how much each statement strengthened practice (n = 30) and strengthened research (n = 28). Multidimensional scaling analysis and hierarchical cluster analysis were used to conduct quantitative analysis. Latent qualitative analysis was also conducted. Results: Analysis resulted in eight clusters which illustrated conceptual areas of professionals’ involvement in research projects. The qualitative latent construct of the cluster map resulted in the themes: challenges for professionals; prerequisites and professionals’ learning can contribute to development of practice; and integrated knowledge benefits older people. There was a strong correlation between what strengthens practice and research (r = 0.92). Conclusions: This study illustrates conceptual areas of professionals’ own perspectives on what their involvement in research can lead to. Their involvement may lead to knowledge being integrated, and the professionals may learn through their involvement, which can contribute to the development of practice. However, there can also be challenges that need to be handled when professionals are involved in research. The study can be useful for improving the understanding of and actual involvement of professionals in research, and for optimizing the involvement of professionals.
Elder Care	Piedra, L., M., Howe, M., J., K., Ridings, J., Montoya, Y., & Conrad K., J.	2022	Convivir (to Coexist) and Other Insights: Results From the Positive Aging for Latinos Study.	Journal of applied gerontology : the official journal of the Southern Gerontological Society	https://doi.org/10.1177%2F07334648211069269		University of Illinois at Urbana-Champaign	Many Latinos in the United States do not have access to culturally sensitive services to help them age well. We combined community-based participatory research with concept mapping methods to understand how a sample of community-dwelling Latino older adults view positive aging. Nine focus groups (N = 101) generated 85 non-repeating statements, which were used to produce a final map with 11 clusters, organized into four overarching regions: Convivir (To Coexist), Self-Sufficiency, Perspectives on Life, and Healthy Behaviors. Further analyses revealed three themes: (1) the importance of varied social connections, as conveyed by the region labeled Convivir; (2) a multifaceted understanding of “stability” that includes finances, relationships, and spirituality; and (3) the need for a mature mindset reflected in the thematic cluster Tomalo Suave (Take It Easy). Findings can inform the development of interventions for Latino older adults and the cultural adaptation of programs initially designed for non-Latinos. Keywords: health promotion, mixed methods, successful aging, hispanic/latino, positive aging, concept mapping
Elder Care	Piedra, L. M., Howe, M., Ridings, J., & Gutwein, M.	2022	Do Latino Older Adults and service Providers Agree on Positive Aging? Using Concept Mapping to Compare Perspectives	Gerontologist	https://doi.org/10.1093/geront/gnac074	https://academic.oup.com/gerontologist/advance-article-pdf/doi/10.1093/geront/gnac074/44992490/gnac074.pdf	University of Illinois at Urbana-Champaign	In the United States, Latino adults are a growing segment of the aging population who will need research-informed interventions to help them age successfully. Arguably, how Latino older adults and service providers understand "positive aging" serves as an important precursor for the cultivation of such interventions. This investigation explored whether Latino older adults' conceptualizations of positive aging aligned with those of service providers. Research design and methods: We compared how Latino older adults (n = 93) and service providers (n = 45) rated 85 positive aging statements produced by Latino older adults. These 85 items were used to generate a concept map, which displays those items thematically by clusters and overarching regions of meaning. Results: We found divergences at each level of the map-statements, clusters, and regions-which illuminate differences between how service providers and Latino older adults think about Latino positive aging. For example, whereas Latino older adults prioritized the cluster containing items related to internal wellbeing, service providers rated it seventh of eleven clusters. The region comprising clusters related to relationships garnered the highest agreement between groups, but also a notable departure; compared to Latino older adults, service providers rated community and social involvement as less important. Discussion and implications: Understanding such differences can help providers tailor services consistent with the interests of Latino older adults. Future studies should examine the extent to which stakeholders believe various aspects of positive aging are modifiable. Keywords: Community-based services; Hispanic older adults; Successful aging.
Elder Care	Knippenberg, I. A., Leontjevas, R., Stoyanov, S., Persoon, A., Verboon, P., Vermeulen, H., J. J. D. M., van Lankveld, & Gerritsen, D. L	2022	Informal antidepressant strategies for nursing home residents: two group concept mapping studies	Aging & Mental Health	https://doi.org/10.1080/13607863.2022.2057427	https://www.tandfonline.com/doi/pdf/10.1080/13607863.2022.2057427	Open University of the Netherlands	To identify and structure potential informal antidepressant strategies that can be used in daily practice for nursing home residents alongside formal treatments. Methods: In a first Group Concept Mapping study, residents, relatives, and professional caregivers (N = 124) brainstormed on strategies residents could use to prevent or alleviate depression. In a second study, the same participants (N = 110) reported strategies for use by others. Furthermore, participants rated the expected effectiveness and feasibility of the suggested strategies. Simultaneously, all strategies were sorted by experts and clustered using multidimensional scaling and hierarchical cluster analysis. Results: Six clusters emerged for strategies by residents themselves and five clusters for strategies by others. For residents’ strategies, the clusters Being socially connected and Participating in activities were perceived as most effective, as was the cluster Offering personal attention for strategies by others. Participants perceived Creating a healthy living environment as the most feasible cluster executed by residents. Within strategies by others, the clusters Offering personal attention, Using positive treatment/approach, and Using or adapting the physical environment were perceived as the most feasible. Conclusion: The results indicated the importance of social connectedness, a personalized and positive approach by significant others, and tailored activity programs. The results also suggest that adaptations to the physical environment within nursing homes may be an easy applicable strategy to prevent or alleviate depression in residents. Although more research is needed, these findings may guide daily practice and the development of interventions that include informal strategies.
Elder Care	Pedersen, I., Ellingsen-Dalskau, L., & Patil, G.	2022	Characteristics of farm based day care services for people with dementia–mapping the stakeholders' views.	Wellbeing, Space and Society	https://doi.org/10.1016/j.wss.2022.100073	https://www.sciencedirect.com/science/article/pii/S2666558122000021/pdfft?md5=10b2a488d6173fda298a4c3a5ece122e&pid=1-s2.0-S2666558122000021-main.pdf	Norwegian University of Life Sciences	The study aimed to identify elements of importance for providing a good care environment in farm-based day care services for people with dementia. Nineteen stakeholders involved in farm-based dementia care participated in a two-phased mixed-method study (concept mapping). Quantitative analyses of 85 collected statements on what identified characteristics of such services formed a map consisting of 8 clusters representing the aggregated elements. Based on the map, a model was developed indicating interactions between the clusters. The farm context was the basis for creating a health promoting care environment facilitating tailored activities essential for person-centered care and wellbeing for the attendees.
Elder Care	G van Voorden, RTCM Koopmans, & M Smalbrugge…	2022	Well-being, multidisciplinary work and a skillful team: essential elements of successful treatment in severe challenging behavior in dementia		https://doi.org/10.1080/13607863.2023.2169248	https://www.tandfonline.com/doi/epdf/10.1080/13607863.2023.2169248?needAccess=true&role=button	Radboud university, Netherlands	Objective Conceptualize successful treatment of persons with dementia and severe challenging behavior as perceived by professionals. Methods In this concept mapping study 82 experts in dementia care participated. The study followed two phases of data collection: (1) an online brainstorm where participants completed the focus prompt: ‘I consider the treatment of people with severe challenging behavior in dementia successful if.’; (2) individual sorting and rating of the collected statements followed by data analysis using multidimensional scaling and hierarchical cluster analysis, resulting in a concept map. Results Three clusters were identified, the first addressing treatment outcomes and the latter two addressing treatment processes, each divided into sub-clusters: (1) well-being, comprising well-being of the person with dementia and all people directly involved; (2) multidisciplinary analysis and treatment, comprising multidisciplinary analysis, process conditions, reduction in psychotropic drugs, and person-centered treatment; and (3) attitudes and skills of those involved, comprising consistent approach by the team, understanding behavior, knowing how to respond to behavior, and open attitudes. Conclusions Successful treatment in people with dementia and severe challenging behavior focuses on well-being of all people involved wherein attention to treatment processes including process conditions is essential to achieve this.
Evaluation	Trochim, W. M. K.	1985	Pattern matching, validity and conceptualization in program evaluation.	Evaluation Review	https://doi.org/10.1177/0193841X8500900503		Cornell University	All social research is based on pattern matching ideas. A pattern match involves a correspondence between a theoretical or conceptual expectation pattern and an observed or measured pattern. Two quasi-experimental designs-the nonequivalent dependent variable design and the reversed treatment design—illustrate pattern matching logic well. In program evaluation three pattern matches are important: the program pattern match that assesses program implementation; the measurement pattern match that assesses the validity of the measures; and the effect pattern match that assesses the causal hypothesis Conceptualization methods are needed to facilitate the articulation of rich theoretical patterns. An example of a conceptualization study is presented and the utility of conceptualization methods for pattern-matching research is discussed.
Evaluation	Trochim, W. M. K. & Linton, R.	1986	Conceptualization for planning and evaluation.	Evaluation and Program Planning	https://doi.org/10.1016/0149-7189(86)90044-3		Cornell University	Conceptualization is a central task in planning and evaluation. There is a need to develop conceptualization methods which can help multiple constituency groups collaborate on the development of conceptual frameworks which can guide the planning and evaluation effort. A general model for conceptualization methods is presented along with considerations for implementation. This model is illustrated in two planning and evaluation studies which involved a broad range of constituent groups within the organizations in the development of "concept maps" which could guide subsequent work. Some general implications of conceptualization methods for planning and evaluation are discussed.
Evaluation	Trochim, W. (Ed.).	1989	Special issue: Concept mapping for evaluation and planning.	Evaluation and Program Planning	https://www.sciencedirect.com/science/article/abs/pii/S0149718916301471		Cornell University	Concept mapping was developed in the 1980s as a unique integration of qualitative (group process, brainstorming, unstructured sorting, interpretation) and quantitative (multidimensional scaling, hierarchical cluster analysis) methods designed to enable a group of people to articulate and depict graphically a coherent conceptual framework or model of any topic or issue of interest. This introduction provides the basic definition and description of the methodology for the newcomer and describes the steps typically followed in its most standard canonical form (preparation, generation, structuring, representation, interpretation and utilization). It also introduces this special issue which reviews the history of the methodology, describes its use in a variety of contexts, shows the latest ways it can be integrated with other methodologies, considers methodological advances and developments, and sketches a vision of the future of the method’s evolution.
Evaluation	Kane, M. & Trochim, W.M.K.	2007	Concept mapping for planning and evaluation.	Thousand Oaks: Sage Publications.	https://us.sagepub.com/en-us/nam/concept-mapping-for-planning-and-evaluation/book229728		Concept Systems, Inc.	Concept mapping is a methodology for mapping ideas that integrates input from multiple sources with differing expertise or interest, creates maps with multivariate data analyses that depict the composite thinking of the group, and yields data that allows for comparisons across rating criteria, stakeholder groups, different points in time, etc. to aid in targeted planning, implementation strategies, and evaluation. Group concept mapping is related to the growing interest in the role that theory plays in planning and evaluation. Concept Mapping for Planning and Evaluation is a thorough, accessible guide to concept mapping for social or organizational researchers in any context. The volume describes the history of structured conceptualization--a most useful form of concept mapping. It also highlights the advantages that group or community concept mapping has over other kinds of group decision processes. With straightforward language and useful examples from the authors' 40 combined years of creating and working with this process, the book describes in detail the six major steps in the conduct of group concept mapping, and shares both the process of concept mapping and the equally important facilitation and guidance techniques that the authors have developed. Examples from work with clients like the Centers for Disease Control, the National Institutes of Health, and state government, as well as interesting examples from concept mapping in social research contexts, illustrate each step in the process. Each chapter provides work sheets for readers to create their own concept mapping plans. References that provide recommendations for further reading are included, as well as contact information for research guidance.
Evaluation	Klenk, N. L. & Hickey, G. M.	2011	A virtual and anonymous, deliberative and analytic participation process for planning and evaluation: The concept mapping policy Delphi.	International Journal of Forecasting	https://doi.org/10.1016/j.ijforecast.2010.05.002		McGill University	Integrating knowledge and values across a range of stakeholders and experts is a common goal of, and challenge in, forecasting and planning processes across numerous decision-making domains. In this paper we present a virtual and anonymous, deliberative and analytical participatory group process which we applied in a planning study. The process was a combination of concept mapping and a policy Delphi. The Concept Mapping Policy Delphi offers an iterative process that is meant to foster critical, dissensus-based thinking by a group about an evaluation problem. In particular, it offers a platform on which to structure the group brainstorming of ideas, integrates knowledge and values, and creates a shared conceptual framework for addressing evaluation problems. We discuss the merits and limitations of this process and compare it with other public engagement mechanisms for decision-making. We argue that the use of a Concept Mapping Policy Delphi is relevant in forecasting and decision-making processes that aim to integrate information which is from various disparate points of view in order to clarify arguments and values, democratize and mediate public participation, and/or provide strategic advice about scenarios or planning options, while mitigating the problematic aspects of face-to-face group processes.
Evaluation	Leyshon, R. & Shaw, L.	2012	Using multiple stakeholders to define a successful return to work: A concept mapping approach.	Work: A Journal of Prevention, Assessment and Rehabilitation	https://doi.org/10.3233/WOR-2012-1317		University of Western Ontario	Objective: Currently no standard or universal outcome measure for return to work (RTW) programs exists making the evaluation and comparison of such programs difficult. RTW outcomes are often measured using nominal scales based on administrative data but these fail to take the perspectives of workers and other stakeholders into consideration. In order to gain that perspective this study was conducted to identify what outcomes are of interest and importance to RTW stakeholders. RTW stakeholders identified indicators of successful RTW in order to develop a conceptual framework of successful RTW. Participants: A total of 24 RTW stakeholders participated, representing both RTW consumers and providers from Southwestern Ontario. Method: This study used a mixed-method integrated form of concept mapping, which qualitatively generates and interprets data, and quantitatively analyzes data using multidimensional scaling and hierarchical cluster analysis. Results: Participants generated 48 statements, which were subsequently clustered into the following six concepts; worker performance, worker job satisfaction, human rights, worker well-being, seamless RTW process through collaborative communication, and satisfaction of stakeholders other than workers. Conclusions: The results reflect the perspectives of stakeholders and suggest that RTW outcome measures are needed that not only evaluate all aspects of the worker's life, but the RTW process as well. Aside from confirming the inadequacy of nominal, administrative type outcomes, these findings imply that the actual RTW process is intimately tied to outcome. Implications and relevance are discussed for planning RTW programs and towards developing a RTW outcome tool.
Evaluation	Miller, J. J.	2016	Concept mapping methodology: A planning and evaluation tool for organizational wellness initiatives.	International Journal of Health, Wellness & Society			University of Kentucky	Increasingly, organizations are recognizing the benefit of developing, implementing, and evaluating wellness initiatives. Despite this recognition, the current literature is devoid of participatory research frameworks to meet these aims, from the perspective of those most impacted: employees. This paper discusses the use of Concept Mapping (CM) as a tool for planning, implementing, and evaluating organizational wellness initiatives. After a brief review of literature related to organizational wellness, this paper will explain CM research methodology and offer a case example for the application of this method at a multi-state social service agency. The conclusion considers the implications derived from the case example and explicates future research possibilities related to the use of CM and organizational wellness endeavors.
Evaluation	Miller, J. J., Grise-Owens, E., Addison, D., Marshall, M., Trabue, D., & Esboar-Ratliff, L.	2016	Planning an organizational wellness initiative at a multi-state social service agency.	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2016.02.001		University of Kentucky	Increasingly, organizations in general, and social service organizations, specifically, are recognizing the importance of planning and evaluating organizational wellness initiatives. Yet, few participatory models for carrying out these aims exist. For this study, researchers utilized concept mapping (CM) to explicate a conceptual framework for planning, and subsequently evaluating, a wellness initiative at a multi-state social service organization. CM is a participatory approach that analyzes qualitative data via multi-dimensional scaling and hierarchical cluster analyses. Outputs include a number of visual depictions that allow researchers to explore complex relationships among sets of the data. Results from this study indicated that participants (N=64), all of whom were employees of the agency, conceptualized organizational wellness via an eight-cluster solution, or Concept Map. Priority areas of this framework, specifically importance and feasibility, were also explored. After a brief review of pertinent literature, this article explicates the CM methodology utilized in this study, describes results, discusses lessons learned, and identifies apt areas for future research. Keywords: Concept mapping; Organizational wellness; Social services.
Evaluation	van Engen-Verheul, M. M., Peek, N., Haafkens, J. A., Joukes, E., Vroman, T., Jaspers, M. W. M., & de Keizer, N. F.	2017	What is needed to implement a web-based audit and feedback intervention with outreach visits to improve care quality: A concept mapping study among cardiac rehabilitation teams.	International Journal of Medical Informatics	https://doi.org/10.1016/j.ijmedinf.2016.10.003	https://isiarticles.com/bundles/Article/pre/pdf/81708.pdf	University of Amsterdam	Introduction: Evidence on successful quality improvement (QI) in health care requires quantitative infor- mation from randomized clinical trials (RCTs) on the effectiveness of QI interventions, but also qualitative information from professionals to understand factors influencing QI implementation. Objective: Using a structured qualitative approach, concept mapping, this study determines factors iden- tified by cardiac rehabilitation (CR) teams on what is needed to successfully implement a web-based audit and feedback (A&F) intervention with outreach visits to improve the quality of CR care. Methods: Participants included 49 CR professionals from 18 Dutch CR centres who had worked with the A&F system during a RCT. In three focus group sessions participants formulated statements on factors needed to implement QI successfully. Subsequently, participants rated all statements for importance and feasibility and grouped them thematically. Multi dimensional scaling was used to produce a final concept map. Results: Forty-two unique statements were formulated and grouped into five thematic clusters in the concept map. The cluster with the highest importance was QI team commitment, followed by organisa- tional readiness, presence of an adequate A&F system, access to an external quality assessor, and future use and functionalities of the A&F system. Conclusion: Concept mapping appeared efficient and useful to understand contextual factors influencing QI implementation as perceived by healthcare teams. While presence of a web-based A&F system and external quality assessor were seen as instrumental for gaining insight into performance and formulating QI actions, QI team commitment and organisational readiness were perceived as essential to actually implement and carry out these actions. These two sociotechnical factors should be taken into account when implementing and evaluating the success of QI implementations in future research
Evaluation	Webster, D. A., Strassheim, V., Newton, J. L., & Hackett, K. L.	2017	A comprehensive service re-evaluation of the UK's first NHS generic fatigue clinic four years following its inception: A mixed methods study.	SDRP Journal of Cellular and Molecular Physiology	https://doi.org/10.25177/JCMP.2.2.1	https://researchportal.northumbria.ac.uk/ws/portalfiles/portal/14675347/A_comprehensive_service_re_evaluation_of_the_UK_first_NHS_generic_fatigue20171112234938.pdf	Newcastle University	To identify if the Newcastle CRESTA (Clinics for Research in Themed Assessment) fatigue clinic continues to meet patient expectations, two years since an initial evaluation in 2015, following changes to the original service model. Background: The CRESTA fatigue clinic was established in 2013 to fulfil the unmet needs of patients with long-term conditions and the symptom of chronic fatigue who did not have access to fatigue management support. The service was previously evaluated using a group concept mapping (GCM) approach and found to successfully meet patients’ expectations. To ensure these needs continued to be met following change to the original service model, we re-evaluated the service using a similar approach. GCM is a mixed method approach. Statements are generated from stakeholders, sorted into themed clusters, and then rated. Method: 146 assessment tools were posted to consecutive clinic patients containing statements generated during the original study. Patients rated each statement for ‘current success’ on a 1-5 Likert scale and provided for free-text feedback. Unpaired t-tests were used to compare cluster success scores from both the previous evaluation and the current cohort of patients. Thematic analysis was used to evaluate the qualitative comments. Results: 46 questionnaires were returned. Comparison of the cluster success scores revealed the clinic has maintained its previous success and made significant improvements in peer support (p≥0.001). The free-text comments were mainly positive and patients found the service to be invaluable. Conclusion: The CRESTA fatigue clinic continues to successfully meet patient expectations and has made significant improvements in peer support.
Evaluation	Haymovitz, E., Houseal-Allport, P., Lee, R. S., & Svistova, J.	2017	Exploring the perceived benefits and limitations of a school-based social-emotional learning program: A concept map evaluation.	Children & Schools	https://doi.org/10.1093/cs/cdx029	https://www.researchgate.net/profile/Ethan-Haymovitz/publication/322735467_Exploring_the_Perceived_Benefits_and_Limitations_of_a_School-Based_Social-Emotional_Learning_Program_A_Concept_Map_Evaluation/links/5f25a37d92851cd302cf4554/Exploring-the-Perceived-Benefits-and-Limitations-of-a-School-Based-Social-Emotional-Learning-Program-A-Concept-Map-Evaluation.pdf?origin=publication_detail	Millersville University of Pennsylvania	Schools today are faced with the challenge of equipping students with the skills they need to succeed in life outside the classroom while also teaching the academic material required. More often, teachers are called on to establish environments in which students learn social and emotional skills alongside academics. With increased recognition that punitive models of school discipline have a negative impact on school culture and on students' individual growth, schools are tasked with designing positive alternatives to improving school engagement and culture. Social Harmony teaches K-8 school communities the skills necessary to promote social-emotional learning and address conflict through restorative methods, a model that is gaining traction. After three years of implementation in a small private school, authors conducted a study that involved 32 students, faculty, and parents in a community-based, concept mapping procedure to articulate perceived impact. Participants reported an observable impact on faculty productivity, student well-being, peer relationships, and school climate. Lessons learned include the need for strong, consistent, and sustainable leadership and stronger parental inclusion, which may best be guaranteed by school social work professionals. The article concludes with a discussion of implications of the findings and recommendations.
Evaluation	Donaldson, A., Reimers, J. L., Brophy, K. T., Nicholson, M.	2018	Barriers to rejecting junk food sponsorship in sport - A formative evaluation using concept mapping.	Public Health	https://doi.org/10.1016/j.puhe.2018.09.021		La Trobe University	Objectives: Energy-dense, nutrient-poor food and drink ('junk food') brands sponsoring sport is a growing public health concern. This study explored sports administrators' perceptions of the barriers to rejecting junk food sponsorship. Study design: This study used concept mapping. Methods: The Concept System® Global MAX™ web platform was used to collect and analyse data from 29 sports administrators across all levels of sport in Victoria, Australia. Results: Brainstorming generated 33 barriers to rejecting junk food sponsorship. After the barriers were synthesised and edited, participants sorted and rated 32 barriers. Multidimensional scaling and hierarchical cluster analysis identified a four-cluster solution: community attitudes and values (seven barriers); junk food is the easy sell (retail; five barriers); financial viability (16 barriers); and organisational capability (policy and governance; four barriers). The financial viability barriers were rated the most important (mean = 3.65 of 5) and the hardest to overcome (1.42). The organisational capability (policy and governance) barriers were rated the least important (2.14) and the easiest to overcome (3.20). Conclusions: Sports administrators clearly perceive that rejecting junk food sponsorship could place significant financial strain on their organisations. There appears to be considerable scope to build the capacity of sporting organisations to rejecting junk food sponsorship. Despite the literature indicating that most parents think junk food companies are not suitable sponsors, sports administrators perceive that there is a broad public acceptance of junk food sponsorship in sport. The fact that sports administrators perceive a link between junk food sponsorship and the lack of healthy options at club canteens and venue food outlets adds an additional, not previously identified, level of complexity to the junk food sponsorship in sport debate.
Evaluation	Szijarto, B. & Cousins, J. B.	2019	Mapping the practice of developmental evaluation: Insights from a concept mapping study.	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2019.05.001		University of Ottawa	The practice of DE is described through 7 clusters of activities in a concept map. The map depicts 3 broad facets of bounding, creating and using an inquiry space. These facets of DE are interconnected in an integrated and distributed practice. Aspects of the practice of DE can be “invisible”; difficult to describe and teach. Guiding principles help with navigation, both for evaluators and program actors. Complexity; Developmental evaluation; Group concept mapping; Guiding principles.
Evaluation	Cargo, M., Potaka-Osborne, G., Cvitanovic, L., Warner, L., Clarke, S., Judd, J., Chakraborty, A., & Boulton, A.	2019	Strategies to support culturally safe health and wellbeing evaluations in Indigenous settings in Australia and New Zealand: A concept mapping study.	International Journal for Equity in Health	https://doi.org/10.1186/s12939-019-1094-z	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6916243/pdf/12939_2019_Article_1094.pdf	University of Canberra	Background: In recent decades, financial investment has been made in health-related programs and services to overcome inequities and improve Indigenous people’s wellbeing in Australia and New Zealand. Despite policies aiming to ‘close the gap’, limited evaluation evidence has informed evidence-based policy and practice. Indigenous leaders have called for evaluation stakeholders to align their practices with Indigenous approaches. Methods This study aimed to strengthen culturally safe evaluation practice in Indigenous settings by engaging evaluation stakeholders, in both countries, in a participatory concept mapping study. Concept maps for each country were generated from multi-dimensional scaling and hierarchical cluster analysis. Results The 12-cluster Australia map identifies four cluster regions: An Evaluation Approach that Honours Community; Respect and Reciprocity; Core Heart of the Evaluation; and Cultural Integrity of the Evaluation. The 11-cluster New Zealand map identifies four cluster regions: Authentic Evaluation Practice; Building Māori Evaluation Expertise; Integrity in Māori Evaluation; and Putting Community First. Both maps highlight the importance of cultural integrity in evaluation. Differences include the distinctiveness of the ‘Respecting Language Protocols’ concept in the Australia map in contrast to language being embedded within the cluster of ‘Knowing Yourself as an Evaluator in a Māori Evaluation Context’ in the New Zealand map. Participant ratings highlight the importance of all clusters with some relatively more difficult to achieve, in practice. Notably, the ‘Funding Responsive to Community Needs and Priorities’ and ‘Translating Evaluation Findings to Benefit Community’ clusters were rated the least achievable, in Australia. The ‘Conduct of the Evaluation’ and the ‘Prioritising Māori Interests’ clusters were rated as least achievable in New Zealand. In both countries, clusters of strategies related to commissioning were deemed least achievable. Conclusions The results suggest that the commissioning of evaluation is crucial as it sets the stage for whether evaluations: reflect Indigenous interests, are planned in ways that align with Indigenous ways of working and are translated to benefit Indigenous communities Identified strategies align with health promotion principles and relational accountability values of Indigenous approaches to research. These findings may be relevant to the commissioning and conduct of Indigenous health program evaluations in developed nations. Keywords: Evaluation, Indigenous, Māori, Aboriginal and Torres Strait islander, Cultural safety, Concept mapping, Commissioning, Health promotion
Evaluation	Strassheim, V., Deary, V., Webster, D. A., Douglas, J., Newton, J. L., & Hackett, K. L.	2019	Conceptualizing the benefits of a group exercise program developed for those with chronic fatigue: A mixed methods clinical evaluation.	Disability and Rehabilitation	https://doi.org/10.1080/09638288.2019.1636315		NHS Foundation Trust	Purpose: Fatigue is a disabling and prevalent feature of many long-term conditions. Orthostatic dizziness is a commonly experienced by those with fatigue. The purpose was; to evaluate factors contributing to successful delivery of a novel group exercise program designed for people with chronic fatigue and orthostatic symptoms and identify targets to improve future program content and delivery. Research methods: We used group concept mapping methodology. Participants of the exercise program with a long-term physical health condition and chronic fatigue- contributed ideas in response to a focus question. They sorted these ideas into themed piles and rated them for importance and success of the program delivery. Multidimensional scaling and cluster analysis were applied to the sort data to produce ideas clusters within a concept map. Value ratings were compared to evaluate the success of the program. Results: The resulting concept map depicted seven key themed clusters of ideas: Exercises, Group atmosphere, Physical benefits, Self-management of symptoms, Acceptance and Education. Value plots of the rating data identified important and successful conceptual ideas. Conclusions: The concept maps have depicted key concepts relating to the successful delivery of a novel exercise program for people with fatigue and identified specific targets for future program enhancements. Implications for rehabilitation Orthostatic symptoms are common in those with fatigue and might be a target for group-based exercise programs. People with fatigue value a group-based exercise program that targets orthostatic symptoms. The key concepts of a group-based exercise program valued by those with fatigue are the exercises, group atmosphere, physical benefits, self-management support, acceptance, education and support with looking forwards following the program.
Evaluation	Baker, C., Eigsti, M., Racine, K., & O’Connell	2023	Advancing Philanthropic Strategy Through Evaluative Thinking: One Foundation's Approach		https://doi.org/10.9707/1944-5660.1618	https://scholarworks.gvsu.edu/cgi/viewcontent.cgi?article=1618&context=tfr	Sisters of Charity Foundation of Cleveland	The Sisters of Charity Foundation of Cleveland supports Catholic sisters and their ministries in northeast Ohio through the grantmaking, partnership, capacitybuilding, and evaluation efforts of its Catholic Sisters Program Area. The decline of sisters actively engaged in ministry, due both to their rising median age and a decades-long decline in their overall numbers, called for a reconsideration and likely revision of the CSPA existing theory of change. Unlike other strategic approaches at the foundation, such as ending homelessness or improving health equity, transitioning from sister-led to lay-led leadership of ministries remained largely unexplored: Basic research was lacking, and model practices were simply not available. Therefore, CSPA staff engaged in a disciplined process to explore, measure, evaluate, and enhance its approach to supporting the legacy and current requirements of Catholic sisters within a rapidly changing environment. This article presents findings and lessons learned from a three-part evaluation process designed to offer an inclusive, systems-based approach to evaluation by identifying outcomes critical to CSPA success and salient areas of evaluative inquiry designed to strengthen the program area; develop a framework of key elements of gospel-inspired service as modeled by sisters, rooted in stakeholder and community input; and employ the conceptual framework to develop measurement tools for sisters and lay partners for ongoing data collection to strengthen existing efforts and plan for the future. Learnings from the systems-based evaluation process suggests and will inform a revision of CSPA’s theory of change, ensuring the foundation will continue to support and effectively promote the formation and activities of well-formed lay leaders and organizationally strong ministries to carry forward gospel-inspired service as modeled by sisters. This article concludes by discussing how this three-part evaluative approach contributes to an expanded understanding of how philanthropic strategic initiatives can be assessed and effectively adapted by foundations experiencing generational or leadership transition or other changing contexts. While the work developed from the specific context of a faith-based foundation, there are several tools and approaches that may be considered or adapted more broadly within philanthropy.
Foundational - Group Concept Mapping Applications	Trochim, W. & Kane, M.	2005	Concept mapping: An introduction to structured conceptualization in health care.	International Journal for Quality in Health Care	https://doi.org/10.1093/intqhc/mzi038	https://academic.oup.com/intqhc/article-pdf/17/3/187/5201811/mzi038.pdf	Cornell University	Structured conceptualization is a specific form of concept mapping that is a mixed methods participatory approach that combines group processes (brainstorming, sorting, group interpretation) with a sequence of multivariate statistical analyses (multidimensional scaling, hierarchical cluster analysis). Concept mapping's relevance to health care quality and services is described. The basic steps and analysis sequence in the concept mapping method are outlined and a brief example of the results for a health planning project are presented. Several examples of the use of concept mapping in health are provided.
Foundational - Group Concept Mapping Applications	Klenk, N. L. & Hickey, G. M.	2011	A virtual and anonymous, deliberative and analytic participation process for planning and evaluation: The concept mapping policy Delphi.	International Journal of Forecasting	https://doi.org/10.1016/j.ijforecast.2010.05.002		McGill University	Integrating knowledge and values across a range of stakeholders and experts is a common goal of, and challenge in, forecasting and planning processes across numerous decision-making domains. In this paper we present a virtual and anonymous, deliberative and analytical participatory group process which we applied in a planning study. The process was a combination of concept mapping and a policy Delphi. The Concept Mapping Policy Delphi offers an iterative process that is meant to foster critical, dissensus-based thinking by a group about an evaluation problem. In particular, it offers a platform on which to structure the group brainstorming of ideas, integrates knowledge and values, and creates a shared conceptual framework for addressing evaluation problems. We discuss the merits and limitations of this process and compare it with other public engagement mechanisms for decision-making. We argue that the use of a Concept Mapping Policy Delphi is relevant in forecasting and decision-making processes that aim to integrate information which is from various disparate points of view in order to clarify arguments and values, democratize and mediate public participation, and/or provide strategic advice about scenarios or planning options, while mitigating the problematic aspects of face-to-face group processes.
Foundational - Group Concept Mapping Applications	Schiller, C., Winters, M., Hanson, H. M., & Ashe, M. C.	2013	A framework for stakeholder identification in concept mapping and health research: A novel process and its application to older adult mobility and the built environment.	BMC public health	https://doi.org/10.1186/1471-2458-13-428	https://bmcpublichealth.biomedcentral.com/track/pdf/10.1186/1471-2458-13-428.pdf	University of British Columbia	Stakeholders, as originally defined in theory, are groups or individual who can affect or are affected by an issue. Stakeholders are an important source of information in health research, providing critical perspectives and new insights on the complex determinants of health. The intersection of built and social environments with older adult mobility is an area of research that is fundamentally interdisciplinary and would benefit from a better understanding of stakeholder perspectives. Although a rich body of literature surrounds stakeholder theory, a systematic process for identifying health stakeholders in practice does not exist. This paper presents a framework of stakeholders related to older adult mobility and the built environment, and further outlines a process for systematically identifying stakeholders that can be applied in other health contexts, with a particular emphasis on concept mapping research. Methods: Informed by gaps in the relevant literature we developed a framework for identifying and categorizing health stakeholders. The framework was created through a novel iterative process of stakeholder identification and categorization. The development entailed a literature search to identify stakeholder categories, representation of identified stakeholders in a visual chart, and correspondence with expert informants to obtain practice-based insight. Results: The three-step, iterative creation process progressed from identifying stakeholder categories, to identifying specific stakeholder groups and soliciting feedback from expert informants. The result was a stakeholder framework comprised of seven categories with detailed sub-groups. The main categories of stakeholders were, (1) the Public, (2) Policy makers and governments, (3) Research community, (4) Practitioners and professionals, (5) Health and social service providers, (6) Civil society organizations, and (7) Private business. Conclusions: Stakeholders related to older adult mobility and the built environment span many disciplines and realms of practice. Researchers studying this issue may use the detailed stakeholder framework process we present to identify participants for future projects. Health researchers pursuing stakeholder-based projects in other contexts are encouraged to incorporate this process of stakeholder identification and categorization to ensure systematic consideration of relevant perspectives in their work.
Foundational - Group Concept Mapping Applications	Goldman, A. W. & Kane, M.	2014	Concept mapping and network analysis: An analytic approach to measure ties among constructs.	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2014.06.005	https://isiarticles.com/bundles/Article/pre/pdf/44378.pdf	Concept Systems, Inc.	Group concept mapping is a mixed-methods approach that helps a group visually represent its ideas on a topic of interest through a series of related maps. The maps and additional graphics are useful for planning, evaluation and theory development. Group concept maps are typically described, interpreted and utilized through points, clusters and distances, and the implications of these features in understanding how constructs relate to one another. This paper focuses on the application of network analysis to group concept mapping to quantify the strength and directionality of relationships among clusters. The authors outline the steps of this analysis, and illustrate its practical use through an organizational strategic planning example. Additional benefits of this analysis to evaluation projects are also discussed, supporting the overall utility of this supplemental technique to the standard concept mapping methodology.
Foundational - Group Concept Mapping Applications	Rosas, S. R. & Ridings, J. W.	2017	The use of concept mapping in measurement development and evaluation: Application and future directions.	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2016.08.016		Concept Systems, Inc.	The past decade has seen an increase of measurement development research in social and health sciences that featured the use of concept mapping as a core technique. The purpose, application, and utility of concept mapping have varied across this emerging literature. Despite the variety of uses and range of outputs, little has been done to critically review how researchers have approached the application of concept mapping in the measurement development and evaluation process. This article focuses on a review of the current state of practice regarding the use of concept mapping as methodological tool in this process. We systematically reviewed 23 scale or measure development and evaluation studies, and detail the application of concept mapping in the context of traditional measurement development and psychometric testing processes. Although several limitations surfaced, we found several strengths in the contemporary application of the method. We determined concept mapping provides (a) a solid method for establishing content validity, (b) facilitates researcher decision-making, (c) insight into target population perspectives that are integrated a priori, and (d) a foundation for analytical and interpretative choices. Based on these results, we outline how concept mapping can be situated in the measurement development and evaluation processes for new instrumentation.
Foundational - Group Concept Mapping Applications	Vaughn, L. M., Jones, J. R., Booth, E., & Burke, J. G.	2017	Concept mapping methodology and community-engaged research: A perfect pairing.	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2016.08.013		Cincinnati Children’s Hospital Medical Center	Concept mapping methodology as refined by Trochim et al. is uniquely suited to engage communities in all aspects of research from project set-up to data collection to interpreting results to dissemination of results, and an increasing number of research studies have utilized the methodology for exploring complex health issues in communities. In the current manuscript, we present the results of a literature search of peer-reviewed articles in health-related research where concept mapping was used in collaboration with the community. A total of 103 articles met the inclusion criteria. We first address how community engagement was defined in the articles and then focus on the articles describing high community engagement and the associated community outcomes/benefits and methodological challenges. A majority (61%; n = 63) of the articles were classified as low to moderate community engagement and participation while 38% (n = 39) of the articles were classified as high community engagement and participation. The results of this literature review enhance our understanding of how concept mapping can be used in direct collaboration with communities and highlights the many potential benefits for both researchers and communities.
Foundational - Group Concept Mapping Applications	Anderson, L. A. & Slonim, A.	2017	Perspectives on the strategic uses of concept mapping to address public health challenges.	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2016.08.011		Centers for Disease Control and Prevention	We examine the adaptation of approaches used to plan and implement the steps of concept mapping to meet specialized needs and requirements in several public health projects. Seven published concept mapping projects are detailed to document how each of the phases were modified to meet the specific aims of each project. Concept mapping was found to be a useful tool to complement public health roles such as assessment, program development, and priority setting. The phases of concept mapping allow for a blending of diverse perspectives, which is critical to public health efforts. The adaptability of concept mapping permits the use of multiple modalities such as the addition of face-to-face brainstorming; use of qualitative methods, including structured interviews; and review and use of published literature and guidelines. Another positive aspect of concept mapping for public health practice is its ability to identify program elements, provide a visual map of generated ideas and their relationships to one another, and assist in identifying priorities. Our reflections on the adaptability should help inform another generation in designing concept mapping projects and related products that may benefit from unique adaptations and the rapidly expanding social media technology and platforms.
Foundational - Group Concept Mapping Applications	Mills, G. D., LaNoue, M., Gentsch, A. T., Doty, A. M. B., Cunningham, A., Nord, G., & Rising, K. L.	2019	Patient experience and challenges in group concept mapping for clinical research.	Journal of Patient-Reported Outcomes	https://doi.org/10.1186/s41687-019-0147-9	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6695458/pdf/41687_2019_Article_147.pdf	Thomas Jefferson University	Background and objective: Group concept mapping (GCM) is a research method that engages stakeholders in generating, structuring and representing ideas around a specific topic or question. GCM has been used with patients to answer questions related to health and disease but little is known about the patient experience as a participant in the process. This paper explores the patient experience participating in GCM as assessed with direct observation and surveys of participants. Methods: This is a secondary analysis performed within a larger study in which 3 GCM iterations were performed to engage patients in identifying patient-important outcomes for diabetes care. Researchers tracked the frequency and type of assistance required by each participant to complete the sorting and rating steps of GCM. In addition, a 17-question patient experience survey was administered over the telephone to the participants after they had completed the GCM process. Survey questions asked about the personal impact of participating in GCM and the ease of various steps of the GCM process. Results: Researchers helped patients 92 times during the 3 GCM iterations, most commonly to address software and computer literacy issues, but also with the sorting phase itself. Of the 52 GCM participants, 40 completed the post-GCM survey. Respondents averaged 56 years of age, were 50% female and had an average hemoglobin A1c of 9.1%. Ninety-two percent (n = 37) of respondents felt that they had contributed something important to this research project and 90% (n = 36) agreed or strongly agreed that their efforts would help others with diabetes. Respondents reported that the brainstorming session was less difficult when compared with sorting and rating of statements. Discussion: Our results suggest that patients find value in participating in GCM. Patients reported less comfort with the sorting step of GCM when compared with brainstorming, an observation that correlates with our observations from the GCM sessions. Researchers should consider using paper sorting methods and objective measures of sorting quality when using GCM in patient-engaged research to improve the patient experience and concept map quality. Keywords: Group concept mapping, Patient reported outcomes, Diabetes, Quality of life, Brainstorming
Foundational - Group Concept Mapping Methodology	Trochim, W. M. K.	1985	Pattern matching, validity and conceptualization in program evaluation.	Evaluation Review	https://doi.org/10.1177/0193841X8500900503		Cornell University	All social research is based on pattern matching ideas. A pattern match involves a correspondence between a theoretical or conceptual expectation pattern and an observed or measured pattern. Two quasi-experimental designs-the nonequivalent dependent variable design and the reversed treatment design—illustrate pattern matching logic well. In program evaluation three pattern matches are important: the program pattern match that assesses program implementation; the measurement pattern match that assesses the validity of the measures; and the effect pattern match that assesses the causal hypothesis Conceptualization methods are needed to facilitate the articulation of rich theoretical patterns. An example of a conceptualization study is presented and the utility of conceptualization methods for pattern-matching research is discussed.
Foundational - Group Concept Mapping Methodology	Trochim, W. M. K. & Linton, R.	1986	Conceptualization for planning and evaluation.	Evaluation and Program Planning	https://doi.org/10.1016/0149-7189(86)90044-3		Cornell University	Conceptualization is a central task in planning and evaluation. There is a need to develop conceptualization methods which can help multiple constituency groups collaborate on the development of conceptual frameworks which can guide the planning and evaluation effort. A general model for conceptualization methods is presented along with considerations for implementation. This model is illustrated in two planning and evaluation studies which involved a broad range of constituent groups within the organizations in the development of "concept maps" which could guide subsequent work. Some general implications of conceptualization methods for planning and evaluation are discussed.
Foundational - Group Concept Mapping Methodology	Trochim, W. (Ed.).	1989	Special issue: Concept mapping for evaluation and planning.	Evaluation and Program Planning	https://www.sciencedirect.com/science/article/abs/pii/S0149718916301471		Cornell University	Concept mapping was developed in the 1980s as a unique integration of qualitative (group process, brainstorming, unstructured sorting, interpretation) and quantitative (multidimensional scaling, hierarchical cluster analysis) methods designed to enable a group of people to articulate and depict graphically a coherent conceptual framework or model of any topic or issue of interest. This introduction provides the basic definition and description of the methodology for the newcomer and describes the steps typically followed in its most standard canonical form (preparation, generation, structuring, representation, interpretation and utilization). It also introduces this special issue which reviews the history of the methodology, describes its use in a variety of contexts, shows the latest ways it can be integrated with other methodologies, considers methodological advances and developments, and sketches a vision of the future of the method’s evolution.
Foundational - Group Concept Mapping Methodology	Kane, M. & Trochim, W.M.K.	2007	Concept mapping for planning and evaluation.	Thousand Oaks: Sage Publications.	https://us.sagepub.com/en-us/nam/concept-mapping-for-planning-and-evaluation/book229728		Concept Systems, Inc.	Concept mapping is a methodology for mapping ideas that integrates input from multiple sources with differing expertise or interest, creates maps with multivariate data analyses that depict the composite thinking of the group, and yields data that allows for comparisons across rating criteria, stakeholder groups, different points in time, etc. to aid in targeted planning, implementation strategies, and evaluation. Group concept mapping is related to the growing interest in the role that theory plays in planning and evaluation. Concept Mapping for Planning and Evaluation is a thorough, accessible guide to concept mapping for social or organizational researchers in any context. The volume describes the history of structured conceptualization--a most useful form of concept mapping. It also highlights the advantages that group or community concept mapping has over other kinds of group decision processes. With straightforward language and useful examples from the authors' 40 combined years of creating and working with this process, the book describes in detail the six major steps in the conduct of group concept mapping, and shares both the process of concept mapping and the equally important facilitation and guidance techniques that the authors have developed. Examples from work with clients like the Centers for Disease Control, the National Institutes of Health, and state government, as well as interesting examples from concept mapping in social research contexts, illustrate each step in the process. Each chapter provides work sheets for readers to create their own concept mapping plans. References that provide recommendations for further reading are included, as well as contact information for research guidance.
Foundational - Group Concept Mapping Methodology	Kane, M. & Trochim, W. M.	2009	Concept mapping for applied social research.	The Sage Handbook of Applied Social Research	ThousandOaks:SagePublications		Concept Systems, Inc.	brainstorming; cluster analysis; clusters; Delaware; Department of Health and Social Services; maps; matrices
Foundational - Group Concept Mapping Methodology	Rosas, S. R. & Kane, M.	2012	Quality and rigor of the concept mapping methodology: A pooled study analysis.	Evaluation Program Planning	https://doi.org/10.1016/j.evalprogplan.2011.10.003		Concept Systems, Inc.	The use of concept mapping in research and evaluation has expanded dramatically over the past 20 years. Researchers in academic, organizational, and community-based settings have applied concept mapping successfully without the benefit of systematic analyses across studies to identify the features of a methodologically sound study. Quantitative characteristics and estimates of quality and rigor that may guide for future studies are lacking. To address this gap, we conducted a pooled analysis of 69 concept mapping studies to describe characteristics across study phases, generate specific indicators of validity and reliability, and examine the relationship between select study characteristics and quality indicators. Individual study characteristics and estimates were pooled and quantitatively summarized, describing the distribution, variation and parameters for each. In addition, variation in the concept mapping data collection in relation to characteristics and estimates was examined. Overall, results suggest concept mapping yields strong internal representational validity and very strong sorting and rating reliability estimates. Validity and reliability were consistently high despite variation in participation and task completion percentages across data collection modes. The implications of these findings as a practical reference to assess the quality and rigor for future concept mapping studies are discussed.
Foundational - Group Concept Mapping Methodology	Rosas, S. R.	2013	The utility of concept mapping for actualizing participatory research.	Cuadernos Hispanoamericanos de Psicologia	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4638322/	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4638322/pdf/nihms714797.pdf	Rutgers University	Community-based participatory research (CBPR) has been identified as a useful approach to increasing community involvement in research. Developing rigorous methods in conducting CBPR is an important step in gaining more support for this approach. The current article argues that concept mapping, a structured mixed methods approach, is useful in the initial development of a rigorous CBPR program of research aiming to develop culturally tailored and community-based health interventions for vulnerable populations. A research project examining social dynamics and consequences of alcohol and substance use in Newark, New Jersey, is described to illustrate the use of concept mapping methodology in CBPR. A total of 75 individuals participated in the study.
Foundational - Group Concept Mapping Methodology	Kane, M. & Rosas, S.	2017	Conversations about group concept mapping: Applications, examples, and enhancements.	Thousand Oaks: Sage Publications.	https://us.sagepub.com/en-us/nam/conversations-about-group-concept-mapping/book248804		Concept Systems, Inc.	Conversations About Group Concept Mapping: Applications, Examples, and Enhancements takes a concise, practice-based approach to group concept mapping. After defining the method, demonstrating how to design a project, and providing guidelines to analyze the results, this book then dives into real research exemplars. Conversations with the researchers are based on in depth interviews that connected method, practice and results. The conversations are from a wide variety of research settings, that include mapping the needs of at-risk African American youth, creating dialogue within a local business community, considering learning needs in the 21st century, and identifying the best ways to support teens receiving Supplemental Social Security Income. The authors reflect on the commonalities between the cases and draw out insights into the overall group concept mapping method from each case.
Foundational - Group Concept Mapping Methodology	Rosas, S. R.	2017	Group concept mapping methodology: Toward an epistemology of group conceptualization, complexity, and emergence.	Quality & Quantity	https://doi.org/10.1007/s11135-016-0340-3		Concept Systems, Inc.	Group concept mapping is a participatory mixed-methods approach to social and behavioral research that integrates qualitative group processes with multivariate statistical analyses to generate, structure and represent the content of a specific topic. Group concept mapping is widely recognized as a means for capturing the complexity found in social phenomena and many claim the process and results of the method are emergent. Despite these claims however, the ontological, epistemological, and methodological foundations of group concept mapping, viewed through the phenomenological lenses of complexity and emergence, have not been fully explored. Moreover, the characteristics of group concept mapping as a shared mental model lacks a clear description. This paper argues for a more precise description of collective group mental model construction and examines emergence as a critical multi-level process for found in group concept mapping. Based on this appraisal, group concept mapping can be characterized as a discontinuous compilation model that displays configural properties congruent with this typology. The phenomenon exhibited in this type of model are the result of patterned emergence processes, and concept mapping appears to exemplify several principles associated with the conceptualization of emergence. The implications for two research activities where group concept mapping is often used, theory and measure development, are discussed.
Foundational - Group Concept Mapping Methodology	Rosas, S. R.	2017	Multi-map comparison for group concept mapping: An approach for examining conceptual congruence through spatial correspondence.	Quality & Quantity	https://doi.org/10.1007/s11135-016-0399-x		Concept Systems, Inc.	Abstract: Group concept mapping, a participatory mixed-methods approach used extensively in behavioral and social research, is used to specify and generate a two-dimensional conceptual model based on input solicited from an identified group. In situations where the systematic evaluation of the multidimensional conceptualized patterns generated by different subgroups is meaningful, little guidance exists. This paper contrasts two analytical approaches, configural similarity comparison and Procrustes comparison, emphasizing the latter as a more rigorous and appropriate technique for facilitating such comparisons. As demonstrated in this study, Procrustes analysis provides a solid statistical and interpretative foundation to measuring the similarity of MDS configurations found in concept mapping output. Paired with a permutation strategy for assessing significance and examination of residual values, Procrustes analysis offers an objective means to evaluate the general concordance of multivariate patterns generated through group concept mapping. Statistical and visual techniques are also used to further explore the specific patterns of residual values generated in the Procrustes comparison. From this demonstration, a procedure for testing the correspondence between multiple two-dimensional concept maps where the same content is considered by independent groups is suggested.
Foundational - Group Concept Mapping Methodology	Trochim, W. & McLinden (Ed.)	2017	Special issue: Concept Mapping: Development, Applications, and Future Directions.	Evaluation and Program Planning	https://pubmed.ncbi.nlm.nih.gov/27601290/		Concept Systems, Inc.	The past decade has seen an increase of measurement development research in social and health sciences that featured the use of concept mapping as a core technique. The purpose, application, and utility of concept mapping have varied across this emerging literature. Despite the variety of uses and range of outputs, little has been done to critically review how researchers have approached the application of concept mapping in the measurement development and evaluation process. This article focuses on a review of the current state of practice regarding the use of concept mapping as methodological tool in this process. We systematically reviewed 23 scale or measure development and evaluation studies, and detail the application of concept mapping in the context of traditional measurement development and psychometric testing processes. Although several limitations surfaced, we found several strengths in the contemporary application of the method. We determined concept mapping provides (a) a solid method for establishing content validity, (b) facilitates researcher decision-making, (c) insight into target population perspectives that are integrated a priori, and (d) a foundation for analytical and interpretative choices. Based on these results, we outline how concept mapping can be situated in the measurement development and evaluation processes for new instrumentation.
Foundational - Group Concept Mapping Statistical Analysis	Ward, J. H., Jr.	1963	Hierarchical grouping to optimize an objective function.	Journal of the American Statistical Association	https://www.tandfonline.com/doi/abs/10.1080/01621459.1963.10500845		Lackland Air Force Base	A procedure for forming hierarchical groups of mutually exclusive subsets, each of which has members that are maximally similar with respect to specified characteristics, is suggested for use in large-scale (n > 100) studies when a precise optimal solution for a specified number of groups is not practical. Given n sets, this procedure permits their reduction to n − 1 mutually exclusive sets by considering the union of all possible n(n − 1)/2 pairs and selecting a union having a maximal value for the functional relation, or objective function, that reflects the criterion chosen by the investigator. By repeating this process until only one group remains, the complete hierarchical structure and a quantitative estimate of the loss associated with each stage in the grouping can be obtained. A general flowchart helpful in computer programming and a numerical example are included.
Foundational - Group Concept Mapping Statistical Analysis	Rosenberg, S. & Kim, M. P.	1975	The method of sorting as a data gathering procedure in multivariate research.	Multivariate Behavioral Research	https://doi.org/10.1207/s15327906mbr1004_7			This study compares two basic variants of the sorting method: single-sort in which each respondent is given only one opportunity to sort the items; and multiple-sort in which the respondent is given several opportunities to sort, each time on a different basis. Kinship terms serve as stimulus materials. Multidimensional scaling solutions show large differences between the two methods with respect to the degree to which the kinship dimensions are used as a basis for sorting. In particular, most respondents ignore the most obvious dimension (sex of the terms) when they believe they have only one opportunity to indicate the dimensions in the set. Similar observations of pairwise judgments in another stimulus domain (consonant phonemes) suggest the same bias may be present in such judgments. Moreover, in both instances hierarchical clustering completely fails to represent the minority of judges who do not ignore the given dimension. These results indicate that a multiple set of judgments from each set of respondents may be superior to a single set of judgments for certain stimulus domains. Finally, the kinship data also indicate that male and female respondents emphasize different kinship dimensions but that aggregated multiple-sort data do appear to reflect the cognitive dimensions present in any given individual.
Foundational - Group Concept Mapping Statistical Analysis	Kruskal, J. B. & Wish, M.	1978	Multidimensional scaling.	Beverly Hills, CA: Sage Publications.	https://dx.doi.org/10.4135/9781412985130			1. Some readers may wonder what happens to this definition if more than one configuration has the same smallest value of stress. In fact, this always occurs. However, these configurations are almost always effectively the same as one another, namely, they differ from each other by rigid motions such as rotation. In certain unusual situations there may be nonequivalent configurations with minimum stress, but even then they usually differ by so little that the uncertainty has no practical importance. 2. This is actually the principal axes orientation as provided directly by KYST. One can choose not to rotate to principal axes orientation if desired; normally, not rotating is useful only when a starting configuration obtained from some other analysis is used. 3. A four-dimensional analysis of data from a larger study replicated these results (Wish, Deutsch, and Biener, 1970, 1972). In addition to the dimensions of Figure 8, however, there were two others that reflected geographic and cultural proximities among nations. 4. The subjects were associates and friends of Kluver's organization, and do not in any sense comprise a random sample of the U.S. population. 5. Significance was determined by F-tests included in the computer output from the PROFIT program. There are R degrees of freedom for the numerator, corresponding to the number of dimensions. The degrees of freedom for the denominator of the F-ratio are I-R-1 (number of stimuli-number of dimensions-1). 6. When profile distances matrices are used, it is preferable to select the option of the INDSCAL program that reads the data values in as Euclidean distances rather than as dissimilarities. When the dissimilarities option is chosen, there are sometimes negative weights resulting from fitting of “noise” when additive constants are estimated. Options are also available in this program for reading in data as correlations or scalar products when appropriate. 7. Many other ways of splitting up the proximities are appropriate for different sorts of data, for example, by blocks or by replications. When data are collected by the method of triads, one sensible way of analyzing them involves splitting the proximities into a separate list for each triad, so that each list contains only three proximities (see Roskam, 1970). Even more extensive splitting, so that each list contains only two proximities, is also possible (Johnson, 1973, and the “absolute value principle” of Guttman)
Foundational - Group Concept Mapping Statistical Analysis	Davison, M. L.	1983	Multidimensional scaling.	New York, John Wiley and Sons.	https://pubmed.ncbi.nlm.nih.gov/23359318/	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3555222/pdf/nihms407684.pdf	Arizona State University	The concept of similarity, or a sense of "sameness" among things, is pivotal to theories in the cognitive sciences and beyond. Similarity, however, is a difficult thing to measure. Multidimensional scaling (MDS) is a tool by which researchers can obtain quantitative estimates of similarity among groups of items. More formally, MDS refers to a set of statistical techniques that are used to reduce the complexity of a data set, permitting visual appreciation of the underlying relational structures contained therein. The current paper provides an overview of MDS. We discuss key aspects of performing this technique, such as methods that can be used to collect similarity estimates, analytic techniques for treating proximity data, and various concerns regarding interpretation of the MDS output. MDS analyses of two novel data sets are also included, highlighting in step-by-step fashion how MDS is performed, and key issues that may arise during analysis.
Foundational - Group Concept Mapping Statistical Analysis	Weller, S. C. & Romney, A. K.	1988	Systematic Data Collection.	Newbury Park, CA: Sage Publications.	https://methods.sagepub.com/book/systematic-data-collection		University of Texas Medical Branch	To many, ethnography conjures stereotypes of field researchers dutifully laboring to make holistic sense of a complex world, attempting to notice and record all things important in culture. Because the mission is impossible, ethnographic compromises take the form of copious field observations, verbatim accounts, and general impressions. The good news of working in this time-honored, if unstructured, way has received regular treatment in the Qualitative Research Methods Series. The bad news, of course, is that ethnographers have too often discovered too late that the value of their interview information is discounted as a consequence of poor sampling (of questions, of informants) and poor elicitation techniques. In this tenth monograph of the Series, Susan C. Weller and A. Kimball Romney show how systematic interviewing complements traditional ethnographic practices. The authors describe in detail how to settle on a research domain of interest, how to form culturally meaningful questions, how to choose a data collection method from an impressive array of alternatives, and how to tally responses to generate desirable (e.g., ordered, similarity, test performance) data types. Weller and Romney justify these strategies with an especially useful discussion of reliability and validity. The structure that Weller and Romney bring to interviewing is of the right kind. The volume compels field researchers to take very seriously not only what they hear, but what they ask. The ethnographic result is bound to be better science.
Foundational - Group Concept Mapping Statistical Analysis	Coxon, A. P. M.	1999	Sorting data: Collection and analysis.	Thousand Oaks, CA: Sage Publications.	https://us.sagepub.com/en-us/nam/sorting-data/book9527		University of Edinburgh	The method of sorting is a flexible, easily-used (and enjoyable) technique well suited to exploring and mapping conceptual domains, to the study of subjective or folk-classifications, and to comparing existing classifications one with another. Originating in linguistics and psychology, sorting methods (also known as "own categories", and "pile-sorting") have diffused to a wide range of other social sciences. This book provides the first systematic introduction to the method of sorting and draws material from new and widely-scattered sources. It covers the collection and analysis of data, using free-sorting as the main focus, but includes other variants. Methods are provided for describing and comparing sortings, drawing on recent developments in partition theory and combinational analysis and for measuring their similarity. Appropriate methods are presented for the representation of both individual sortings and of the objects themselves: multidimensional scaling, correspondence analysis, and clustering techniques. Applications and available software are covered.
Foundational - Group Concept Mapping Statistical Analysis	Krippendorf, K.	2004	Content analysis: An introduction to its methodology.	Thousand Oaks: Sage Publications.	https://us.sagepub.com/en-us/nam/content-analysis/book258450		University of Pennsylvania	What matters in people’s social lives? What motivates and inspires our society? How do we enact what we know? Since the first edition published in 1980, Content Analysis has helped shape and define the field. In the highly anticipated Fourth Edition, award-winning scholar and author Klaus Krippendorff introduces readers to the most current method of analyzing the textual fabric of contemporary society. Students and scholars will learn to treat data not as physical events but as communications that are created and disseminated to be seen, read, interpreted, enacted, and reflected upon according to the meanings they have for their recipients. Interpreting communications as texts in the contexts of their social uses distinguishes content analysis from other empirical methods of inquiry. Organized into three parts, Content Analysis first examines the conceptual aspects of content analysis, then discusses components such as unitizing and sampling, and concludes by showing readers how to trace the analytical paths and apply evaluative techniques. The Fourth Edition has been completely revised to offer readers the most current techniques and research on content analysis, including new information on reliability and social media. Readers will also gain practical advice and experience for teaching academic and commercial researchers how to conduct content analysis.
Foundational - Group Concept Mapping Statistical Analysis	Everitt, B.		Cluster analysis (2nd ed.)	New York, NY: Halsted Press.	https://link.springer.com/referenceworkentry/10.1007/978-1-4419-1153-7_119		University of Georgia	Cluster analysis is a generic term for various procedures that are used objectively to group entities based on their similarities and differences. In applying these procedures, the objective is to group the entities (elements, items, objects, etc.) into mutually exclusive clusters so that elements within each cluster are relatively homogeneous in nature while the clusters themselves are distinct. The key purposes of cluster analysis are reduction of data, data exploration, determination of natural groups, prediction based on groups, classification, model fitting, generation and testing of hypotheses (Everitt 1993; Aldenderfer and Blashfield 1984; Lorr 1983). Due to the importance of clustering in different disciplines such as psychology, zoology, botany, sociology, artificial intelligence and information retrieval, a variety of other names have been used to refer to such techniques: Q-analysis, typology, grouping, clumping, classification, numerical taxonomy, and...
Higher Education	Hynes, D., Stoyanov, S., Drachsler, H., Maher, B. Orrego, C., Stieger, L., Druener, S., Sopka, S., Schroder, H., & Henn, P.	2015	Designing learning outcomes for handoff teaching of medical students using group concept mapping: Findings from a multicountry European study.	Academic Medicine	https://doi.org/10.1097/ACM.0000000000000642		University College Cork	Purpose: To develop, by consultation with an expert group, agreed learning outcomes for the teaching of handoff to medical students using group concept mapping. Method: In 2013, the authors used group concept mapping, a structured mixed-methods approach, applying both quantitative and qualitative measures to identify an expert group's common understanding about the learning outcomes for training medical students in handoff. Participants from four European countries generated and sorted ideas, then rated generated themes by importance and difficulty to achieve. The research team applied multidimensional scaling and hierarchical cluster analysis to analyze the themes. Results: Of 127 experts invited, 45 contributed to the brainstorming session. Twenty-two of the 45 (48%) completed pruning, sorting, and rating phases. They identified 10 themes with which to select learning outcomes and operationally define them to form a basis for a curriculum on handoff training. The themes "Being able to perform handoff accurately" and "Demonstrate proficiency in handoff in workplace" were rated as most important. "Demonstrate proficiency in handoff in simulation" and "Engage with colleagues, patients, and carers" were rated most difficult to achieve. Conclusions: The study identified expert consensus for designing learning outcomes for handoff training for medical students. Those outcomes considered most important were among those considered most difficult to achieve. There is an urgent need to address the preparation of newly qualified doctors to be proficient in handoff at the point of graduation; otherwise, this is a latent error within health care systems. This is a first step in this process.
Higher Education	Winseman, J. S., Higgins, E. A., Balkoski, V. I., & Rosas, S. R.	2015	What affects well-being during medical education? A student and faculty concept map.	Annals of Behavioral Science and Medical Education	https://doi.org/10.1007/BF03355305	https://www.researchgate.net/profile/Elizabeth-Higgins-7/publication/283246483_What_Affects_Well-being_during_Medical_Education_A_Student_and_Faculty_Concept_Map/links/5e9efe9d92851c2f52b6d673/What-Affects-Well-being-during-Medical-Education-A-Student-and-Faculty-Concept-Map.pdf?origin=publication_detail	Albany Medical Center	Student and faculty opinions about factors affecting student well-being have not been systematically explored, yet these viewpoints may provide crucial information for improving well-being during medical education. Methods: The mixed methods approach known as “concept mapping” was utilized to construct a visual depiction of factors thought to be affecting medical student well-being. Results:Nine clusters of factors emerged. Students rated “maintaining wellness” and “relationships” as the most important clusters (p<.01 for both clusters). Personal health was viewed as the single most important factor. Students at all stages of education tended to exhibit similar rating profiles and students rated “courses/grades” higher in importance than did faculty (p<.001). Conclusions: According to students, personal wellness and supportive relationships are the most significant contributors to well-being during medical school. Level of education does not significantly affect students’ views. Differences in the opinions of students and faculty demonstrate the need for comprehensive stakeholder involvement in education governance.
Higher Education	Butterfield, A. K., Tafesse, M., & Moxley, D. P.	2016	International higher education partnerships: Concept mapping of the processes and outcomes of USAID-funded projects in Ethiopia.	Social Development Issues		https://www.researchgate.net/profile/Alice-Butterfield/publication/305775754_International_Higher_Education_Partnerships_Concept_mapping_of_the_processes_and_outcomes_of_USAID_funded_projects_in_Ethiopia/links/57a7a34208ae455e8546cdef/International-Higher-Education-Partnerships-Concept-mapping-of-the-processes-and-outcomes-of-USAID-funded-projects-in-Ethiopia.pdf?origin=publication_detail	University of Illinois at Chicago	There is little systematic research on the processes and outcomes of international higher education partnerships (IHEPs) the focus of which is institutional capacity building. The authors employ concept mapping methodology to examine eight international higher education partnerships between Ethiopian universities and ones in the United States, which were funded by USAID through Higher Education for Development between 1998 and 2005. The concept mapping process reveals institutional capacity development and sustainability as important qualities of successful IHEPs. Eight clusters were statistically transformed into three broad categories: Reform and Staff Development, Research and Fundraising, and Mutual Benefits.
Higher Education	Hagell, P., Edfors, E., Hedin, G., Westergren, A., & Hammarlund, C. S.	2016	Group concept mapping for evaluation and development in nursing education.	Nurse Education in Practice	https://doi.org/10.1016/j.nepr.2016.08.006		Kristianstad University	The value of course evaluations has been debated since they frequently fail to capture the complexity of education and learning. Group Concept Mapping (GCM), a participant-centred mixed-method was explored as a tool for evaluation and development in nursing education and to better understand students' learning experiences, using data from a GCM-based evaluation of a research training assignment integrating clinical practice and research data collection within a Swedish university nursing program. Student nurses (n = 47) participated in a one-day GCM exercise. Focus group brainstorming regarding experiences from the assignment that the students considered important and instructive yielded 98 statements that were individually sorted based on their student-perceived relationships, and rated regarding their importance/instructiveness and need for development. Quantitative analysis of sort data produced a 2-dimensional map representing their conceptual relationships, and eight conceptual areas. Average cluster ratings were plotted relative to each other and provided a decision aid for development and planning by identifying areas (i.e., "Research methodology", "Patients' perspectives", and "Interviewer role") considered highly important/instructive and in high need for development. These experiences illustrate the use and potential of GCM as an interactive participant-centred approach to evaluation, planning and development in nursing and other higher health science educations.
Higher Education	Morley, C. P., Rosas, S. R., Mishori, R., Jordan, W., Jarris, Y. S., Family Medicine/Public Health Competencies Work Group, & Prunuske, J.	2017	Essential public health competencies for medical students: Establishing a consensus in family medicine.	Teaching and Learning in Medicine	https://doi.org/10.1080/10401334.2016.1268964	https://www.tandfonline.com/doi/pdf/10.1080/10401334.2016.1268964?needAccess=true	SUNY Upstate University	Phenomenon: The integration of public health (PH) competency training into medical education, and further integration of PH and primary care, has been urged by the U.S. Institute of Medicine. However, PH competencies are numerous, and no consensus exists over which competencies are most important for adoption by current trainees. Our objective was to conduct a group concept mapping exercise with stakeholders identifying the most important and feasible PH skills to incorporate in medical and residency curricula. Approach: We utilized a group concept mapping technique via The Concept System® Global MAX™ ( http://www.conceptsystems.com ), where family medicine educators and PH professionals completed the phrase, "A key Public Health competency for physicians-in-training to learn is …" with 1-10 statements. The statement list was edited for duplication and other issues; stakeholders then sorted the statements and rated them for importance and feasibility of integration. Multidimensional scaling and cluster analysis were used to create a two-dimensional point map of domains of PH training, allowing visual comparison of groupings of related ideas and relative importance of these ideas. Findings: There were 116 nonduplicative statements (225 total) suggested by 120 participants. Three metacategories of competencies emerged: Clinic, Community & Culture, Health System Understanding, and Population Health Science & Data. Insights: We identified and organized a set of topics that serve as a foundation for the integration of family medicine and PH education. Incorporating these topics into medical education is viewed as important and feasible by family medicine educators and PH professions. Keywords: Schools; education; medical; primary care; public health.
Higher Education	Reppond, H. A., Thomas-Brown, K., Sampson, N. R., & Price, C. E.	2018	Addressing food insecurity in college: Mapping a shared conceptual framework for campus pantries in Michigan.	Analyses of Social Issues and Public Policy	https://doi.org/10.1111/asap.12161	https://spssi.onlinelibrary.wiley.com/doi/epdf/10.1111/asap.12161	University of Michigan, Dearborn	The first known university food pantry started at Michigan State University in 1993. Since then, campus food pantries are more widespread, although little is known about them. The current study examined how college pantries best serve students and foster their success. Twenty-eight food pantry directors and staff from across sixteen Michigan college campuses engaged in concept mapping, a technique used to examine the interrelationships among concepts understood by stakeholders. Analyses identified six concepts, examined importance of each concept as assigned by participants, and evaluated variation among institutions. Implications for findings and future research directions are discussed.
Higher Education	Ziring, D., Frankel, R. M., Danoff, D., Isaacson, J. H., Lochnan, H.	2018	Silent witnesses: Faculty reluctance to report medical students' professionalism lapses.	Academic Medicine	https://doi.org/10.1097/ACM.0000000000002188		Thomas Jefferson University	Purpose: Assessing students' professionalism is a critical component of medical education. Nonetheless, faculty reluctance to report professionalism lapses remains a significant barrier to the effective identification, management, and remediation of such lapses. The authors gathered information from faculty who supervise medical students to better understand their perceived barriers to reporting. Method: In 2015-2016, data were collected using a group concept mapping methodology, which is an innovative, asynchronous, structured mixed-methods approach using qualitative and quantitative measures to identify themes characterizing faculty reluctance to report professionalism lapses. Participants from four U.S. and Canadian medical schools brainstormed, sorted, and rated statements about perceived barriers to reporting. Multidimensional scaling and hierarchical cluster analyses were used to analyze these data. Results: Of 431 physicians invited, 184 con-tributed to the brainstorming task (42.7%), 48 completed the sorting task (11.1%), and 83 completed the rating task (19.3%). Participants identified six barriers or themes to reporting lapses. The themes "uncertainty about the process," "ambiguity about the 'facts,'" "effects on the learner," and "time constraints" were rated highest as perceived barriers. Demographic subgroup analysis by gender, years of experience supervising medical students, years since graduation, and practice discipline revealed no significant differences (P > .05). Conclusions: The decision to report medical students' professionalism lapses is more complex and nuanced than a binary choice to report or not. Faculty face challenges at the systems level and individual level. The themes identified in this study can be used for faculty development and to improve processes for reporting students' professionalism lapses.
Higher Education	Streiner, S. C. & Besterfield-Sacre, M. E.	2018	Development of the global engineering programming model: A participatory, mixed-methods approach.	Journal of International Engineering Education	https://doi.org/10.23860/jiee.2018.01.01.03	https://digitalcommons.uri.edu/cgi/viewcontent.cgi?article=1002&context=jiee	Rowan University	Over the past few decades, higher education institutions have emphasized global education as a core aspect of their strategic goals, yet a gap exists in implementation at the school level, particularly in engineering. As engineering schools invest in internationalizing their programs, research is needed regarding key strategic areas and their relationship to sustained programming efforts. This study uses a participatory, integrative mixed-methods approach to develop an operational framework for global strategies, policies, and programs. A thematic, qualitative analysis of semi-structured interviews followed by a group concept mapping activity was conducted with directors of study abroad and vice provosts of global education from nine universities regarding their global programming strategies, intended outcomes, and organizational resources. The results of this research provide both implicit and explicit engineering school-wide global programming strategies, their sustainable development, and future program evaluation plans.
Higher Education	Kirschner, P. A. & Stoyanov, S.	2018	Educating youth for nonexistent/not yet existing professions.	Educational Policy	https://doi.org/10.1177/0895904818802086	https://journals.sagepub.com/doi/pdf/10.1177/0895904818802086	Open University of the Netherlands	In today’s and tomorrow’s world, people will be required to work longer. At the same time, their employment future will become increasingly insecure due to technological advances and obsolescence of acquired knowledge and skills. This means that something needs to happen in the education and training of our youth. Using a group concept mapping (GCM) procedure, experts in different fields (educators, educational researchers, human resource professionals, etc.) from primarily Europe and North America generated 239 ideas with regard to the trigger statement: “One specific way to prepare youth to make effective and efficient use of information skills to optimally function in tomorrow’s labour market is . . . .” The generated ideas were sorted into 15 thematic clusters (i.e., Critical Thinking, Skills Transfer, High-Level Thinking, Competences, Metacognition and Reflection, Efficacy [Self-Image] Building, Learn in Authentic Situations, Integrate School and Profession, Collaboration, Teacher Professionalization, Information Literacy, Redesign the School, Literacy, and Numeracy, Information Skills, and Learn for the Future) and then rated with respect to their importance and ease/difficulty of implementation. The results showed a disconnect between what was important and ease of implementation with highly important clusters judged to be difficult to implement and vice versa. This led to the definition of a 3-stage approach to adapting education to prepare youth for shortly nonexistent/not yet existing professions.
Higher Education	Schophuizen, M. J. F., Kreijns, K., Stoyanov, S., & Kalz, M.	2018	Eliciting the challenges and opportunities organizations face when delivering open online education: A group-concept mapping study.	The Internet and Higher Education	https://doi.org/10.1016/j.iheduc.2017.08.002		Open University of The Netherlands	The global attention for open online education (OOE) caused a situation in which higher education institutions (HEIs) reconsider the way they deliver education to the population. With a funding policy, the Dutch Government aims to stimulate OOE in HEIs. The goal is to create more expedient, accessible and personalized learning experiences, that contribute to an improvement of quality of education and study success. However, many projects are failing to embed OOE within the institution. In this study, we elicited the challenges and opportunities of OOE projects within an organizational context of Dutch HEIs by using group concept mapping. Multidimensional scaling and hierarchical clustering resulted in a cluster map and a pattern match graph for interpreting the experts' ideas and opinions, clarifying and structuring the collective understanding. Core themes that represent the challenges and opportunities with regard to OOE identified in this study were: 1. Online teaching, 2. Supporting mechanisms, 3. Assessment, 4. External target groups, 5. Educational flexibility, 6. Quality of education, 7. Institutional reputation, and 8. Educational efficiency. The results indicated a skills gap among educators and a lack of central support for the development of OOE. Organizational efforts to implement OOE should take educational flexibility and online teaching into account and support mechanisms for OOE should be provided.
Higher Education	Buchem, I., Konert, J., Carlino, C., Casanova, G., Rajagopal, K., Firssova, O., & Andone, D.	2018	Designing a collaborative learning hub for virtual mobility skills - Insights from the European project Open Virtual Mobility.	In: Zaphiris P., Ioannou A. (eds) Learning and Collaboration Technologies. Design, Development and Technological Innovation.	https://doi.org/10.1007/978-3-319-91743-6_27		Beuth University	Higher education faces high requirements and challenges in today's global world, including internationalisation as a response to globalisation. Virtual Mobility (VM) has a great potential to contribute to the internationalisation, innovation and inclusion in higher education. While it is feasible to encourage outward and inward student and faculty mobility, the main limitations include high costs of travelling and living in a foreign country, diverse socio-economic, health-related and even political issues. These barriers can be reduced by adding virtual components to mobility programs and actions (e. g. virtual seminars, virtual labs, virtual internships). This paper presents an approach for designing a collaborative learning hub for promoting VM Skills of educators and students in the European Higher Education Area. The VM Learning Hub assists to enhance the Virtual Mobility readiness of higher education institutions, educators and students through achievement, assessment and recognition of VM skills. This paper introduces the concept and the architecture of VM Learning Hub – aCollaborative and Personal Learning Environment with embedded technologies for innovative forms of skill attainment (open education, gamification), skill assessment (test-based and evidence-based e-assessment), skill recognition (open credentials, linked data) and collaboration (based on algorithm-based matching of learning groups).
Higher Education	Sampson, N. R., Price, C. E., Reppond, H. A., DeRoche, M., & Thomas-Brown, K.	2019	Feminist action research in response to food insecurity among college students.	Action Research	https://doi.org/10.1177/1476750320905893		University of Michigan-Dearborn	Feminist action research can instigate community, organizational, and policy changes to address social issues. We describe how we considered inclusion, participation, action, social change, and researcher reflexivity, as well as researcher positionality, in design and implementation of the 2016 Michigan College Campuses Food Pantry Summit. Specifically, in this case study, we describe ways we used these principles to plan this event around concept mapping, an interactive, collaborative research approach. Our event led to the formation of a regional community of practitioners, enabled an exchange of institutional best practices among campus pantries, and informed federal policy on food access for college students.
Higher Education	Scheffel, M., Tsai, Y. S., Gašević, D., & Drachsler, H.	2019	Policy matters: Expert recommendations for learning analytics policy.	Lecture Notes in Computer Science	https://doi.org/10.1007/978-3-030-29736-7_38	https://researchmgt.monash.edu/ws/portalfiles/portal/289607927/289606638_oa.pdf	Open University of the Netherlands	Interest in learning analytics (LA) has grown rapidly among higher education institutions (HEIs). However, the maturity levels of HEIs in terms of being ‘student data-informed’ are only at early stages. There often are barriers that prevent data from being used systematically and effectively. To assist higher education institutions to become more mature users and custodians of digital data collected from students during their online learning activities, the SHEILA framework, a policy development framework that supports systematic, sustainable and responsible adoption of LA at an institutional level, was recently built. This paper presents a mix-method study using a group concept mapping (GCM) approach that was conducted with LA experts to explore essential features of LA policy in HEI in contribution the development of the framework. The study identified six clusters of features that an LA policy should include, provided ratings based on ease of implementation and importance for each of the six themes, and offered suggestions to HEIs how they can proceed with the development of LA policies.
Higher Education	Donohoe, J., O'Rourke, M., Hammond, S., Stoyanov, S., & O'Tuathaigh, C.	2020	Strategies for enhancing resilience in medical students: A group concept mapping analysis.	Academic Psychiatry volume	https://doi.org/10.1007/s40596-020-01208-x		University College Cork	Research has consistently shown that medical students have greater rates of stress and mental-ill health in comparison with non-medical students. The objective of this study was to investigate the resilience strategies employed by medical students in an Irish medical school to inoculate themselves against the deleterious effects of stress on health and wellbeing. Methods: Group concept mapping was utilized incorporating qualitative and quantitative methodologies. The stages undertaken by year 3 students at an Irish medical school involved brainstorming/idea generation, categorization, and rating of resilience strategies students employed to manage stress during medical school. The data was analyzed utilizing The Concept System® software through multidimensional scaling and hierarchical clustering. Results: Categories of resilience strategies employed included "friends and family," "de-stress through exercise/sport," "extra-curricular non-medical activities," "self-enabled distraction," "organization," and "enhancing emotional and mental wellbeing." Students rated spending time with "friends and family" to be most effective when seeking to relieve stress, whereas students rated "de-stressing through exercise/sport" as being of greatest importance in relation to inclusion in a resilience-based intervention. Students recognized the value of incorporating strategies to enhance emotional and mental wellbeing into a resilience-promoting program. "Self-enabled distraction" rated poorly on both scales. Conclusions: Strategies rated by students to be important to incorporate in a stress reduction management program are accessible, are feasible, and can be implemented into the medical curriculum. Keywords: Group concept mapping; Medical students; Resilience; Support.
Higher Education	Rajagopal, K., Firssova, O., Op de Beeck, I., Van der Stappen, E., Stoyanov, S., Henderikx, P., & Buchem, I.	2020	Learner skills in open virtual mobility.	Research in Learning Technology	https://doi.org/10.25304/rlt.v28.2254	https://www.researchgate.net/profile/Olga-Firssova/publication/340042859_Learner_skills_in_open_virtual_mobility/links/5eb1440245851592d6b98259/Learner-skills-in-open-virtual-mobility.pdf?origin=publication_detail	Educational Development Unit	Internationalisation has been a key theme in higher education (HE) for decades. Multiple initiatives across the world have contributed to creating offerings of high-quality online education, with collaborations across national borders. Two of the concepts that have proved to be influential are Virtual Mobility (VM) and Open Education (OE). Virtual mobility refers to study activities that students enrolled in HE in one country undertake online in other countries without physically moving. Such activities are certified and mutually acknowledged by participating institutions. Open education covers global initiatives increasing access to free online quality education, without or with alternative forms of certification. The research presented in this article identifies the learner skills and competences that are supported by Open Virtual Mobility (OpenVM), a new trend in online education that builds upon these two concepts. A group concept mapping study based on the contributions of experts in both VM and OE resulted in defining seven learner skills and competence areas including: intercultural skills and attitudes; networked learning; active self-regulated learner skills; media and digital literacy; autonomy-driven learning, interactive and collaborative learning in an authentic international environment and open-mindedness. The study provided input for further conceptualising of OpenVM as a bridge between VM and OE.
Higher Education	Ogden, K., Kilpatrick, S., Elmer., S. & Rooney, K.	2021	Attributes and generic competencies required of doctors: findings from a participatory concept mapping study.	BMC health services research	https://doi.org/10.1186/s12913-021-06519-9	https://bmchealthservres.biomedcentral.com/track/pdf/10.1186/s12913-021-06519-9.pdf	University of Tasmania	Medical education should ensure graduates are equipped for practice in modern health-care systems. Practicing effectively in complex health-care systems requires contemporary attributes and competencies, complementing core clinical competencies. These need to be made overt and opportunities to develop and practice them provided. This study explicates these attributes and generic competencies using Group Concept Mapping, aiming to inform pre-vocational medical education curriculum development. Methods: Group Concept Mapping is a mixed methods consensus building methodology whereby ideas are generated using qualitative techniques, sorted and grouped using hierarchical cluster analysis, and rated to provide further quantitative confirmation of value. Health service providers from varied disciplines (including medicine, nursing, allied health), health profession educators, health managers, and service users contributed to the conceptual model's development. They responded to the prompt 'An attribute or non-clinical competency required of doctors for effective practice in modern health-care systems is...' and grouped the synthesized responses according to similarity. Data were subjected to hierarchical cluster analysis. Junior doctors rated competencies according to importance to their practice and preparedness at graduation. Results: Sixty-seven contributors generated 338 responses which were synthesised into 60 statements. Hierarchical cluster analysis resulted in a conceptual map of seven clusters representing: value-led professionalism; attributes for self-awareness and reflective practice; cognitive capability; active engagement; communication to build and manage relationships; patient-centredness and advocacy; and systems awareness, thinking and contribution. Logic model transformation identified three overarching meta-competencies: leadership and systems thinking; learning and cognitive processes; and interpersonal capability. Ratings indicated that junior doctors believe system-related competencies are less important than other competencies, and they feel less prepared to carry them out. Conclusion: The domains that have been identified highlight the competencies necessary for effective practice for those who work within and use health-care systems. Three overarching domains relate to leadership in systems, learning, and interpersonal competencies. The model is a useful adjunct to broader competencies frameworks because of the focus on generic competencies that are crucial in modern complex adaptive health-care systems. Explicating these will allow future investigation into those that are currently well achieved, and those which are lacking, in differing contexts. Keywords: Attributes; Delivery of health services; Generic competencies; Group concept mapping; Medical education.
Higher Education	Ulbrich, F., & Luzern H.	2021	Planning Effective Instructional Interventions.	Scientific Contribution	https://doi.org/10.3217/zfhe-16-01/11	https://zfhe.at/index.php/zfhe/article/download/1466/976	Lucerne University	While instructional intervention studies predominately focus on empirically evaluating interventional outcomes, the question of where an intervention should take place is often neglected. To bridge this gap, this paper integrates a learners’ perspective into planning effective interventions, using group concept mapping. Employing this approach enables higher education institutions to prioritize where to intervene and, hence, to direct their planning efforts to areas in which most impact can potentially be made on attaining intended learning outcomes.
Higher Education	Petersson, P., Westergren, A., Edfors, E., & Hammarlund, C. S.	2022	Identifying important conceptual areas in a nursing education programme to meet future demands, using group concept mapping	Nurse Education Today	https://doi.org/10.1016/j.nedt.2022.105485	https://www.sciencedirect.com/science/article/pii/S0260691722002210	Kristianstad University	A nursing programme in southern Sweden was revised to meet future demands. The aim of this study was to explore important conceptual areas to be included in a nursing programme in order to meet long-term societal and health care requirements. Group concept mapping (GCM), a mixed-methods approach, was used. Thirty-four experienced teachers participated. Data was collected during brainstorming sessions in focus groups. Following editing and removal of duplicates, 101 statements remained to be sorted into piles that had similar conceptual representation in nursing education. The final step was then to rate each statement from 1 to 5 (higher values = more important/more feasible). Quantitative analysis using non-metric multidimensional scaling and hierarchical cluster analysis resulted in 11 clusters. Assessment and treatment and Person-centred care were rated as the most important and Scientific theories and methods, Basic caregiving in nursing and Person-centred care had the highest feasibility ratings. Further analyses suggested that the content of nursing education can be seen from a systems theory perspective, represented by the macro, meso, and micro levels. These levels may increase the understanding of the complexity of nursing care. Furthermore, the cluster analysis can facilitate the development of a concept-based curriculum for nursing education.
Higher Education	Simelane, T., Ryan, D.J., Stoyanov, S. et al.	2021	Bridging the divide between medical school and clinical practice: identification of six key learning outcomes for an undergraduate preparatory course in radiology	Insights Imaging	https://doi.org/10.1186/s13244-021-00971-1	https://insightsimaging.springeropen.com/counter/pdf/10.1186/s13244-021-00971-1.pdf	University Hospital Kerry	There exists a significant divide between what is learnt in medical school and subsequently what is required to practice medicine effectively. Despite multiple strategies to remedy this discordance, the problem persists. Here, we describe the identification of a comprehensive set of learning outcomes for a preparation for practice course in radiology. Methods: Assessment of interns’ readiness to interact with the radiology department was conducted using a national survey of both interns and radiologists. In parallel, group concept mapping (GCM) which involves a combination of qualitative and quantitative techniques was used to identify the shared understanding of participants from a diverse range of medical specialties regarding what topics should be included in an intern preparatory course for interacting with the radiology department. Results: The survey demonstrated that most interns and radiologists felt that undergraduate medical training did not prepare interns to interact with the radiology department. GCM identified six learning outcomes that should be targeted when designing a preparatory module: requesting investigations; clinical decision support; radiology department IT and communication; adverse reactions and risks; interpretation of radiology results and urgent imaging. The thematic clusters from the group concept mapping corroborated the deficiencies identified in the national survey. Conclusion: We have identified six key learning outcomes that should be included in a preparation for practice module in radiology. Future courses targeting these thematic clusters may facilitate a smoother transition from theory to practice for newly graduated doctors. Clinical translational research; evaluation; mixed methods; stakeholder engagement; qualitative methods Preparedness for clinical practice, Radiology, Internship, Radiologists, Group concept mapping, Medical school, Interventional radiology
Higher Education	Evans, M. and Cloutier, L.M.	2023	Integrating higher degree education with practice: exploring the value proposition of executive MBA apprenticeships		https://doi.org/10.1108/HESWBL-10-2022-0207		De Montfort University	Purpose The study aims to explore how the collective representations of stakeholders associated with an Executive MBA (EMBA) apprenticeship are conceptualised, and what value elements are perceived as relevant for personal, professional and organisational development. Design/methodology/approach Forty stakeholders participated in a mixed methods-based group concept mapping (GCM) approach, representing the tripartite relationship of an EMBA apprenticeship. This approach allowed the deconstruction and shared understanding of the value proposition of higher degree apprenticeships. Findings Analysis identified seven conceptualised value clusters around an eight central cluster “Professional Development”. Two regions of meaning were identified: the personal dimensions of apprentices and their contribution within and to their organisation. Findings showed that a work-based designed curriculum improves confidence and communication skills and that much of the value proposition is personal and self-managed by the apprentices. The tripartite relationship was shown to be incomplete and inconsistent, particularly regarding mentoring and reflective practice. Practical implications The pandemic has brought about significant changes in business practice. This study identifies several areas for improving higher degree apprenticeship pedagogy in readiness for the new business landscape, as well as identifying limitations of the tripartite relationship. Originality/value The study addresses a gap in the literature by exploring the value proposition an EMBA apprenticeship programme. The interrelatedness of cluster concepts has identified value elements missing from previous apprenticeship delivery. Deconstructing the senior leader apprenticeship enables educators to redesign and refine models of engagement for improving the apprenticeship experience.
Higher Education	Homer, S.T. and Khor, K.S.	2022	Sustainable campus using concept mapping: a bottom-up approach engaging both staff and students	International Journal of Sustainability in Higher Education	https://doi.org/10.1108/IJSHE-02-2021-0059		Sunway University	This paper aims to highlight a multidimensional model of sustainability practices that are considered meaningful and practical for implementation by higher education institutions (HEIs). Design/methodology/approach: The Concept System® Global MAX© software facilitated the bottom-up approach of this study, where 32 staff and students of a private HEI were prompted with the question, “What design features or facilities should the university building have for you to consider the building sustainable?” Their opinions were collected as statements via online brainstorming and the process was followed through with the sorting and rating of reduced statements. The software was also used to perform multi-dimensional scaling and cluster analysis to generate the findings of this study. Findings: An eight-cluster solution was proposed based on the themes within respective clusters. Respondents rated the importance of sustainability resource usage and sustainability and technology highly. Whilst sustainable campus facilities appeal to students, education for sustainable development were more important to staff. Originality/value: The community-based participatory research recommends activities that enhance the adoption of sustainable development in making universities a “living lab” for sustainability.
K-12 Education	Miller, L. C., Rosas, S. R., & Hall, K.	2011	Using concept mapping to describe sources of information for public health and school nursing practice.	Journal of Research in Nursing	https://doi.org/10.1177/1744987111403883	https://cmc.ihmc.us/Papers/cmc2004-060.pdf#:~:text=In%20addition%2C%20reducing%20qualitative%20data%20to%20a%20one,educators%2C%20social%20workers%2C%20and%20lawyers%20learned%20%28Daley%2C%202001%29.	University of Missouri	Concept-mapping methodology was used to construct a conceptual model of information access for public health and school nursing practice. Concept mapping is an integrated mixed-methods approach that combines familiar group processes with multivariate statistical analyses to represent a group’s understanding of a phenomenon. In this project, 36 public health and school nurses brainstormed 207 unique information sources that were collated and reduced to 57 sources to allow sorting of the statements. A subgroup of 25 public health (n = 16) and school nurses (n = 9) sorted and rated the 57 statements to generate an eight-cluster concept map. The two-dimensional concept map revealed a sophisticated multivariate framework of information access occurring within an intricate, interrelated network of human and data-driven sources that intersect with community and professionally focused systems. Clusters of information sources included those from community groups, healthcare providers, professional organisations, educational tools, state resources, online resources, surveillance data and government-based resources. Ratings of importance, credibility and usefulness by public health and school nurses revealed overall agreement; however, some important differences of specific sources were noted. More complex than previously described, the map represents sources, means of access and systems of health information available to community-based nurses that influence their practice.
K-12 Education	Johnson, S. L., Burke, J. G., & Gielen, A. C.	2012	Urban students' perceptions of the school environment's influence on school violence.	Children & Schools	https://doi.org/10.1093/cs/cds016	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4696597/pdf/nihms744505.pdf	Johns Hopkins University	This article provides information about the aspects of the school environment students perceive influence the occurrence of school violence. Concept mapping, a mixed methods methodology, was used with two groups of urban, primarily African American high school students (n=27) to create conceptual frameworks of their understanding of the school social and physical environment's influence on school violence. Each group of students identified over 50 different ways they perceived their school environment contributed to school violence. These ideas were categorized into six main topics: Student Behaviors, Norms of Behavior, Relationships with School Staff, Learning Environment, School Safety, and Neighborhood Environment. Students' perceptions supported the current conceptualization of the role of the school environment in school violence. However, this study supplements the current literature by identifying school level aspects of the social and physical environment that contribute to students perceptions of the safety of their school. At this level, differences were seen between the two school environments, indicating a need for intervention tailoring. Keywords: African American; concept mapping; high school; school environment; violence prevention.
K-12 Education	Wisner, B. L.	2013	An exploratory study of mindfulness meditation for alternative school students: Perceived benefits for improving school climate and student functioning.	Mindfulness	https://doi.org/10.1007/s12671-013-0215-9		Texas State University	This exploratory study examined the perceived benefits of mindfulness meditation (MM) for compensatory alternative high school students. An 8-week school-based MM program was provided to high school students (N = 35; 19 boys and 16 girls). Concept mapping, a mixed-method approach, was used to collect and analyze the data. This process yielded eight clusters representing the perceived benefits of meditation for students: improved stress management, enhanced self-awareness, enhanced emotional coping, enhanced ability to pay attention, improved state of mind, more time spent being calm, improved school climate, and enhanced student engagement. These clusters encompass three broad domains of perceived benefits for students including intrapersonal, psychosocial, and systemic benefits. Students rated the potential for meditation to relieve stress and to improve school climate as particularly important for them. These findings may be used when planning school-based meditation programs and may serve as a useful guide for researchers studying meditation practices for youth.
K-12 Education	Dare, L. & Nowicki, E.	2015	Conceptualizing concurrent enrollment: Why high achieving students go for it.	Gifted Child Quarterly	https://doi.org/10.1177/0016986215597749		University of Western Ontario	Research shows that carefully planned acceleration offers academic benefits with little social or emotional risk to high-ability learners. However, acceleration is underutilized and little is known about students’ motivations to accelerate. In this study, 21 high-ability high school students in Grades 11 and 12 took part in a structured conceptualization exercise that revealed why they chose to concurrently enroll in university courses. Participants brainstormed responses to a focus prompt, then structured the data by sorting and rating their responses. The structured data were analyzed using multidimensional scaling and hierarchical cluster analysis to produce a cluster map of participants’ motivations. In order of importance, key concepts included (a) university preparation, (b) demonstrating initiative, (c) getting ahead, (d) love of learning, (e) self-fulfillment, (f) seeking challenge, and (g) socializing. The key concepts were examined within a self-determination theory framework. Study findings provide a deeper understanding of high-achieving students’ views on concurrent enrollment. Educational and research implications are discussed.
K-12 Education	Allen, M. L., Schaleben-Boateng, D., Davey, C. S., Hang, M., & Pergament, S.	2015	Concept mapping as an approach to facilitate participatory intervention building.	Progress in Community Health Partnerships: Research, Education and Action	https://doi.org/10.1353/cpr.2015.0076	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5451901/pdf/nihms862118.pdf	University of Minnesota	Background: A challenge to addressing community-defined need through community-based participatory intervention building is ensuring that all collaborators' opinions are represented. Concept mapping integrates perspectives of individuals with differing experiences, interests, or expertise into a common visually depicted framework, and ranks composite views on importance and feasibility. Objectives: To describe the use of concept mapping to facilitate participatory intervention building for a school-based, teacher-focused, positive youth development (PYD) promotion program for Latino, Hmong, and Somali youth. Particiants were teachers, administrators, youth, parents, youth workers, and community and university researchers on the projects' community collaborative board. We incorporated previously collected qualitative data into the process. Methods: In a mixed-methods process we 1) generated statements based on key informant interview and focus group data from youth workers, teachers, parents, and youth in multiple languages regarding ways teachers promote PYD for Somali, Latino and Hmong youth; 2) guided participants to individually sort statements into meaningful groupings and rate them by importance and feasibility; 3) mapped the statements based on their relation to each other using multivariate statistical analyses to identify concepts, and as a group identified labels for each concept; and 4) used labels and statement ratings to identify feasible and important concepts as priorities for intervention development. Results: We identified 12 concepts related to PYD promotion in schools and prioritized 8 for intervention development. Conclusions: Concept mapping facilitated participatory intervention building by formally representing all participants' opinions, generating visual representation of group thinking, and supporting priority setting. Use of prior qualitative work increased the diversity of viewpoints represented.
K-12 Education	Kaplan, D. M., deBlois, M., Dominguez, V., & Walsh, M. E.	2016	Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2016.06.001		University of Arizona	Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed.
K-12 Education	Cleversey, K., Brown, J., & Kapasi, A.	2017	Educating adolescents with Fetal Alcohol Spectrum Disorder: Caregiver support needs.	Journal of Child & Family Studies	https://doi.org/10.1007/s10826-017-0776-7		Western University	The purpose of this study was to identify caregivers’ needs in helping youth with fetal alcohol spectrum disorder (FASD) succeed in school. Sixteen caregivers raising a youth with FASD participated in telephone interviews that included the question: “What do caregivers need to help youth be successful in school?”. Participants then sorted responses to these questions into piles they believed to be a conceptual fit with one another, and the data was analyzed using multi-dimensional scaling and cluster analysis. Five concepts emerged: (1) Working to meet the needs of the individual, (2) educational accommodations, (3) FASD-literate schools, (4) resources, and (5) therapeutic supports. These concepts were compared and contrasted with the existing literature.
K-12 Education	Haymovitz, E., Houseal-Allport, P., Lee, R. S., & Svistova, J.	2017	Exploring the perceived benefits and limitations of a school-based social-emotional learning program: A concept map evaluation.	Children & Schools	https://doi.org/10.1093/cs/cdx029	https://www.researchgate.net/profile/Ethan-Haymovitz/publication/322735467_Exploring_the_Perceived_Benefits_and_Limitations_of_a_School-Based_Social-Emotional_Learning_Program_A_Concept_Map_Evaluation/links/5f25a37d92851cd302cf4554/Exploring-the-Perceived-Benefits-and-Limitations-of-a-School-Based-Social-Emotional-Learning-Program-A-Concept-Map-Evaluation.pdf?origin=publication_detail	Millersville University of Pennsylvania	Schools today are faced with the challenge of equipping students with the skills they need to succeed in life outside the classroom while also teaching the academic material required. More often, teachers are called on to establish environments in which students learn social and emotional skills alongside academics. With increased recognition that punitive models of school discipline have a negative impact on school culture and on students' individual growth, schools are tasked with designing positive alternatives to improving school engagement and culture. Social Harmony teaches K-8 school communities the skills necessary to promote social-emotional learning and address conflict through restorative methods, a model that is gaining traction. After three years of implementation in a small private school, authors conducted a study that involved 32 students, faculty, and parents in a community-based, concept mapping procedure to articulate perceived impact. Participants reported an observable impact on faculty productivity, student well-being, peer relationships, and school climate. Lessons learned include the need for strong, consistent, and sustainable leadership and stronger parental inclusion, which may best be guaranteed by school social work professionals. The article concludes with a discussion of implications of the findings and recommendations.
K-12 Education	Dare, A., Dare, L., & Nowicki, E.	2017	Concurrent enrollment: Comparing how educators and students categorize students’ motivations.	Social Psychology of Education	https://doi.org/10.1007/s11218-016-9364-8	https://www.researchgate.net/profile/Lynn-Dare/publication/313468143_Concurrent_Enrollment_Comparing_How_Educators_and_Students_Categorize_Students'_Motivations/links/5cb522de4585156cd79ae33c/Concurrent-Enrollment-Comparing-How-Educators-and-Students-Categorize-Students-Motivations.pdf	McMaster University	High-ability students have special education needs that are often overlooked or misunderstood (Blaas in "Aust J Guid Couns" 24(2):243-255, 2014) which may result in talent loss (Saha and Sikora in "Int J Contemp Sociol Discuss J Contemp Ideas Res" 48(1):9-34, 2011). Educational acceleration can help avoid these circumstances and support high-ability students to reach their full potential by providing a better match between students' abilities and the pace of their education (Assouline et al. in "A nation empowered: evidence trumps the excuses holding back America's brightest students," The Connie Belin & Jacqueline N. Blank International Center for Gifted Education and Talent Development, Iowa City, 2015). Concurrent or dual enrollment is a type of acceleration in which students are enrolled in two levels of school simultaneously, for example, secondary students might attend college or university. In this comparative research, we examined how educators and students categorized students' motivations to choose concurrent enrollment through a group concept mapping process. Participants structured a set of 85 reasons for concurrent enrollment by sorting the data into meaningful groups. We applied multi-dimensional scaling and hierarchical cluster analysis to the grouped data to create a cluster map of the educators' categorizations. Key concepts in the educators' map included (a) Planning Ahead, (b) Love Learning, (c) Challenge, (d) Smart kids!, and (e) Meet Intellectual Peers. Next, we quantitatively and qualitatively compared the educators' concept map to a map created by students in an earlier study. Using Procrustes analysis, we found overall similarities in the placement of individual statements on the two maps. However, our analysis of the cluster solutions revealed some differences between educators' and students' maps. Of particular interest, the students' map had more categories, suggesting that students categorized their motivations more finely than educators did. Educational practice implications are discussed
K-12 Education	Cleversey, K., Brown, J., & Kapasi, A.	2018	Educational services for youth with fetal alcohol spectrum disorder: Caregivers' perspectives.	International Journal of Mental Health and Addiction	https://doi.org/10.1007/s11469-017-9838-8		Western University	The purpose of this study was to identify services that caregivers of youth with fetal alcohol spectrum disorder believe would help youth with FASD succeed in school. Sixteen caregivers participated in telephone interviews that included the question: “What services would help youth be successful in school?” A concept mapping technique was employed, in which responses were grouped together by participants and the grouping data was analyzed using multidimensional scaling and cluster analysis. Six concepts emerged from the question about services, including the following: (1) being heard by educators, (2) FASD-informed educators, (3) involvement in child’s education, (4) resources and accommodations, (5) supportive knowledge base, and (6) support and understanding at home. Concepts were compared to the existing literature.
K-12 Education	Dare, L., Nowicki, E. A., & Smith, S.	2019	On deciding to accelerate: High-ability students identify key considerations.	Gifted Child Quarterly	https://doi.org/10.1177/0016986219828073		University of Western Ontario	Acceleration is a well-researched educational intervention supporting positive outcomes for high-ability students. However, access to acceleration may be restricted due to educators’ misapprehensions about this practice. To better understand whether students share educators’ concerns, our study explored 26 high-ability students’ beliefs about important considerations in grade-based acceleration. Seventeen high-ability students who had accelerated (age 9-14 years) participated in group concept mapping activities, which involved sorting and rating a list of student-generated considerations. We applied multidimensional scaling and hierarchical cluster analysis to the sorted data to create a structured conceptualization of students’ advice on deciding to accelerate. Our analyses revealed the following six key concepts, from most to least important: (a) Best Learning Environment, (b) Child’s Preferences, (c) Abilities Across Different Subjects, (d) Peer Group, (e) Context and School Support, and (f) Social Considerations. Our interpretations include comparison of high-ability students’ advice to existing acceleration guidelines. Practical implications are discussed.
K-12 Education	Delorey, J., Specht, J., Fairbrother, M., Ismailos, L., Villella, M., Charles, E., Vanderloon, M., Gallagher, T., Howell, G., & Whitley, J.	2020	Experiences that shape pre-service teachers’ inclusive practice beliefs: a group concept mapping study.	International Journal of Inclusive Education	https://doi.org/10.1080/13603116.2020.1862403	https://www.researchgate.net/profile/Melissa-Villella/publication/347945097_Experiences_that_shape_pre-service_teachers%27_inclusive_practice_beliefs_a_group_concept_mapping_study/links/617efb173c987366c30f6f6f/Experiences-that-shape-pre-service-teachers-inclusive-practice-beliefs-a-group-concept-mapping-study.pdf?origin=publication_detail	Western University	Teachers’ beliefs inform their instructional practice, which in turn has direct bearing on students’ success. The current study utilised Trochim’s Group Concept Mapping (GCM) to explore the experiences that influence pre-service teachers’ beliefs about teaching and learning in inclusive classrooms. Fifty-one pre-service teachers at the end of their programme were interviewed about these experiences. Fifteen pre-service teachers sorted the statements that captured these experiences and rated how important they would be for developing beliefs about teaching in inclusive classrooms. Four distinct themes were identified as was their importance. Practicum/collaboration experiences were most important followed by work and personal experience, and then education. These results underscore the importance of both professional and personal experiences and implicate teacher education programmes in the development process.
K-12 Education	Lynn Dare Elizabeth A. Nowicki Lori L. Murray	2020	How students conceptualize grade‐based acceleration in inclusive settings.	Psychology in the Schools	https://doi.org/10.1002/pits.22435		University of Western Ontario	Despite extensive research supporting educational acceleration for students with high academic ability, some psychologists, counselors, and educators express concerns about accelerative interventions. Such concerns often hinge on uncertainty about social acceptance, even in inclusive education settings. Research on acceleration has consistently shown benefits for students with high ability; however, there is a lack of research about grade-based acceleration in inclusive schools. This study engaged two groups of students in group concept mapping processes to examine how they conceptualized beliefs about grade-based acceleration in inclusive schools. First, 26 students in inclusive classes generated beliefs about grade-based acceleration. Then they, and a group of 14 students with high ability, structured the data by sorting and rating a synthesized list of the generated beliefs. We analyzed the sorted data using multidimensional scaling and hierarchical cluster analysis. The resultant cluster maps revealed some differences and some similarities in the ways that the two groups of students conceptualized beliefs about educational acceleration. Practical implications are discussed.
K-12 Education	Chun, J., Lee, S. & Kim, J.	2021	Conceptualizing the Protective Factors of Cyberbullying Victimization in Korean Adolescents.	School Mental Health	https://doi.org/10.1007/s12310-021-09422-0	https://link.springer.com/content/pdf/10.1007/s12310-021-09422-0.pdf	Ewha Womans University	This study conceptualized the protective factors for cyberbullying victimization as perceived by 43 Korean adolescents and explored gender differences in such conceptualizations using concept mapping method, a mixed-methods approach. Concept mapping revealed six major protective factors against cyberbullying victimization: ‘supportive relationships’ (M = 3.75, SD = 0.39), ‘school’s interest in cyberbullying’ (M = 3.58, SD = 0.11), ‘personal traits’ (M = 3.57, SD = 0.22), ‘reporting and monitoring system’ (M = 3.51, SD = 0.36), ‘education and help-seeking’ (M = 3.38, SD = 0.31), and ‘personal traits in online behavior’ (M = 3.30, SD = 0.60). Overall, the ‘supportive relationships’ cluster received the highest ratings from both male and female participants. Moreover, pattern matching by gender revealed lack of agreement (r = 0.54). In particular, male participants gave higher ratings to the ‘personal traits’ cluster, whereas female participants perceived ‘education and help-seeking’ to be a more important cluster than their counterparts. These results suggest that school-based intervention strategies can be used to improve supportive relationships, personal traits, netiquette, and awareness of online behaviors. At the institutional level, an automatic reporting and monitoring system and more school-linked cyberbullying laws could be implemented.
K-12 Education	Specht, J., Miesera, S., McGhie-Richmond, D., & Haider, F.	2022	Experiences that shape the development of inclusive instruction in preservice teachers: An international comparison	European Journal of Special Education Research	https://doi.org/10.46827/ejse.v8i4.4436	https://oapub.org/edu/index.php/ejse/article/view/4436/7071	Western University	Preservice teacher education programs are vital in teachers’ development of instructional practices for inclusive classrooms. In previous research, preservice teachers in Canada had higher scores on measures of experience with people with disabilities when compared to those in Germany. The current study investigated the proposition that differences existed because of experiences of inclusion in the respective countries. Participants were 18 Canadian preservice teachers from faculties of education in Ontario, Canada and 29 German preservice teachers from a Bavarian university. A Group Concept Mapping (GCM) technique was employed. Both groups identified Practicum Experiences, Education Program, Past Jobs, and Personal Life Experiences as contributing to the development of their inclusive practice. Only the Canadian sample identified Mentoring Relationships and Professional Development. Differences and similarities in teacher education programs are highlighted as possible contributors to the differences in Canadian and German preservice teachers’ perceptions of experiences useful for shaping their instructional practice.
K-12 Education	Habash, M., Roedlach, A., Fox, J. M., Oltman, G., Abraham, A. T., & Jakmouj, Y. H.	2023	Challenges Faced by Jesuit Worldwide Learning Students: Piloting a Mixed Methods Investigation	Jesuit Higher Education	https://doi.org/10.53309/2164-7666.1366	https://epublications.regis.edu/cgi/viewcontent.cgi?article=1366&context=jhe		Abstract In 2017 a Creighton University Global Initiative grant provided 20 scholarships in its online B.S. in Leadership Studies for Jesuit Worldwide Learning graduates of the Diploma in Liberal Studies. In 2018-19 the first cohort of scholarship students living in Afghanistan and Jordan were enrolled at Creighton University (CU). In spring 2019, three Creighton University students collaborated with two of the co-authors to develop and to implement a research project to explore barriers faced by Jesuit Worldwide Learning students enrolled in Creighton’s B.S. program. The purpose of this project was to test if Group Concept Mapping, a mixed methods research approach integrating qualitative and quantitative methods, combined with the analysis of narrative course evaluations and interview texts with students, faculty, and staff adopting the Grounded Theory approach can lead to insights that further our understanding of barriers and struggles faced by Jesuit Worldwide Learning students and their instructors, can help strengthen institutional gaps in international learning, and can be used for a future study. The process and the results strongly suggest that the methodology is indeed appropriate to systematically study this or a related research question.
K-12 Education	Specht IO, Larsen SC, Nielsen AK, Rohde JF, Heitmann BL, et al.	2023	Types of kindergarten and their relationship with parental and children's socio-demographic characteristics in Denmark	PLOS ONE	https://doi.org/10.1371/journal.pone.0288846	https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0288846&type=printable		In Danish outdoor kindergartens, children are spending most of the day outdoors often in forests or similar nature environments. These children are assumed to be healthier than children attending conventional kindergartens, however, factors related to choosing a specific type of kindergarten may explain the differences. To better understand this, we aimed to investigate parents reasons for choosing either outdoor or conventional kindergartens based on a mixed-method participatory Concept Mapping approach, and further if parental socio-demographics and early child characteristics differed prior to enrolling children to either type of kindergarten using a cohort register-based approach. Parents of children attending outdoor kindergartens (n = 23) weighed reasons such as “physical setting, outdoor life, and freedom of movement” high, whereas “a good first impression of the kindergarten” was an important reason for parents choosing a conventional kindergarten (n = 22). In the register-based approach, 2434 and 2643 children attended outdoor or conventional kindergartens, respectively. The parents choosing outdoor kindergartens as well as their children differed according to most investigated characteristics, including origin (maternal non-Western: 4.2% vs. 21.9%, p < .0001), educational level (maternal long education: 45.6% vs. 33.0%, p < .0001), prematurity (5.1% vs. 7.1%, p = 0.004) and sex (females: 43.5% vs. 48.6%, p = <0.0013). In conclusion, parental reasons for choosing kindergarten as well as parental socio-demographics differed substantially among kindergarten type. These differences might cause selection bias if not considering when comparing health outcomes among children attending different kinds of kindergartens.
Nursing	Miller, L. C., Rosas, S. R., & Hall, K.	2011	Using concept mapping to describe sources of information for public health and school nursing practice.	Journal of Research in Nursing	https://doi.org/10.1177/1744987111403883	https://cmc.ihmc.us/Papers/cmc2004-060.pdf#:~:text=In%20addition%2C%20reducing%20qualitative%20data%20to%20a%20one,educators%2C%20social%20workers%2C%20and%20lawyers%20learned%20%28Daley%2C%202001%29.	University of Missouri	Concept-mapping methodology was used to construct a conceptual model of information access for public health and school nursing practice. Concept mapping is an integrated mixed-methods approach that combines familiar group processes with multivariate statistical analyses to represent a group’s understanding of a phenomenon. In this project, 36 public health and school nurses brainstormed 207 unique information sources that were collated and reduced to 57 sources to allow sorting of the statements. A subgroup of 25 public health (n = 16) and school nurses (n = 9) sorted and rated the 57 statements to generate an eight-cluster concept map. The two-dimensional concept map revealed a sophisticated multivariate framework of information access occurring within an intricate, interrelated network of human and data-driven sources that intersect with community and professionally focused systems. Clusters of information sources included those from community groups, healthcare providers, professional organisations, educational tools, state resources, online resources, surveillance data and government-based resources. Ratings of importance, credibility and usefulness by public health and school nurses revealed overall agreement; however, some important differences of specific sources were noted. More complex than previously described, the map represents sources, means of access and systems of health information available to community-based nurses that influence their practice.
Nursing	Subramaniam, D. P., Baker, E. A., Zelicoff, A. P., & Elliott, M. B.	2015	Factors influencing seasonal influenza vaccination uptake in emergency medical services workers: A concept mapping approach.	Journal of Community Health	https://doi.org/10.1007/s10900-015-0144-8		University of Kansas	Seasonal influenza has serious impacts on morbidity and mortality and has a significant economic toll through lost workforce time and strains on the health system. Health workers, particularly emergency medical services (EMS) workers have the potential to transmit influenza to those in their care, yet little is known of the factors that influence EMS workers' decisions regarding seasonal influenza vaccination (SIV) uptake, a key factor in reducing potential for transmitting disease. This study utilizes a modified Theory of Planned Behavior (TPB) model as a guiding framework to explore the factors that influence SIV uptake in EMS workers. Concept mapping, which consists of six-stages (preparation, generation, structuring, representation, interpretation, and utilization) that use quantitative and qualitative approaches, was used to identify participants' perspectives towards SIV. This study identified nine EMS-conceptualized factors that influence EMS workers' vaccination intent and behavior. The EMS-conceptualized factors align with the modified TPB model and suggest the need to consider community-wide approaches that were not initially conceptualized in the model. Additionally, the expansion of non-pharmaceutical measures went above and beyond original conceptualization. Overall, this study demonstrates the need to develop customized interventions such as messages highlighting the importance of EMS workers receiving SIV as the optimum solution. EMS workers who do not intend to receive the SIV should be provided with accurate information on the SIV to dispel misconceptions. Finally, EMS workers should also receive interventions which promote voluntary vaccination, encouraging them to be proactive in the health decisions they make for themselves. Keywords: Concept mapping; Emergency medical services; Health behavior; Health promotion; Health services; Immunization; Occupational health; Seasonal influenza vaccination.
Nursing	Hernandez, A. R., Hurtig, A. K., Dahlblom, K., & San Sebastian, M.	2015	Integrating views on support for mid-level health worker performance: A concept mapping study with regional health system actors in rural Guatemala.	International Journal for Equity in Health	https://doi.org/10.1186/s12939-015-0225-4	https://equityhealthj.biomedcentral.com/track/pdf/10.1186/s12939-015-0225-4.pdf	Umeå University	Introduction: Mid-level health workers are on the front-lines in underserved areas in many LMICs, and their performance is critical for improving the health of vulnerable populations. However, improving performance in low-resource settings is complex and highly dependent on the organizational context of local health systems. This study aims to examine the views of actors from different levels of a regional health system in Guatemala on actions to support the performance of auxiliary nurses, a cadre of mid-level health workers with a prominent role in public sector service delivery. A concept mapping study was carried out to develop an integrated view on organizational support and identify locally relevant strategies for strengthening performance. Methods: A total of 93 regional and district managers, and primary and secondary care health workers participated in generating ideas on actions needed to support auxiliary nurses' performance. Ideas were consolidated into 30 action items, which were structured through sorting and rating exercises, involving a total of 135 of managers and health workers. Maps depicting participants' integrated views on domains of action and dynamics in sub-groups' interests were generated using a sequence of multivariate statistical analyses, and interpreted by regional managers. Results: The combined input of health system actors provided a multi-faceted view of actions needed to support performance, which were organized in six domains, including: Communication and coordination, Tools to orient work, Organizational climate of support, Motivation through recognition, Professional development and Skills development. The nature of relationships across hierarchical levels was identified as a cross-cutting theme. Pattern matching and go-zone maps indicated directions for action based on areas of consensus and difference across sub-groups of actors. Conclusions: This study indicates that auxiliary nurses' performance is interconnected with the performance of other health system actors who require support, including managers and community-level collaborators. Organizational climate is critical for making auxiliary nurses feel supported, and greater attention to improving the quality of hierarchical relationships is needed in LMIC settings. The participatory nature of the concept-mapping process enabled health system actors to collaborate in co-production of context-specific knowledge needed to guide efforts to strengthen performance in a vulnerable region.
Nursing	Thomas, S. J., Wallace, C., Jarvis, P., & Davis, R. E.	2016	Mixed-methods study to develop a patient complexity assessment instrument for district nurses.	RCNI Nurse Researcher	https://doi.org/10.7748/nr.23.4.9.s3		University of South Wales	Background: There is increasing reference to complex patient needs in health care. However, little is known about how to measure patient complexity or the relationship between it and district nursing activity. Aim: To illustrate the use of group concept mapping (GCM) to conceptualise and develop items for a patient complexity assessment instrument to be used by district nurses. Discussion: The first phase of this research used GCM conceptualisation and consensus methodology to identify items for a community-based patient complexity instrument. GCM helped to provide a conceptual understanding of community-based patient complexity through focused exploration of the term. Results: indicated that a number of environmental, sociological, psychological, behavioural, physical and organisational factors needed to be included. This, in turn, showed that an existing taxonomy did not contain the relevant items. Consequently, amendments were made and a new instrument developed. Conclusion: GCM is a suitable consensus method for use in nursing theory and developing instruments. It proved successful in achieving consensus with no loss of participants' views. Implications for practice: GCM is a suitable method for nurses to use in research or practice development activities as it is based on a facilitative and engagement-led approach.
Nursing	Hagell, P., Edfors, E., Hedin, G., Westergren, A., & Hammarlund, C. S.	2016	Group concept mapping for evaluation and development in nursing education.	Nurse Education in Practice	https://doi.org/10.1016/j.nepr.2016.08.006		Kristianstad University	The value of course evaluations has been debated since they frequently fail to capture the complexity of education and learning. Group Concept Mapping (GCM), a participant-centred mixed-method was explored as a tool for evaluation and development in nursing education and to better understand students' learning experiences, using data from a GCM-based evaluation of a research training assignment integrating clinical practice and research data collection within a Swedish university nursing program. Student nurses (n = 47) participated in a one-day GCM exercise. Focus group brainstorming regarding experiences from the assignment that the students considered important and instructive yielded 98 statements that were individually sorted based on their student-perceived relationships, and rated regarding their importance/instructiveness and need for development. Quantitative analysis of sort data produced a 2-dimensional map representing their conceptual relationships, and eight conceptual areas. Average cluster ratings were plotted relative to each other and provided a decision aid for development and planning by identifying areas (i.e., "Research methodology", "Patients' perspectives", and "Interviewer role") considered highly important/instructive and in high need for development. These experiences illustrate the use and potential of GCM as an interactive participant-centred approach to evaluation, planning and development in nursing and other higher health science educations.
Nursing	Blackstone, S., Iwelunmor, J., Plange-Rhule, J., Gyamfi, J., Quakyi, N. K., Ntim, M., & Ogedegbe, G.	2017	Sustaining nurse-led task-shifting strategies for hypertension control: A concept mapping study to inform evidence-based practice.	Worldviews on Evidence-based Nursing	https://doi.org/10.1111/wvn.12230		University of Illinois Urbana-Champaign	Background: The use of task-shifting is an increasingly widespread delivery approach for health interventions targeting prevention, treatment, and control of hypertension in adults living in sub-Saharan Africa (SSA). Addressing a gap in the literature, this research examined the sustainability of an ongoing task-shifting strategy for hypertension (TASSH) from the perspectives of community health nurses (CHNs) implementing the program. Methods: We used concept-mapping, a mixed-methods participatory approach to understand CHNs' perceptions of barriers and enablers to sustaining a task-shifting program. Participants responded to focal prompts, eliciting statements regarding perceived barriers and enablers to sustaining TASSH, and then rated these ideas based on importance to the research questions and feasibility to address. Twenty-eight community health nurses (21 women, 7 men) from the Ashanti region of Ghana completed the concept-mapping process. Results: Factors influencing sustainability were grouped into five categories: Limited Drug Supply, Financial Support, Provision of Primary Health Care, Personnel Training, and Patient-Provider Communication. The limited supply of antihypertensive medication was considered by CHNs as the most important item to address, while providing training for intervention personnel was considered most feasible to address. Linking evidence to action: This study's findings highlight the importance of examining nurses' perceptions of factors likely to influence the sustainability of evidence-based, task-shifting interventions. Nurses' perceptions can guide the widespread uptake and dissemination of these interventions in resource-limited settings. Keywords: Ghana; community health nurses; hypertension; stakeholder analysis; task-shifting.
Nursing	Iris, M. A.	2017	Short-form elder self-neglect assessment.	Springer Publishing Company			Northwestern University	This chapter describes the development of the Short-Form Elder Self-Neglect Assessment (SF-ESNA) and presents findings from its use by practitioners in the field of self-neglect assessment and intervention. The SF-ESNA includes 12 indicators of self-neglect relating to physical and psychosocial aspects of self-neglect, and 13 indicators related to environmental and personal living conditions. Results of the assessment confirmed that elder self-neglect stemming from personal behaviors and psychosocial characteristics is more common, as compared to self-neglect involving inadequate or deplorable environmental and personal living conditions. This suggests that self-neglect conditions may progress over time, from self-care deficits to more severe housing conditions. In addition, investigators noted cognitive impairments and mental health problems in over half of the 50 older adults suffering from self-neglect. Those scoring high on the SF-ESNA were more likely to have some type of cognitive impairment or mental illness as compared to those with lower scores.
Nursing	Veenema, T. G., Deruggiero, K., Losinski, S., & Barnett, D.	2017	Hospital administration and nursing leadership in disasters: An exploratory study using concept mapping.	Nursing Administration Quarterly	https://doi.org/10.1097/NAQ.0000000000000224		Johns Hopkins University	Strong leadership is critical in disaster situations when “patient surge” challenges a hospital's capacity to respond and normally acceptable patterns of care are disrupted. Activation of the emergency operations plan triggers an incident command system structure for leadership decision making. Yet, implementation of the emergency operations plan and incident command system protocols is ultimately subject to nursing and hospital leadership at the service- and unit level. The results of these service-/unit-based leadership decisions have the potential to directly impact staff and patient safety, quality of care, and ultimately, patient outcomes. Despite the critical nature of these events, nurse leaders and administrators receive little education regarding leadership and decision making during disaster events. The purpose of this study is to identify essential competencies of nursing and hospital administrators' leadership during disaster events. An integrative mixed-methods design combining qualitative and quantitative approaches to data collection and analysis was used. Five focus groups were conducted with nurse leaders and hospital administrators at a large urban hospital in the Northeastern United States in a collaborative group process to generate relevant leadership competencies. The Concept System® Global MAX™ was used to sort, prioritize, and analyze the data (https://conceptsystems.com/). The results suggest that participants' institutional knowledge (of existing resources, communications, processes) and prior disaster experience increase leadership competence.
Nursing	Rising, K. L., Doyle, S. K., Powell, R. E., Doty, A. M. B., LaNoue, M., & Gerolamo, A. M.	2018	Use of group concept mapping to identify patient domains of uncertainty that contribute to emergency department use.	Journal of Emergency Nursing	https://doi.org/10.1016/j.jen.2018.05.015		Thomas Jefferson University	Introduction: Prior research suggests that uncertainty related to symptoms is a driver of emergency department (ED) use, and that patients often leave the ED with uncertainty not being addressed. Our objective was to engage patients to identify domains that contribute to feelings of uncertainty and decisions to use the ED. Methods: We used Group Concept Mapping, a quasi-qualitative/quasi-quantitative method, to elicit patients' views on how uncertainty related to experiencing symptoms contributes to decisions to access the ED. Purposive sampling was used to recruit participants who either sought treatment at the ED twice within a 30-day period, or visited both the ED and a primary care provider at least once within the past year. Results: Thirty-four participants engaged in two rounds of Group Concept Mapping during which participants participated in structured brainstorming of ideas, followed by ranking and clustering of ideas into domains. The first round generated 47 idea statements reflecting uncertainty about consequences, severity, emergency room services, primary care options, finances, and psychologic concerns. The second round generated 52 idea statements reflecting uncertainty about self-management, causation, diagnosis and treatment plan, trust in the provider and institution, accessibility, and alternative care options. Discussion: Factors that contribute to uncertainty and decision-making about ED use are both intrinsic (ie, cause, symptom severity) and extrinsic (ie, finances, accessibility). These domains can inform approaches to measure the uncertainty that patients experience, and to design and test interventions for nurses and other providers to help manage patient uncertainty during acute illness. Keywords: Emergency department use; Emergency nursing; Patient uncertainty; Quality of health care.
Nursing	Westergren, A., Edfors, E., Norberg, E., Studdenforff, A., Hedin, G., Wetterstrand, M., Rosas, S. R., & Hagell, P.	2018	Computer-based training in eating and nutrition facilitates person-centered hospital care: A group concept mapping study.	Computer informatics Nursing	https://doi.org/10.1097/CIN.0000000000000416		Kristianstad University	Studies have shown that computer-based training in eating and nutrition for hospital nursing staff increased the likelihood that patients at risk of undernutrition would receive nutritional interventions. This article seeks to provide understanding from the perspective of nursing staff of conceptually important areas for computer-based nutritional training, and their relative importance to nutritional care, following completion of the training. Group concept mapping, an integrated qualitative and quantitative methodology, was used to conceptualize important factors relating to the training experiences through four focus groups (n = 43), statement sorting (n = 38), and importance rating (n = 32), followed by multidimensional scaling and cluster analysis. Sorting of 38 statements yielded four clusters. These clusters (number of statements) were as follows: personal competence and development (10), practice close care development (10), patient safety (9), and awareness about the nutrition care process (9). First and second clusters represented "the learning organization," and third and fourth represented "quality improvement." These findings provide a conceptual basis for understanding the importance of training in eating and nutrition, which contributes to a learning organization and quality improvement, and can be linked to and facilitates person-centered nutritional care and patient safety.
Nursing	Dunlop, S., Lewis, N., Richardson, R., Thomas, S., Devonald-Morris, M., Pontin, D., & Wallace, C.	2019	Using group concept mapping to explore the complexities of managing children's care.	Nurse Researcher	https://doi.org/10.7748/nr.2020.e1696	https://www.researchgate.net/profile/Sue-Dunlop/publication/338629604_Using_group_concept_mapping_to_explore_the_complexities_of_managing_children%27s_care/links/5eb8f7034585152169c5821a/Using-group-concept-mapping-to-explore-the-complexities-of-managing-childrens-care.pdf?origin=publication_detail	University South Wales	Background: Children whose assessed health needs cannot be met by statutory and universal services may require bespoke packages of continuing care. A project management group was set up to design a study that would explore the complexities for a children's community nurse (CCN) of managing such packages. Methodology: Group concept mapping (GCM), a mixed quantitative/qualitative participant-centred methodology, was used to obtain consensus from 20 CCNs about the complexities inherent in managing such packages and to develop a concept map that illustrated the emerging conceptual framework. Discussion: The participants' ideas were written as statements and analysed. Core analysis of a square symmetrical matrix through multidimensional scaling and hierarchical cluster analysis was undertaken to produce a set of maps and reports. The final concept map was interpreted. It contained 99 statements organised into five conceptual clusters: 'education and training' (17 statements), 'risk and safety' (15 statements), 'continuing care process' (17 statements), 'relationships and boundaries' (22 statements) and 'working with families' (28 statements). Conclusion: CCNs used GCM to explore their roles and responsibilities when managing children's continuing care. Their resulting ideas were developed into a five-cluster conceptual framework that illustrated their views about the complexities of managing such care. Implications for practice: The emergent conceptual framework enables CCNs to explore their practice in relation to managing packages of care. Additionally, the framework will be used to design a CCN workforce planning instrument that will be useful to measure complexity in CCN caseloads. The GCM methodology could be used by other nursing teams who wish to develop their practice. Keywords: children; continuing care; management; mixed-methods; research; research methods; service evaluation; study design.
Nursing	Robinson, L. J., Stephens, N. M., Wilson, S., Graham, L., & Hackett, K. L.	2019	Conceptualizing the key components of rehabilitation following major musculoskeletal trauma: A mixed methods service evaluation.	Journal of Evaluation in Clinical Practice	https://doi.org/10.1111/jep.13331		NHS Foundation Trust	Rationale, aims, and objectives: The reorganization of acute major trauma pathways in England has increased survival following traumatic injury, resulting in an increased patient population with diverse and complex needs requiring specialist rehabilitation. However, national audit data indicate that only 5% of patients with traumatic injuries have access to specialist rehabilitation, and there are limited guidelines or standards to inform the delivery of rehabilitation interventions for individuals following major trauma. This group concept mapping project aimed to identify the clinical service needs of individuals accessing our major trauma rehabilitation service, prioritize these needs, determine whether each of these needs is currently being met, and plan targeted service enhancements. Methods: Participants contributed towards a statement generation exercise to identify the key components of rehabilitation following major trauma, and individually sorted these statements into themes. Each statement was rated based on importance and current success. Multi-dimensional scaling and hierarchical cluster analysis were applied to the sorted data to produce themed clusters of ideas within concept maps. Priority values were applied to these maps to identify key areas for targeted service enhancement. Results: Fifty-eight patients and health care professionals participated in the ideas generation activity, 34 in the sorting, and 49 in the rating activity. A 7-item cluster map was agreed upon, containing the following named clusters: Communication and Coordination; Emotional and psychological wellbeing; Rehabilitation environment; Early rehabilitation; Structured therapy input; Planning for home; and Long-term support. Areas for targeted service enhancement included access to timely and adequate information provision, collaborative goal setting, and specialist pain management across the rehabilitation pathway. Conclusion: The conceptual framework presented in this article illustrates the importance of a continuum of rehabilitation provision across the injury trajectory, and provides a platform to track future service changes and facilitate the codesign of new rehabilitation interventions for individuals following major trauma. Keywords: group concept mapping; major trauma; rehabilitation; service evaluation.
Nursing	Bennett, R. J., Conway, N., Fletcher, S., & Barr, C.	2020	The role of the general practitioner in managing age-related hearing loss: perspecitives of general practitioners, patients and practice staff.	BMC Family Practice	https://doi.org/10.1186/s12875-020-01157-2	https://europepmc.org/backend/ptpmcrender.fcgi?accid=PMC7226944&blobtype=pdf	University of Melbourne	For people with hearing loss, the General Practitioner (GP) can play an instrumental role in early detection of hearing loss as well as guiding appropriate and timely choices for addressing hearing concerns. The aim of this study was to generate a conceptual framework for understanding the role of the GP in managing age-related hearing loss. Methods: Concept mapping techniques were used to gather the perspectives of GPs (n = 8), adults with hearing loss (n = 22), and professionals working with GPs (n = 5), in Australia. Participants generated statements describing the role of the GP in managing age-related hearing loss, and then grouped the statements to identify key themes, via an online portal. Results: Ninety-eight items describing the role of the GP in managing age-related hearing loss were identified across six concepts: 1) Determine - Diagnose - Discuss, 2) Ask - Assess - Act, 3) Know - Refer - Coordinate, 4) Inform - Advise - Partner, 5) Educate - Strategise - Encourage, 6) Reassure - Support - Empower. Conclusions: The role of the GP in managing age-related hearing loss is multifaceted and requires partnership that motivates and empowers patients' to overcome their hearing concerns. Enlisting the help of Practice Nurses, Practice Managers and local audiologists could help GPs improve their hearing loss detection and intervention rates.
Nursing	Nielsen, K. T., Rasmussen, M. U., Overgaard, A. F., Klokker, L., Christensen, R., & Waehrens, E. E.	2020	Identifying values and preferences around the choice of analgesia for patients with acute trauma pain in emergency and prehospital settings: Using group concept mapping methodology.	BMJ Open	https://doi.org/10.1136/bmjopen-2019-031863	https://bmjopen.bmj.com/content/bmjopen/10/3/e031863.full.pdf	University College of Northern Denmark	The main study aim was to examine the applicability of a novel method to assess the criterion of values and preferences within the Grading of Recommendation, Assessment, Development and Evaluation evidence to decision framework. The group concept mapping (GCM) approach was applied to identify, organise and prioritise values and preferences in the example of health professionals’ choice of analgesia for patients with acute trauma pain. Setting Prehospital and emergency care centres in the Nordic countries of Denmark, Norway, Sweden, Finland and Iceland. Participants Acute care health professionals with qualifications to administer analgesic agents to patients in emergency and prehospital settings, including advanced ambulance assistants, rescue officers, paramedics, emergency physicians and emergency nurses, participated in an online survey in which statements were generated (n=40) and structured (n=11) and finally analysed and interpreted in a validation meeting (n=4). Results Using GCM, ideas were generated and structured through online participation. Results were interpreted at a validation meeting. In total, 111 unique ideas were identified and organised into seven clusters: drug profile, administration, context, health professionals’ preferences and logistics, safety profile, patient’s medical history and acute clinical situation. Conclusions Based on GCM, a conceptual model was developed, and values and preferences around choice of analgesia in emergency care were revealed. Health professionals within acute care can apply the conceptual model to support their decision-making when choosing the best available treatment for pain for their patients in emergency care. http://creativecommons.org/licenses/by-nc/4.0/ This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Nursing	Petersson, P., Westergren, A., Edfors, E., & Hammarlund, C. S.	2022	Identifying important conceptual areas in a nursing education programme to meet future demands, using group concept mapping	Nurse Education Today	https://doi.org/10.1016/j.nedt.2022.105485	https://www.sciencedirect.com/science/article/pii/S0260691722002210	Kristianstad University	A nursing programme in southern Sweden was revised to meet future demands. The aim of this study was to explore important conceptual areas to be included in a nursing programme in order to meet long-term societal and health care requirements. Group concept mapping (GCM), a mixed-methods approach, was used. Thirty-four experienced teachers participated. Data was collected during brainstorming sessions in focus groups. Following editing and removal of duplicates, 101 statements remained to be sorted into piles that had similar conceptual representation in nursing education. The final step was then to rate each statement from 1 to 5 (higher values = more important/more feasible). Quantitative analysis using non-metric multidimensional scaling and hierarchical cluster analysis resulted in 11 clusters. Assessment and treatment and Person-centred care were rated as the most important and Scientific theories and methods, Basic caregiving in nursing and Person-centred care had the highest feasibility ratings. Further analyses suggested that the content of nursing education can be seen from a systems theory perspective, represented by the macro, meso, and micro levels. These levels may increase the understanding of the complexity of nursing care. Furthermore, the cluster analysis can facilitate the development of a concept-based curriculum for nursing education.
Nutrition & Food Research	Martin, W. & Wagner, L.	2018	How to grow a city: Cultivating an urban agriculture action plan through concept mapping.	Agriculture & Food Security	https://doi.org/10.1186/s40066-018-0186-0	https://agricultureandfoodsecurity.biomedcentral.com/track/pdf/10.1186/s40066-018-0186-0.pdf	University of Saskatchewan	Urban agriculture is a means to improve community health and reduce health inequities. It encourages civic participation in food system governance and offers citizens opportunities to explore concepts of food sovereignty within an urban setting. The objective of this study was to engage civic participation in developing an urban agriculture action plan for a Canadian prairie city. The purpose was to identify the short- and long-term goals and the barriers and facilitators to growing more food in the city. Results: Using a combination of The Concept System® Global MAX™ concept mapping and group discussions, 66 participants contributed to developing a plan to advance urban agriculture. Six concepts form the action plan. Growing more food within public spaces in order to make urban agriculture more visible and improving education strategies are two areas that participants ranked both important and feasible. Participants relayed that increased visibility could create a cultural shift to strengthen the local food knowledge. Conclusions: School engagement, community development, maximizing food production in public places, and attending to regulations and bylaws are focus areas for improving urban agriculture. An integrated vision from the city administration with a paid position to make connections, oversee bylaws, and consider local food procurement systems is necessary to advance a healthy community-based food system. A systems approach to building a resilient food system and strengthening food sovereignty will require political will and a public mandate
Nutrition & Food Research	Donaldson, A., Reimers, J. L., Brophy, K. T., Nicholson, M.	2018	Barriers to rejecting junk food sponsorship in sport - A formative evaluation using concept mapping.	Public Health	https://doi.org/10.1016/j.puhe.2018.09.021		La Trobe University	Objectives: Energy-dense, nutrient-poor food and drink ('junk food') brands sponsoring sport is a growing public health concern. This study explored sports administrators' perceptions of the barriers to rejecting junk food sponsorship. Study design: This study used concept mapping. Methods: The Concept Systems Global MAX™ web platform was used to collect and analyse data from 29 sports administrators across all levels of sport in Victoria, Australia. Results: Brainstorming generated 33 barriers to rejecting junk food sponsorship. After the barriers were synthesised and edited, participants sorted and rated 32 barriers. Multidimensional scaling and hierarchical cluster analysis identified a four-cluster solution: community attitudes and values (seven barriers); junk food is the easy sell (retail; five barriers); financial viability (16 barriers); and organisational capability (policy and governance; four barriers). The financial viability barriers were rated the most important (mean = 3.65 of 5) and the hardest to overcome (1.42). The organisational capability (policy and governance) barriers were rated the least important (2.14) and the easiest to overcome (3.20). Conclusions: Sports administrators clearly perceive that rejecting junk food sponsorship could place significant financial strain on their organisations. There appears to be considerable scope to build the capacity of sporting organisations to rejecting junk food sponsorship. Despite the literature indicating that most parents think junk food companies are not suitable sponsors, sports administrators perceive that there is a broad public acceptance of junk food sponsorship in sport. The fact that sports administrators perceive a link between junk food sponsorship and the lack of healthy options at club canteens and venue food outlets adds an additional, not previously identified, level of complexity to the junk food sponsorship in sport debate.
Nutrition & Food Research	Westergren, A., Edfors, E., Norberg, E., Studdenforff, A., Hedin, G., Wetterstrand, M., Rosas, S. R., & Hagell, P.	2018	Computer-based training in eating and nutrition facilitates person-centered hospital care: A group concept mapping study.	Computer informatics Nursing	https://doi.org/10.1097/CIN.0000000000000416		Kristianstad University	Studies have shown that computer-based training in eating and nutrition for hospital nursing staff increased the likelihood that patients at risk of undernutrition would receive nutritional interventions. This article seeks to provide understanding from the perspective of nursing staff of conceptually important areas for computer-based nutritional training, and their relative importance to nutritional care, following completion of the training. Group concept mapping, an integrated qualitative and quantitative methodology, was used to conceptualize important factors relating to the training experiences through four focus groups (n = 43), statement sorting (n = 38), and importance rating (n = 32), followed by multidimensional scaling and cluster analysis. Sorting of 38 statements yielded four clusters. These clusters (number of statements) were as follows: personal competence and development (10), practice close care development (10), patient safety (9), and awareness about the nutrition care process (9). First and second clusters represented "the learning organization," and third and fourth represented "quality improvement." These findings provide a conceptual basis for understanding the importance of training in eating and nutrition, which contributes to a learning organization and quality improvement, and can be linked to and facilitates person-centered nutritional care and patient safety.
Nutrition & Food Research	Sampson, N. R., Price, C. E., Reppond, H. A., DeRoche, M., & Thomas-Brown, K.	2019	Feminist action research in response to food insecurity among college students.	Action Research	https://doi.org/10.1177/1476750320905893		University of Michigan-Dearborn	Feminist action research can instigate community, organizational, and policy changes to address social issues. We describe how we considered inclusion, participation, action, social change, and researcher reflexivity, as well as researcher positionality, in design and implementation of the 2016 Michigan College Campuses Food Pantry Summit. Specifically, in this case study, we describe ways we used these principles to plan this event around concept mapping, an interactive, collaborative research approach. Our event led to the formation of a regional community of practitioners, enabled an exchange of institutional best practices among campus pantries, and informed federal policy on food access for college students.
Nutrition & Food Research	Visek, A. J., Blake, E. F., Otterbein, M., Chandran, A., & Sylvetsky, A. C.	2019	SWEET MAPS: A conceptualization of low-calorie sweetener consumption among young adults.	Current Developments in Nutrition	https://doi.org/10.1093/cdn/nzy103	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6437264/pdf/nzy103.pdf	George Washington University	Background: The extent to which low-calorie sweeteners (LCSs) are helpful or harmful for weight management and metabolic health is unclear, because LCS effects may depend on the context in which they are consumed. Objective To develop a conceptual framework for LCS consumption. Methods: Young adults ages 18–35 y, who reported LCS consumption, were recruited from a private, urban, university in the mid-Atlantic United States. Concept mapping, a mixed-method approach was used to identify, organize, and quantify determinants of LCS consumption. First, participants (n = 68) identified reasons for their LCS consumption through brainstorming; content analysis of those reasons identified 37 specific determinants of LCS consumption. Second, participants (n = 93) sorted all 37 determinants conceptually. Third, participants (n = 97) rated the extent to which each of the 37 determinants was reflective of their own consumption. Similarity matrices, multidimensional scaling, and hierarchical cluster analysis produced a series of 2-dimensional concept maps (SWEET MAPS). Results: The SWEET MAPS identified 37 determinants, organized within 8 factors reflective of 3 overarching motives: perceived health benefits, palatability, and accessibility of LCSs. At the determinant level, the most highly rated determinants that exceeded the boundary (rating >3.0) were: “I want something that tastes sweet,” “I am trying to maintain/control my weight,” “They contain fewer calories,” “They are available,” and “I want to save calories because I am eating a high-calorie meal.” Conclusions: LCS consumption is a function of many inter-related determinants spanning biological, psychological, and social domains. The SWEET MAPS are an important and novel use of concept mapping methods that can be used to inform the design and interpretation of future studies evaluating LCS effects.
Nutrition & Food Research	Halberg, S. E., Visek, A. J., Blake, E. F., Essel, K. D., Sacheck, J., & Sylvetsky, A. C.	2021	SODA MAPS: A Framework for Understanding Caffeinated Sugary Drink Consumption Among Children.	Frontiers in Nutrition	https://doi.org/10.3389/fnut.2021.640531	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7988216/pdf/fnut-08-640531.pdf	George Washington University	Excess sugary drink (SD) consumption is associated with childhood obesity and development of cardiometabolic disease. In addition to having high added sugar content, many SDs also contain caffeine, which may further encourage excess SD consumption among children. The objective of this study was to develop a conceptual framework of children's caffeinated SD consumption using group concept mapping, an applied social research multimethodology that collectively harnesses qualitative and quantitative data from participants to generate a visual representation of their ideas and input. Children, 8–14 years old, who reported consuming ≥12 ounces of caffeinated SDs (e.g., sodas, sweet teas) per day were recruited throughout Washington, D.C. and invited to participate. Concept mapping included three participant-driven activities: (1) brainstorming (n = 51), during which children reported reasons for their SD consumption, from which 58 unique reasons were identified; (2) sorting (n = 70), during which children sorted each of the reported reasons into categories and named each category; and (3) rating (n = 74), during which children rated the influence of each reason on their own caffeinated SD consumption. Similarity matrices, multidimensional scaling, and hierarchical cluster analysis were used to generate concept maps (hereafter “SODA MAPS”), which display the 58 reasons organized within eight overarching clusters. Among these eight clusters, Taste and Feel, Something to Do, and Energy were rated as particularly influential. Children's caffeinated SD consumption is encouraged not only by the palatable taste and reported preferences for these beverages (e.g., Taste and Feel), but also by psychological (e.g., Mood and Focus), biological (e.g., Energy), social (e.g., Something to Do) and environmental reasons (e.g., Nothing Better Available). Thus, the SODA MAPS can inform the development of tailored, multi-level SD reduction interventions that incorporate strategies to address important and currently overlooked reasons for caffeinated SD consumption among children.
Nutrition & Physical Activity	Walker, R. E., Fryer, C. S., Butler, J., Keane, C. R., Kriska, A., & Burke, J. G.	2011	Factors influencing food buying practices in residents of a low-income food desert and a low-income food oasis.	Journal of Mixed Methods Research	https://doi.org/10.1177/1558689811412971	https://www.researchgate.net/profile/James-Butler-Iii/publication/235435817_Factors_Influencing_Food_Buying_Practices_in_Residents_of_a_Low-Income_Food_Desert_and_a_Low-Income_Food_Oasis/links/557b15bc08ae26eada8afd1d/Factors-Influencing-Food-Buying-Practices-in-Residents-of-a-Low-Income-Food-Desert-and-a-Low-Income-Food-Oasis.pdf?origin=publication_detail	University of Pittsburgh	Studies suggest that proximity to a supermarket influences access to healthy foods. However, little is known about factors that influence food buying practices within areas with limited supermarket access. This study identified these factors and explored how they are related and influence healthy eating. Twenty-five men and women engaged in the concept mapping process, a mixed methods approach allowing participants to identify, sort, and rate ideas. Participants generated 121 unique (nonduplicate) statements of factors that influence food buying practices and sorted them into 12 clusters that represented their perceptions. Average cluster ratings for residents with poor supermarket access were higher than residents with supermarket access. Awareness of these factors is important for increasing access to and consumption of healthy foods.
Nutrition & Physical Activity	Walker, R. E., Block, J., & Kawachi, I.	2012	Do residents of food deserts express different food buying preferences compared to residents of food oases? A mixed-methods analysis.	International Journal of Behavioral Nutrition and Physical Activity	https://doi.org/10.1186/1479-5868-9-41	https://ijbnpa.biomedcentral.com/track/pdf/10.1186/1479-5868-9-41.pdf	Harvard School of Public Health	Background: Many people lack access to food stores that provide healthful food. Neighborhoods with poor supermarket access have been characterized as “food deserts” (as contrast with “food oases”). This study explored factors influencing food buying practices among residents of food deserts versus food oases in the city of Boston, USA. Methods We used the mixed-methods approach of concept mapping, which allows participants to identify, list, and organize their perceptions according to importance. Resulting maps visually illustrate priority areas. Results Sixty-seven low-income adults completed the concept mapping process that identified 163 unique statements (e.g. relating to affordability, taste, and convenience) that influence food buying practices. Multivariate statistical techniques grouped the 163 statements into 8 clusters or concepts. Results showed that average cluster ratings and rankings were similar between residents of food deserts and food oases. Conclusions The implication of this study pertains to the importance of community resources and emergency food assistance programs that have served to minimize the burden associated with hunger and poor food access among low-income, urban populations.
Nutrition & Physical Activity	Hanson, H. M., Schiller, C., Winters, M., Sims-Gould, J., Clarke, P. Curran, E., Donaldson, M. G., Pitman, B., Scott, V., McKay, H. A., & Ashe, M. C.	2013	Concept mapping applied to the intersection between older adults' outdoor walking and the built and social environments.	Preventive Medicine	https://doi.org/10.1016/j.ypmed.2013.08.023	https://www.sciencedirect.com/science/article/pii/S0091743513003150/pdfft?md5=828f98f9aad5677926122d974bc049fc&pid=1-s2.0-S0091743513003150-main.pdf	University of British Columbia	Objective: For older adults, the ability to navigate walking routes in the outdoor environment allows them to remain active and socially engaged, facilitating community participation and independence. In order to enhance outdoor walking, it is important to understand the interaction of older adults within their local environments and the influence of broader stakeholder priorities that impact these environments. Thus, we aimed to synthesize perspectives from stakeholders to identify elements of the built and social environments that influence older adults' ability to walk outdoors. Method We applied a concept mapping approach with the input of diverse stakeholders (N = 75) from British Columbia, Canada in 2012. Results: A seven-cluster map best represented areas that influence older adults' outdoor walking. Priority areas identified included sidewalks, crosswalks, and neighborhood features. Conclusion Individual perceptions and elements of the built and social environments intersect to influence walking behaviors, although targeted studies that address this area are needed.
Nutrition & Physical Activity	Elliott, E., Jones, E., & Bulger, S.	2014	Active WV: A systematic approach to developing a physical activity plan for West Virginia.	Journal of Physical Activity & Health	https://doi.org/10.1123/jpah.2013-0083	https://www.researchgate.net/profile/Sean-Bulger/publication/261515639_ActiveWV_A_Systematic_Approach_to_Developing_a_Physical_Activity_Plan_for_West_Virginia/links/56020ef408ae42bbd541f659/ActiveWV-A-Systematic-Approach-to-Developing-a-Physical-Activity-Plan-for-West-Virginia.pdf?origin=publication_detail	West Virginia University	Modeled after the National Physical Activity Plan (NPAP), ActiveWV 2015: The West Virginia Physical Activity Plan was developed to provide strategic direction for physical activity promotion within the state. The purpose of this manuscript is to describe the systematic approach taken in developing ActiveWV. Method: Plan development began with establishing capacity and leadership among key stakeholders representing all societal sectors. A multiphase, statewide decision-making process allowed for input across sectors and geographic regions. The process results identified five priority areas that served as the conceptual framework for ActiveWV. Sector teams, comprised of key organization stakeholders across the eight sectors, finalized the sector-specific strategies and tactics using the NPAP evidence-based recommendations, results from a formalized strategic process, and the teams' expertise and experience. Results: ActiveWV was officially released on January 19, 2012 at the State Capitol in Charleston, West Virginia. Community events throughout the state surrounded the release and celebrated West Virginia Physical Activity Day. Ongoing implementation and dissemination efforts are underway at state and local levels. Conclusions: As the NPAP calls for states and communities to develop plans that meet the needs of their particular context, other states may find the lessons learned from West Virginia helpful in the development process.
Nutrition & Physical Activity	Bergeron, K. & Levesque, L.	2014	Designing active communities: A coordinated action framework for planners and public health professionals.	Journal of Physical Activity & Health	https://doi.org/10.1123/jpah.2012-0178		Queen’s University	Community design can have a positive or negative influence on the physical activity level of residents. The complementary expertise of professionals from both planning and public health is needed to build active communities. The current study aimed to develop a coordinated framework for planners and public health professionals to enhance the design of active communities. Methods: Planners and public health professionals working in Ontario, Canada were recruited to participate in a concept mapping process to identify ways they should work together to enhance the design of active communities. Results: This process generated 72 actions that represent collaborative efforts planners and public health professionals should engage in when designing active communities. These actions were then organized by importance and feasibility. This resulted in a coordinated action framework that includes 19 proximal and 6 distal coordinated actions for planners and public health professionals. Conclusion: Implementation of the recommended actions has the potential to make a difference in community design as a way to enhance physical activity in community members. This Coordinated Action Framework provides a way to address physical inactivity from an environmental and policy standpoint.
Nutrition & Physical Activity	Dulin-Keita, A., Clay, O., Whittaker, S., Hannon, L., Adams, I. K., Rogers, M., & Gans, K.	2015	The influence of HOPE VI neighborhood revitalization on neighborhood-based physical activity: A mixed-methods approach.	Social Science & Medicine	https://doi.org/10.1016/j.socscimed.2015.06.002		University of Alabama at Birmingham	Objectives: This study uses a mixed methods approach to 1) identify surrounding residents' perceived expectations for Housing Opportunities for People Everywhere (HOPE VI) policy on physical activity outcomes and to 2) quantitatively examine the odds of neighborhood-based physical activity pre-/post-HOPE VI in a low socioeconomic status, predominantly African American community in Birmingham, Alabama. Methods: To address aim one, we used group concept mapping which is a structured approach for data collection and analyses that produces pictures/maps of ideas. Fifty-eight residents developed statements about potential influences of HOPE VI on neighborhood-based physical activity. In the quantitative study, we examined whether these potential influences increased the odds of neighborhood walking/jogging. We computed block entry logistic regression models with a larger cohort of residents at baseline (n = 184) and six-months (n = 142, 77% retention; n = 120 for all informative variables). We examined perceived neighborhood disorder (perceived neighborhood disorder scale), walkability and aesthetics (Neighborhood Environment Walkability Scale) and HOPE VI-related community safety and safety for physical activity as predictors. Results: During concept mapping, residents generated statements that clustered into three distinct concepts, "Increased Leisure Physical Activity," "Safe Play Areas," and "Generating Health Promoting Resources." The quantitative analyses indicated that changes in neighborhood walkability increased the odds of neighborhood-based physical activity (p = 0.04). When HOPE VI-related safety for physical activity was entered into the model, it was associated with increased odds of physical activity (p = 0.04). Walkability was no longer statistically significant. Conclusions: These results suggest that housing policies that create walkable neighborhoods and that improve perceptions of safety for physical activity may increase neighborhood-based physical activity. However, the longer term impacts of neighborhood-level policies on physical activity require more longitudinal evidence to determine whether increased participation in physical activity is sustained.
Nutrition & Physical Activity	Ruud, M. P., Raanaas, R. K., & Bjelland, M.	2016	Caregivers' perception of factors associated with a healthy diet among people with intellectual disability living in community residences: A concept mapping method.	Research in Developmental Disabilities	https://doi.org/10.1016/j.ridd.2016.09.006		Norwegian University of Life Science	Background: Many people with intellectual disabilities (ID) living in community-based residences have been found to have unhealthy diet and weight disturbances. In Norway, a majority of people with ID live in such residences. Aims: The aim of the study was to examine factors affecting the caregivers' opportunity to promote a healthy diet among the residents. Methods and procedures: A concept mapping methodology was adopted, including group-based brainstorming, idea synthesising, sorting, rating and analysis of the results. Informants were caregivers in four different community residences for people with mild to moderate ID in the southeast of Norway. A total of 13 informants were recruited (12 females and 1 male), and 10 informants completed two sessions. Results: Eight clusters were identified as affecting the caregivers' ability to promote a healthy diet: "Availability and accessibility", "Guidance and autonomy", "Competence among staff", "Planning and involvement", "Customization", "External conditions affecting staff", "Legislation, rules and structure" and "Everyday challenges", each including both barriers and facilitators. Conclusions and implications: Multiple factors affect the caregivers' ability to promote a healthy diet. Caregivers' opportunity to promote a healthy diet is complex. Availability and accessibility of healthy food is crucial, but a healthy diet also requires time and competence among the caregivers. Keywords: Care workers; Deinstitutionalization; Developmental disability; Health promotion; Life style; Nutrition.
Nutrition & Physical Activity	Dulin-Keita, A., Whittaker, S., Wynter, J., Kidanu, T. W., Chhay, C., Cardel, M. & Gans, K.	2016	Applying concept mapping methodology to identify the perceived risk and protective factors for childhood obesity among Southeast Asians.	Journal of Health Care for the Poor and Underserved	https://doi.org/10.1353/hpu.2016.0171	https://webcache.googleusercontent.com/search?q=cache:MlVfV9YBTe4J:https://chip.uconn.edu/wp-content/uploads/sites/1245/2019/05/Dulin-Keita-et-al-2016-Concept-Mapping.pdf	Johns Hopkins University	This study identifies Southeast Asian refugee parents' and grandparents' perceptions of the risk and protective factors for childhood obesity. Methods: We used a mixed methods approach (concept mapping) for data collection and analyses. Fifty-nine participants engaged in modified nominal group meetings where they generated statements about children's weight status and structuring meetings where they sorted statements into piles based on similarity and rated statements on relative importance. The Concept System® Global MAX™ software generated clusters of ideas, cluster ratings, and pattern matches. Results: Eleven clusters emerged. Participants rated "Healthy Food Changes Made within the School" and "Parent-related Physical Activity Factors" as most important, whereas "Neighborhood Built Features" was rated as the least important. Cambodian and Hmong participants agreed the most on cluster ratings of relative importance (r = 0.62). Conclusion: The study findings may be used to inform the development of culturally appropriate obesity prevention interventions for Southeast Asian refugee communities.
Nutrition & Physical Activity	Dulin-Keita, A., Hannon, L., Buys, D., Casazza, K., & Clay, O. J.	2016	Surrounding community residents' expectations of HOPE VI for their community, health and physical activity.	Journal of Community Practice	https://doi.org/10.1080/10705422.2015.1129005	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5029852/pdf/nihms-779588.pdf	Brown University	Using a community-engaged participatory research approach, this study identified surrounding community residents' expectations for how a HOPE VI housing initiative might affect their community and individual health and physical activity. Fifty-nine women and men engaged in concept mapping, which is a mixed methods approach, where participants generate, sort, and rate ideas. Participants generated 197 unique statements. Thirteen thematic clusters related to expected changes for the community, health and physical activity emerged. Residents' rated 'Increased Pride in the Neighborhood' and 'Increased Safety' as the most important factors related to HOPE VI whereas 'Drawbacks of HOPE VI' was rated as least important. This research provides insight into the potential impacts of housing initiatives from the perspective of those most affected by such initiatives. The findings also highlight environmental changes as potential mechanisms that may improve residents' perceptions of the community and encourage healthy lifestyles. Keywords: African American; community engaged research; concept mapping; housing policy; mixed-methods.
Nutrition & Physical Activity	Masse, L. C., O'Connor, T. M., Tu, A. W., Hughes, S. O., Beauchamp, M. R., Baranowski, T., & Physical Activity Parenting Expert Group	2017	Conceptualizing physical activity parenting practices using expert informed concept mapping analysis.	BMC public health	https://doi.org/10.1186/s12889-017-4487-1	https://bmcpublichealth.biomedcentral.com/track/pdf/10.1186/s12889-017-4487-1.pdf	University of British Columbia	Parents are widely recognized as playing a central role in the development of child behaviors such as physical activity. As there is little agreement as to the dimensions of physical activity-related parenting practices that should be measured or how they should be operationalized, this study engaged experts to develop an integrated conceptual framework for assessing parenting practices that influence multiple aspects of 5 to 12 year old children’s participation in physical activity. The ultimate goal of this study is to inform the development of an item bank (repository of calibrated items) aimed at measuring physical activity parenting practices. Methods Twenty four experts from 6 countries (Australia, Canada, England, Scotland, the Netherlands, & United States (US)) sorted 77 physical activity parenting practice concepts identified from our previously published synthesis of the literature (74 measures) and survey of Canadian and US parents. Concept Mapping software was used to conduct the multi-dimensional scaling (MDS) analysis and a cluster analysis of the MDS solution of the Expert’s sorting which was qualitatively reviewed and commented on by the Experts. Results The conceptual framework includes 12 constructs which are presented using three main domains of parenting practices (neglect/control, autonomy support, and structure). The neglect/control domain includes two constructs: permissive and pressuring parenting practices. The autonomy supportive domain includes four constructs: encouragement, guided choice, involvement in child physical activities, and praises/rewards for their child’s physical activity. Finally, the structure domain includes six constructs: co-participation, expectations, facilitation, modeling, monitoring, and restricting physical activity for safety or academic concerns. Conclusion The concept mapping analysis provided a useful process to engage experts in re-conceptualizing physical activity parenting practices and identified key constructs to include in measures of physical activity parenting. While the constructs identified ought to be included in measures of physical activity parenting practices, it will be important to collect data among parents to further validate the content of these constructs. In conclusion, the method provided a roadmap for developing an item bank that captures key facets of physical activity parenting and ultimately serves to standardize how we operationalize measures of physical activity parenting.
Nutrition & Physical Activity	Stankov, I., Howard, N. J., Daniel, M., & Cargo, M.	2017	Policy, research and residents' perspectives on built environments implicated in heart disease: A concept mapping approach.	International Journal of Environmental Research and Public Health	https://doi.org/10.3390/ijerph14020170	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5334724/pdf/ijerph-14-00170.pdf	Drexel University	An underrepresentation of stakeholder perspectives within urban health research arguably limits our understanding of what is a multi-dimensional and complex relationship between the built environment and health. By engaging a wide range of stakeholders using a participatory concept mapping approach, this study aimed to achieve a more holistic and nuanced understanding of the built environments shaping disease risk, specifically cardiometabolic risk (CMR). Moreover, this study aimed to ascertain the importance and changeability of identified environments through government action. Through the concept mapping process, community members, researchers, government and non-government stakeholders collectively identified eleven clusters encompassing 102 built environmental domains related to CMR, a number of which are underrepresented within the literature. Among the identified built environments, open space, public transportation and pedestrian environments were highlighted as key targets for policy intervention. Whilst there was substantive convergence in stakeholder groups’ perspectives concerning the built environment and CMR, there were disparities in the level of importance government stakeholders and community members respectively assigned to pedestrian environments and street connectivity. These findings support the role of participatory methods in strengthening how urban health issues are understood and in affording novel insights into points of action for public health and policy intervention.
Nutrition & Physical Activity	O'Connor, T. M., Masse, L.C., Tu, A. W., Watts, A. W., Hughes, S. O., Beaucramp, M. R., Baranowski, T., Pham, T., Berge, J. M., Fiese, B., Golley, R. K., Hingle, M., Kremers, S. P. J., Rhee, K. E., Skouteris, J. H., & Vaughn, A.	2017	Food parenting practices for 5 to 12 year old children: A concept map analysis of parenting and nutrition experts input.	International Journal of Behavioral Nutrition and Physical Activity	https://doi.org/10.1186/s12966-017-0572-1	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5594481/pdf/12966_2017_Article_572.pdf	Baylor College of Medicine	Background: Parents are an important influence on children's dietary intake and eating behaviors. However, the lack of a conceptual framework and inconsistent assessment of food parenting practices limits our understanding of which food parenting practices are most influential on children. The aim of this study was to develop a food parenting practice conceptual framework using systematic approaches of literature reviews and expert input. Method: A previously completed systematic review of food parenting practice instruments and a qualitative study of parents informed the development of a food parenting practice item bank consisting of 3632 food parenting practice items. The original item bank was further reduced to 110 key food parenting concepts using binning and winnowing techniques. A panel of 32 experts in parenting and nutrition were invited to sort the food parenting practice concepts into categories that reflected their perceptions of a food parenting practice conceptual framework. Multi-dimensional scaling produced a point map of the sorted concepts and hierarchical cluster analysis identified potential solutions. Subjective modifications were used to identify two potential solutions, with additional feedback from the expert panel requested. Results: The experts came from 8 countries and 25 participated in the sorting and 23 provided additional feedback. A parsimonious and a comprehensive concept map were developed based on the clustering of the food parenting practice constructs. The parsimonious concept map contained 7 constructs, while the comprehensive concept map contained 17 constructs and was informed by a previously published content map for food parenting practices. Most of the experts (52%) preferred the comprehensive concept map, while 35% preferred to present both solutions. Conclusion: The comprehensive food parenting practice conceptual map will provide the basis for developing a calibrated Item Response Modeling (IRM) item bank that can be used with computerized adaptive testing. Such an item bank will allow for more consistency in measuring food parenting practices across studies to better assess the impact of food parenting practices on child outcomes and the effect of interventions that target parents as agents of change. Keywords: Child; Concept mapping; Family; Food; Measurement; Nutrition; Parenting; Parenting practices.
Nutrition & Physical Activity	Mulderij, L. S., Verkooijen, K. T., Koelen, M. A., & Wagemakers, A.	2019	De werkzame elementen van een gecombineerde leefstijlinterventie voor mensen met een lage sociaaleconomische status. Een concept mapping-caseonderzoek. [The active elements of a combined lifestyle intervention for people with a low socio-economic status. A concept mapping case study.]	TSG - Tijdschrift voor gezondheidswetenschappen	https://doi.org/10.1007/s12508-019-00243-w	https://link.springer.com/content/pdf/10.1007/s12508-019-00243-w.pdf	Wageningen University	Health inequalities still exist between people with a low socioeconomic status (SES) and people with a high SES. Combined lifestyle interventions (CLIs) could benefit the health of people with a low SES. However, it is unclear which CLI elements are effective for this group. Therefore, this study aimed to determine the effective elements X‑Fittt 2.0, a CLI for people with a low SES. Nine professionals and one participant of X‑Fittt 2.0 participated in a concept mapping (CM) process to develop an overview of the effective elements of X‑Fittt 2.0. CM consists of six steps: preparing, brainstorming, clustering, scoring, analysing, and discussing and interpreting. This process resulted in 72 effective elements, grouped in nine clusters, focused on monitoring (12), internal (7) and external (4) collaborations, structure and guidance (10), agreements with participants (5), sports options in the first 12 weeks (10), the sports environment (10), recruitment strategies (5) and the preconditions for X‑Fittt 2.0 (9). These results provide a valuable first overview of effective elements of CLIs for people with a low SES.
Nutrition & Physical Activity	Vlot-van Anrooij, K., Naaldenberg, J., Hilgenkamp, T. I. M., Vaandrager, K., van der Velden, & Leusink, G. L.	2019	Towards healthy settings for people with intellectual disabilities.	Health Promotion International	https://doi.org/10.1093/heapro/daz054	https://onlinelibrary.wiley.com/doi/epdf/10.1111/jar.12776	Radboud University	Background: People with intellectual disabilities (ID) depend on their environment to live healthily. Asset-based health promotion enhances a settings’ health-promoting capacity starting with identifying protective or promotive factors that sustain health. Method: This inclusive mixed-methods study used group sessions to generate and rank ideas on assets supporting healthy nutrition and physical activity in Dutch intellectual disability care settings. Participants included people with moderate intellectual disabilities and family and care professionals of people with severe/profound intellectual disabilities. Results Fifty-one participants identified 185 assets in group sessions. They include the following: (i) the social network and ways “people” can support, (ii) assets in/around “places,” and person–environment fit, and (iii) “preconditions”: health care, prevention, budget, and policy. Conclusion: This inclusive research provides a user perspective on assets in the living environment supporting healthy living. This gives insight in contextual factors needed for development and sustainable embedment of health promotion in the systems of intellectual disability support settings.
Nutrition & Physical Activity	Strassheim, V., Deary, V., Webster, D. A., Douglas, J., Newton, J. L., & Hackett, K. L.	2019	Conceptualizing the benefits of a group exercise program developed for those with chronic fatigue: A mixed methods clinical evaluation.	Disability and Rehabilitation	https://doi.org/10.1080/09638288.2019.1636315		NHS Foundation Trust	Purpose: Fatigue is a disabling and prevalent feature of many long-term conditions. Orthostatic dizziness is a commonly experienced by those with fatigue. The purpose was; to evaluate factors contributing to successful delivery of a novel group exercise program designed for people with chronic fatigue and orthostatic symptoms and identify targets to improve future program content and delivery. Research methods: We used group concept mapping methodology. Participants of the exercise program with a long-term physical health condition and chronic fatigue- contributed ideas in response to a focus question. They sorted these ideas into themed piles and rated them for importance and success of the program delivery. Multidimensional scaling and cluster analysis were applied to the sort data to produce ideas clusters within a concept map. Value ratings were compared to evaluate the success of the program. Results: The resulting concept map depicted seven key themed clusters of ideas: Exercises, Group atmosphere, Physical benefits, Self-management of symptoms, Acceptance and Education. Value plots of the rating data identified important and successful conceptual ideas. Conclusions: The concept maps have depicted key concepts relating to the successful delivery of a novel exercise program for people with fatigue and identified specific targets for future program enhancements. Implications for rehabilitation Orthostatic symptoms are common in those with fatigue and might be a target for group-based exercise programs. People with fatigue value a group-based exercise program that targets orthostatic symptoms. The key concepts of a group-based exercise program valued by those with fatigue are the exercises, group atmosphere, physical benefits, self-management support, acceptance, education and support with looking forwards following the program.
Nutrition & Physical Activity	Staley, K. Donaldson, A., Randle, E., Nicholson, M., O'Halloran, P., Nelson, R., & Cameron, M.	2019	Challenges for sport organisations developing and delivering non-traditional social sport products for insufficiently active populations.	Australian and New Zealand Journal of Public Health	https://doi.org/10.1111/1753-6405.12912	https://onlinelibrary.wiley.com/doi/epdf/10.1111/1753-6405.12912	La Trobe University	Objectives: To explore the challenges that Victorian sporting organisations experience when developing, delivering or scaling non-traditional social sport products to engage insufficiently active people. Methods: Online Concept Mapping was used to gather qualitative data and analyse it quantitatively. Results: A total of 68 participants (27 organisations) brainstormed 158 challenges. The research team synthesised these to 71 unique challenges for participants to sort into groups and rate for importance (0-5) and ease of overcoming (0-5). A nine-cluster solution - Deliverers; Capacity to drive the product; Facilities and partnerships; Product development; Sustainable business model; Marketing to insufficiently active; Attracting the insufficiently active; Clubs and volunteers; and Shifting traditional sport culture - was considered most appropriate. Participants rated the Deliverers challenges as the most important (mean=3.52), and the Marketing to insufficiently active challenges as the easiest to overcome (2.72). Conclusions: Key ingredients to successfully developing and delivering non-traditional sport opportunities for insufficiently active populations are: recruiting appropriate product deliverers; building the capacity of delivery organisations and systems; and developing products relevant to the delivery context that align with the needs and characteristics of the target population. Implications for public health: A system-wide response is required to address the challenges associated with sport organisations developing, scaling and delivering innovative social sport products for insufficiently active populations.
Nutrition & Physical Activity	Bruder, A. M., Crossley, K. M., Mosler, A. B., Patterson, B., Haberfield, M., & Donaldson, A.	2019	Co-creation of a sport-specific anterior cruciate ligament injury risk reduction program for women: A Concept Mapping approach.	Journal of Science and Medicine in Sport	https://doi.org/10.1016/j.jsams.2019.10.019		La Trobe University	Objectives: To engage physiotherapists experienced in female elite sport and athletes to co-create a sport-specific anterior cruciate ligament (ACL) injury risk reduction program. Design: Concept Mapping. Methods: The Concept System® Global MAX™ web platform was used to collect and analyse data from 27 context and content experts (22 physiotherapists, 5 athletes). Participants brainstormed statements representing the critical elements that should be included in an ACL injury risk reduction program for women playing elite Australian Football (AF). Results: Twenty-two participants brainstormed 56 statements that were synthesised and edited to 62 statements. Statements were sorted into clusters by twenty-three participants and rated on importance and feasibility using six-point scales. Multidimensional scaling and cluster analysis identified a 5-cluster solution as follows: Football-specific preparation (15 statements); Movement skills (17 statements); Strength and conditioning (15 statements); Individual preparation (7 statements); and Education (8 statements). Calculation of mean ratings for each cluster and statement identified the Movement skills cluster as most important (mean=3.61 out of 5) and the Football-specific preparation cluster as most feasible (3.75 out of 5). By contrast, the Individual preparation cluster was rated the least important (mean=2.9 out of 5), and the least feasible (3.12 out of 5), to include in the program. Conclusions: The five clusters of critical elements to include in an ACL injury risk reduction program for women playing elite AF, in order of most to least importance were: movement skills, football-specific preparation, education, strength and conditioning and individual preparation. Keywords: Athlete; Co-create; End-user; Knee injuries; Prevention and control; Sports.
Nutrition & Physical Activity	Visek, A. J., Mannix, H., Chandran, A., Cleary, S. D., McDonnell, K. A., & DiPietro, L.	2019	Toward Understanding Youth Athletes' Fun Priorities: An Investigation of Sex, Age and Levels of Play.	Human Kinetics Journal	https://doi.org/10.1123/wspaj.2018-0004	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8152670/pdf/nihms-1059321.pdf	George Washington University	Colloquial conjecture asserts perceptions of difference in what is more or less important to youth athletes based on binary categorization, such as sex (girls vs. boys), age (younger vs. older), and level of competitive play (recreational vs. travel). The fun integration theory’s FUN MAPS, which identify 11 fun-factors comprised of 81 fun-determinants, offers a robust framework from which to test these conceptions related to fun. Therefore, the purposes of this study were to scientifically explore: (a) the extent to which soccer players’ prioritization of the 11 fun-factors and 81 fun-determinants were consistent with the gender differences hypothesis or the gender similarities hypothesis, and (b) how their fun priorities evolved as a function of their age and level of play. Players’ (n = 141) data were selected from the larger database that originally informed the conceptualization of the fun integration theory’s FUN MAPS. Following selection, innovative pattern match displays and go-zone displays were produced to identify discrete points of consensus and discordance between groups. Regardless of sex, age, or level of play, results indicated extraordinarily high consensus among the players’ reported importance of the fun-factors (r = .90–.97) and fun-determinants (r = .92–.93), which were consistently grouped within strata of primary, secondary, and tertiary importance. Overall, results were consistent with the gender similarities hypothesis, thereby providing the first data to dispel common conceptions about what is most fun with respect to sex, in addition to age and level of play, in a sample of youth soccer players. Keywords: concept mapping, enjoyment, fun integration theory, FUN MAPS, youth development
Nutrition & Physical Activity	D'Alonzo, K. T., Vilaró, F. M., Joseph, M. E., Oyeneye, V., Garsman, L., Rosas, S. R., Castañeda, M., & Vivar, M.	2020	Using Concept Mapping within A Community-Academic Partnership to Examine Obesity among Mexican Immigrants.	Progress in Community Health Partnerships: Research, Education, and Action,	https://doi.org/10.1353/cpr.2020.0016	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7787540/pdf/nihms-1602749.pdf	Rutgers University	Weight gain is common following migration to a new country. Mexican immigrants have a disparate prevalence of overweight/obesity and food insecurity. Social stressors, such as unemployment, discrimination, and the threat of deportation, may fuel both food insecurity and weight gain in this population. Objectives: We sought to (1) examine community-defined causes and correlates of obesity among Mexican-Americans; (2) determine how current social stressors, policies, and programs impact food insecurity and obesity; and (3) identify community-defined priorities for preventive interventions. Methods: Group concept mapping (GCM) was used in a community-academic partnership (CAP) to describe the factors contributing to weight gain and obesity among Mexican immigrant families. Activities included community brainstorming, sorting and rating, multivariate statistical analysis, and community interpretation of results. Results: Eighty statements were generated in the brainstorming sessions. These statements were sorted into nine clusters, which were organized into three regions: (1) intrapersonal factors; (2) community-level factors; and (3) social policy-related barriers. Statements reflecting the impact of immigration-related stressors were found in all three regions, addressing participants' fears of deportation, and the prioritization of resources away from healthy eating, resulting in food insecurity. Community members identified five priority areas for intervention planning: (1) lack of exercise; (2) lack of knowledge of a healthy diet; (3) expense of healthy foods; (4) "junk" food; and (5) stress management. Conclusions: Results suggest high levels of social stress are contributing to food insecurity and obesity among Mexican immigrant families. Areas identified for intervention planning reflect the need for a multifaceted approach toward obesity prevention. Keywords: Social conditions; community health; health; immigrants; metabolic diseases.
Nutrition & Physical Activity	S. Johnson, A. Van Hoye, A. Donaldson, Et al	2020	Building health-promoting sports clubs: a participative concept mapping approach.	Public Health	https://doi.org/10.1016/j.puhe.2020.08.029		Côte d'Azur University	The potential of sports clubs to promote health beyond physical activity has been acknowledged by researchers and policy-makers. This study gathered stakeholder ideas on support sports clubs need to increase health promotion efforts and prioritize them based on importance and feasibility. Study design: The study design used in this study is a mixed-methods concept mapping approach. Methods: French sports and public health stakeholders (n = 45) were invited to participate. Steps included are as follows: (1) formulating a focus prompt, (2) brainstorming statements in response to the focus prompt, (3) sorting statements into themed piles, and (4) rating statements based on indicators. Multidimensional scaling and hierarchical cluster analysis were used to produce visual cluster maps, and descriptive statistics generated Go-Zone graphs based on mean importance and feasible ratings. Results: Participants generated 62 statements from the focus prompt: 'What assistance would benefit sports clubs to become a health-promoting setting?'. Final sorting produced 9 clusters: Tools for health promotion, Communication tools, Stakeholder training courses, Diagnostic and Financing, Awareness and Mobilization, Advocacy, Policies and Methods, Sharing and Networking, as well as Communication and Dissemination. Participant ratings produced 34 statements within the Go-Zone graphs. Conclusion: Understanding stakeholders' needs to increase health promotion activities in sports clubs is crucial to planning and implementing sustainable health promotion policies and practice. Priority areas include increasing awareness of health promotion benefits, mobilizing actors, advocating for support, and educating sports club actors. Keywords: Concept mapping; Health promotion; Intervention; Settings-based approach; Sports clubs.
Nutrition & Physical Activity	Racine, A. N., Garbarino, J. M., & K., Corrion	2020	Perceptions of barriers and levers of health-enhancing physical activity policies in mid-size French municipalities.	Health Research Policy and Systems	https://doi.org/10.1186/s12961-020-00575-z	https://health-policy-systems.biomedcentral.com/track/pdf/10.1186/s12961-020-00575-z.pdf	Côte d’Azur University	Policy is one of the levers for initiating structural change to foster the promotion of health-enhancing physical activity (HEPA). To this end, policy-makers have to deal with complex ecosystems embedded in specific contexts. However, limited research has been conducted on this topic at the local level. The purpose of this study was to identify the perceived barriers and levers of HEPA policies according to department heads and elected officials across various sectors in mid-size French municipalities. Methods: This study used a mixed method primarily based on an adaptation of the concept mapping approach. A list of statements completing the sentence: 'In a mid-size municipal context, to develop HEPA policies, it is necessary to …' was submitted to key informants of 17 mid-sized French cities. Key informants in each municipality first rated the importance of each statement without considering their local context; they then rated the feasibility of each statement given their local context. In both cases, they used a Likert scale ranging from 1 to 6. Results: A total of 23 municipal department heads and 10 elected officials from the sport (n = 14), health (n = 10) and social (n = 9) sectors in 11 mid-size French cities participated in this study. A list of 84 statements, sorted into 16 categories, was rated by participants according to their importance (M = 4.52, SD = 0.86) and their feasibility (M = 3.77, SD = 0.74). Potential barriers to (n = 10) and levers of (n = 38) HEPA policy development were identified. These results varied according to the position and sector of the participants. Conclusions: The results suggest that local contextual factors can affect the development of HEPA policies in mid-size French municipalities. The different perceptions of the potential levers and barriers according to sector might affect intersectoral collaboration. This study contributes by enhancing understanding of how local HEPA policies are developed in the French context. Keywords: Health-enhancing physical activity; concept mapping; local policy; municipality; policy-making.
Nutrition & Physical Activity	Dulin, A., Mealy, R., Whittaker, S., Cardel, M., Wang, J., Risica, P. M., & Gans, K.	2022	Identifying Barriers to and Facilitators of Using a Mobile Fruit and Vegetable Market Intervention Delivered to Low-Income Housing Sites: A Concept Mapping Study.	Health Education & Behavior	https://doi.org/10.1177%2F1090198121998287	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8446086/pdf/nihms-1689822.pdf	Brown University	Mobile fruit and vegetable (F&V) markets may be a promising strategy to improve F&V intake among low-income and racial/ethnic minority groups. However, challenges remain in terms of maximizing the reach and utilization of such markets. Therefore, this study identifies perceived barriers to and facilitators of utilizing a mobile F&V market among residents who lived in low-income housing that received the markets. Specifically, this article reports the results of the follow-up acceptability study of the "Live Well, Viva Bien" (LWVB) intervention. Method: We conducted concept mapping with residents in housing communities that received the Fresh to You (FTY) markets. Participants generated, sorted, and rated statements concerning barriers to and facilitators of market use. We compared the rating data by residents' level of market utilization and created a map representing how statements clustered into conceptual themes. Results: We retained 66 unique participant-generated statements. Eight thematic clusters emerged; four pertained to barriers: financial/promotion, produce-related, scheduling/knowledge, and logistic/awareness barriers, and four related to facilitators: produce/staffing, promotion, accessibility, and multilevel market facilitators. There was a strong correlation in ratings between participants who more frequently versus less frequently shopped at the markets (r = 0.94). Conclusions: Participants identified financial barriers, market promotion, ease of market accessibility, produce variety and quality, and staffing as key factors influencing FTY market use. This study highlights the importance of identifying the perceived barriers to and facilitators of mobile F&V market use among target populations to inform future efforts to scale up such approaches. Keywords: diet; food access; intervention; low income; neighborhood; qualitative.
Nutrition & Physical Activity	Donaldson A, Staley K, Cameron M, Dowling S, Randle E, O’Halloran P, McNeil N, Stukas A, Nicholson M.	2021	The Challenges of Partnering to Promote Health through Sport	International Journal of Environmental Research and Public Health	https://doi.org/10.3390/ijerph18137193	https://www.mdpi.com/1660-4601/18/13/7193/pdf?version=1625481026	La Trobe University	Interagency partnerships and collaborations underpin a settings-based approach to health promotion in all settings, including sport. This study used an online concept mapping approach to explore the challenges that Regional Sports Assemblies (RSAs) in Victoria, Australia experienced when working in partnerships to develop and deliver physical activity programs in a community sport context. Participants from nine RSAs brainstormed 46 unique partnership-related challenges that they then sorted into groups based on similarity of meaning and rated for importance and capacity to manage (6-point scale; 0 = least, 5 = most). A six cluster map (number of statements in cluster, mean cluster importance and capacity ratings)—Co-design for regional areas (4, 4.22, 2.51); Financial resources (3, 4.00, 2.32); Localised delivery challenges (4, 3.72, 2.33); Challenges implementing existing State Sporting Association (SSA) products (9, 3.58, 2.23); Working with clubs (8, 3.43, 2.99); and Partnership engagement (18, 3.23, 2.95)—was considered the most appropriate interpretation of the sorted data. The most important challenge was Lack of volunteer time (4.56). Partnerships to implement health promotion initiatives in sports settings involve multiple challenges, particularly for regional sport organisations working in partnership with community sport clubs with limited human and financial resources, to implement programs developed by national or state-based organisations. View Full-Text Keywords: settings-based health promotion; community sports clubs; partnerships; concept mapping; collaborations; physical activity
Nutrition & Physical Activity	Smyth E. A., Donaldson A., Drew M. K., Menaspa M., Cooke J., Guevara S. A., Purdam C., Appaneal C., Wiasak R., Toohey L.	2022	What Contributes to Athlete Performance Health?	International Journal of Environmental Research and Public Health	https://doi.org/10.3390/ijerph20010300	https://www.mdpi.com/1660-4601/20/1/300	University of Canberra	Background: In high-performance sport, athlete performance health encompasses a state of optimal physical, mental, and social wellbeing related to an athlete’s sporting success. The aim of this study was to identify the priority areas for achieving athlete performance health in Australia’s high-performance sport system (HPSS). Methods: Participants across five socioecological levels of Australia’s HPSS were invited to contribute to this study. Concept mapping, a mixed-methods approach incorporating qualitative and quantitative data collection, was used. Participants brainstormed ideas for what athlete performance health requires, sorted the ideas into groups based on similar meaning and rated the importance, and ease of achieving each idea on a scale from 1 (not important/easiest to overcome) to 5 (extremely important/hardest to overcome). Results: Forty-nine participants generated 97 unique statements that were grouped into 12 clusters following multidimensional scaling and hierarchical cluster analysis. The three clusters with highest mean importance rating were (mean importance rating (1–5), mean ease of overcoming (1–5)): ‘Behavioral competency’ (4.37, 2.30); ‘Collaboration and teamwork’ (4.19, 2.65); ‘Valuing athlete wellbeing’ (4.17, 2.77). The 12 clusters were grouped into five overarching domains: Domain one—Performance health culture; Domain two—Integrated strategy; Domain three—Operational effectiveness; Domain four—Skilled people; Domain five—Leadership. Conclusion: A diverse sample of key stakeholders from Australia’s HPSS identified five overarching domains that contribute to athlete performance health. The themes that need to be addressed in a strategy to achieve athlete performance health in Australia’s HPSS are ‘Leadership’, ‘Skilled people’, ‘Performance health culture’, ‘Operational effectiveness’, and ‘Integrated strategy’. Keywords: athletic performance; sports; athletes; health; injury
Nutrition & Physical Activity	Staley, K., Seal, E., Donaldson, A., Randle, E., Forsdike, K., Burnett, D., & Thorn, L. M. Nicholson	2021	Staying safe while staying together: the COVID-19 paradox for participants returning to community-based sport in Victoria, Australia		https://doi.org/10.1111/1753-6405.13177	https://onlinelibrary.wiley.com/doi/10.1111/1753-6405.13177	La Trobe University	Objective: To identify the challenges adult community sport participants anticipate when returning to sport in Victoria, Australia, post a COVID-19 shutdown. Methods: Using online concept mapping, participants brainstormed challenges to returning to community sport, sorted them into groups and rated them for impact and ability/capacity to overcome. Analysis included multidimensional scaling and hierarchical cluster analysis. Results: Forty-five community sport participants representing 24 sports identified 69 unique challenges to returning to sport. Eight clusters/questions participants need answered emerged from the sorting data (mean cluster impact and ability/capacity rating out of 5): Will we have enough participants? (3.32, 2.89); How do we stay safe? (3.31, 3.35); How will our sport change? (3.17, 2.85); How can we stay together? (3.15, 3.01); Will I be physically ready? (3.15, 3.05); What about the money? (2.86, 2.53); What about me? (2.65, 3.13); and What about the facilities? (2.49, 2.45). Conclusions: Participants perceived paradoxical challenges to returning to sport after COVID-19 shutdown, which revolved around staying safe, staying connected and accessing meaningful sport activities. Implications for public health: Sport organisations and public health practitioners should address the participant-centred challenges identified in this study to maximise the public health benefits of participants returning to community sport.
Nutrition & Physical Activity	Rocliffe, P., O’ Keeffe, B. T., Sherwin, I., Mannix-McNamara, P., & MacDonncha, C.	2023	School-based physical education, physical activity and sports provision: A concept mapping framework for evaluation	PLOS One	https://doi.org/10.1371/journal.pone.0287505	https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0287505&type=printable	University of Limerick	Objective Physical education, physical activity and sports provision are important factors in whole school health promotion, however, a standardised evaluation framework to evaluate the contribution of these components is lacking. A framework that accounts for the distinct structures and associated factors, that impact upon provision would facilitate a more coherent evaluation. Methods A concept mapping methodology, involving the generation of factors relevant to school physical education, physical activity and sports provision and their subsequent thematic and numeric rating and sorting was utilised. Concept mapping effectively gathers, integrates, and visually and numerically represents the composite thinking of a group of relevant and expert stakeholders around a complex social phenomenon. Following a review of the extant literature and synthesis among 20 expert stakeholders, a list of 95 factor statements relevant to school physical education, physical activity and sports provision were developed. Results Each factor statement was rated and sorted by 197 multi-disciplinary participants. An eight-cluster framework that demonstrated good validity (stress value: 0.266), was derived from the data based on: 1. Partnerships and Pupil Centered Physical Education; 2. Physical Activity and Sports; 3. School Demographics; 4. Equipment, Facilities and Budget; 5. Extra Costs; 6. Curriculum and Policy; 7. School Management and 8. Timetable. Statements within the cluster on school management received the highest mean importance and modifiability ratings while statements within the cluster on school demographics received the lowest mean importance and modifiability ratings. Conclusions Eight overarching structures which account for school physical education, physical activity and sports provision have been identified. Within each of these, structures and overall factors of greatest importance and modifiability have been illuminated. Findings stemming from this rigorous methodology, provide the foundation for the development of a national provision evaluation index to inform both school-level and national policy and actions. It is recommended the current methodology is replicated in other nations to gain corresponding insights.
Nutrition & Physical Activity	SA Guevara, A Donaldson, RJ Keegan, RN Appaneal…	2023	Gender and socioecological level differences in stakeholders' perceptions of athlete attrition factors in an Australian high-performance pathway system	Journal of Science and Medicine in Sport	https://www.jsams.org/article/S1440-2440(23)00463-2/fulltext	https://www.jsams.org/action/showPdf?pii=S1440-2440%2823%2900463-2	Research Institute for Sports and Exercise Medicine, University of Canberra, Australia	Objectives: This study aimed to build on previous work by the authors. It examines how socioecological level and gender influence high-performance sport system (HPSS) stakeholders' perspectives of the relative importance and feasibility to address athlete attrition factors within an Australian high-performance pathway system (HPPS). Design: Mixed methods. Methods: Sub-analysis was conducted of rating data from 30 participants who had contributed to identifying 83 statements in 13 clusters in a previous Concept Mapping study. The 13 clusters were statistically analysed in ‘R’ using cumulative link mixed models (CLMMs) to determine differences in perceived importance and feasibility between 1) socioecological levels, and 2) genders. Results: Mean ratings for 11 and three of the 13 clusters were statistically significantly different between at least two of the five socioecological levels, for importance and feasibility, respectively. Athletes had the largest variation in mean ratings from the most (athlete health 4.59), to least (performance potential 2.83) important cluster, when compared to the other four socioecological levels. There were statistically significant differences between the ratings between genders (Men/Women) for two clusters for each rating scale: Importance: ‘athlete health’ (M3.33:W3.84 [p 0.012]); ‘performance potential’ (M3.35:W2.57; [p 0.001]), Feasibility: ‘abuse and mismanagement of health’ (M2.97:W3.68; [p 0.000]) and ‘athlete health’ (M2.54:W3.33; [p 0.000]). Conclusions: This study highlights the need to implement more robust athlete attrition monitoring protocols. It also highlights the importance of listening to youth athletes' voices, and enabling equal gender representation to ensure holistically tailored environments are created to retain talented athletes in high-performance pathway programmes.
Patient Reported Outcomes & Quality of Life	C Meyer, M Waite, J Atkins, K Ekberg, N Scarinci… - Ear and Hearing,	2022	How Can eHealth Meet the Hearing and Communication Needs of Adults With Hearing Impairment and their Significant Others? A Group Concept Mapping Study		https://doi.org/10.1097/AUD.0000000000001097	https://onlinelibrary.wiley.com/doi/epdf/10.1111/hex.13720	University of Queensland	Objectives: To seek the perspectives of key stakeholders regarding: (1) how eHealth could help meet the hearing and communication needs of adults with hearing impairment and their significant others; and (2) how helpful each aspect of eHealth would be to key stakeholders personally. Design: Group concept mapping, a mixed-methods participatory research method, was used to seek the perspectives of key stakeholders: adults with hearing impairment (n = 39), significant others (n = 28), and hearing care professionals (n = 56). All participants completed a short online survey before completing one or more of the following activities: brainstorming, sorting, and rating. Brainstorming required participants to generate ideas in response to the focus prompt, “One way I would like to use information and communication technologies to address the hearing and communication needs of adults with hearing loss and their family and friends is to….” The sorting task required participants to sort all statements into groups that made sense to them. Finally, the rating task required participants to rate each of the statements according to “How helpful would this idea be to you?” using a 5-point Likert scale. Hierarchical cluster analysis was applied to the “sorting” data to develop a cluster map using the Concept Systems software. The “rating” data were subsequently analyzed at a cluster level and an individual-item level using descriptive statistics. Differences in cluster ratings between stakeholder groups were examined using Kruskal-Wallis tests. Results: Overall, 123 statements were generated by participants in response to the focus prompt and were included in subsequent analyses. Based on the “sorting” data and hierarchical cluster analysis, a seven-cluster map was deemed to be the best representation of the data. Three key themes emerged from the data, including using eHealth to (1) Educate and Involve Others; (2) Support Aural Rehabilitation; and (3) Educate About and Demonstrate the Impacts of Hearing Impairment and Benefits of Hearing Rehabilitation. Overall median rating scores for each cluster ranged from 3.97 (educate and involve significant others) to 3.44 (empower adults with hearing impairment to manage their hearing impairment from home). Conclusions: These research findings demonstrate the broad range of clinical applications of eHealth that have the capacity to support the implementation of patient- and family-centered hearing care, with self-directed educational tools and resources typically being rated as most helpful. Therefore, eHealth appears to be a viable option for enabling a more biopsychosocial approach to hearing healthcare and educating and involving significant others in the hearing rehabilitation process without adding more pressure on clinical time. More research is needed to inform the subsequent development of eHealth interventions, and it is recommended that health behavior change theory be adhered to for such interventions.
Patient Reported Outcomes & Quality of Life	Ismail, S. Y., Duerinckx, N., van der Knoop, M. M., Timmerman, L., Wimar, W., Dobbels, F., Massey, E. K., & Busschbach, J. J. J.	2015	Toward a conceptualization of the content of psychosocial screening in living organ donors: An ethical legal psychological aspects of transplantation consensus.	Transplantation	https://doi.org/10.1097/TP.0000000000000771	https://www.researchgate.net/profile/Jjv-Busschbach/publication/279153737_Toward_a_Conceptualization_of_the_Content_of_Psychosocial_Screening_in_Living_Organ_Donors_An_Ethical_Legal_Psychological_Aspects_of_Transplantation_Consensus/links/5b1c25d2a6fdcca67b6821c9/Toward-a-Conceptualization-of-the-Content-of-Psychosocial-Screening-in-Living-Organ-Donors-An-Ethical-Legal-Psychological-Aspects-of-Transplantation-Consensus.pdf?origin=publication_detail	Erasmus University	Background: Across Europe, transplant centers vary in the content of the psychosocial evaluation for eligible living organ donors. To identify whether a common framework underlies this variation in this evaluation, we studied which psychosocial screening items are most commonly used and considered as most important in current psychosocial screening programs of living organ donors. Methods: A multivariate analytic method, concept mapping, was used to generate a visual representation of the "psychosocial" screening items of living kidney and liver donors. A list of 75 potential screening items was derived from a systematic literature review and sorted and rated for their importance and commonness by multidisciplinary affiliated health care professionals from across Europe. Results were discussed and fine-tuned during a consensus meeting. Results: The analyses resulted in a 6-cluster solution. The following clusters on psychosocial screening items were identified, listed from most to least important: (1) personal resources, (2) motivation and decision making, (3) psychopathology, (4) social resources, (5) ethical and legal factors, and (6) information and risk processing. Conclusions: We provided a conceptual framework of the essential elements in psychosocial evaluation of living donors which can serve as a uniform basis for the selection of relevant psychosocial evaluation tools, which can be further tested in prospective studies.
Patient Reported Outcomes & Quality of Life	Pines, J. M., Lotrecchiano, G. R., Zocchi, M. S., Lazar, D., Leedekerken, J. B., Margolis, G. S., & Carr, B. G.	2016	A conceptual model for episodes of acute, unscheduled care.	Annals of Emergency Medicine	https://doi.org/10.1016/j.annemergmed.2016.05.029		George Washington University	We engaged in a 1-year process to develop a conceptual model representing an episode of acute, unscheduled care. Acute, unscheduled care includes acute illnesses (eg, nausea and vomiting), injuries, or exacerbations of chronic conditions (eg, worsening dyspnea in congestive heart failure) and is delivered in emergency departments, urgent care centers, and physicians' offices, as well as through telemedicine. We began with a literature search to define an acute episode of care and to identify existing conceptual models used in health care. In accordance with this information, we then drafted a preliminary conceptual model and collected stakeholder feedback, using online focus groups and concept mapping. Two technical expert panels reviewed the draft model, examined the stakeholder feedback, and discussed ways the model could be improved. After integrating the experts' comments, we solicited public comment on the model and made final revisions. The final conceptual model includes social and individual determinants of health that influence the incidence of acute illness and injury, factors that affect care-seeking decisions, specific delivery settings where acute care is provided, and outcomes and costs associated with the acute care system. We end with recommendations for how researchers, policymakers, payers, patients, and providers can use the model to identify and prioritize ways to improve acute care delivery.
Patient Reported Outcomes & Quality of Life	Lotrecchiano, G. R., Pines, J., Kane, M., Zocchi, M., Gosa, J., & Lazar, D.	2016	When sciences collide: Social, statistical, and health sciences research that builds voice while informing policy.	AIS Integrative Pathways		https://www.researchgate.net/profile/Gaetano-Lotrecchiano/publication/304253944_When_Sciences_Collide_Social_Statistical_and_Health_Sciences_Research_that_Builds_Voice_While_Informing_Policy/links/576affa208ae5b9a62b3a6e2/When-Sciences-Collide-Social-Statistical-and-Health-Sciences-Research-that-Builds-Voice-While-Informing-Policy.pdf?origin=publication_detail	George Washington University	In four online and in-person focus groups (one of each type per sub-sample) GCM sought feed-back, identified relationships and articulated priorities from participants. With a single universal focus prompt, “An additional issue that needs to be addressed in this model of acute care management is…,” participants contributed feedback to the prompt. Each participant was encouraged to answer as many times as they chose. Statements were aggregated and all participants were asked to sort and rate statements thereafter. The process with each focus group was the same utilizing the main steps of the concept mapping process: Brainstorming through through anonymous answers to the prompt; • Individual sorting of statements gathered from the brainstorming step into related “piles” of information, based on the individual sorts subjected to multi-dimensional scaling (MDS) to understand the relationship between individual concepts;• Rating, on a scale of importance or centrality of the characteristics for the purpose at hand; • Analysis follows that produces Maps, Clusters, and Labels of the knowledge entities providing visualization of relationships based on clustering of statements of greatest shared meaning shown in proximal spatial relationship.
Patient Reported Outcomes & Quality of Life	Ogden, K., Barr, J., & Greenfield, D.	2017	Determining requirements for patient-centred care: A participatory concept mapping study.	BMC Health Services Research	https://doi.org/10.1186/s12913-017-2741-y	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5704567/pdf/12913_2017_Article_2741.pdf	University of Tasmania	Recognition of a need for patient-centred care is not new, however making patient-centred care a reality remains a challenge to organisations. We need empirical studies to extend current understandings, create new representations of the complexity of patient-centred care, and guide collective action toward patient-centred health care. To achieve these ends, the research aim was to empirically determine what organisational actions are required for patient-centred care to be achieved. Methods We used an established participatory concept mapping methodology. Cross-sector stakeholders contributed to the development of statements for patient-centred care requirements, sorting statements into groupings according to similarity, and rating each statement according to importance, feasibility, and achievement. The resultant data were analysed to produce a visual concept map representing participants’ conceptualisation of patient-centred care requirements. Analysis included the development of a similarity matrix, multidimensional scaling, hierarchical cluster analysis, selection of the number of clusters and their labels, identifying overarching domains and quantitative representation of rating data. Results The outcome was the development of a conceptual map for the Requirements of Patient-Centred Care Systems (ROPCCS). ROPCCS incorporates 123 statements sorted into 13 clusters. Cluster labels were: shared responsibility for personalised health literacy; patient provider dynamic for care partnership; collaboration; shared power and responsibility; resources for coordination of care; recognition of humanity – skills and attributes; knowing and valuing the patient; relationship building; system review evaluation and new models; commitment to supportive structures and processes; elements to facilitate change; professional identity and capability development; and explicit education and learning. The clusters were grouped into three overarching domains, representing a cross-sectoral approach: humanity and partnership; career spanning education and training; and health systems, policy and management. Rating of statements allowed the generation of go-zone maps for further interrogation of the relative importance, feasibility, and achievement of each patient-centred care requirement and cluster. Conclusion The study has empirically determined requirements for patient-centred care through the development of ROPCCS. The unique map emphasises collaborative responsibility of stakeholders to ensure that patient-centred care is comprehensively progressed. ROPCCS allows the complex requirements for patient-centred care to be understood, implemented, evaluated, measured, and shown to be occurring. Electronic supplementary material The online version of this article (10.1186/s12913-017-2741-y) contains supplementary material, which is available to authorized users. Keywords: Concept mapping, Patient-centred care, Health care systems, Implementation, Research
Patient Reported Outcomes & Quality of Life	Klokker, L., Tugwell, P., Furst, D. E. , Devoe, D., Williamson, P., Terwee, C. B., Suarez-Almazor, M. E., Strand, V., Woodworth, T., Leong, A. L., Goel, N., Boers, M., Brooks, P. M., Simon, L. S., & Christensen, R.	2017	Developing an OMERACT core outcomes set for assessing safety components in Rheumatology trials: The OMERACT safety working group.	The Journal of Rheumatology	https://doi.org/10.3899/jrheum.161105	https://www.jrheum.org/content/jrheum/44/12/1916.full.pdf	The Parker Institute	Objective: Failure to report harmful outcomes in clinical research can introduce bias favoring a potentially harmful intervention. While core outcome sets (COS) are available for benefits in randomized controlled trials in many rheumatic conditions, less attention has been paid to safety in such COS. The Outcome Measures in Rheumatology (OMERACT) Filter 2.0 emphasizes the importance of measuring harms. The Safety Working Group was reestablished at the OMERACT 2016 with the objective to develop a COS for assessing safety components in trials across rheumatologic conditions. Methods: The safety issue has previously been discussed at OMERACT, but without a consistent approach to ensure harms were included in COS. Our methods include (1) identifying harmful outcomes in trials of interventions studied in patients with rheumatic diseases by a systematic literature review, (2) identifying components of safety that should be measured in such trials by use of a patient-driven approach including qualitative data collection and statistical organization of data, and (3) developing a COS through consensus processes including everyone involved. Results: Members of OMERACT including patients, clinicians, researchers, methodologists, and industry representatives reached consensus on the need to continue the efforts on developing a COS for safety in rheumatology trials. There was a general agreement about the need to identify safety-related outcomes that are meaningful to patients, framed in terms that patients consider relevant so that they will be able to make informed decisions. Conclusion: The OMERACT Safety Working Group will advance the work previously done within OMERACT using a new patient-driven approach. Keywords: CORE OUTCOME SET; HARM; OMERACT; RHEUMATOLOGY; SAFETY.
Patient Reported Outcomes & Quality of Life	Stolk-Vos, A. C., van de Klundert, J. J., Maijers, N., Zijlmans, B. L. M., & Busschbach, J. J. V.	2017	Multi-stakeholder perspectives in defining health-services quality in cataract care.	International Journal for Quality in Health Care	https://doi.org/10.1093/intqhc/mzx048	https://academic.oup.com/intqhc/article/29/4/470/3814293?login=false	Erasmus University	Objective: To develop a method to define a multi-stakeholder perspective on health-service quality that enables the expression of differences in systematically identified stakeholders' perspectives, and to pilot the approach for cataract care. Design: Mixed-method study between 2014 and 2015. Setting: Cataract care in the Netherlands. Participants: Stakeholder representatives. Intervention(s): We first identified and classified stakeholders using stakeholder theory. Participants established a multi-stakeholder perspective on quality of cataract care using concept mapping, this yielded a cluster map based on multivariate statistical analyses. Consensus-based quality dimensions were subsequently defined in a plenary stakeholder session. Main outcome measure(s): Stakeholders and multi-stakeholder perspective on health-service quality. Results: Our analysis identified seven definitive stakeholders, as follows: the Dutch Ophthalmology Society, ophthalmologists, general practitioners, optometrists, health insurers, hospitals and private clinics. Patients, as dependent stakeholders, were considered to lack power by other stakeholders; hence, they were not classified as definitive stakeholders. Overall, 18 stakeholders representing ophthalmologists, general practitioners, optometrists, health insurers, hospitals, private clinics, patients, patient federations and the Dutch Healthcare Institute sorted 125 systematically collected indicators into the seven following clusters: patient centeredness and accessibility, interpersonal conduct and expectations, experienced outcome, clinical outcome, process and structure, medical technical acting and safety. Importance scores from stakeholders directly involved in the cataract service delivery process correlated strongly, as did scores from stakeholders not directly involved in this process. Conclusions: Using a case study on cataract care, the proposed methods enable different views among stakeholders concerning quality dimensions to be systematically revealed, and the stakeholders jointly agreed on these dimensions. The methods helped to unify different quality definitions and facilitated operationalisation of quality measurement in a way that was accepted by relevant stakeholders. Keywords: cataract; community-based participatory research; concept formation; quality indicators; quality of healthcare.
Patient Reported Outcomes & Quality of Life	Humphrey, L., Wilgoss, T., Trigg, A., Meysner, S., Kane, M., Dickinson, S., & Kitchen, H.	2017	A comparison of three methods to generate a conceptual understanding of a disease based on the patients' perspective.	Journal of Patient-Reported Outcomes	https://doi.org/10.1186/s41687-017-0013-6	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5934934/pdf/41687_2017_Article_13.pdf	Clinical Outcomes Solutions, LLC	The Food and Drug Administration patient-reported outcome (PRO) guidance provides standards for PRO development, but these standards bring scientific and logistical challenges which can result in a lengthy and expensive instrument development process. Thus, more pragmatic methods are needed alongside traditional approaches. Methods: Partnering with the National Ankylosing Spondylitis (AS) Society, we compared three methods for eliciting patient experiences: 1) concept elicitation (CE) interviews with 12 individuals with AS, 2) "group concept mapping" (GCM) with 16 individuals with AS, 3) a social media review (SMR) of AS online chatrooms. Three conceptual models were developed and compared to explore data breadth/depth, as well as the practicalities and patient-centeredness. Results: Overlap in concepts was observed between conceptual models; 35% of symptoms were identified by all methods. The SMR approach identified the most concepts (n = 23), followed by CE interviews (n = 18), and GCM (n = 15). Eight symptoms were uniquely identified using GCM and SMR. Eliciting in-depth data was challenging for SMR as detail was not always provided. Insight into the relationships between symptoms was obtained as a "concept map" in GCM, via effective probing within interviews, and through the subject's descriptions in SMR. Practical investment varied; CE interviews were the most resource intensive, whereas SMR was the least. Individuals in GCM and CE interviews reported high engagement. Conclusions: Primary CE interviews achieved the greatest depth in conceptual understanding of patient experience; however, novel methods (GCM, SMR) provide complementary approaches for identifying measurement concepts. Each method has strengths and weaknesses and should be selected based on specific research objectives.
Patient Reported Outcomes & Quality of Life	Bennett, R. J., Laplante-Levesque, A., Meyer, C. J., & Eikelboom, R. H.	2018	Exploring hearing aid problems: Perspectives of hearing aid owners and clinicians.	Ear and Hearing	https://doi.org/10.1097/AUD.0000000000000477		University of Western Australia	Objectives: To gather perspectives of hearing aid owners and hearing healthcare clinicians with regard to problems that arise after hearing aid fitting and use these perspectives to generate a conceptual framework to gain a better understanding of these problems. Design: Participants included a group of 17 hearing aid owners and a group of 21 hearing healthcare clinicians; data collection occurred separately for each group. Participants each attended two group sessions in Perth, Western Australia, wherein they: (1) generated statements describing the problems associated with hearing aids and (2) grouped and rated the statements to identify key themes. Concept mapping was used to generate a conceptual framework. Results: Participants identified four concepts regarding hearing aid problems as follows: (1) hearing aid management; (2) hearing aid sound quality and performance; (3) feelings, thoughts, and behaviors; and (4) information and training. While hearing aid owners and clinicians generated similar results regarding the concepts derived, the clinicians reported that the problems identified had a greater negative impact on hearing aid success than did hearing aid owners. Conclusions: The magnitude and diversity of hearing aid problems identified in this study highlight the ongoing challenges that hearing aid owners face and suggest that current processes for hearing aid fitting can be improved. Problems relating to hearing aid management were most often deemed to have the greatest impact on hearing aid success and be the most preventable/solvable, and thus are a good starting point when addressing hearing aid-related problems.
Patient Reported Outcomes & Quality of Life	LaNoue, M. D., Gerolamo, A. M., Powell, R., Nord, G., Doty, A. M. B., & Rising, K. L.	2018	Development and preliminary validation of a scale to measure patient uncertainty: The "Uncertainty Scale."	Journal of Health Psychology	https://doi.org/10.1177/1359105317752827		Thomas Jefferson University	Research suggests that patient uncertainty related to experiencing symptoms may drive decisions to seek care. The only validated measure of patient uncertainty assesses uncertainty related to defined illness. In prior work, we engaged patients to describe uncertainty related to symptoms and used findings to develop the 'U-Scale' scale. In this work, we present results from preliminary scale reliability and validity testing. Psychometric testing demonstrated content validity, high internal consistency, and evidence for concurrent validity. Next steps include administration in diverse populations for continued refinement and validation, and exploration of the potential contribution of uncertainty to healthcare utilization.
Patient Reported Outcomes & Quality of Life	McCaffrey, S. A., Chiauzzi, E., Chan, C., & Hoole, M.	2018	Understanding 'good health care' from the patient's perspective: Development of a conceptual model using group concept mapping.	The Patient - Patient-Centered Outcomes Research	https://doi.org/10.1007/s40271-018-0320-x	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6335377/pdf/40271_2018_Article_320.pdf	PatientsLikeMe, Inc.	Background: There is an increasing focus on measuring performance indicators of health care providers, but there is a lack of patient input into what defines ‘good care.’ Objective: The primary objective was to develop a conceptual model of ‘good health care’ from the patient’s perspective. Exploratory analyses were also conducted to investigate (1) differences in patient priorities based on demographic and clinical factors, and (2) differences between patients and health stakeholders (e.g., clinicians, researchers) with respect to patient health care priorities. Method: These objectives were accomplished using group concept mapping. Following statement generation, PatientsLikeMe members, Baltimore community members recruited through a university-affiliated clinic, and stakeholders individually sorted the statements into meaningful categories and rated the statements with respect to importance. Qualitative and quantitative analyses generated a final conceptual model. Results: One hundred and fifty-seven patients and 17 stakeholders provided input during statement generation. The 1779-statement pool was reduced to 79 statements for the structuring (sorting and rating) activities. In total, 221 patients and 16 stakeholders completed structuring activities through group concept mapping software. Results yielded a 10-cluster solution, and patient priorities were found to be relatively invariant across demographic/clinical groups. Results were also similar between patients and stakeholders. Conclusions This comprehensive qualitative and quantitative investigation is an important first step in developing patient-reported outcome performance measures that capture the aspects of health care that are most important and relevant for patients. Limitations and future directions are discussed.
Patient Reported Outcomes & Quality of Life	Hackett, K. L., Deane, K. H. O., Newton, J. L., Deary, V., Bowman, S., Rapley, T., Ng, W., & The United Kingdom Primary Sjogren's Syndrome Registry.	2018	A mixed-methods study identifying key intervention targets to improve participation in daily living activities in primary Sjögren's syndrome patients.	Arthritis Care & Research	https://doi.org/10.1002/acr.23536	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6033158/pdf/ACR-70-1064.pdf	Newcastle University	Functional ability and participation in life situations are compromised in many primary Sjögren's syndrome (SS) patients. This study aimed to identify the key barriers and priorities to participation in daily living activities, in order to develop potential future interventions. Methods Group concept mapping, a semiquantitative, mixed‐methods approach was used to identify and structure ideas from UK primary SS patients, adult household members living with a primary SS patient, and health care professionals. Brainstorming generated ideas, which were summarized into a final set of statements. Participants individually arranged these statements into themes and rated each statement for importance. Multidimensional scaling and hierarchical cluster analysis were applied to sorted and rated data to produce visual representations of the ideas (concept maps), enabling identification of agreed priority areas for interventions. Results: A total of 121 patients, 43 adult household members, and 67 health care professionals took part. In sum, 463 ideas were distilled down to 94 statements. These statements were grouped into 7 clusters: Patient Empowerment, Symptoms, Wellbeing, Access and Coordination of Health Care, Knowledge and Support, Public Awareness and Support, and Friends and Family. Patient Empowerment and Symptoms were rated as priority conceptual themes. Important statements within priority clusters indicate patients should be taken seriously and supported to self‐manage symptoms of oral and ocular dryness, fatigue, pain, and poor sleep. Conclusion: Our data highlighted the fact that in addition to managing primary SS symptoms, interventions aiming to improve patient empowerment, general wellbeing, access to health care, patient education, and social support are important to facilitate improved participation in daily living activities.
Patient Reported Outcomes & Quality of Life	Jørgensen, T. S., Lykkegaard J. J., Hansen, A., Schrøder, H. M., Stampe, B., Sweeney, A. T., Esbensen, B. A., Bech, B., Christensen, K., Friis-Mikkelsen, E., Røgind, H., Lundbak, T., Taylor, P. C., Petersson, I. F., Wæhrens, E. E., Kjellberg, J., Gudbergsen, H., Kristensen, L. E.	2018	Protocol for evaluating and implementing a pragmatic value-based healthcare management model for patients with inflammatory arthritis: A Danish population-based regional cohort and qualitative implementation study.	BMJ Open	https://doi.org/10.1136/bmjopen-2018-023915	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6224730/pdf/bmjopen-2018-023915.pdf	Copenhagen University	Introduction: The provision of healthcare for patients with inflammatory arthritis occurs in the context of somewhat conflicting targets, values and drivers. Therefore, there is a need for introducing ‘value-based healthcare’ defined as the value of patient relevant health outcomes in relation to costs. This term is a central part of tomorrow’s healthcare sector, especially for rheumatic diseases, yet the transition is a huge challenge, as it will impact the development, delivery and assessment of healthcare. Aims: The aim of this study is to compare medical and patient evaluated impact of the traditional settlement and financing production (DAGS) controlled healthcare setting with a value-based and patient-centred adjunctive to standard care. Methods and analysis: Patients with inflammatory arthritis receiving treatment in routine care at the outpatient clinics in the Capital Region of Denmark will prospectively and consecutively be enrolled in a Non-Intervention-Study framework providing a pragmatic value-based management model. A Danish reference cohort, used for comparison will be collected as part of routine clinical care. The enrolment period will be from 1 June 2018 until 31December 2023. Baseline and follow-up visits will be according to routine clinical care. Registry data will be obtained directly from patients and include personal, clinical and outcomes information. The study results will be reported in accordance with the STROBE statement. Ethics and dissemination The study has been notified to the Danish Data Protection Agency and granted authorisation for the period June 2018 to January 2025 (pending). Informed consent will be obtained from all patients before enrolment in the study. The study is approved by the ethics committee, Capital Region of Denmark (H-18013158). Results of the study will be disseminated through publication in international peer-reviewed journals
Patient Reported Outcomes & Quality of Life	Nielsen, K. T., Klokker, L., Guidetti, S., & Waehrens, E. E.	2019	At identificere, organisere og prioritere ideer til, hvordan evnen til almindelig daglig levevis (ADL) kan forbedres.	UCN Perspektiv	https://doi.org/10.17896/UCN.perspektiv.n6.353	https://journals.ucn.dk/index.php/perspektiv/article/view/353/334	University of Southern Denmark	Baggrund: Der er behov for at udvikle evidensbaserede ergoterapeutiske interventioner, der sigter mod at forbedre evnen til at udføre almindelig daglig levevis (ADL) for personer med kroniske tilstande. I udviklingsprocessen bør forskellige former for information inddrages, herunder ergoterapeuters kliniske erfaringer samt klienternes præferencer. Formål: At identificere, organisere og prioritere idéer til, hvordan ADL-evnen kan forbedres for personer, der lever med kroniske tilstande. Metode: Group concept mapping blev anvendt, og følgende faser indgik i processen: brainstorming, sortering og prioritering, generering af cluster rating map, validering af cluster rating map og udvikling af konceptuel model. Deltagerne var personer med kroniske tilstande (n = ≤18) og ergoterapeuter (n = ≤23). Konklusion: Der blev identificeret forskellige temaer, i forhold til hvordan ADL-evnen kan forbedres for personer med kroniske tilstande. Temaerne spænder bredt og illustrerer derved kompleksiteten i at løse ADL-problemer. Personer med kroniske tilstande og ergoterapeuter har forskellige prioriteter, i forhold til hvordan ADL-problemer løses. Derfor er det vigtigt, at ergoterapeuter i daglig praksis involverer klienter i beslutninger om mulige løsninger. Ligeledes er det vigtigt, at både ergoterapeuter og klienter involveres i udvikling af interventioner.
Patient Reported Outcomes & Quality of Life	Rivas, C., Tkacz, D., Antao, L., Mentzakis, E., Gordon, M., Anstee, S., and Giordano, R.	2019	Automated analysis of free-text comments and dashboard representations in patient experience surveys: a multimethod co-design study.	Health Service Delivery Research	https://doi.org/10.3310/hsdr07230	https://www.ncbi.nlm.nih.gov/books/NBK543270/	University of Southampton	Background: Patient experience surveys (PESs) often include informative free-text comments, but with no way of systematically, efficiently and usefully analysing and reporting these. The National Cancer Patient Experience Survey (CPES), used to model the approach reported here, generates > 70,000 free-text comments annually. Main aim: To improve the use and usefulness of PES free-text comments in driving health service changes that improve the patient experience. Secondary aims: (1) To structure CPES free-text comments using rule-based information retrieval (IR) (‘text engineering’), drawing on health-care domain-specific gazetteers of terms, with in-built transferability to other surveys and conditions; (2) to display the results usefully for health-care professionals, in a digital toolkit dashboard display that drills down to the original free text; (3) to explore the usefulness of interdisciplinary mixed stakeholder co-design and consensus-forming approaches in technology development, ensuring that outputs have meaning for all; and (4) to explore the usefulness of Normalisation Process Theory (NPT) in structuring outputs for implementation and sustainability. Design: A scoping review, rapid review and surveys with stakeholders in health care (patients, carers, health-care providers, commissioners, policy-makers and charities) explored clinical dashboard design/patient experience themes. The findings informed the rules for the draft rule-based IR [developed using half of the 2013 Wales CPES (WCPES) data set] and prototype toolkit dashboards summarising PES data. These were refined following mixed stakeholder, concept-mapping workshops and interviews, which were structured to enable consensus-forming ‘co-design’ work. IR validation used the second half of the WCPES, with comparison against its manual analysis; transferability was tested using further health-care data sets. A discrete choice experiment (DCE) explored which toolkit features were preferred by health-care professionals, with a simple cost–benefit analysis. Structured walk-throughs with NHS managers in Wessex, London and Leeds explored usability and general implementation into practice. Key outcomes: A taxonomy of ranked PES themes, a checklist of key features recommended for digital clinical toolkits, rule-based IR validation and transferability scores, usability, and goal-oriented, cost–benefit and marketability results. The secondary outputs were a survey, scoping and rapid review findings, and concordance and discordance between stakeholders and methods. Results: (1) The surveys, rapid review and workshops showed that stakeholders differed in their understandings of the patient experience and priorities for change, but that they reached consensus on a shortlist of 19 themes; six were considered to be core; (2) the scoping review and one survey explored the clinical toolkit design, emphasising that such toolkits should be quick and easy to use, and embedded in workflows; the workshop discussions, the DCE and the walk-throughs confirmed this and foregrounded other features to form the toolkit design checklist; and (3) the rule-based IR, developed using noun and verb phrases and lookup gazetteers, was 86% accurate on the WCPES, but needs modification to improve this and to be accurate with other data sets. The DCE and the walk-through suggest that the toolkit would be well accepted, with a favourable cost–benefit ratio, if implemented into practice with appropriate infrastructure support. Limitations: Small participant numbers and sampling bias across component studies. The scoping review studies mostly used top-down approaches and focused on professional dashboards. The rapid review of themes had limited scope, with no second reviewer. The IR needs further refinement, especially for transferability. New governance restrictions further limit immediate use. Conclusions: Using a multidisciplinary, mixed stakeholder, use of co-design, proof of concept was shown for an automated display of patient experience free-text comments in a way that could drive health-care improvements in real time. The approach is easily modified for transferable application. Future work: Further exploration is needed of implementation into practice, transferable uses and technology development co-design approaches. Funding: The National Institute for Health Research Health Services and Delivery Research programme.
Patient Reported Outcomes & Quality of Life	Mills, G. D., LaNoue, M., Gentsch, A. T., Doty, A. M. B., Cunningham, A., Nord, G., & Rising, K. L.	2019	Patient experience and challenges in group concept mapping for clinical research.	Journal of Patient-Reported Outcomes	https://doi.org/10.1186/s41687-019-0147-9	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6695458/pdf/41687_2019_Article_147.pdf	Thomas Jefferson University	Background and objective: Group concept mapping (GCM) is a research method that engages stakeholders in generating, structuring and representing ideas around a specific topic or question. GCM has been used with patients to answer questions related to health and disease but little is known about the patient experience as a participant in the process. This paper explores the patient experience participating in GCM as assessed with direct observation and surveys of participants. Methods: This is a secondary analysis performed within a larger study in which 3 GCM iterations were performed to engage patients in identifying patient-important outcomes for diabetes care. Researchers tracked the frequency and type of assistance required by each participant to complete the sorting and rating steps of GCM. In addition, a 17-question patient experience survey was administered over the telephone to the participants after they had completed the GCM process. Survey questions asked about the personal impact of participating in GCM and the ease of various steps of the GCM process. Results: Researchers helped patients 92 times during the 3 GCM iterations, most commonly to address software and computer literacy issues, but also with the sorting phase itself. Of the 52 GCM participants, 40 completed the post-GCM survey. Respondents averaged 56 years of age, were 50% female and had an average hemoglobin A1c of 9.1%. Ninety-two percent (n = 37) of respondents felt that they had contributed something important to this research project and 90% (n = 36) agreed or strongly agreed that their efforts would help others with diabetes. Respondents reported that the brainstorming session was less difficult when compared with sorting and rating of statements. Discussion: Our results suggest that patients find value in participating in GCM. Patients reported less comfort with the sorting step of GCM when compared with brainstorming, an observation that correlates with our observations from the GCM sessions. Researchers should consider using paper sorting methods and objective measures of sorting quality when using GCM in patient-engaged research to improve the patient experience and concept map quality. Keywords: Group concept mapping, Patient reported outcomes, Diabetes, Quality of life, Brainstorming
Patient Reported Outcomes & Quality of Life	Rising, K. L., LaNoue, M., Gentsch, A. T., Doty, A. M. B., Cunningham, A., Carr, B. G., Hollander, J. E., Latimer, L., Loebell, L., Weingarten, G., White, N., & Mills, G.	2019	The power of the group: Comparison of interviews and group concept mapping for identifying patient-important outcomes of care.	BMC Medical Research Methodology	https://doi.org/10.1186/s12874-018-0656-x	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6323717/pdf/12874_2018_Article_656.pdf	Thomas Jefferson University	Background: Data are limited regarding how to effectively and efficiently identify patient priorities for research or clinical care. Our goal was to compare the comprehensiveness and efficiency of group concept mapping (GCM), a group participatory method, to interviews for identifying patient goals when seeking care. Methods: We engaged patients with moderately- to poorly-controlled diabetes mellitus in either GCM or an individual interview. The primary outcome was the comprehensiveness of GCM brainstorming (the first stage of GCM) as compared to interviews for eliciting patient-important outcomes (PIOs) related to seeking care. Secondary outcomes included 1) comprehensiveness of GCM brainstorming and interviews compared to a master list of PIOs and 2) efficiency of GCM brainstorming, the entire GCM process and interviews. Results: We engaged 89 interview participants and 52 GCM participants (across 3 iterations of GCM) to identify outcomes most important to patients when making decisions related to diabetes management. We identified 26 PIOs in interviews, 33 PIOs in the first GCM brainstorming session, and 38 PIOs across all three GCM brainstorming sessions. The initial GCM brainstorming session identified 77% (20/26) of interview PIOs, and all 3 GCM brainstorming sessions combined identified 88% (23/26). When comparing GCM brainstorming and interviews to the master list of PIOs, the initial GCM brainstorming sessions identified 80% (33/41), all 3 GCM brainstorming sessions identified 93% (38/41) and interviews identified 63% (26/41) of all PIOs. Compared to interviews, GCM brainstorming required less research team time, more patient time, and had a lowest cost. The entire GCM process still required less research team time than interviews, though required more patient time and had a higher cost than interviews. Conclusions: GCM brainstorming is a powerful tool for effectively and efficiently identifying PIOs in certain scenarios, though it does not provide the breadth and depth of individual interviews or the higher level conceptual organization of the complete process of GCM. Selection of the optimal method for patient engagement should include consideration of multiple factors including depth of patient input desired, research team expertise, resources, and the population to be engaged.
Patient Reported Outcomes & Quality of Life	C. Wentick, M. Huijbers Et al	2019	Enhancing shared decision making about discontinuation of antidepressant medication: a concept-mapping study in primary and secondary mental health care.	British Journal of General Practice	https://doi.org/10.3399/bjgp19X706001	https://bjgp.org/content/bjgp/69/688/e777.full.pdf	Radboud University	The apparent rise of antidepressant use seems to be explained to a large extent by an increase in long-term use. Both professionals and patients appear reluctant to discontinue antidepressant medication (ADM). It is not known what factors determine this reluctance. Aim: This study aimed to identify factors that enable the shared decision-making process about discontinuation of ADM between long-term users and their GPs. Design and setting Concept-mapping study of a purposive sample of both patients and professionals from primary and secondary mental health care in the Netherlands. Method Concept mapping was used to conceptualise and structure the topics relevant to the discontinuation process from the perspective of both patients and professionals. Participants generated topics in brainstorming sessions and subsequently prioritised and sorted them. Multidimensional scaling and hierarchical cluster analyses were used for the cluster topics. Results Thirty-seven patients and 27 professionals generated 50 separate topics. Hierarchical cluster analysis revealed six clusters of topics: ‘Process of discontinuation’, ‘Expectations’, ‘Professional guidance’, ‘Current use’, ‘Environment’, and ‘Side effects’. Patients and professionals came up with largely similar topics. Nevertheless, a difference was found between these groups regarding the perceived importance of professional guidance. Conclusion This study yielded an informed selection of the topics that seem most important to discuss when considering whether to discontinue ADM. As perspectives of both patients and professionals were combined, the topics may provide patients and GPs with a broader and more balanced scope of factors to consider, and thus facilitate a better shared decision-making process. Keywords: antidepressive agents, decision making, deprescriptions, general practice
Patient Reported Outcomes & Quality of Life	Robinson, L. J., Stephens, N. M., Wilson, S., Graham, L., & Hackett, K. L.	2019	Conceptualizing the key components of rehabilitation following major musculoskeletal trauma: A mixed methods service evaluation.	Journal of Evaluation in Clinical Practice	https://doi.org/10.1111/jep.13331		NHS Foundation Trust	Rationale, aims, and objectives: The reorganization of acute major trauma pathways in England has increased survival following traumatic injury, resulting in an increased patient population with diverse and complex needs requiring specialist rehabilitation. However, national audit data indicate that only 5% of patients with traumatic injuries have access to specialist rehabilitation, and there are limited guidelines or standards to inform the delivery of rehabilitation interventions for individuals following major trauma. This group concept mapping project aimed to identify the clinical service needs of individuals accessing our major trauma rehabilitation service, prioritize these needs, determine whether each of these needs is currently being met, and plan targeted service enhancements. Methods: Participants contributed towards a statement generation exercise to identify the key components of rehabilitation following major trauma, and individually sorted these statements into themes. Each statement was rated based on importance and current success. Multi-dimensional scaling and hierarchical cluster analysis were applied to the sorted data to produce themed clusters of ideas within concept maps. Priority values were applied to these maps to identify key areas for targeted service enhancement. Results: Fifty-eight patients and health care professionals participated in the ideas generation activity, 34 in the sorting, and 49 in the rating activity. A 7-item cluster map was agreed upon, containing the following named clusters: Communication and Coordination; Emotional and psychological wellbeing; Rehabilitation environment; Early rehabilitation; Structured therapy input; Planning for home; and Long-term support. Areas for targeted service enhancement included access to timely and adequate information provision, collaborative goal setting, and specialist pain management across the rehabilitation pathway. Conclusion: The conceptual framework presented in this article illustrates the importance of a continuum of rehabilitation provision across the injury trajectory, and provides a platform to track future service changes and facilitate the codesign of new rehabilitation interventions for individuals following major trauma. Keywords: group concept mapping; major trauma; rehabilitation; service evaluation.
Patient Reported Outcomes & Quality of Life	Glista, D., O’Hagan, R., Moodie, S., & Scollie, S.	2020	An examination of clinical uptake factors for remote hearing aid support: a concept mapping study with audiologists.	International Journal of Audiology	https://doi.org/10.1080/14992027.2020.1795281	https://www.informahealthcare.com/doi/full/10.1080/14992027.2020.1795281?scroll=top&needAccess=true	University of Western Ontario	To develop a conceptual framework around the factors that influence audiologists in the clinical uptake of remote follow-up hearing aid support services. Design: A purposive sample of 42 audiologists, stratified according to client-focus of either paediatric or adult, were recruited from professional associations in Ontario, Canada, as members of the six-step, participatory-based concept mapping process. Analyses included multidimensional scaling and hierarchical cluster analysis. Results: Six main themes emerged from this research according to overall level of importance: (1) technology and infrastructure; (2) audiologist-centred considerations; (3) hearing healthcare regulations; (4) client-centred considerations; (5) clinical implementation considerations; and (6) financial considerations. Subthemes were identified at the group-level and by subgroup. These highlight the importance of TECH factors (accessible Technology, Easy to use, robust Connection, and Help available), as well as the multi-faceted nature of the perceived attitudes/aptitudes across stakeholders. Conclusion: Findings can be utilised in tailored planning and development efforts to support future research, knowledge dissemination, best-practice protocol/guideline development, and related training to assist in the clinical uptake of remote follow-up hearing aid support services, across variable practice contexts.
Patient Reported Outcomes & Quality of Life	Kiran, T., Wells, D., Okrainec, K., Kennedy, C., Devotta, K., Mabaya, G., Phillips, L., Lang, A., & O'Campo, P.	2020	Patient and caregiver priorities in the transition from hospital to home: Results from province-wide group concept mapping.	BMJ Quality & Safety	https://doi.org/10.1136/bmjqs-2019-009993		University of Toronto	Background: Patients and caregivers often face significant challenges when they are discharged home from hospital. We sought to understand what influenced patient and caregiver experience in the transition from hospital to home and which of these aspects they prioritised for health system improvement. Methods: We conducted group concept mapping over 11 months with patients-and their caregivers-who were admitted to a hospital overnight in the last 3 years in Ontario, Canada and discharged home. Home included supportive housing, shelters and long-term care. Participants responded to a single focal prompt about what affected their experience during the transition. We summarised responses in unique statements. We then recruited participants to rate each statement on a five-point scale on whether addressing this gap should be a priority for the health system. The provincial quality agency recruited participants in partnership with patient, community and healthcare organisations. Participation was online, in-person or virtual. Results: 736 participants provided 2704 responses to the focal prompt. Unique concepts were summarised in 52 statements that were then rated by 271 participants. Participants rated the following three statements most highly as a gap that should be a priority for the health system to address (in rank order): 'Not enough publicly funded home care services to meet the need', 'Home care support is not in place when arriving home from hospital' and 'Having to advocate to get enough home care'. The top priority was consistent across multiple subgroups. Conclusions: In a country with universal health insurance, patients and caregivers from diverse backgrounds consistently prioritised insufficient public coverage for home care services as a gap the health system should address to improve the transition from hospital to home. Keywords: health policy; health services research; healthcare quality improvement; hospital medicine; transitions in care.
Patient Reported Outcomes & Quality of Life	Rachlis, B., Nam, S., Rosenes, R., Santoni, T., Peck, R., Betts, A., Kendall, C., Yoong, D., Sharp, A., Gauvin, H., Goddard, L., Owino, M., Rourke, S. B., Antoniou, T., & Ontario HIV Drug Coverage Study Team	2020	Using Concept Mapping to explore the challenges associated with affording and accessing medications amount people living with HIV in Ontario Canada.	AIDS Care	https://doi.org/10.1080/09540121.2020.1770182		University of Toronto	Antiretroviral medications are expensive, and people living with HIV often experience challenges accessing and paying for medication due to various obstacles. We used concept mapping to explore the challenges people living with HIV in Ontario, Canada, face when accessing medication. In brainstorming, 68 participants generated 447 statements in response to the focus prompt "Some people living with HIV have trouble getting and paying for prescription drugs because … ". These were consolidated into 77 statements, which were sorted (n = 30) and rated (n = 32) on importance and commonality. A ten-cluster concept map consisting of individual- and health system-related clusters was generated. Clusters included: (1) Stigma, (2) Medication-Related Issues, (3) Individual Challenges, (4) Basic Needs, (5) Immigration, (6) Coverage, (7) Trillium Drug Program, (8) Access to Services, (9) System-Level Issues and (10) Access to Professional Services. Statements in Coverage and Basic Needs were rated most important and common although there was variability by Ontario residence and drug coverage mechanisms. Strategies to address challenges were generated in Interpretation (n = 25 participants). Given that continuous access to antiretroviral therapy is necessary to fully realize treatment benefits, policies and interventions that address these challenges are needed. Keywords: HIV; Ontario; access; drug coverage; medications.
Patient Reported Outcomes & Quality of Life	Puid-Barrachina, V., Malmusi, D., Artazcoz, L., Bartoll, X., Clotet, E., Cortes-Franch, I., Ventura, L., Daban, F., Diez, E., & Borrell, C.	2020	How does a targeted active labour market program impact on the well-being of the unemployed? A concept mapping study on Barcelona “Employment in the Neighbourhoods.”	BMC public health	https://doi.org/10.1186/s12889-020-8441-2	https://bmcpublichealth.biomedcentral.com/track/pdf/10.1186/s12889-020-8441-2.pdf	Public Health Organization in Barcelona	The "Employment in the neighbourhoods" program is an innovative, tailor-made Active Labour Market Program that has been implemented in 12 neighbourhoods in Barcelona (Spain). Its goal is to get people from deprived, high-unemployment neighbourhoods back to work. The aim of this study was to describe the effects of the program on participants' quality of life, and identify the mechanisms underlying these effects, according to their own perception and the perception of technical staff who assisted them. Methods: We used Concept Mapping, a mixed methods approach combining qualitative and quantitative analysis, to develop a conceptual map of the participants' and technical staffs' perceptions about changes in the participants' quality of life. Data collection occurred within the generation and structuring steps where participants brainstormed answers to a focus question, and then rated and sorted the responses. To create maps, we used Concept Systems Incorporated The Concept System® Global MAX™ software, which conducted two main forms of analysis, a multidimensional scaling analysis, and a hierarchical cluster analysis. Results: Study participants reported several positive effects on mental health and emotional wellbeing, including self-esteem and empowerment, and considered that this was achieved through strengthened social networks, skills acquisition, emotional coaching, and personalized technical assistance. They also described some negative impacts, mainly related to the labour market situation. We observed marked gender differences in the discourses of program participants. Conclusions: The results obtained have allowed us to identify different perceived effects and mechanisms by which the "Employment in the Neighbourhoods" Active Labour Market Programme can influence quality of life of participants from the most deprived areas of Barcelona. Keywords: Active labour market programs; Barcelona City (Spain); Concept mapping; Deprived neighbourhoods; Gender; Quality of life; Unemployment.
Patient Reported Outcomes & Quality of Life	Rising, K. L., Gentsch, A. T., Mills, G., LaNoue, M., Doty, A., Cunningham, A., Carr, B. G., & Hollander, J. E.	2021	Patient-important outcomes to inform shared decision making and goal setting for diabetes treatment.	Patient education and counseling	https://doi.org/10.1016/j.pec.2021.03.005		Thomas Jefferson University	Despite well-established treatment guidelines, diabetes is difficult to manage for many individuals. The importance of using shared decision making to optimize diabetes treatment is recognized, yet what matters most to individuals with diabetes is not well established. Our goal was to identify patients' goals and priorities for diabetes management. Methods: We engaged 141 participants through interviews and group concept mapping to identify patient-important outcomes (PIOs) for diabetes care. We generated a master list of PIOs by aggregating interview data coded to "goals" and ideas brainstormed during concept mapping, and then a patient advisory board sorted the PIOs into higher-level domains. Results: We identified 41 PIOs sorted into 7 broad domains: optimize daily self-care, optimize long term health, learn about diabetes, achieve measurable goals, manage medications, manage diet and best utilize medical / professional services. Conclusions: Most (4/7) of PIO domains focused on personal and life goals, not medically-oriented goals. Use of these PIOs and domains may facilitate more effective SDM discussions for patients with diabetes. Practice implications: Use of PIOs from this work can enable the empowerment of patients to voice their priorities during SDM conversations, thus facilitating development of truly individualized diabetes treatment plans. Keywords: Diabetes; Group concept mapping; Interviews; Patient engagement; Patient goals; Shared decision making.
Patient Reported Outcomes & Quality of Life	Singer, B. A., Keith, S., Howerter, A., Doll, H., Pham, T., & Mehta, R.	2021	A Study Comparing Patient and Clinician Perspectives of Treatments for Multiple Sclerosis via Group Concept Mapping.	Patient preference and adherence	https://doi.org/10.2147/PPA.S297052	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8126969/pdf/ppa-15-975.pdf	Baptist Medical Center	Clinicians treating multiple sclerosis (MS) should consider patient preferences when making treatment decisions. An online mixed-methods approach to elicit patient-centered concepts, group concept mapping (GCM), was used to generate statements reflecting the patient experience in relapsing-remitting MS and identify the most important patient-centered outcomes from patient and clinician perspectives. Patients and Methods: Twenty patients and 12 MS specialists in the United States provided statements describing what an ideal treatment would do to improve symptoms and daily functioning. Statements were sorted by participants into meaningful domains and rated on importance on an 11-point scale. Results: Sixty-four unique statements supporting 6 domains of clustered concepts were generated. Patient and clinician ratings of importance were highly correlated (r=0.82); however, patients rated the domains of Activities of Daily Living, Prevent & Cure, and Address Symptoms as highest in importance, whereas clinicians rated Prevent & Cure, Safe & Effective, and Activities of Daily Living as highest in importance. Statements rated above the domain mean by both patients and clinicians included “Improve cognitive function” and “Improve motor function” in the Activities of Daily Living domain and “Help with memory issues” and “Help preserve cognition” in the Address Symptoms domain. The statement “Improve short term memory” was 1 of 3 statements rated above the domain mean by patients but below the domain mean by clinicians. Conclusion: High levels of agreement of concept importance were found between patients and MS specialists, although certain domains and statements were rated more highly by one group. Overall, concepts such as cognitive function, physical and emotional functioning, and activities of daily living were perceived as having great importance for treatment outcomes versus symptom-focused outcomes like gait or tingling sensations. This comprehensive concept model for the MS patient experience can be used for further development of patient-centered outcome measures in MS treatment. Keywords: relapsing-remitting multiple sclerosis, patient outcomes, cognitive function, quality of life
Patient Reported Outcomes & Quality of Life	Stolk-Vos, A., De Korne, D., Lamoureux, E., Wai, C., Busschbach, J. J., & van de Klundert, J. J	2021	Multi-stakeholder perspectives in defining health services quality indicators and dimensions: a concept mapping based comparison for cataract care between Singapore and The Netherlands.	BMJ open	https://doi.org/10.1136/bmjopen-2020-046226	https://bmjopen.bmj.com/content/bmjopen/11/4/e046226.full.pdf	Erasmus University	Objective: This study aims to advance understanding of globally valid versus country-specific quality dimensions and indicators, as perceived by relevant stakeholders. It specifically addresses patient-level indicators for cataract surgery. Design: A mixed-methods case study comparing Singapore and The Netherlands Setting Singapore (2017–2019) and The Netherlands (2014–2015). Participants Stakeholder representatives of cataract care in Singapore and The Netherlands. Intervention Based on the previously identified complete set of stakeholders in The Netherlands, we identified stakeholders of cataract care in Singapore. Stakeholder representatives then established a multi-stakeholder perspective on the quality of cataract care using a concept mapping approach. This yielded a multidimensional cluster map based on multivariate statistical analyses. Consensus-based quality dimensions were subsequently defined during a plenary session. Thereafter, Singaporean dimensions were matched with dimensions obtained in The Netherlands to identify commonalities and differences. Main outcome measure Health-services quality dimensions of cataract care. Results: 19 Singaporean stakeholders representing patients, general practitioners, ophthalmologists, nurses, care providers, researchers and clinical auditors defined health-services quality of cataract care using the following eight dimensions: clinical outcome, patient outcomes, surgical process, surgical safety, patient experience, access, cost and standards of care. Compared with the Dutch results, 61% of the indicators were allocated to dimensions of comparable names and compositions. Considerable differences also existed in the composition of some dimensions and the importance attached to indicators. Conclusions and relevance: This study on cataract care in Singapore and The Netherlands shows that cataract care quality measurement instruments can share a common international core. At the same time, it emphasises the importance of taking a country-specific multi-stakeholder approach to quality definition and measurement. Complementing an international core set with country-specific measures is required to ensure that the included dimensions and indicators adequately capture the country-specific quality views.
Patient Reported Outcomes & Quality of Life	WR Alolayan, JM Rieger, MN Yoon	2023	Head and neck cancer treatment outcome priorities: A multi-perspective concept mapping study	Plos One	https://doi.org/10.1371/journal.pone.0294712		University of Alberta, Edmonton	With the increasing focus on patient-centred care, this study sought to understand priorities considered by patients and healthcare providers from their experience with head and neck cancer treatment, and to compare how patients’ priorities compare to healthcare providers’ priorities. Group concept mapping was used to actively identify priorities from participants (patients and healthcare providers) in two phases. In phase one, participants brainstormed statements reflecting considerations related to their experience with head and neck cancer treatment. In phase two, statements were sorted based on their similarity in theme and rated in terms of their priority. Multidimensional scaling and cluster analysis were performed to produce multidimensional maps to visualize the findings. Two-hundred fifty statements were generated by participants in the brainstorming phase, finalized to 94 statements that were included in phase two. From the sorting activity, a two-dimensional map with stress value of 0.2213 was generated, and eight clusters were created to encompass all statements. Timely care, education, and person-centred care were the highest rated priorities for patients and healthcare providers. Overall, there was a strong correlation between patient and healthcare providers’ ratings (r = 0.80). Our findings support the complexity of the treatment planning process in head and neck cancer, evident by the complex maps and highly interconnected statements related to the experience of treatment. Implications for improving the quality of care delivered and care experience of head and cancer are discussed.
Research & Implementation	Reis, R. S., Kelly, C. M., Parra, D. C., Barros, M., Gomes, G., Malta, D., Schmid, T., & Brownson, R. C.	2012	Developing a research agenda for promoting physical activity in Brazil through environmental and policy change.	Revista Panamericana de Salud Pública		https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4746078/pdf/nihms-755665.pdf	Pontifical Catholic University of Paraná	Objective: To identify the highest priorities for research on environmental and policy changes for promoting physical activity (PA) in Brazil; to uncover any gaps between researchers' and practitioners' priorities; and to consider which tools, methods, collaborative strategies, and actions could be useful to moving a research agenda forward. Methods This was a mixed-methods study (qualitative and quantitative) conducted by Project GUIA (Guide for Useful Interventions for Activity in Brazil and Latin America) in February 2010–January 2011. A total of 240 individuals in the PA field (186 practitioners and 54 researchers) were asked to generate research ideas; 82 participants provided 266 original statements from which 52 topics emerged. Participants rated topics by “importance” and “feasibility;” a separate convenience sample of 21 individuals categorized them. Cluster analysis and multidimensional scaling were used to create concept maps and pattern matches. Results Five distinct clusters emerged from the concept mapping, of which “effectiveness and innovation in PA interventions” was rated most important by both practitioners and researchers. Pattern matching showed a divergence between the groups, especially regarding feasibility, where there was no consensus. Conclusions The study results provided the basis for a research agenda to advance the understanding of environmental and policy influences on PA promotion in Brazil and Latin America. These results should stimulate future research and, ultimately, contribute to the evidence-base of successful PA strategies in Latin America.
Research & Implementation	Schell, S. F., Luke, D. A., Schooley, M. W., Elliot, M. B., Herbers, S. H., Mueller, N. B., & Bunger, A. C.	2013	Public health program capacity for sustainability: A new framework.	Implementation Science	https://doi.org/10.1186/1748-5908-8-15	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3599102/pdf/1748-5908-8-15.pdf	Washington University in St. Louis	Public health programs can only deliver benefits if they are able to sustain activities over time. There is a broad literature on program sustainability in public health, but it is fragmented and there is a lack of consensus on core constructs. The purpose of this paper is to present a new conceptual framework for program sustainability in public health. Methods This developmental study uses a comprehensive literature review, input from an expert panel, and the results of concept-mapping to identify the core domains of a conceptual framework for public health program capacity for sustainability. The concept-mapping process included three types of participants (scientists, funders, and practitioners) from several public health areas (e.g., tobacco control, heart disease and stroke, physical activity and nutrition, and injury prevention). Results The literature review identified 85 relevant studies focusing on program sustainability in public health. Most of the papers described empirical studies of prevention-oriented programs aimed at the community level. The concept-mapping process identified nine core domains that affect a program’s capacity for sustainability: Political Support, Funding Stability, Partnerships, Organizational Capacity, Program Evaluation, Program Adaptation, Communications, Public Health Impacts, and Strategic Planning. Concept-mapping participants further identified 93 items across these domains that have strong face validity—89% of the individual items composing the framework had specific support in the sustainability literature. Conclusions The sustainability framework presented here suggests that a number of selected factors may be related to a program’s ability to sustain its activities and benefits over time. These factors have been discussed in the literature, but this framework synthesizes and combines the factors and suggests how they may be interrelated with one another. The framework presents domains for public health decision makers to consider when developing and implementing prevention and intervention programs. The sustainability framework will be useful for public health decision makers, program managers, program evaluators, and dissemination and implementation researchers. Keywords: Program sustainability, Concept mapping, Chronic disease programs, Evaluation, Dissemination and implementation
Research & Implementation	Proctor, E., Luke, D., Calhoun, A., McMillan, C., Brownson, R., McCrary, S., & Padek, M.	2015	Sustainability of evidence-based healthcare: Research agenda, methodological advances, and infrastructure support.	Implementation Science	https://doi.org/10.1186/s13012-015-0274-5	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4494699/pdf/13012_2015_Article_274.pdf	Washington University in St. Louis	Background: Little is known about how well or under what conditions health innovations are sustained and their gains maintained once they are put into practice. Implementation science typically focuses on uptake by early adopters of one healthcare innovation at a time. The later-stage challenges of scaling up and sustaining evidence-supported interventions receive too little attention. This project identifies the challenges associated with sustainability research and generates recommendations for accelerating and strengthening this work. Methods: A multi-method, multi-stage approach, was used: (1) identifying and recruiting experts in sustainability as participants, (2) conducting research on sustainability using concept mapping, (3) action planning during an intensive working conference of sustainability experts to expand the concept mapping quantitative results, and (4) consolidating results into a set of recommendations for research, methodological advances, and infrastructure building to advance understanding of sustainability. Participants comprised researchers, funders, and leaders in health, mental health, and public health with shared interest in the sustainability of evidence-based health care. Results: Prompted to identify important issues for sustainability research, participants generated 91 distinct statements, for which a concept mapping process produced 11 conceptually distinct clusters. During the conference, participants built upon the concept mapping clusters to generate recommendations for sustainability research. The recommendations fell into three domains: (1) pursue high priority research questions as a unified agenda on sustainability; (2) advance methods for sustainability research; (3) advance infrastructure to support sustainability research. Conclusions: Implementation science needs to pursue later-stage translation research questions required for population impact. Priorities include conceptual consistency and operational clarity for measuring sustainability, developing evidence about the value of sustaining interventions over time, identifying correlates of sustainability along with strategies for sustaining evidence-supported interventions, advancing the theoretical base and research designs for sustainability research, and advancing the workforce capacity, research culture, and funding mechanisms for this important work.
Research & Implementation	Scahill, S.	2015	Concept mapping and pattern matching in pharmacy practice research.	In Z. Babar (Ed.) Pharmacy Practice and Research Methods			University of Auckland	This chapter aims to introduce techniques to the pharmacy practice research community that have been applied to the wider health services research sector. The health-care environment is busy, complex and ever-changing, and clear and structured thinking about the future is a challenging task. This is an international problem for the health-care sector, and pharmacy has not escaped this challenge. Pharmacists don’t have an adequate voice and have been found not to think enough about the future. “Concept mapping” is a generic term that describes any process which helps to represent ideas as pictures or maps. There are many types of concept-mapping techniques, and variants have been used mostly to aid individual creativity in problem solving. Usually this occurs through synthesis of maps by a single person who is endeavouring to conceptualise complex issues within health and find solutions to them. Trochim’s Concept-Mapping technique is underpinned by the need for group creativity; it uses mixed methods, is participatory and predominantly interpretative. This means that it is a meld of robust statistical process and subjective interpretation, based on the researcher(s) understanding of study context. The focus of this chapter is to introduce concept mapping and pattern matching and to outline the application of these techniques within the context of community pharmacy practice. A future research agenda is posed.
Research & Implementation	Tubbing, L., Harting, J., & Stronks, K.	2015	Unravelling the concept of integrated public health policy: Concept mapping with Dutch experts from science, policy, and practice.	Health Policy	https://doi.org/10.1016/j.healthpol.2014.12.020		University of Amsterdam	While expectations of integrated public health policy (IPHP) promoting public health are high, assessment is hampered by the concept's ambiguity. This paper aims to contribute to conceptual clarification of IPHP as first step in further measurement development. Methods: In an online concept mapping procedure, we invited 237 Dutch experts, 62 of whom generated statements on characteristics of IPHP. Next, 100 experts were invited, 24 of whom sorted the statements into piles according to their perceived similarity and rated the statements on relevance and measurability. Data was analyzed using concept mapping software. Results: The concept map consisted of 97 statements, grouped into 11 clusters and five themes. Core themes were 'integration', concerning 'policy coherence' and 'organizing connections', and 'health', concerning 'positioning health' and 'addressing determinants'. Peripheral themes were 'generic aspects', 'capacities', and 'goals and setting', which respectively addressed general notions of integrated policy making, conditions for IPHP, and the variety in manifestations of IPHP. Measurability ratings were low compared to relevance. Conclusion: The concept map gives an overview of interrelated themes, distinguishes core from peripheral dimensions, and provides pointers for theories of the policy process. While low measurability ratings indicate measurement difficulties, the core themes provide pointers for systematic insight into IPHP through measurement. Keywords: Concept mapping; Health in all policies; Healthy public policy; Integrated public health policy; Intersectoral action for health.
Research & Implementation	Waltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., Proctor, E. K., & Kirchner, J. E.	2015	Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study.	Implementation Science	https://doi.org/10.1186/s13012-015-0295-0	https://implementationscience.biomedcentral.com/track/pdf/10.1186/s13012-015-0295-0.pdf	Eastern Michigan University	Background: Poor terminological consistency for core concepts in implementation science has been widely noted as an obstacle to effective meta-analyses. This inconsistency is also a barrier for those seeking guidance from the research literature when developing and planning implementation initiatives. The Expert Recommendations for Implementing Change (ERIC) study aims to address one area of terminological inconsistency: discrete implementation strategies involving one process or action used to support a practice change. The present report is on the second stage of the ERIC project that focuses on providing initial validation of the compilation of 73 implementation strategies that were identified in the first phase. Findings Purposive sampling was used to recruit a panel of experts in implementation science and clinical practice (N = 35). These key stakeholders used concept mapping sorting and rating activities to place the 73 implementation strategies into similar groups and to rate each strategy’s relative importance and feasibility. Multidimensional scaling analysis provided a quantitative representation of the relationships among the strategies, all but one of which were found to be conceptually distinct from the others. Hierarchical cluster analysis supported organizing the 73 strategies into 9 categories. The ratings data reflect those strategies identified as the most important and feasible. Conclusions This study provides initial validation of the implementation strategies within the ERIC compilation as being conceptually distinct. The categorization and strategy ratings of importance and feasibility may facilitate the search for, and selection of, strategies that are best suited for implementation efforts in a particular setting.
Research & Implementation	Goldman, A. W., Burmeister, Y., Cesnulevicius, K., Herbert, M., Kane, M., Lescheid, D., McCaffrey, T., Schultz, M., Seilheimer, B., Smit, A., St. Laurent III, G., Berman, B.	2015	Bioregulatory systems medicine: An innovative approach to integrating the science of molecular networks, inflammation, and systems biology with the patient's autoregulatory capacity?	Frontiers in Physiology: Systems Biology	https://doi.org/10.3389/fphys.2015.00225	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4541032/	Cornell University	Bioregulatory systems medicine (BrSM) is a paradigm that aims to advance current medical practices. The basic scientific and clinical tenets of this approach embrace an interconnected picture of human health, supported largely by recent advances in systems biology and genomics, and focus on the implications of multi-scale interconnectivity for improving therapeutic approaches to disease. This article introduces the formal incorporation of these scientific and clinical elements into a cohesive theoretical model of the BrSM approach. The authors review this integrated body of knowledge and discuss how the emergent conceptual model offers the medical field a new avenue for extending the armamentarium of current treatment and healthcare, with the ultimate goal of improving population health.
Research & Implementation	Frerichs, L., Kim, M., Dave, G., Cheney, A., Lich, K. H., Jones, J., Young, T. L., Cene, C., W., Varma, D. S., Schaal, J., Black, A., Striley, C. W., Vassar, S., Sullivan, G., Cottler, L. B., Brown, A., Burker, J. G., Corbie-Smith, G.	2016	Stakeholder perspectives on creating and maintaining trust in community-academic research partnerships.	Health Education & Behavior	https://doi.org/10.1177/1090198116648291	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6051524/pdf/nihms980873.pdf	University of North Carolina at Chapel Hill	Community–academic research partnerships aim to build stakeholder trust in order to improve the reach and translation of health research, but there is limited empirical research regarding effective ways to build trust. This multisite study was launched to identify similarities and differences among stakeholders’ perspectives of antecedents to trust in research partnerships. In 2013–2014, we conducted a mixed-methods concept mapping study with participants from three major stakeholder groups who identified and rated the importance of different antecedents of trust on a 5-point Likert-type scale. Study participants were community members (n = 66), health care providers (n = 38), and academic researchers (n = 44). All stakeholder groups rated “authentic communication” and “reciprocal relationships” the highest in importance. Community members rated “communication/methodology to resolve problems” (M = 4.23, SD = 0.58) significantly higher than academic researchers (M = 3.87, SD = 0.67) and health care providers (M = 3.89, SD = 0.62; p < .01) and had different perspectives regarding the importance of issues related to “sustainability.” The importance of communication and relationships across stakeholders indicates the importance of colearning processes that involve the exchange of knowledge and skills. The differences uncovered suggest specific areas where attention and skill building may be needed to improve trust within partnerships. More research on how partnerships can improve communication specific to problem solving and sustainability is merited. Keywords: collaboration, community-based participatory research, translational research, trust
Research & Implementation	Tabak, R. G., Padek, M. M., Kerner, J. F., Stange, K. C., Proctor, E. K., Dobbins, M. J., Colditz, G. A., Chambers, D. A., & Brownson, R. C.	2017	Dissemination and implementation science training needs: Insights from practitioners and researchers.	American Journal of Preventive Medicine	https://doi.org/10.1016/j.amepre.2016.10.005	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5321656/pdf/nihms843815.pdf	Washington University in St. Louis	Dissemination and implementation research training has great potential to improve the impact and reach of health-related research; however, research training needs from the end user perspective are unknown. This paper identifies and prioritizes dissemination and implementation research training needs. Methods A diverse sample of researchers, practitioners, and policymakers was invited to participate in Concept Mapping in 2014–2015. Phase 1 (Brainstorming) gathered participants’ responses to the prompt: To improve the impact of research evidence in practice and policy settings, a skill in which researchers need more training is… The resulting statement list was edited and included subsequent phases. Phase 2 (Sorting) asked participants to sort each statement into conceptual piles. In Phase 3 (Rating), participants rated the difficulty and importance of incorporating each statement into a training curriculum. A multidisciplinary team synthesized and interpreted the results in 2015–2016. Results During Brainstorming, 60 researchers and 60 practitioners/policymakers contributed 274 unique statements. Twenty-nine researchers and 16 practitioners completed sorting and rating. Nine concept clusters were identified: Communicating Research Findings, Improve Practice Partnerships, Make Research More Relevant, Strengthen Communication Skills, Develop Research Methods and Measures, Consider and Enhance Fit, Build Capacity for Research, and Understand Multilevel Context. Though researchers and practitioners had high agreement about importance (r =0.93) and difficulty (r =0.80), ratings differed for several clusters (e.g., Build Capacity for Research). Conclusions Including researcher and practitioner perspectives in competency development for dissemination and implementation research identifies skills and capacities needed to conduct and communicate contextualized, meaningful, and relevant research.
Research & Implementation	Powell, B. J., Stanick, C. F., Halko, H. M., Dorsey, C. N., Weiner, B. J., Barwick, M. A., Damschroder, L. J., Wensing, M., Wolfenden, L., & Lewis, C. C.	2017	Toward criteria for pragmatic measurement in implementation research and practice: A stakeholder-driven approach using concept mapping.	Implementation Science	https://doi.org/10.1186/s13012-017-0649-x	https://implementationscience.biomedcentral.com/track/pdf/10.1186/s13012-017-0649-x.pdf	University of North Carolina at Chapel Hill	Advancing implementation research and practice requires valid and reliable measures of implementation determinants, mechanisms, processes, strategies, and outcomes. However, researchers and implementation stakeholders are unlikely to use measures if they are not also pragmatic. The purpose of this study was to establish a stakeholder-driven conceptualization of the domains that comprise the pragmatic measure construct. It built upon a systematic review of the literature and semi-structured stakeholder interviews that generated 47 criteria for pragmatic measures, and aimed to further refine that set of criteria by identifying conceptually distinct categories of the pragmatic measure construct and providing quantitative ratings of the criteria’s clarity and importance. Methods: Twenty-four stakeholders with expertise in implementation practice completed a concept mapping activity wherein they organized the initial list of 47 criteria into conceptually distinct categories and rated their clarity and importance. Multidimensional scaling, hierarchical cluster analysis, and descriptive statistics were used to analyze the data. Findings: The 47 criteria were meaningfully grouped into four distinct categories: (1) acceptable, (2) compatible, (3) easy, and (4) useful. Average ratings of clarity and importance at the category and individual criteria level will be presented. Conclusions: This study advances the field of implementation science and practice by providing clear and conceptually distinct domains of the pragmatic measure construct. Next steps will include a Delphi process to develop consensus on the most important criteria and the development of quantifiable pragmatic rating criteria that can be used to assess measures.
Research & Implementation	Lotrecchiano, G. R., Kane, M., Zocchi, M. S., Gosa, J., Lazar, D., & Pines, J. M.	2017	Bringing voice in policy building: A cross-population multi-stakeholder conceptual model for management of acute unscheduled care in the United States using group concept mapping.	Leadership in Health Sciences	https://doi.org/10.1108/LHS-07-2016-0034		George Washington University	Purpose: The purpose of this paper is to describe the use of group concept mapping (GCM) as a tool for developing a conceptual model of an episode of acute, unscheduled care from illness or injury to outcomes such as recovery, death and chronic illness. Design/methodology/approach: After generating a literature review drafting an initial conceptual model, The Concept System® Global MAX™ is used to organize and identify strengths and directionality between concepts generated through feedback about the model from several stakeholder groups: acute care and non-acute care providers, patients, payers and policymakers. Through online and in-person population-specific focus groups, the GCM approach seeks feedback, assigned relationships and articulated priorities from participants to produce an output map that described overarching concepts and relationships within and across subsamples. Findings: A clustered concept map made up of relational data points that produced a taxonomy of feedback was used to update the model for use in soliciting additional feedback from two technical expert panels (TEPs), and finally, a public comment exercise was performed. The results were a stakeholder-informed improved model for an acute care episode, identified factors that influence process and outcomes, and policy recommendations, which were delivered to the Department of Health and Human Services's (DHHS) Assistant Secretary for Preparedness and Response. Practical implications This study provides an example of the value of cross-population multi-stakeholder input to increase voice in shared problem health stakeholder groups. Originality/value: This paper provides GCM results and a visual analysis of the relational characteristics both within and across sub-populations involved in the study. It also provides an assessment of observational key factors supporting how different stakeholder voices can be integrated to inform model development and policy recommendations. Keywords: Federal policy; Group concept mapping; Multiple stakeholders.
Research & Implementation	Dave, G., Frerichs, L., Jones, J., Kim, M., Schaal, J., Vassar, S., Varma, D., Striley, C., Ruktanonchai, C., Black, A., Hankins, J., Lovelady, N., Cene, C., Green, M., Young, T., Tiwari, S., Cheney, A., Cottler, L., Sullivan, G., Brown, A., Burke, J., & Corbie-Smith, G.	2018	Conceptualizing trust in community-academic research partnerships using concept mapping approach: A multi-CTSA study.	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2017.10.007	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5705432/	University of North Carolina-Chapel Hill	Objectives: Collaborations between communities, healthcare practices and academic institutions are a strategy to address health disparities. Trust is critical in the development and maintaining of effective collaborations. The aim of this pilot study was to engage stakeholders in defining determinants of trust in community academic research partnerships and to develop a framework for measuring trust. Methods: The study was conducted by five collaborating National Institute of Health' Clinical and Translational Sciences Awardees. We used concept mapping to engage three stakeholders: community members, healthcare providers and academicians. We conducted hierarchical cluster analysis to assess the determinants of trust in community-academic research partnerships. Results: A total of 186 participants provided input generating 2,172 items that were consolidated into 125 unique items. A five cluster solution was defined: authentic, effective and transparent communication; mutually respectful and reciprocal relationships; sustainability; committed partnerships; and, communication, credibility and methodology to anticipate and resolve problems. Conclusion: Results from this study contribute to an increasing empirical body of work to better understand and improve the underlying factors that contribute to building and sustaining trust in community academic research partnerships. Keywords: CBPR; CTSA; Community Engagement; Community-Academic Partnerships; Community-Engaged Research; Concept Mapping; Evaluation; Research Outcomes; Translational Research; Trust.
Research & Implementation	Birken, S. A., Rohweder, C. L., Powell, B. J., Shea, C. M., Scott, J., Leeman, J., Grewe, M. E., Kirk, M. A., Damschroder, L., Aldridge II, W. A., Haines, E. R., Straus, S., & Presseau, J.	2018	T-CaST: An implementation theory comparison and selection tool.	Implementation Science	https://doi.org/10.1186/s13012-018-0836-4	https://implementationscience.biomedcentral.com/track/pdf/10.1186/s13012-018-0836-4.pdf	University of North Carolina at Chapel Hill	Background: Theories, models, and frameworks (TMF) are foundational for generalizing implementation efforts and research findings. However, TMF and the criteria used to select them are not often described in published articles, perhaps due in part to the challenge of selecting from among the many TMF that exist in the field. The objective of this international study was to develop a user-friendly tool to help scientists and practitioners select appropriate TMF to guide their implementation projects. Methods: Implementation scientists across the USA, the UK, and Canada identified and rated conceptually distinct categories of criteria in a concept mapping exercise. We then used the concept mapping results to develop a tool to help users select appropriate TMF for their projects. We assessed the tool’s usefulness through expert consensus and cognitive and semi-structured interviews with implementation scientists. Results: Thirty-seven implementation scientists (19 researchers and 18 practitioners) identified four criteria domains: usability, testability, applicability, and familiarity. We then developed a prototype of the tool that included a list of 25 criteria organized by domain, definitions of the criteria, and a case example illustrating an application of the tool. Results of cognitive and semi-structured interviews highlighted the need for the tool to (1) be as succinct as possible; (2) have separate versions to meet the unique needs of researchers versus practitioners; (3) include easily understood terms; (4) include an introduction that clearly describes the tool’s purpose and benefits; (5) provide space for noting project information, comparing and scoring TMF, and accommodating contributions from multiple team members; and (6) include more case examples illustrating its application. Interview participants agreed that the tool (1) offered them a way to select from among candidate TMF, (2) helped them be explicit about the criteria that they used to select a TMF, and (3) enabled them to compare, select from among, and/or consider the usefulness of combining multiple TMF. These revisions resulted in the Theory Comparison and Selection Tool (T-CaST), a paper and web-enabled tool that includes 16 specific criteria that can be used to consider and justify the selection of TMF for a given project. Criteria are organized within four categories: applicability, usability, testability, and acceptability. Conclusions: T-CaST is a user-friendly tool to help scientists and practitioners select appropriate TMF to guide implementation projects. Additionally, T-CaST has the potential to promote transparent reporting of criteria used to select TMF within and beyond the field of implementation science.
Research & Implementation	Klesges, L. M., Vinson, C. A., & Kane, M.	2018	Concept mapping of implementation research priorities in rural cancer control: A two-phased project.	National Cancer Institute, University of Memphis Foundation		https://cancercontrol.cancer.gov/sites/default/files/2020-09/Summary-Concept-Mapping-Report-Rural-2018-final.pdf	University of Memphis	This project was conducted between May and November 2017 to provide perspectives for identifying cancer control research questions that address disparities in rural areas of the United States. The project transpired in two phases beginning with a research meeting entitled, Rural Cancer Control: Challenges and Opportunities,” held at University of Memphis May 4-5, 20172. The phase I meeting was planned by a multi-disciplinary panel of rural health experts including researchers, practitioners, and stakeholders, who identified critical areas of need within the context of implementation research across the cancer control continuum. Speaker presentations and panel discussions addressed these key areas and participants and attendees identified opportunities for future rural cancer control research within topics of prevention, emerging methods, information technology to address disparities, clinical research and quality of care, and improving access, engagement and care experiences. Summary of small group discussions during the conference lead to initial themes and topics statements for further development (described in Phase I). The second phase of this project explored specific dissemination and implementation research questions that could inform future research opportunities developed and funded by the National Cancer Institute. Group concept mapping (GCM) was used to develop and create a visual map of foundational dissemination and implementation research questions relevant to rural cancer control. Participants from the phase 1 meeting provided additional content during an on-line brainstorming session by responding to a focus prompt: To achieve measurable progress in Rural Cancer Prevention and Control, a comprehensive research and translation agenda would consider or include... Respondent statements were reviewed for responsiveness to the original focus prompt and merged with content from the Memphis meeting breakout sessions. Similar statements from Phase I and Phase II were combined and the final set was reduced to 107. These statements were then presented to 69 participants (researchers, intermediaries and practitioners) to be sorted into conceptually similar groups and rated on importance and current state of the research. Results were analyzed to determine which statements were frequently grouped together, and which were not, by all participants in the sorting phase. Multi-dimensional scaling analysis was used to provide a visual representation of similarities and dissimilarities of the statements generated from the sorting phase. Coordinates for individual statements are generated and a two-dimensional point map was generated that shows the relation between all statements. Statements that were frequently grouped together (high correlation) are closer than statements that were not generally grouped together. Hierarchical cluster analysis was conducted to create a cluster map that shows how statements are grouped together and allowed themes to be identified Themes identified from the group concept mapping included: a need to leverage data and technology, define rural research context, adapt research approaches, use systems approaches in community, build trust and recognition, adapt models, identify care and access issues and focus on prevention and self-care (described in Phase II). This report describes the outcomes from the two different phases of the project and provides a roadmap for implementation science research in rural cancer control, emphasizing the critical aspects of context and capacity to adapt current knowledge and models. Rather than suggesting the need for new structures and systems, the map suggests that integration of existing capacity and knowledge may provide the strongest approach to an informed and agreed-upon structure for implementation science in rural environments.
Research & Implementation	Dopp, A. R., Parisi, K. E., Munson, S. A., & Lyon, A. R.	2018	A glossary of user-centered design strategies for implementation experts.	Translational Behavioral Medicine	https://doi.org/10.1093/tbm/iby119	https://www.researchgate.net/profile/Kathryn-Parisi/publication/329485496_A_glossary_of_user-centered_design_strategies_for_implementation_experts/links/5c2ee63e299bf12be3ab432b/A-glossary-of-user-centered-design-strategies-for-implementation-experts.pdf?origin=publication_detail	University of Arkansas	User-centered design (UCD), a discipline that seeks to ground the design of an innovation in information about the people who will ultimately use that innovation, has great potential to improve the translation of evidence-based practices from behavioral medicine research for implementation in health care settings. UCD is a diverse, innovative field that remains highly variable in terms of language and approaches. Ultimately, we produced a glossary of UCD-related strategies specifically for experts in implementation research and practice, with the goal of promoting interdisciplinary collaboration in implementation efforts. We conducted a focused literature review to identify key concepts and specific strategies of UCD to translate into the implementation field. We also categorized the strategies as primarily targeting one or more levels of the implementation process (i.e., interventions, individuals, inner context, and outer context). Ultimately, we produced a glossary of 30 UCD strategies for implementation experts. Each glossary term is accompanied by a short, yet comprehensive, definition. The strategies and their definitions are illustrated, using a hypothetical behavioral medicine intervention as an example, for each of the four levels of the implementation process. This UCD glossary may prove useful to implementation experts who wish to develop effective collaborations and “shared language” with UCD experts to enhance use of behavioral medicine research in health services. Directions for future research are also discussed.
Research & Implementation	Phad, A., Johnston, S., Tabak, R. G., Mazzucca, S., & Haire-Joshu, D.	2019	Developing priorities to achieve health equity through diabetes translation research: A concept mapping study.	BMJ Open Diabetes Research & Care	https://doi.org/10.1136/bmjdrc-2019-000851	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6936412/pdf/bmjdrc-2019-000851.pdf	Washington University in St. Louis	Introduction: The goal of diabetes translation research is to advance research into practice and ensure equitable benefit from scientific evidence. This study uses concept mapping to inform and refine future directions of diabetes translation research with the goal of achieving health equity in diabetes prevention and control. Research design and methods This study used concept mapping and input from a national network of diabetes researchers and public health practitioners. Concept mapping is a mixed-method, participant-based process. First, participants generated statements by responding to a focus prompt (“To eliminate disparities and achieve health equity in the prevention and treatment of diabetes, research should…”). Participants then sorted statements by conceptual similarity and rated each statement on importance and feasibility (Likert scale of 1–5). A cluster map was created using multidimensional scaling and hierarchical cluster analysis; statements were plotted by average importance and feasibility. Results Ten clusters were identified containing between 6 and 12 statements from 95 total generated statements. The ranges of average importance and feasibility ratings for clusters were fairly high and narrow (3.62–4.09; 3.10–3.93, respectively). Clusters with the most statements in the “go-zone” quadrant (above average importance/feasibility) were community and partner engagement (n=7), dissemination and implementation principles (n=4), and enrichment and capacity building (n=4). Clusters with the most statements in the “innovative-targets” quadrant (above average importance, below average feasibility) included next generation interventions (n=6), policy approaches (n=4), and interventions for specific populations (n=4). Conclusions This study created a framework of 10 priority areas to guide current and future efforts in diabetes translation research to achieve health equity. Themes rated as highly important and feasible provide the basis to evaluate current research support. Future efforts should explore how to best support innovative-targets, those rated highly important but less feasible. Keywords: translation research, health disparities
Research & Implementation	Rivas, C., Tkacz, D., Antao, L., Mentzakis, E., Gordon, M., Anstee, S., and Giordano, R.	2019	Automated analysis of free-text comments and dashboard representations in patient experience surveys: a multimethod co-design study.	Health Service Delivery Research	https://doi.org/10.3310/hsdr07230	https://www.ncbi.nlm.nih.gov/books/NBK543270/	University of Southampton	Background: Patient experience surveys (PESs) often include informative free-text comments, but with no way of systematically, efficiently and usefully analysing and reporting these. The National Cancer Patient Experience Survey (CPES), used to model the approach reported here, generates > 70,000 free-text comments annually. Main aim: To improve the use and usefulness of PES free-text comments in driving health service changes that improve the patient experience. Secondary aims: (1) To structure CPES free-text comments using rule-based information retrieval (IR) (‘text engineering’), drawing on health-care domain-specific gazetteers of terms, with in-built transferability to other surveys and conditions; (2) to display the results usefully for health-care professionals, in a digital toolkit dashboard display that drills down to the original free text; (3) to explore the usefulness of interdisciplinary mixed stakeholder co-design and consensus-forming approaches in technology development, ensuring that outputs have meaning for all; and (4) to explore the usefulness of Normalisation Process Theory (NPT) in structuring outputs for implementation and sustainability. Design: A scoping review, rapid review and surveys with stakeholders in health care (patients, carers, health-care providers, commissioners, policy-makers and charities) explored clinical dashboard design/patient experience themes. The findings informed the rules for the draft rule-based IR [developed using half of the 2013 Wales CPES (WCPES) data set] and prototype toolkit dashboards summarising PES data. These were refined following mixed stakeholder, concept-mapping workshops and interviews, which were structured to enable consensus-forming ‘co-design’ work. IR validation used the second half of the WCPES, with comparison against its manual analysis; transferability was tested using further health-care data sets. A discrete choice experiment (DCE) explored which toolkit features were preferred by health-care professionals, with a simple cost–benefit analysis. Structured walk-throughs with NHS managers in Wessex, London and Leeds explored usability and general implementation into practice. Key outcomes: A taxonomy of ranked PES themes, a checklist of key features recommended for digital clinical toolkits, rule-based IR validation and transferability scores, usability, and goal-oriented, cost–benefit and marketability results. The secondary outputs were a survey, scoping and rapid review findings, and concordance and discordance between stakeholders and methods. Results: (1) The surveys, rapid review and workshops showed that stakeholders differed in their understandings of the patient experience and priorities for change, but that they reached consensus on a shortlist of 19 themes; six were considered to be core; (2) the scoping review and one survey explored the clinical toolkit design, emphasising that such toolkits should be quick and easy to use, and embedded in workflows; the workshop discussions, the DCE and the walk-throughs confirmed this and foregrounded other features to form the toolkit design checklist; and (3) the rule-based IR, developed using noun and verb phrases and lookup gazetteers, was 86% accurate on the WCPES, but needs modification to improve this and to be accurate with other data sets. The DCE and the walk-through suggest that the toolkit would be well accepted, with a favourable cost–benefit ratio, if implemented into practice with appropriate infrastructure support. Limitations: Small participant numbers and sampling bias across component studies. The scoping review studies mostly used top-down approaches and focused on professional dashboards. The rapid review of themes had limited scope, with no second reviewer. The IR needs further refinement, especially for transferability. New governance restrictions further limit immediate use. Conclusions: Using a multidisciplinary, mixed stakeholder, use of co-design, proof of concept was shown for an automated display of patient experience free-text comments in a way that could drive health-care improvements in real time. The approach is easily modified for transferable application. Future work: Further exploration is needed of implementation into practice, transferable uses and technology development co-design approaches. Funding: The National Institute for Health Research Health Services and Delivery Research programme.
Research & Implementation	Rogal, S. S., Yakovchenko, V., Waltz, T. J., Powell, B. J., Gonzalez, R., Park, A., Chartier, M., Ross, D., Morgan, T. R., Kirchner, J. E., Proctor, E. K., & Chinman, M. J.	2019	Longitudinal assessment of the association between implementation strategy use and the uptake of hepatitis C treatment: Year 2.	Implementation Science	https://doi.org/10.1186/s13012-019-0881-7	https://implementationscience.biomedcentral.com/track/pdf/10.1186/s13012-019-0881-7.pdf	University of Pittsburgh	To increase the uptake of evidence-based treatments for hepatitis C (HCV), the Department of Veterans Affairs (VA) established the Hepatitis Innovation Team (HIT) Collaborative. Teams of providers were tasked with choosing implementation strategies to improve HCV care. The aim of the current evaluation was to assess how site-level implementation strategies were associated with HCV treatment initiation and how the use of implementation strategies and their association with HCV treatment changed over time. Methods: A key HCV provider at each VA site (N = 130) was asked in two consecutive fiscal years (FYs) to complete an online survey examining the use of 73 implementation strategies organized into nine clusters as described by the Expert Recommendations for Implementing Change (ERIC) study. The number of Veterans initiating treatment for HCV, or “treatment starts,” at each site was captured using national data. Providers reported whether the use of each implementation strategy was due to the HIT Collaborative. Results: Of 130 sites, 80 (62%) responded in Year 1 (FY15) and 105 (81%) responded in Year 2 (FY16). Respondents endorsed a median of 27 (IQR19–38) strategies in Year 2. The strategies significantly more likely to be chosen in Year 2 included tailoring strategies to deliver HCV care, promoting adaptability, sharing knowledge between sites, and using mass media. The total number of treatment starts was significantly positively correlated with total number of strategies endorsed in both years. In Years 1 and 2, respectively, 28 and 26 strategies were significantly associated with treatment starts; 12 strategies overlapped both years, 16 were unique to Year 1, and 14 were unique to Year 2. Strategies significantly associated with treatment starts shifted between Years 1 and 2. Pre-implementation strategies in the “training/educating,” “interactive assistance,” and “building stakeholder interrelationships” clusters were more likely to be significantly associated with treatment starts in Year 1, while strategies in the “evaluative and iterative” and “adapting and tailoring” clusters were more likely to be associated with treatment starts in Year 2. Approximately half of all strategies were attributed to the HIT Collaborative. Conclusions: These results suggest that measuring implementation strategies over time is a useful way to catalog implementation of an evidence-based practice over time and across settings.
Research & Implementation	Sommerfeld, D. H., Granholm, E., Holden, J., Seijo, C., Rapoport, C. S., Mueser, K. T., Naqvi, J. B., & Aarons, G. A.	2019	Concept mapping study of stakeholder perceptions of implementation of cognitive-behavioral social skills training on assertive community treatment teams.	Psychological Services	https://doi.org/10.1037/ser0000335	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6778484/pdf/nihms-1013175.pdf	University of Michigan	This study aimed to identify factors associated with implementation of Cognitive Behavioral Social Skills Training (CBSST) on Assertive Community Treatment teams in a large public sector behavioral health system. This study used Concept Mapping (a mixed-method approach) and involved a sample including diverse stakeholder participants, including patients, ACT team members, team leaders, organization leaders, and system leaders. We identified 14 distinct issues related to implementing CBSST on ACT teams: 1) CBSST Fit with ACT Structure; 2) CBSST Fit with ACT Process; 3) Provider Perceptions about CBSST; 4) Staff Pressures/Other Demands; 5) CBSST & ACT Synergy; 6) Client Characteristics; 7) Benefits of CBSST; 8) Coordination/Interaction among ACT Providers; 9) Gov./Regulatory Factors; 10) Integration of CBSST into ACT; 11) Training Support; 12) Training Resources; 13) Multi-Level Agency Leadership; 14) Provider Characteristics. Each of these dimensions were rated in regard to importance and changeability with the top five rated dimensions including effective training support, alignment of leadership across levels of the community-based organizations delivering services, perceived benefits of CBSST, CBSST and ACT synergy, and provider perceptions of CBSST. The most critical issues for CBSST implementation on ACT teams should be addressed in future studies. Implementation strategies that capitalize on enhancing leadership and organizational climate hold promise to address all of these issues
Research & Implementation	Dopp, A. R., Parisi, K. E., Munson, S. A., & Lyon, A. R.	2019	Integrating implementation and user-centered design strategies to enhance the impact of health services: Protocol from a concept mapping study.	Health Research Policy and Systems	https://doi.org/10.1186/s12961-018-0403-0	https://health-policy-systems.biomedcentral.com/track/pdf/10.1186/s12961-018-0403-0.pdf	University of Arkansas	Background: Innovative approaches are needed to maximise the uptake and sustainment of evidence-based practices in a variety of health service contexts. This protocol describes a study that will seek to characterise the potential of one such approach, user-centred design (UCD), which is an emerging field that seeks to ground the design of an innovation in information about the people who will ultimately use that innovation. The use of UCD to enhance strategies for implementation of health services, although promising, requires a multidisciplinary perspective based on a firm understanding of how experts from each discipline perceives the interrelatedness and suitability of these strategies. Method: This online study will use a combination of purposive and snowball sampling to recruit a sample of implementation experts (n = 30) and UCD experts (n = 30). These participants will each complete a concept mapping task, which is a mixed-method conceptualisation technique that will allow for identification of distinct clusters of implementation and/or UCD strategies. The research team has selected a set of implementation strategies and UCD strategies that each participant will sort and rate on dimensions of importance and feasibility. Data analyses will focus on describing the sample, identifying related clusters of strategies, and examining the convergences, divergences, and potential for collaboration between implementation science and UCD. Discussion: By leading to a better understanding of the overlap between implementation science and UCD, grounded within established theoretical frameworks, this study holds promise for improving the impact and sustainability of evidence-based health services in community settings.
Research & Implementation	Rauwerdink, A., Kasteleyn, M. J., Haafkens, J. A., Chavannes, N. H., Schijven, M. P., on behalf of the steering committee of the Citrien fund program eHealth.	2019	A national eHealth vision developed by University Medical Centres: A concept mapping study.	International Journal of Medical Informatics	https://doi.org/10.1016/j.ijmedinf.2019.104032		University of Amsterdam	EHealth solutions are envisaged to contribute significantly to a sustainable healthcare system. Between 2016 and 2018 the eight Dutch University Medical Centers (UMCs) received Dutch Government's funding to undertake research into the clinical impact, cost-effectiveness and ethical consideration of eHealth. The UMCs collaborated within the consortium ‘Citrien fund (CF) program eHealth’ and found that, in order to increase the value of eHealth in routine care, a national vision on eHealth developed by the UMCs was warranted. Objective: The objective of this paper was to elucidate the process of the ‘Netherlands Federation of UMCs (NFU) eHealth vision' development by describing the results of the performed concept mapping study. Methods: A concept mapping approach was followed. Sixteen members of the steering committee of the CF program eHealth were selected as participants. First, each member selected relevant objectives from the eight individual UMC eHealth vision documents, which was to be incorporated into the overall 'NFU eHealth vision'. Second, objectives were rated for necessary to be included in the vision document and the need to achieve the objective within five years. Thereafter, the objectives were sorted into self-created thematic clusters. And finally, the concept map with the thematic clusters and corresponding objectives was discussed with the steering committee to determine the major themes of the ‘NFU eHealth vision’. Results: 38 objectives were determined by the steering committee and grouped into the following 6 thematic clusters on the concept map: ‘patient participation and empowerment’; ‘infrastructure’; ‘education and research’; ‘multi-disciplinary care’; ‘organisational restructuring’; and ‘essential conditions for development of eHealth solutions’. After discussing the concept mapping results with the steering committee, the following five major themes were determined to be addressed in the vision document: ‘patient and caregiver’; ‘research and innovation’; ‘education’; ‘organisation of care’; and ‘essential conditions for development of eHealth solutions’. Conclusion: Concept mapping was successfully applied to conceptualise the different values and opinions of the eight Dutch UMCs in order to develop a national vision on eHealth. This vision document will give direction to the development, evaluation and implementation of eHealth in the eight Dutch UMCs and their adherent.
Research & Implementation	Krahn, M. D., Bremner, K. E., de Oliveira, C., Almeida, N., Clement, F., Lorenzetti, D. L., O'Campo, P., Pechlivanoglou, P., & Tricco, A. C.	2019	Picturing ELSI+: A visual representation of ethical, legal, and social issues, and patient experiences in Health Technology Assessment in Canada.	International Journal of Technology Assessment in Health Care	https://doi.org/10.1017/S0266462319000722		University Health Network, Toronto	Objectives: Consideration of ethical, legal, and social issues plus patient values (ELSI+) in health technology assessment (HTA) is challenging because of a lack of conceptual clarity and the multi-disciplinary nature of ELSI+. We used concept mapping to identify key concepts and inter-relationships in the ELSI+ domain and provide a conceptual framework for consideration of ELSI+ in HTA. Methods: We conducted a scoping review (Medline and EMBASE, 2000-2016) to identify ELSI+ issues in the HTA literature. Items from the scoping review and an expert brainstorming session were consolidated into eighty ELSI+-related statements, which were entered into Concept Systems® Global MAX™ software. Participants (N = 38; 36 percent worked as researchers, 21 percent as academics; 42 percent self-identified as HTA experts) sorted the statements into thematic groups, and rated them on importance in making decisions about adopting technologies in Canada, from 1 (not at all important) to 5 (extremely important). We used Concept Systems® Global MAX™ software to create and analyze concept maps with four to sixteen clusters. Results: Our final ELSI+ map consisted of five clusters, with each cluster representing a different concept and the statements within each cluster representing the same concept. Based on the concepts, we named these clusters: patient preferences/experiences, patient quality of life/function, patient burden/harm, fairness, and organizational. The highest mean importance ratings were for the statements in the patient burden/harm (3.82) and organizational (3.92) clusters. Conclusions: This study suggests an alternative approach to ELSI+, based on conceptual coherence rather than academic disciplines. This will provide a foundation for incorporating ELSI+ into HTA. Keywords: Concept map; ELSI; Health technology assessment; Patient preferences; Patient values.
Research & Implementation	Kim, M. M., Cheney, A., Black, A. S., Thorpe, Jr. R. J., Cene, C. D., Dave, G. J., Schaal, J., Vassar, S., Ruktanonchai, C., Frerichs, L., Young, T., Jones, J., Burke, J., Varma, D., Striley, C., Cottler, L., Brown, A., Sullivan, G., & Corbie-Smith, G.	2019	Trust in community-engaged research partnerships: A methodological overview of designing a multisite clinical and translational science awards (CTSA) initiative.	Evaluation & the Health Professions	https://doi.org/10.1177/0163278718819719	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6752969/pdf/nihms-1049987.pdf	Duke University	Community-engaged research (CEnR) builds on the strengths of the Clinical and Translational Science Awards (CTSA) framework to address health in underserved and minority communities. There is a paucity of studies that identify the process from which trust develops in CEnR partnerships. This study responds to the need for empirical investigation of building and maintaining trust from a multistakeholder perspective. We conducted a multi-institutional pilot study using concept mapping with to better understand how trust, a critical outcome of CEnR partnerships, can act as "social capital." Concept mapping was used to collect data from the three stakeholder groups: community, health-care, and academic research partners across three CTSAs. Concept mapping is a mixed-methods approach that allows participants to brainstorm and identify factors that contribute to a concept and describe ways in which those factors relate to each other. This study offers important insights on developing an initial set of trust measures that can be used across CTSAs to understand differences and similarities in conceptualization of trust among key stakeholder groups, track changes in public trust in research, identify both positive and negative aspects of trust, identify characteristics that maintain trust, and inform the direction for future research.
Research & Implementation	Kwok, E. Y. L., Moodie, S. T., Cunningham, B. J., & Oram Cardy, J. E.	2020	Selecting and Tailoring Implementation Interventsion: a Concept Mapping Approach.	BMC Health Services Research	https://doi.org/10.1186/s12913-020-05270-x	https://bmchealthservres.biomedcentral.com/track/pdf/10.1186/s12913-020-05270-x.pdf	University of Western Ontario	To improve the uptake of research into practice, knowledge translation frameworks recommend tailoring implementation strategies to address practice barriers. This study reports our experience pairing the Theoretical Domains Framework with information from multiple stakeholder groups to co-develop practice-informed strategies for improving the implementation of an evidence-based outcome measurement tool across a large community health system for preschoolers with communication impairments. Methods Concept mapping was used to identify strategies for improving implementation of the Focus on the Outcomes of Communication Under Six (FOCUS) in Ontario Canada’s Preschool Speech and Language Program. This work was done in five stages. First, we interviewed 37 speech-language pathologists (clinicians) who identified 90 unique strategies to resolve practice barriers to FOCUS implementation. Second, clinicians (n = 34), policy-makers (n = 3), and members of the FOCUS research team (n = 6) sorted and rated the strategies by importance and feasibility. Third, stakeholders’ sorting data were analyzed to generate a two-dimensional concept map. Based on the rating data from stakeholders, we prioritized a list of strategies that were rated as highly important and highly feasible, and summarized the practice barriers addressed by each of the prioritized strategies. Fourth, we validated these findings with stakeholders via an online survey. Fifth, the mechanisms of action of the prioritized list of strategies were considered based on available evidence from the Theoretical Domains Framework and associated behavior change literature. Results Stakeholders categorized the 90 unique implementation strategies into a six-cluster concept map. Based on stakeholders’ ratings, a list of 14 implementation strategies were prioritized. These implementation strategies were reported to resolve barriers within the environmental context and resources and beliefs about consequences domains of the Theoretical Domains Framework. All but one of the prioritized strategies have a demonstrated link in resolving existing barriers according to the behavioral change literature. Conclusions Our study contributes to a growing literature that demonstrates the process of tailoring implementation strategies to specific barriers. Practical drawbacks and benefits of using concept mapping as a way to engage stakeholders in implementation research are discussed.
Research & Implementation	A. Dopp, K. Parisi, S. Munson, & A. Lyon	2020	Aligning implementation and user-centered design strategies to enhance the impact of health services: results from a concept mapping study.	Implementation Science Communications	https://doi.org/10.1186/s43058-020-00020-w	https://implementationsciencecomms.biomedcentral.com/track/pdf/10.1186/s43058-020-00020-w.pdf	University of Arkansas	Innovative approaches are needed to maximize fit between the characteristics of evidence-based practices (EBPs), implementation strategies that support EBP use, and contexts in which EBPs are implemented. Standard approaches to implementation offer few ways to address such issues of fit. We characterized the potential for collaboration with experts from a relevant complementary approach, user-centered design (UCD), to increase successful implementation. Method: Using purposive and snowball sampling, we recruited 56 experts in implementation (n = 34) or UCD (n = 22). Participants had 5+ years of professional experience (M = 10.31), worked across many settings (e.g., healthcare, education, human services), and were mostly female (59%) and white (73%). Each participant completed a web-based concept mapping structured conceptualization task. They sorted strategies from established compilations for implementation (36 strategies) and UCD (30 strategies) into distinct clusters, then rated the importance and feasibility of each strategy. Results: We used multidimensional scaling techniques to examine patterns in the sorting of strategies. Based on conceptual clarity and fit with established implementation frameworks, we selected a final set of 10 clusters (i.e., groups of strategies), with five implementation-only clusters, two UCD-only clusters, and three trans-discipline clusters. The highest-priority activities (i.e., above-average importance and feasibility) were the trans-discipline clusters plus facilitate change and monitor change. Implementation and UCD experts sorted strategies into similar clusters, but each gave higher importance and feasibility ratings to strategies/clusters from their own discipline. Conclusions: In this concept mapping study, experts in implementation and UCD had perspectives that both converged (e.g., trans-discipline clusters, which were all rated as high-priority) and diverged (e.g., in importance/feasibility ratings). The results provide a shared understanding of the alignment between implementation science and UCD, which can increase the impact and sustainability of EBP implementation efforts. Implications for improved collaboration among implementation and UCD experts are discussed. Keywords: Concept mapping; Evidence-based practice; Human-centered design; Implementation strategies; User-centered design.
Research & Implementation	Laustsen, C., E., Westergren, A., Petersson, P., & Haak, M.	2021	Conceptualizing researchers’ perspectives on involving professionals in research: a group concept mapping study.	Health Research Policy and Systems	https://doi.org/10.1186/s12961-021-00685-2	https://health-policy-systems.biomedcentral.com/track/pdf/10.1186/s12961-021-00685-2.pdf	Kristianstad University	Researchers have shown an increased interest in involving professionals from outside academia in research projects. Professionals are often involved in research on ageing and health when the purpose is to address the gap between research and practice. However, there is a need to acquire more knowledge about what the involvement might lead to by exploring researchers’ experiences of involving professionals in research on ageing and health and developing conceptual areas. Therefore, the aim of this study was to identify conceptual areas of professionals’ involvement in research on ageing and health, from the perspective of researchers themselves. Methods Group concept mapping, a participatory and mixed method, was used to conceptualize areas. Researchers with experience of involving professionals in research projects on ageing and health participated in qualitative data collection through brainstorming sessions (n = 26), and by sorting statements (n = 27). They then took part in quantitative data collection, where they rated statements according to how much a statement strengthened research (n = 26) and strengthened practice (n = 24). Data were analysed using multidimensional scaling analysis and hierarchical cluster analysis. In addition, a qualitative analysis of the latent meaning of the cluster map was conducted. Results Analysis of the sorting stage generated five clusters illustrating conceptual areas of professionals’ involvement in research projects on ageing and health. The five clusters are as follows: complex collaboration throughout the research process; adaptation of research to different stakeholders, mutual learning through partnership; applicable and sustainable knowledge; legitimate research on ageing and health. The qualitative latent meaning of the cluster map showed two themes: the process of involvement and the outcome of involvement. A positive strong correlation (0.87) was found between the rating of strengthened research and practice. Conclusions This study reveals conceptual areas on a comprehensive and illustrative map which contributes to the understanding of professionals’ involvement in research on ageing and health. A conceptual basis for further studies is offered, where the aim is to investigate the processes and outcomes entailed in involving professionals in research on ageing and health. The study also contributes to the development of instruments and theories for optimizing the involvement of professionals in research.
Research & Implementation	Laustsen, C. E., Petersson, P., Westergren, A., & Haak, M.	2021	Involvement of professionals in research: knowledge integration, development of practice, and challenges: a group concept mapping study.	Health Research Policy and Systems	https://doi.org/10.1186/s12961-021-00763-5	https://health-policy-systems.biomedcentral.com/track/pdf/10.1186/s12961-021-00763-5.pdf	Kristianstad University	Research and practice are often considered as two different worlds with different values, which causes a gap between them. Involving professionals such as practitioners, managers, decision-makers, and policy-makers in research on ageing and health might address the gap between research and practice, strengthen the healthcare system, and increase older people’s possibilities for healthy ageing. The aim of this study was to conceptualize professionals’ involvement in research on ageing and health from the perspective of the professionals themselves. Methods: A mixed method called group concept mapping was used. Professionals with experience being involved in research on ageing and health participated in qualitative data collection through brainstorming sessions (n = 29) and by sorting statements (n = 29). Afterwards, they participated in a quantitative data collection by rating statements according to how much each statement strengthened practice (n = 30) and strengthened research (n = 28). Multidimensional scaling analysis and hierarchical cluster analysis were used to conduct quantitative analysis. Latent qualitative analysis was also conducted. Results: Analysis resulted in eight clusters which illustrated conceptual areas of professionals’ involvement in research projects. The qualitative latent construct of the cluster map resulted in the themes: challenges for professionals; prerequisites and professionals’ learning can contribute to development of practice; and integrated knowledge benefits older people. There was a strong correlation between what strengthens practice and research (r = 0.92). Conclusions: This study illustrates conceptual areas of professionals’ own perspectives on what their involvement in research can lead to. Their involvement may lead to knowledge being integrated, and the professionals may learn through their involvement, which can contribute to the development of practice. However, there can also be challenges that need to be handled when professionals are involved in research. The study can be useful for improving the understanding of and actual involvement of professionals in research, and for optimizing the involvement of professionals.
Research & Implementation	Zebrack, B., Schapmire, T., Otis-Green, S., Nelson, K., Miller, N., Donna, D., & M., Grignon	2022	Establishing core competencies, opportunities, roles and expertise for oncology social work.	BMC Palliative Care	https://doi.org/10.1177%2F14680173211051983		University of Michigan	While oncology social workers are the primary providers of psychosocial services, they vary in what they do and how they work across different cancer care settings. Standards of Practice suggest that there exists a core or universal set of activities and tasks that are grounded in the values and principles of social work and apply across all settings. The purpose of this study was to identify activities that delineate and distinguish Competencies, Opportunities, Roles and Expertise (CORE) for oncology social work. Research was conducted using Concept Mapping, a structured and prescribed approach to collecting, analyzing, and interpreting qualitative and quantitative data while engaging stakeholders in the research process. Findings An expert panel of oncology social work practitioners, academicians, and leaders in the field (n = 35) generated 91 practice behaviors that were subject to card sorting and ratings of importance. A visual map consisting of six clusters best represented the statistical fit of the data (stress value = 0.18) while maintaining the most meaningful categorization of individual statements. These six domains were as follows: Clinical Assessment and Intervention (38 items; mean importance = 3.31); Professional Advocacy and Political Action (5 items; mean importance = 3.03); Case Management and Care Coordination (16 items; mean importance = 3.02); Patient Education and Advocacy (8 items; mean importance = 2.82); Organizational Support and Service (12 items; mean importance = 2.74); Professional Education (12 items; mean importance = 2.45). Application These results may inform initiatives related to social work education and training, credentialing and certification, health policy, research and advocacy on behalf of patients, families, communities, and the profession. Keywords: Social Work, Medical Social Work, Practice Standards Education, Best Practice, Clinical Practice
Research & Implementation	Vogt, L., Stoyanov, S., Bergs, J., Schröder, H., & Drachsler, H.	2022	Are the World Health Organization's Patient Safety Learning Objectives Still Up-to-Date: A Group Concept Mapping Study.	Journal of Patient Safety	https://doi.org/10.1097/pts.0000000000000993	https://journals.lww.com/journalpatientsafety/Abstract/9000/Are_the_World_Health_Organization_s_Patient_Safety.98882.aspx	RWTH Aachen University	The World Health Organization (WHO) Patient Safety Curriculum Guide defines learning objectives for patient safety. Current implementation in healthcare education is insufficient. Possible explanations may be obsolescence and/or a shift in needs. We investigated whether overarching topics and specific learning objectives of the WHO Patient Safety Curriculum Guide are still up-to-date, their attributed importance, and their perceived difficulty to achieve. Methods: Experts on patient safety and medical education from 3 European countries were asked to suggest learning objectives concerning patient safety using group concept mapping. Following 3 successive steps, experts rated ideas by importance and difficulty to achieve. Correlation analyses investigated the relationship between those. Overarching topics of the learning goals (clusters) were identified with multivariate analysis. Results: A total of 119 statements about intended learning objectives on patient safety were generated, of which 86 remained for sorting and rating. Based on multivariate analyses, 10 overarching topics (clusters) emerged. Both the learning objectives and the overarching topics showed high correspondence with the WHO Patient Safety Curriculum Guide. Strong correlations emerged between importance and difficulty ratings for learning objectives and overarching topics. Conclusions: The WHO Patient Safety Curriculum Guide's learning goals are still relevant and up-to-date. Remarkably, learning objectives categorized as highly important are also perceived as difficult to achieve. In summary, the insufficient implementation in medical curricula cannot be attributed to the content of the learning goals. The future focus should be on how the WHO learning goals can be implemented in existing curricular courses.
Research & Implementation	Breuer, M. E., Bakker-van Gijssel, E. J., Vlot-van Anrooij, K., Tobi, H., Leusink, G. L., & Naaldenberg, J.	2022	Exploring views on medical care for people with intellectual disabilities: an international concept mapping study	International Journal for Equity in Health	https://doi.org/10.1186/s12939-022-01700-w	https://equityhealthj.biomedcentral.com/track/pdf/10.1186/s12939-022-01700-w.pdf	Radboud University	Medical care for people with intellectual and developmental disabilities (IDD) is organized differently across the globe and interpretation of the concept of medical care for people with IDD may vary across countries. Existing models of medical care are not tailored to the specific medical care needs of people with IDD. This study aims to provide an improved understanding of which aspects constitute medical care for people with IDD by exploring how international researchers and practitioners describe this care, using concept mapping. Methods Twenty-five experts (researchers and practitioners) on medical care for people with IDD from 17 countries submitted statements on medical care in their country in a brainstorming session, using an online concept mapping tool. Next, they sorted all collected statements and rated them on importance. Results Participants generated statements that reflect current medical and health care practice, their ideas on good practice, and aspirations for future medical and health care for people with IDD. Based on the sorting of all statements, a concept map was formed, covering 13 aspects that characterize medical and health care for people with IDD across nations. The 13 aspects varied minimally in importance ratings and were grouped into five overarching conceptual themes: (i) active patient role, (ii) provider role, (iii) context of care, (iv) consequences of care for people with IDD, and (v) quality of care. Conclusions The themes, clusters and statements identified through this explorative study provide additional content and context for the specific patient group of people with IDD to the dimensions of previous models of medical care.
Research & Implementation	Lebow-Skelley, E., Young, L., Noibi, Y., Blaginin, K., Hooker, M., Williamson, D., M. S., Thomlinson, M. C., Kegler & Pearson, M. A.	2022	Defining the Exposome Using Popular Education and Concept Mapping With Communities in Atlanta, Georgia	Frontiers in Public Health	https://doi.org/10.3389/fpubh.2022.842539	https://www.frontiersin.org/articles/10.3389/fpubh.2022.842539/pdf	Emory University	Introduction: The exposome concept provides a framework to better incorporate the environment into the study of health and disease and has been defined by academics to encompass all lifetime exposures including toxicants, diet, and lifestyle choices. However, initial applications of the exposome concept have been less apt at measuring social determinants of health, focusing primarily on conventional environmental exposures and lifestyle choices that do not reflect the complex lived experience of many communities. To bring community voice into the exposome concept, the HERCULES Exposome Research Center and its Stakeholder Advisory Board co-developed the Exposome Roadshow. We present and discuss the resulting community-exposome definition to inform and improve exposome research. Materials and Methods: Four communities from distinct areas across metro-Atlanta participated in separate 2-day Exposome Roadshow workshops with concept mapping. Aligned with a popular education approach in which community knowledge is used to work collectively for change, concept mapping provided a systematic method to collect and visualize community members' knowledge and create a shared understanding to take action. Community members brainstormed, sorted, and rated their responses to the prompt: “What in your environment is affecting your and your community's health?” Responses were analyzed and visually depicted by concept maps consisting of separate but interrelated clusters of ideas. Community members discussed and validated the maps, selecting a final map illustrating their community's exposome. Results: A total of 118 community members completed concept mapping. On average communities identified 7 clusters to define their exposome. The resulting concept maps offer a community definition of the exposome. Five major themes arose across all four communities: conventional environmental concerns, built environment, social relationships, crime and safety, and individual health and behaviors. Discussion: The resulting community-exposome definition demonstrates the importance of expanding the scope of exposures beyond traditional environmental influences to include the lived experience of individuals and communities. While newer exposome definitions align more closely with this community definition, traditional exposome methods do not routinely include these factors. To truly capture the totality of lifetime exposures and improve human health, researchers should incorporate community perspectives into exposome research.
Research & Implementation	Soule, E. K., Ford, S., Newton Jr, R. L., & Thomas, A.	2022	Perceived Barriers to Serving on National Institutes of Health Scientific Review Groups Experienced by Black and African American Scientists	JAMA Netw Open	https://doi.org/10.1001/jamanetworkopen.2022.22085	https://jamanetwork.com/journals/jamanetworkopen/fullarticle/2794165?utm_campaign=articlePDF&utm_medium=articlePDFlink&utm_source=articlePDF&utm_content=jamanetworkopen.2022.22085	East Carolina University	Question: What are the perceived barriers that prevent Black and African American scientists from serving on National Institutes of Health (NIH) scientific review groups? Finding: This qualitative study of 52 scientists identifying as Black and/or African American develops descriptive themes for barriers that may prevent Black scientists from serving as NIH grant reviewers. Themes developed included structural racism, diversity not valued, toxic environment, review workload demand, lack of reward, negative affect about the review process, competing demands at home institution, lack of opportunity, and perceptions of being unqualified. Meaning: These results suggest that Black and African American scientists perceive undue barriers that prevent participation in the NIH grant review process; these barriers should be addressed to promote health equity. Importance: African American and Black scientists are awarded disproportionately fewer National Institutes of Health (NIH) grants than White scientists. Increasing Black representation on NIH scientific review groups (SRGs) likely will contribute to increased equity in funding rates because research topics of Black and African American scientists’ submitted applications will be more highly valued; however, Black and African American scientists often perceive barriers that prevent them from serving on NIH SRGs. Objective: To examine perceived barriers that prevent Black and African American scientists from serving on NIH SRGs. Design, Setting, and Participants: This qualitative study used a mixed methods online approach with a convenience sample of Black and African American scientists to identify barriers to NIH grant review participation. Eligible participants were recruited online from professional organizations with primarily Black and African American membership. From February through April 2021, participants were asked to identify barriers to serving on NIH SRGs using concept mapping. Participants brainstormed statements describing barriers to serving on NIH SRGs, sorted statements into content themes, and rated statements on how true they were. Multidimensional scaling and a hierarchical cluster analysis identified content themes. Data analysis was conducted in May and June of 2021. Main Outcomes and Measures: Self-reported barriers to serving on an NIH SRG among Black and African American scientists. Results: A total of 52 scientists participated in both phases of the study (mean [SD] age, 42.3 [8.2] years; 46 women [88.5%]). Participants provided 68 unique statements that were organized into 9 thematic clusters describing barriers to serving on NIH SRGs. Themes included structural racism, diversity not valued, toxic environment, review workload demand, lack of reward, negative affect about the review process, competing demands at home institution, lack of opportunity, and perceptions of being unqualified. Conclusions and Relevance: Black and African American scientists reported many barriers to serving on NIH SRGs that are unique to Black and African American scientists, as well as barriers that transcend race but are exacerbated by structural racism. This study provides NIH with concrete opportunities to address realized barriers to increase inclusion of Black and African American scientists on NIH SRGs, fund more Black and African American scientists, and ultimately reduce health inequities in the US.
Research & Implementation	Specht, I. O., Karoline, W., Robin, C., Bomhoff, C., Raffing, R., Wæhrens, E. E.	2022	Working from home during COVID-19 in a Danish hospital research setting: experiences of researchers and healthcare providers, explored by Group Concept Mapping	BMJ open	https://doi.org/10.1136/bmjopen-2022-063279	https://bmjopen.bmj.com/content/12/8/e063279.long	Bispebjerg Hospital	Objectives The COVID-19 pandemic has changed the working environment, how we think of it and how it stands to develop into the future. Knowledge about how people have continued to work on-site and adjusted to working from home during the COVID-19 lockdown will be vital for planning work arrangements in the post-pandemic period. Our primary objective was to investigate experiences of working from home or having colleagues working from home during a late stage of the COVID-19 lockdown among researchers and healthcare providers in a hospital research setting. Second, we aimed to investigate researchers’ productivity through changes in various proxy measures during lockdown as compared with pre-lockdown. Design Mixed-method participatory Group Concept Mapping (GCM). Setting and participants GCM, based on a mixed-method participatory approach, was applied involving researchers’ and healthcare providers’ online sorting and rating experiences working from home during the COVID-19 pandemic. At a face-to-face meeting, participants achieved consensus on the number and labelling of domains—the basis for developing a conceptual model. Results Through the GCM approach, 47 participants generated 125 unique statements of experiences related to working from home, which were organised into seven clusters. Using these clusters, we developed a conceptual model that illustrated the pros and cons of working from home. Conclusion The future work setting, the role of the office and the overall work environment need to respond to workers’ increased wish for flexible work arrangements and co-decision.
Research & Implementation	Bentley, S. A., Black, A. A., Hindmarsh, G.P., Owsley, C.	2022	Concept Mapping to Identify Content for a Performance-Based Measure of Low Luminance Vision-Related Activities of Daily Living	Translational Vision Science & Technology	https://doi.org/10.1167/tvst.11.9.27	https://tvst.arvojournals.org/article.aspx?articleid=2783683	Queensland University of Technology	Purpose: The purpose of this study was to identify low luminance activities of daily living (ADL) relevant to adults with vision impairment using a concept-mapping approach. Methods: “Group concept mapping” was utilized to identify specific ADLs that persons with vision impairment find challenging under low light conditions. In the first “brainstorming” phase, 24 adults with vision impairment from a range of eye conditions (mean age = 73 years, SD = 14 years) and 26 international low vision experts (mean experience = 22, SD = 11 years) generated statements to the focus prompt, “Thinking as broadly as possible, generate a list of statements detailing specific day-to-day activities a person with vision impairment might find challenging under low light conditions, such as in a poorly lit room or outside at dusk.” In the second phase, participants sorted activities by similarity and rated the importance of each activity. Multidimensional scaling and hierarchical cluster analysis were applied to produce concept maps showing clusters of prioritized activities. Results: One hundred thirteen unique ideas/activities were generated, rated and sorted. Eight clusters were identified (from highest to lowest importance): hazard detection and safety outside; social interactions; navigation; near reading; selfcare and safety at home; distance spotting; searching around the home; and cooking and cleaning. Conclusions: The conceptual framework and low luminance ADLs identified (the most important being hazard detection and safety outside, and social interactions) provide a basis for developing a performance-based measure of low luminance visual function. Translational Relevance: A performance-based measure of low luminance vision-related ADLs is required for comprehensively and objectively assessing efficacy of eye treatments and low vision rehabilitation outcomes in adults with vision impairment.
Research & Implementation	Fede, J., Kogut, S., Hayward, A., Stevenson, J., Willey-Temkin, C., Fournier, H., . . . Padbury, J.	2021	Improving the quality and quantity of clinical and translational research statewide: An application of group concept mapping	Journal of Clinical and Translational Science	http://doi.org/10.1017/cts.2020.572	https://www.cambridge.org/core/services/aop-cambridge-core/content/view/95E59CD175D126968A4DCFCDE575D2CB/S2059866120005725a.pdf/improving-the-quality-and-quantity-of-clinical-and-translational-research-statewide-an-application-of-group-concept-mapping.pdf	University of Rhode Island	Introduction: Advance Clinical and Translational Research (Advance-CTR) serves as a central hub to support and educate clinical and translational researchers in Rhode Island. Understanding barriers to clinical research in the state is the key to setting project aims and priorities. Methods: We implemented a Group Concept Mapping exercise to characterize the views of researchers and administrators regarding how to increase the quality and quantity of clinical and translational research in their settings. Participants generated ideas in response to this prompt and rated each unique idea in terms of how important it was and feasible it seemed to them. Results: Participants generated 78 unique ideas, from which 9 key themes emerged (e.g., Building connections between researchers). Items rated highest in perceived importance and feasibility included providing seed grants for pilot projects, connecting researchers with common interests and networking opportunities. Implications of results are discussed. Conclusions: The Group Concept Mapping exercise enabled our project leadership to better understand stakeholder-perceived priorities and to act on ideas and aims most relevant to researchers in the state. This method is well suited to translational research enterprises beyond Rhode Island when a participatory evaluation stance is desired. Clinical translational research; evaluation; mixed methods; stakeholder engagement; qualitative methods
Research & Implementation	S. Murray-Mendes, A. R. Martinez, and K. L. Hackett	2021	Identifying Occupational Therapy Research Priorities in Trinidad and Tobago: A Group Concept Mapping Study	Occupational Therapy International	https://doi.org/10.1155/2021/9970566	https://downloads.hindawi.com/journals/oti/2021/9970566.pdf	Northumbria University	In Trinidad and Tobago, occupational therapy is an emerging profession with limitations in the number of practitioners and the scope of practice. With the development of a new Master of Science Occupational Therapy programme in the country, the profession is continuously growing. There has been an increased demand for culturally relevant research to build the occupational therapy evidence base locally. However, the narrow range of occupational therapy literature in the country makes it difficult to highlight research gaps and decipher what research areas should be prioritised to best impact occupational therapy practice at present. This group concept mapping study is aimed at identifying priority areas for occupational therapy research in Trinidad and Tobago from the perspectives of occupational therapy students and practitioners. Participants brainstormed and contributed specific research ideas they would like to see developed in the country. Individually, participants sorted these ideas into themes and rated each idea based on perceived importance and feasibility. Using the GroupWisdom™ software, multidimensional scaling and hierarchical cluster analyses were applied to the sort data to create idea clusters within a concept map. Rating values were analysed to determine priority research themes within the concept map. The resulting concept map illustrated seven research priorities: Contextualising Practitioner Development, The Realities of Emerging OT Practice, Localising Mental Health OT, Occupation and Participation of Children and Youth, School-based OT in the Local Context, OT with Special Populations, and OT Contributions to the Public Health Sector. These findings represent the research needs of the occupational therapy profession in Trinidad and Tobago and will help to focus future researchers’ efforts to expand the local evidence base.
Research & Implementation	Moretti, Baum, Ehlers, Finger, & Broring	2023	Exploring actors' perceptions of the precision agriculture innovation system – A Group Concept Mapping approach in Germany and Switzerland		https://doi.org/10.1016/j.techfore.2022.122270		University of Bonn (Germany, Switzerland)	Abstract Precision Agriculture Technologies (PATs) promise to enhance productivity and foster sustainability. However, attempts to explain the low adoption of PATs, particularly in Europe, lack attention to the role of shared understanding of PATs among actors in the development and diffusion of this innovation. To uncover what could guide the emergence of a collective understanding of PATs, we explore how the actors comprising the nascent innovation system perceive PATs and how they perceive possibilities for influencing the precision agriculture innovation system. We utilize the mixed-method approach of Group Concept Mapping to uncover (in)congruences in relation to PAT perceptions of farmers from Germany and Switzerland vis-à-vis other stakeholders in the innovation system. We found that negative perceptions of the economic and social aspects of PATs are a source of discrepancies among the actors. Conversely, positive perceptions of the prospective value propositions of PATs seem to be a point of coherence. We argue that the maturity of the innovation system thus depends on the further alignment of such perceptions as well as the realization of the innovation's value proposition. Both practitioners and policymakers could strengthen the innovation system of PATs, with the help of intermediaries, through aligning perceptions of challenges and value propositions.
Research & Implementation	Block, C., Rennings, M., & Bröring, S.	2022	Selecting technologies to engage in sustainability transitions—A multi-stakeholder perspective	Business Strategy and the Environment	https://doi.org/10.1002/bse.3316	https://onlinelibrary.wiley.com/doi/pdf/10.1002/bse.3316	University of Bonn	Given the need for systemic changes to reach a sustainability transition from a fossil-based toward a bio-based economy, it is crucial to align different actors' expectations along the value chain when developing and commercializing sustainability-oriented technologies (SOTs). To analyze what different actors along the value chain look for when selecting SOTs, this study draws upon a group concept mapping approach based on a group discussion and a subsequent sorting and rating process of selection criteria. Applied to the case of the bio-based economy, this study seeks to aggregate the perceptions of four different stakeholder groups along the value chain, that is, (1) agricultural and feedstock, (2) (bio)chemical, (3) consumer industries, and (4) consultancies and networks. We derive 11 different categories subsuming 59 criteria that have been perceived as relevant when selecting SOTs. Results show that selection criteria related to the future competitiveness, the public acceptance, and the sustainability aspects of the technology are perceived as highly relevant for most actors when selecting SOTs. Further, we summarize the 11 categories into four dimensions involving (1) market environment and viability, (2) corporate strategy and technology integration, (3) capabilities and knowledge exchange, and (4) institutional and regulatory frames related criteria. We contribute to sustainability transition literature by providing, first, a conceptual framework for relevant selection criteria of SOTs from a value chain spanning perspective; and second, areas of coherence versus noncoherence in technology evaluation across different value chain actors allowing targeted support initiatives to facilitate the technology transfer in the context of sustainability transitions.
Research & Implementation	Mion, L.C., Tan, A., Brockman, A., Tate, J.A., Vasilevskis, E.E., Pun, B.T., Rosas, S.R., & Balas, M.C.	2023	An Exploration of Critical Care Professionals’ Strategies to Enhance Daily Implementation of the Assess, Prevent, and Manage Pain; Both Spontaneous Awakening and Breathing Trials; Choice of Analgesia and Sedation; Delirium Assess, Prevent, and Manage; Early Mobility and Exercise; and Family Engagement and Empowerment: A Group Concept Mapping Study	Critical Care Explorations	https://doi.org/10.1097/CCE.0000000000000872	https://journals.lww.com/ccejournal/Fulltext/2023/03000/An_Exploration_of_Critical_Care_Professionals_.9.aspx	Ohio State University	OBJECTIVES: The goals of this exploratory study were to engage professionals from the Society for Critical Care Medicine ICU Liberation Collaborative ICUs to: 1) conceptualize strategies to enhance daily implementation of the Assess, prevent, and manage pain; Both spontaneous awakening and breathing trials; Choice of analgesia and sedation; Delirium assess, prevent, and manage; Early mobility and exercise; and Family engagement and empowerment (ABCDEF) bundle from different perspectives and 2) identify strategies to prioritize for implementation. DESIGN: Mixed-methods group concept mapping over 8 months using an online method. Participants provided strategies in response to a prompt about what was needed for successful daily ABCDEF bundle implementation. Responses were summarized into a set of unique statements and then rated on a 5-point scale on degree of necessity (essential) and degree to which currently used. SETTING: Sixty-eight academic, community, and federal ICUs. PARTICIPANTS: A total of 121 ICU professionals consisting of frontline and leadership professionals. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: A final set of 76 strategies (reduced from 188 responses) were suggested: education (16 strategies), collaboration (15 strategies), processes and protocols (13 strategies), feedback (10 strategies), sedation/pain practices (nine strategies), education (eight strategies), and family (five strategies). Nine strategies were rated as very essential but infrequently used: adequate staffing, adequate mobility equipment, attention to (patient’s) sleep, open discussion and collaborative problem solving, nonsedation methods to address ventilator dyssynchrony, specific expectations for night and day shifts, education of whole team on interdependent nature of the bundle, and effective sleep protocol. CONCLUSIONS: In this concept mapping study, ICU professionals provided strategies that spanned a number of conceptual implementation clusters. Results can be used by ICU leaders for implementation planning to address context-specific interdisciplinary approaches to improve ABCDEF bundle implementation.
Research & Implementation	O’Keefe, V.M., Maudrie, T.L., Cole, A.B. et al.	2023	Conceptualizing Indigenous strengths-based health and wellness research using group concept mapping	Arch Public Health	https://doi.org/10.1186/s13690-023-01066-7	https://archpublichealth.biomedcentral.com/articles/10.1186/s13690-023-01066-7	Johns Hopkins University	Indigenous communities and scholars have long prioritized and advocated for strengths-based approaches to public health and wellness research, interventions, funding, and policy. This advocacy movement is occurring in parallel to increasing national agendas emphasizing Indigenous leadership to alter societal narratives and the creation of Indigenous futures aligned with cultural values [1]. The emphasis on strengths-based approaches often desired by Indigenous communities is challenging in that agencies supporting community programming and health interventions often require risk-focused outcomes not reflective of Indigenous values and approaches to health and wellness [2, 3]. Risk-focused outcomes are instead more aligned with deficits-based models that draw from Eurocentric definitions of health that may be harmful to Indigenous communities in terms of stigmatization and perpetuation of negative stereotypes that Indigenous Peoples are “prone to ill health and in need of intervention” [2,3,4]. In sum, if the focus is solely on pathology, pathology is what will be found. There continues to be calls for a shift in gaze from individual level determinants of health to broader system determinants of Indigenous Peoples health including oppressive histories, policies, and practices that remain unaddressed including that of colonization [5,6,7]. Although relevant and important to address, Indigenous communities also carry strengths, wellness, and wisdom to resist, survive, heal, and persist despite the systemic pressures to disconnect from culture, spirit, and wholistic collectivism [8, 9]. These strengths and assets within Indigenous Nations are well delineated at the community level; however, a definition or framework for an “Indigenous strengths-based approach to health and wellness research” specifically has yet to be clearly translated. We take steps to address this gap in existing public health literature by engaging Indigenous scholars in a collaborative process for brainstorming, rating, and describing strengths-based Indigenous health research.
Research & Implementation	Bailey, D., Bishop, A., Foster, N. E., & Holden, M. A.	2022	Conceptualising adherence to exercise for musculoskeletal pain: A concept mapping study		https://doi.org/10.1002/pri.1989		Keele University	Background The concept of adherence to exercise for musculoskeletal (MSK) pain is poorly defined and inadequately measured. This study aimed to, (1) conceptualise adherence to exercise therapy for MSK pain, and (2) identify statements most representative of the new conceptualisation that could be developed into items for a new measurement tool. Methods Concept mapping methodology was used, which is an integrated mixed methods approach. Focus groups with stakeholders generated statements describing adherence to exercise for MSK pain. Statements were grouped according to themes and rated for importance. Data analysis via multidimensional scaling and hierarchical cluster analysis produced a series of concept maps, which were refined during a further stakeholder workshop to produce the final conceptualisation of exercise adherence. Mean importance ratings established statements most suitable for future development. Results Twenty-eight participants produced 100 unique statements concerning adherence, which were sorted and rated. Analysis of the sort data with further participant refinement concluded that adherence to exercise consists of six domains: communication with experts; targets; how exercise is prescribed; patient knowledge and understanding; motivation and support; and psychological approach and attitudes. Fifty-six statements were rated with above average importance for inclusion in a new measure of adherence to exercise for MSK pain. Conclusion Adherence to exercise for MSK pain is a complex and multi-dimensional construct represented by six distinct domains. Statements that best represent these domains have been identified by key stakeholders and will inform the development of a new measure of adherence to exercise for MSK pain.
Research & Implementation	Homer, S. T.	2023	Group concept mapping–bridging the gap between conceptual papers and empirical research	Global Business and Organizational Excellence	https://doi.org/10.1002/joe.22228			With growing internationalism, there is a shift in research patterns in developing countries, especially China and India, generating vital and contemporary research areas that are beginning to challenge the existing Western-dominated research literature in social sciences. Yet, many of the new ideas within conceptual papers by the social sciences are not empirically validated, let alone operationalized. This is where the group concept mapping method can play a role in bridging the gap between phenomenal conceptualization and having an empirically valid model that can then be operationalized. The group concept mapping process involves five steps: create statements, sort statements, run multidimensional scaling (MDS) of sorted units, run cluster analysis, and label the clusters. This approach allows for the collective thoughts of a pre-defined group to be collected and organized into a tangible output with academic rigor. This paper offers an overview of the group concept mapping methodology, discussing the processes of the method, how the method can be utilized fully within the business and broader social science context, and the strengths, weaknesses, and practical implications of group concept mapping.
Research & Implementation	Tackett, S., Jenn Ng, C., Sugarman, J., Daniel, E.G.S., Gopalan, N., Tivyashinee, , Kamarulzaman, A. and Ali, J.	2023	A Competency Framework for Health Research Ethics Educational Programs: Results from a Stakeholder-Driven Mixed-Method Process		https://doi.org/10.1002/eahr.500166	https://onlinelibrary.wiley.com/doi/epdf/10.1002/eahr.500166		Educational programs are integral to building health research ethics (HRE) capacity, but no outcomes framework exists to guide them. We empirically developed a competency framework for health research ethics education—the Framework for Research Ethics Studies Competencies and Outcomes (FRESCO)—using mixed methods, including group concept mapping and a survey of international experts. FRESCO includes seven competency domains: (1) Foundational Knowledge; (2) Laws, Regulations, Guidelines, and Policies for Research Oversight; (3) Ethical-Issue Identification, Analysis, and Resolution; (4) Engagement, Communication, and Advocacy; (5) Lifelong Learning, Education, Research, and Scholarship; (6) Coordination, Stewardship, and Responsiveness in HRE Systems; and (7) Impartiality, Honesty, and Responsibility. These domains are detailed in 27 subdomains. Survey respondents rated FRESCO's relevance to HRE highly. FRESCO can be adapted and implemented in educational programs to refine recruitment and selection processes, educational and assessment methods, and performance measures to ensure that HRE educational programs have their intended effects.
Under-18 Participation	Chun, J.	2018	Conceptualizing effective interventions for smartphone addiction among Korean female adolescents.	Children and Youth Services Review	https://doi.org/10.1016/j.childyouth.2017.11.013		Ewha Womans University	This study is the first of its kind to conceptualize effective interventions for smartphone addiction among female adolescents in South Korea using a mixed method concept-mapping approach. The participants were Korean female adolescents (N = 36) who had been referred to an Internet addiction treatment centers due to their smartphone addiction problems. Concept mapping was conducted to collect, organize, and interpret qualitative data using quantitative techniques such as hierarchical cluster analysis and multidimensional scaling. The study found five clusters of effective interventions: involuntary restriction, self-awareness and self-control, school restrictions, peer support, and professional services. This conceptual framework can be utilized in planning and developing interventions for female adolescents with smartphone addiction.
Under-18 Participation	Moreno, M. A., Midamba, N., Berman, H. S., Moreno, P. S., Donlin, M., & Schlocker, E.	2019	Cyberbullying among adolescents: Stakeholder-driven concept mapping approach.	JMIR Pediatrics and Parenting	https://doi.org/10.2196/12683	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6746102/pdf/pediatrics_v2i1e12683.pdf	University of Wisconsin Madison	Background: Cyberbullying includes bullying behaviors on the Web; these behaviors are inconsistently measured and lack standardized definitions. The Uniform Definition of Bullying provides a consensus-based definition of bullying, and it highlights the need for an evidence-based definition of a model for cyberbullying. Objective: Toward understanding the key elements and constructs defining cyberbullying, the objective of this study was to develop a stakeholder-driven conceptual model of cyberbullying. Methods Concept mapping is a validated research method that leverages both qualitative and quantitative approaches to integrate stakeholder input on complex topics. This process was used to develop a concept map and adapt it through participant input to a conceptual model. The validated concept mapping approach includes 5 steps: preparation, generation (brainstorming), structuring (sorting), representation (statistical analysis), and interpretation. We recruited stakeholder participants, including adolescents, as well as parents and professionals representing education, health, and the justice system. Analysis included hierarchical cluster analysis to develop a cluster map representing cyberbullying, followed by adaptation of that map to a conceptual model through qualitative participant feedback. Results: A total of 177 participants contributed to the concept mapping process, including 69% females, 50% adults, and 68% Caucasian, representing each of our stakeholder groups. A total of 228 brainstorming items were generated and sorted into a concept map that included 9 clusters. Clusters included topics that had strong overlap with traditional bullying, such as consequences for perpetrators and targets, with example items “alienating” and “crippling.” Some clusters were unique, such as cyberbullying techniques, with example item “excessive messaging,” and characteristics of the cyberbullying experience, with example item “constant.” Through the interpretation step, a conceptual model emerged, illustrating connections and distinctions between traditional bullying and cyberbullying. Conclusions: We found that in generating a stakeholder-driven concept map of cyberbullying, participants could not describe cyberbullying without integrating key concepts from traditional bullying. On the basis of our conceptual model, there are unique characteristics of cyberbullying that suggest that uniform definitions of bullying need to be evaluated to ensure their application to cyberbullying.
Under-18 Participation	Dare, L. & Nowicki, E.	2019	Engaging children and youth in research and evaluation using group concept mapping.	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2019.101680		University of Western Ontario	Group concept mapping is a systematic methodology that recognizes participants' expertise in their own experiences. In this approach, participants share their diverse knowledge and interpret the data generated by all group members. This approach uniquely blends quantitative and qualitative techniques to create illustrative, structured conceptualizations. In this article, we describe the steps in group concept mapping and report feedback on this method from 37 children and youth who participated in group concept mapping studies. We recommend group concept mapping as an engaging way to involve children and youth in research and evaluation activities.
Under-18 Participation	Cook, K. & Bergeron, K.	2019	Using group concept mapping to engage a hard-to-reach population in research: Young adults with life-limiting conditions.	International Journal of Qualitative Methods	https://doi.org/10.1177/1609406919891315	https://journals.sagepub.com/doi/pdf/10.1177/1609406919891315	Athabasca University	Patient engagement strategies are used in community-based participatory research. A successful strategy requires that patients, researchers, and health-care providers collaborate to create meaningful outcomes. Hard-to-reach patient populations such as those living with complex physical or psychosocial conditions, who are geographically dispersed, or who are disadvantaged financially or socially, experience judgment, stigmatization, and marginalization within society and in the research process. Therefore, strategies are needed to better engage hard-to-reach populations in research. One strategy to engage this population is group concept mapping (GCM). This article illustrates how GCM was utilized to engage a hard-to-reach population of young adults (YAs) with life-limiting conditions (LLC), parents of YAs with LLC, and health and health and community experts. Study participants were involved in generating, analyzing, and interpreting data. Five attributes of GCM are outlined, and suggestions are made for how other researchers could use GCM to engage their hard-to-reach patient populations.
Under-18 Participation	Rosas, S. R., Smith, C., Eenigenburg, A., BaileyShea, C., Jerome, K., & Millane, M.	2022	A large-scale, geographical approach to using group concept mapping for planning: The Teen Opinions Count (TOC) project	Evaluation and Program Planning	https://doi.org/10.1016/j.evalprogplan.2022.102097		Concept Systems, Inc.	The use of group concept mapping (GCM) for large-scale, multi-site planning has been limited. The Teens Opinions Count (TOC) project utilized the group concept mapping methodology to develop a framework for after school time program development for teens in 16 counties in the Southeast Michigan and Western New York regions. This extensive planning effort demonstrated a large-scale, geographical approach to the implementation of GCM, where multiple sites (in this case counties) simultaneously engaged in independent processes on the same topic, with the purpose of producing separate locale-specific conceptualizations. TOC was the largest GCM project ever conducted in terms of the number of participants and volume of data submitted. This report details GCM recruitment, data collection, data compilation, and analysis of ideas from over 20,000 teens and 2,000 adults. Although implementation was conducted at the county level, many of the separate county-level GCM processes were larger than what is typically encountered in the literature. Operationalizing GCM at such a scale required significant planning, design, communication, and data management solutions. The extensive data collection effort required the need for creative and innovative procedures to engage teens and process the sheer volume of data. The lessons learned are discussed and suggestions for future applications offered. Group Concept Mapping, Planning, After school, Large-scale
Under-18 Participation	Smith, A. C. G. & Crooks, C. V.	2022	Youth-identified Considerations for Programming to Support Newcomers’ Healthy Development: A Group Concept Mapping Study	Child & Youth Care Forum	https://doi.org/10.1007/s10566-022-09695-9	https://link.springer.com/content/pdf/10.1007/s10566-022-09695-9.pdf	Western University	There is a well-documented need for more responsive promotion and prevention programming for young immigrants and refugees in the context of mental health and healthy development. Incorporating the voice of newcomers in the development of promotion and prevention efforts could assist in producing culturally-relevant materials and improve program outcomes. Objective: Our goal was to utilize youth voice to identify considerations for developing programming to support newcomer youths’ healthy development. Methods: We employed mixed methods and analyzed data using concept mapping. A total of 37 newcomers between the ages of 14 and 22 participated in focus groups to share their ideas for creating programming that would focus on relationships and well-being. Relevant responses were collated, cleaned, and generated into unique statements, and then sorted individually by 26 youth into thematically similar categories. We used multidimensional scaling and hierarchal cluster analysis to produce a concept map. Results: Six concepts, in rank order of importance, emerged as follows: create a space for sharing; discuss relational issues; teach strategies for adjusting to a new country; teach wellness skills; have feel-good activities; and plan for diversity. Conclusions: Participants’ lived experience and their own attendance in programming at newcomer organizations assisted them in brainstorming what types of activities, topics, and skills would be helpful for other newcomer youth, as well as considerations for facilitators implementing such programming. Promotion and prevention efforts intended for newcomer youth may benefit by incorporating ideas from the concept map.
Violence Prevention	Ahmad, F., Smylie, J., Omand, M., Cyriac, A., & O'Campo, P.	2015	South Asian immigrant men and women and conceptions of partner violence.	Journal of Immigrant and Minority Health	https://doi.org/10.1007/s10903-015-0301-2	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5285422/pdf/10903_2015_Article_301.pdf	St Michael’s Hospital	Limited knowledge exists about conceptual variations in defining intimate partner violence (IPV) by ethnicity, such as South Asian (SA) immigrant men and women. In a multi-ethnic study, we employed participatory concept mapping with three phases: brainstorming on what constitutes IPV; sorting of the brainstormed items; and interpretation of visual concept maps generated statistically. The parent study generated an overall general multi-ethnic map (GMEM) that included participant interpretations. In the current study, we generated a SA specific initial-map that was interpreted by eleven SA men and women in gender specific groups. Their interpretations are examined for similar and unique aspects across men and women and compared to GMEM. SA men and women shared similar views about sexual abuse and victim retaliation, which also aligned closely with GMEM. Both SA women and men had an expanded view of the concept of controlling behaviors compared to GMEM. SA women, unlike SA men, viewed some aggressive behaviors and acts as cultural with some GMEM congruence. SA women uniquely identified some IPV acts as private–public. We discuss implications for research and service assessments. Keywords: Intimate partner violence, Concept mapping, Ethnicity, South Asian, Immigrants
Violence Prevention	Vives-Cases, C., Golcolea, I., Hernandez, A., Sanz-Barbero, B., Gill, A. K., Baldry, A. C., Schrottle, M., & Stockl, H.	2016	Expert opinions on improving femicide data collection across Europe: A concept mapping study.	PLOS One	https://doi.org/10.1371/journal.pone.0154060	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4747603/pdf/pone.0148364.pdf	University of Alicante	Femicide, defined as the killings of females by males because they are females, is becoming recognized worldwide as an important ongoing manifestation of gender inequality. Despite its high prevalence or widespread prevalence, only a few countries have specific registries about this issue. This study aims to assemble expert opinion regarding the strategies which might feasibly be employed to promote, develop and implement an integrated and differentiated femicide data collection system in Europe at both the national and international levels. Concept mapping methodology was followed, involving 28 experts from 16 countries in generating strategies, sorting and rating them with respect to relevance and feasibility. The experts involved were all members of the EU-Cost-Action on femicide, which is a scientific network of experts on femicide and violence against women across Europe. As a result, a conceptual map emerged, consisting of 69 strategies organized in 10 clusters, which fit into two domains: "Political action" and "Technical steps". There was consensus among participants regarding the high relevance of strategies to institutionalize national databases and raise public awareness through different stakeholders, while strategies to promote media involvement were identified as the most feasible. Differences in perceived priorities according to the level of human development index of the experts' countries were also observed.
Violence Prevention	Goldman, A. W., Mulford, C. & Blachman-Demner, D.	2016	Advancing our approach to teen dating violence: A youth and professional defined framework of teen dating relationships.	Psychology of Violence	https://doi.org/10.1037/a0039849		Cornell University	Objective: Little research has considered how well assumptions about teen dating relationships that guide teen dating violence (TDV) work actually align with youth perspective and experience. This study aimed to better understand areas of convergence and divergence in how youth and adult professionals conceptualize and define teen dating relationships to more fully inform TDV research, programming, and policy. Method: Concept mapping-an inductive, participatory approach-was used to capture, compare, and visually represent perspectives of teen dating relationships across samples of teens ages 14 to 18 (N = 147), young adults ages 19 to 22 (N = 81), and adult professionals (N = 76). Researchers conducted subsequent facilitated discussions with these 3 groups. Results: A single concept map coauthored by youth and professionals described teen dating relationships using 100 ideas, 9 higher-order constructs, and 2 conceptual dimensions. Across groups, substantial agreement emerged on the characteristics of teen dating and their interrelationships. Participants conceptualized dating relationships as multidimensional, consisting of a range of behaviors, emotions, and cognitions that vary in their frequency and desirability. Relationships were also characterized by temporally oriented phases that can shape teens' perceptions of their dating experiences. Conclusion: The findings suggest that professionals are studying TDV and developing related programming from a conceptual basis that comports with youth dating experience. Nevertheless, the complexity of teen dating presents a need for researchers and practitioners to expand their focus to more effectively address the social and behavioral processes through which TDV unfolds. Efforts should more holistically consider relevant aspects of dating relationships, including the confluence of healthy and unhealthy characteristics with emotional, cognitive, and behavioral components. (PsycINFO Database Record
Violence Prevention	Vives-Cases, C., Golcolea, I., Hernandez, A., Sanz-Barbero, B., Davo-Blanes, M., & La Parra-Casado, D.	2017	Priorities and strategies for improving Roma women’s access to primary health care services in cases on intimate partner violence: A concept mapping study.	International Journal for Equity in Health	https://doi.org/10.1186/s12939-017-0594-y	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5463323/pdf/12939_2017_Article_594.pdf	Alicante University	Background: With an explicit focus on Roma women in Spain (Kale/Spanish Gypsies), this study aims to integrate key informants' opinions about the main actions needed to improve primary health care services' and professionals' responses to Roma women in an Intimate Partner Violence (IPV) situation. Methods: Concept mapping study. A total of 50 (brainstorming phase), 36 (sorting and rating phase) and 16 (interpretation phase) participants from Roma civil society groups, primary health care professionals and other related stakeholders (social services, academic experts and other IPV NGOs representatives) from different cities in Spain were involved in the different study phases. Results: Among the 55 action proposals generated, ten priority actions were identified through consensus as most important for improving primary health care's response to Romani women in an IPV situation, and these included primary, secondary and tertiary prevention activities. Conclusion: Results indicated that efforts to address this challenge should take an integrated approach that reinforces the primary health care response to IPV in general, while also promoting more specific actions to address barriers to access that affect all Roma women and those who experience IPV in particular.
Violence Prevention	Vila, B., James, S., James, L.	2018	How police officers perform in encounters with the public: Measuring what matters at the individual level.	Policing: An International Journal of Police Strategies and Management	https://doi.org/10.1108/PIJPSM-11-2016-0166		Washington State University	The purpose of this paper is to develop and describe the implementation of a novel method for creating interval-level metrics for objectively assessing police officer behaviors during an encounter with the public. These behaviors constitute officer performance and affect the probability of desirable encounter outcomes. The metrics measure concrete, micro-level performance in the common types of complex, dynamic, and low-information police-public encounters that often require immediate action using “naturalistic” decision making. Difficulty metrics also were developed to control for situational variability. The utility of measuring what officers do vs probabilistic outcomes is explored with regard to informing policymaking, field practice, and training. Design/methodology/approach – Metric sets were developed separately for three types of police-public encounters: deadly force judgment and decision making, cross-cultural tactical social interaction, and crisis intervention. In each, “reverse concept mapping” was used with a different diverse focus group of “true experts” to authoritatively deconstruct implicit concepts and derive important variables. Variables then were scaled with Thurstone’s method using 198 diverse expert trainers to create interval-level metrics for performance and situational difficulty. Metric utility was explored during two experimental laboratory studies and in response to a problematic police encounter. Findings – Objective, interval-level metric sets were developed for measuring micro-level police performance and encounter difficulty. Validation and further refinement are required. Research limitations/implications – This novel method provides a practical way to rapidly develop metrics that measure micro-level performance during police-public encounters much more precisely than was previously possible. Originality/value – The metrics developed provide a foundation for measuring officers’ performance as they exercise discretion, engage people, and affect perceptions of police legitimacy. Keywords: Procedural justice, Performance measures, Evaluation metrics, Naturalistic decision making, Police discretion and accountability, Police policy and training
Violence Prevention	Maddox, R., O'Campo, P., Grove, J., Yonas, M., Chan, C., Kassam, A., & Velonis, A.	2018	Identifying how to engage men in domestic violence research: A concept mapping study.	Journal of Family Violence	https://doi.org/10.1007/s10896-018-9985-0		University of Canberra	The Engaging Men project aimed to identify facilitators, societal approaches to and support for domestic violence, and barriers to men’s participation in domestic violence research, assessing the importance of each factor. Participatory concept mapping was used with a convenience sample of men (n = 142) in person and online across Australia, Canada and the United States of America. Engaging Men identified 43 facilitators, societal approaches to and support for domestic violence, and/or barriers to men’s participation in domestic violence research. The strongest facilitators related to external connections, such as concern for women around them. Men also recognized societal approaches to and support for domestic violence and the strongest barriers centered on internal feelings, including fear, shame and guilt about being linked to domestic violence. This study suggests that providing a safe environment for men to express genuine thoughts, feeling and views about domestic violence is vital, yet rarely available in domestic violence research. Therefore, research opportunities need to be more effectively designed and incentivized to address challenging issues identified by men, such as fear, shame and guilt and offer meaningful opportunities to demonstrate positive change.
Violence Prevention	Holliday, C. N., Morse, S. M., Irvin, N. A., Green-Manning, A., Nitsch, L. M., Burke, J. G., Campbell, J. C., & Decker, M. R.	2018	Concept mapping: Engaging urban men to understand community influences on partner violence perpetration.	Journal of Urban Health	https://doi.org/10.1007/s11524-018-0297-8	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6391285/pdf/11524_2018_Article_297.pdf	Johns Hopkins University	Intimate partner violence (IPV) is a significant health concern rooted in community experiences and other social determinants. The purpose of this study is to understand community-based risk and protective factors of IPV perpetration through participatory research that engages men who use IPV. Secondarily, we assess the relative influence, as measured by ranking, of these factors regarding risk of IPV perpetration and stress. We conducted concept mapping with Baltimore men (n = 28), ages 18 and older, enrolled in an abuse intervention program (AIP), through partnership with a domestic violence agency. Concept mapping, a three-phase participatory process, generates ideas around an issue then visually presents impactful domains via multi-dimensional scaling and hierarchical clustering. Most participants were Black (87.5%) and 20–39 years old (75%). Seven key domains, or clusters, were established. “No hope for the future” was the greatest contributor to IPV perpetration. “Socioeconomic struggles” (i.e., lack of employment) and “life in Baltimore” (i.e., homicide) were most likely to result in stress. Emergent domains related to IPV perpetration and stress were ranked similarly, but with some nuance. Having good support systems (i.e., family, community centers) were felt to prevent IPV and reduce stress. This participant-driven process among a primarily young, Black sample of Baltimore men speaks to the influence of perceived social disempowerment and underlying trauma on intimate relationships and the potential for mitigation. Few studies have engaged men who use IPV through participatory research to understand the comprehensive dynamics of an impoverished, urban environment. Results provide direction for community-based intervention and prevention programming to increase self-efficacy, particularly among younger men, and to enact trauma-informed violence prevention policy from the perspectives of male IPV perpetrators.
Violence Prevention	Ast, R. S., Banyard, V. L., Burnham, J., & Edwards, K. M.	2021	Community Conversations on Relationship Violence: Town Variations in Prevention Perceptions through Concept Mapping.	American Journal of Community Psychology	https://doi.org/10.1002/ajcp.12488		Rutgers University	To further develop domestic and sexual violence (DSV) prevention strategies at the community level requires an understanding of how community members in towns think about prevention. Using concept mapping, this study sought to better understand community members’ perspectives about what DSV prevention strategies would be most feasible, most effective, and generate the greatest community support within their town. Data were collected across four rural Northern England towns. Participants (>90% White) in each town (total sample size = 119) brainstormed, sorted, and rated between 67 and 90 statements per town (x̅ = 75). Based on the results, a 5-cluster solution of school settings, conversations, individual direct action, community building, and community awareness was identified across all four towns as DSV prevention strategies with one town identifying an additional cluster solution of governance. Despite identifying similar prevention strategies, participants from each town rated these clusters of strategies differently on how feasible, effective, and supported they would be in their community. Overall, our results suggest that there were interesting consistencies across four towns in a similar geographic region in terms of how DSV prevention was described. However, individual communities differed in their views of the feasibility and acceptability of the different strategies. These results suggest that different strategies and higher-level actions may be required to address and prevent DSV within different towns and communities and that community narratives can clarify which specific strategies may encounter fewer barriers to implementation.
Women's Wellness	Weinstein, L. C., LaNoue, M., Hurley, K., Sifri, R., & Myers, R.	2015	Using concept mapping to explore barriers and facilitators to breast cancer screening in formerly homeless women with serious mental illness.	Journal of Health Care for the Poor and Underserved	https://doi.org/10.1353/hpu.2015.0104		Thomas Jefferson University	Women with serious mental illness (SMI) have disproportionately worse breast cancer profiles than those of other women. The purpose of this project was to examine barriers to and facilitators of breast cancer screening, specifically in formerly homeless women with SMI using the participatory methodology of concept mapping. A series of three concept mapping focus groups were held with 27 women over the age of 40 with a diagnosis of a SMI who live in supportive housing programs, and with 16 housing program staff. Data from the focus groups were combined through multidimensional scaling to create a visual cluster map. Barriers and facilitators to mammography screening generated by the participants clustered into eight categories. Participants rated addressing educational issues as most important and feasible. Interventions designed to improve mammogram screening in this population should address patients' perception of personal risk and should target education and support systems as modifiable factors.
Women's Wellness	Becerril-Montekio, V., Alcalde-Rabanal, J., Darney, B. G., & Orozco-Nunez, E.	2016	Using systematized tacit knowledge to prioritize implementation challenges in existing maternal health programs: Implications for the post MDG era.	Health Policy and Planning	https://doi.org/10.1093/heapol/czw033	https://academic.oup.com/heapol/article/31/8/1031/2198184?login=false	National Institute of Public Health of Mexico	Strategic priority setting and implementation of strategies to reduce maternal mortality are key to the post Millennium Development Goal (MDG) 2015 agenda. This article highlights the feasibility and the advantages of using a systematized tacit knowledge approach, using data from maternal health program personnel, to identify local challenges to implementing policies and programs to inform the post MDG era. Communities of practice, conceived as groups of people sharing professional interests, experiences and knowledge, were formed with diverse health personnel implementing maternal health programs in Mexico and Nicaragua. Participants attended several workshops and developed different online activities aiming to strengthen their capacities to acquire, analyze, adapt and apply research results and to systematize their experience and knowledge of the actual implementation of these programs. Concept mapping, a general method designed to organize and depict the ideas of a group on a particular topic, was used to manage, discuss and systematize their tacit knowledge about implementation problems of the programs they work in. Using a special online concept mapping platform, participants prioritized implementation problems by sorting them in conceptual clusters and rating their importance and feasibility of solution. Two hundred and thirty-one participants from three communities of practice in each country registered on the online concept mapping platform and 200 people satisfactorily completed the sorting and rating activities. Participants further discussed these results to prioritize the implementation problems of maternal health programs. Our main finding was a great similarity between the Mexican and the Nicaraguan general results highlighting the importance and the feasibility of solution of implementation problems related to the quality of healthcare. The use of rigorously organized tacit knowledge of health personnel proved to be a feasible and useful tool for prioritization to inform implementation priorities in the post MDG agenda.
Women's Wellness	Vives-Cases, C., Golcolea, I., Hernandez, A., Sanz-Barbero, B., Davo-Blanes, M., & La Parra-Casado, D.	2017	Priorities and strategies for improving Roma women’s access to primary health care services in cases on intimate partner violence: A concept mapping study.	International Journal for Equity in Health	https://doi.org/10.1186/s12939-017-0594-y	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5463323/pdf/12939_2017_Article_594.pdf	Alicante University	Background: With an explicit focus on Roma women in Spain (Kale/Spanish Gypsies), this study aims to integrate key informants' opinions about the main actions needed to improve primary health care services' and professionals' responses to Roma women in an Intimate Partner Violence (IPV) situation. Methods: Concept mapping study. A total of 50 (brainstorming phase), 36 (sorting and rating phase) and 16 (interpretation phase) participants from Roma civil society groups, primary health care professionals and other related stakeholders (social services, academic experts and other IPV NGOs representatives) from different cities in Spain were involved in the different study phases. Results: Among the 55 action proposals generated, ten priority actions were identified through consensus as most important for improving primary health care's response to Romani women in an IPV situation, and these included primary, secondary and tertiary prevention activities. Conclusion: Results indicated that efforts to address this challenge should take an integrated approach that reinforces the primary health care response to IPV in general, while also promoting more specific actions to address barriers to access that affect all Roma women and those who experience IPV in particular.
Women's Wellness	Rainey, L., van der Waal, D., Donnelly, L. S., Evans, D. G., Wengstrom, Y., & Broeders, M.	2018	Women's decision-making regarding risk-stratified breast cancer screening and prevention from the perspective of international healthcare professionals.	PLOS One	https://doi.org/10.1371/journal.pone.0197772	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5983562/pdf/pone.0197772.pdf	Radboud University	Introduction: Increased knowledge of breast cancer risk factors may enable a paradigm shift from one-size-fits-all breast cancer screening to screening and subsequent prevention guided by a woman’s individual risk of breast cancer. Professionals will play a key role in informing women about this new personalised screening and prevention programme. Therefore, it is essential to explore professionals’ views of the acceptability of this new programme, since this may affect shared decision-making. Methods: Professionals from three European countries (the Netherlands, United Kingdom, and Sweden) participated in digital concept mapping, a systematic mixed methods approach used to explore complex multidimensional constructs. Results: Across the three countries, professionals prioritised the following five themes which may impact decision-making from the perspective of eligible women: (1) Anxiety/worry; (2) Proactive approach; (3) Reassurance; (4) Lack of knowledge; and (5) Organisation of risk assessment and feedback. Furthermore, Dutch and British professionals expressed concerns regarding the acceptability of a heterogeneous screening policy, suggesting women will question their risk feedback and assigned pathway of care. Swedish professionals emphasised the potential impact of the programme on family relations. Conclusions: The perspectives of Dutch, British, and Swedish professionals of women’s decision-making regarding personalised breast cancer screening and prevention generally appear in line with women’s own views of acceptability as previously reported. This will facilitate shared decision-making. However, concerns regarding potential consequences of this new programme for screening outcomes and organisation need to be addressed, since this may affect how professionals communicate the programme to eligible women.
Women's Wellness	Zegbe, E. M., Montekio, V. B., & Rabanal, J. A.	2018	Conocimientos tácito y explícito: análisis comparativo de la priorización de problemas de salud materna en México (Tacit and explicit knowledge: comparative analysis of the prioritization of maternal health problems in Mexico).	Gaceta Sanitaria	https://doi.org/10.1016/j.gaceta.2017.04.006	https://www.scielosp.org/pdf/gs/2018.v32n3/251-261/es	National Institute of Public Health of Mexico	Resumen Objetivo: Identificar coincidencias y diferencias en la identificación y la priorización de problemas de los servicios de salud materna en México, desde las perspectivas del conocimiento tácito y el conocimiento explícito, que ofrezcan evidencias que contribuyan a alcanzar los Objetivos de Desarrollo Sostenible. Método Estudio mixto, realizado en tres etapas: 1) sistematización de problemas de los servicios de atención a la salud materna identificados por el conocimiento tácito (derivado de la experiencia profesional); 2) identificación de problemas de los servicios de atención a la salud materna en América Latina abordados por el conocimiento explícito (publicaciones científicas); 3) comparación de problemas identificados por los conocimientos tácito y explícito. Resultados Los principales problemas identificados según el conocimiento tácito están vinculados con la mala calidad de la atención, mientras que aquellos mayormente abordados por el conocimiento explícito se refieren a barreras de acceso a la atención en los servicios de salud. Aproximadamente el 70% de los problemas identificados en el conocimiento tácito son señalados en el conocimiento explícito. Paralelamente, el 70% de los problemas identificados en la literatura también son considerados por el conocimiento tácito. No obstante, al comparar los problemas uno a uno no se encuentran similitudes estadísticamente significativas entre ambos enfoques. Conclusiones El estudio mostró que la identificación de problemas en los servicios de atención a la salud materna por el conocimiento tácito y por el conocimiento explícito es medianamente comparable, según el índice de comparabilidad utilizado, y subraya el interés de integrar ambos abordajes a fin de mejorar la priorización y la toma de decisiones hacia los Objetivos de Desarrollo Sostenible. Abstract Objective To identify coincidences and differences in the identification and prioritization of maternal healthcare service problems in Mexico based on the perspective of tacit knowledge and explicit knowledge that may offer evidence that can contribute to attaining the Sustainable Development Goals. Methods Mixed study performed in three stages: 1) systematization of maternal healthcare service problems identified by tacit knowledge (derived from professional experience); 2) identification of maternal healthcare service problems in Latin America addressed by explicit knowledge (scientific publications); 3) comparison between the problems identified by tacit and explicit knowledge. Results The main problems of maternal health services identified by tacit knowledge are related to poor quality of care, while the predominant problems studied in the scientific literature are related to access barriers to health services. Approximately, 70% of the problems identified by tacit knowledge are also mentioned in the explicit knowledge. Conversely, 70% of the problems identified in the literature are also considered by tacit knowledge. Nevertheless, when looking at the problems taken one by one, no statistically significant similarities were found. Conclusions The study discovered that the identification of maternal health service problems by tacit knowledge and explicit knowledge is fairly comparable, according to the comparability index used in the study, and highlights the interest of integrating both approaches in order to improve prioritization and decision making towards the Sustainable Development Goals.
Women's Wellness	Kazmerski, T. M., Prushinskaya, O. V., Hill, K., Nelson, E., Leonard, J., Mogren, K., Pitts, S. A. B., Roboff, J., Uluer, A., Emans, S. J., Miller, E., & Sawicki, G. S.	2018	Sexual and reproductive health of young women with Cystic Fibrosis: A concept mapping study.	Academic Pediatrics	https://doi.org/10.1016/j.acap.2018.08.011		Department of Medicine	Adolescent and young adult (AYA) women with pediatric-onset chronic diseases, such as cystic fibrosis (CF), face disease-specific sexual and reproductive health (SRH) concerns. Using concept mapping (CM), this study aimed to identify the SRH topics and outcomes valued by AYA women with CF and their parents.
Women's Wellness	Rouhi, M., Stirling, C., & Crisp, E. P.	2019	Mothers' views of health problems in the twelve months after childbirth: A concept mapping study.	Journal of Advanced Nursing	https://doi.org/10.1111/jan.14187	https://onlinelibrary.wiley.com/doi/epdf/10.1111/jan.14187	University of Tasmania	Aims: To identify the health problems that women feel require help and subsequent help-seeking behaviour during the 12 months period after childbirth. Background: Many women experience physical and mental health problems after childbirth, but there is a gap in understanding how they perceive their health after childbirth. Studies suggested they are inhibited in expressing their needs and so seek informal rather than professional help for their health problems. Design: A mixed method concept mapping study. Method: Two groups of Australian women were recruited by an online platform and purposive sampling (N = 81) in 2017-2018, based on an established concept mapping methodology. A first group created 83 brainstorm statements about post-childbirth health problems and help-seeking and a second group sorted and rated the statements based on their perception of the prevalence of the issues and the help-seeking advice they would offer to others. Bradshaw`s Taxonomy of Needs was used to theoretically underpins the explanation of the results of women's felt need after childbirth. Results: Multidimensional scaling resulted in six clusters of issues which were categorized into three domains: 'health issues and care', 'support' and 'fitness'. Despite being directly asked, about two-thirds of the women did not report experiencing any health problems. Conclusion: Our findings showed women had a broader perception of healthcare needs which included support and fitness. There is a potential gap in services for women who do not have good social support. Impact: Family and friends were a key source of help-seeking. Post-childbirth routine care was focused on infant care and limited to the first 6 weeks after childbirth. The content of current post-childbirth care must be reviewed
Women's Wellness	McMahon, S., Burnham, J., & Banyard, V. L.	2020	Bystander Intervention as a Prevention Strategy for Campus Sexual Violence: Perceptions of Historically Minoritized College Students.	Prevention Science	https://doi.org/10.1007/s11121-020-01134-2		Rutgers University	The bystander intervention approach to campus sexual violence has received increased attention as a promising prevention strategy. However, there lacks research on the perspective of historically minoritized students, such as students of color, LGBTQ-spectrum students, and the intersections thereof. As such, the purpose of this paper is to present the findings from an exploratory study regarding bystander intervention that focused exclusively on the perspectives of 101 racialized and/or LGBTQ-spectrum students at three campuses across a large public university. Using concept mapping methodology, the study was conducted in three phases: brainstorming of statements about bystander intervention, sorting and rating of statements, and mapping and interpretation of the results. Using multidimensional scaling and hierarchical cluster analysis, a six-cluster solution was determined, representing key themes related to supporting students' efforts as helpful bystanders. Overall, findings indicate a need for bystander intervention efforts to widen their focus by employing an intersectional, social justice lens. Study participants identified various forms of racism, homophobia, transphobia, and microaggressions as intertwined with their ability to be active bystanders on college campuses. Keywords: Concept mapping; Minoritized populations; Sexual violence prevention; Social justice.
Women's Wellness	Brand, A., M., Rosas, S., Waterink, W., & Stoyanov, S.	2022	Conceptualization and Inventory of the Sexual and Psychological Burden of Women With Pelvic Floor Complaints; A Mixed-Method Study.	Sexual Medicine	https://doi.org/10.1016/j.esxm.2022.100504	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9177886/pdf/main.pdf	Open University of The Netherlands	Despite the fact that the literature reports various restrictions and types of distress in women with pelvic floor complaints, a comprehensive overview of women's sexual and psychological burden emerging from these complaints is lacking, which compromises our ability to assess and grasp the impact to women. Aim: This study was performed to conceptualize women's sexual and psychological burden and create a more comprehensive overview on this topic from both women's and health care providers' perspectives. Furthermore, this research intended to identify items to populate a to-be-developed instrument to assess sexual and psychological burden. Methods: In Group Concept Mapping, 125 statements were used about restrictions and distress that women with pelvic floor complaints experienced. Women with, and health care providers with and without pelvic floor complaints (13 women and 3 men) sorted the statements into comprehensive self-labeled clusters and rated their nature and severity. Multidimensional scaling and hierarchical cluster analyses were performed to identify a conceptual model of coherent clusters of statements. Item-total correlations of severity scores were calculated to identify statements that can be used in future research to represent women's sexual and psychological burden. Main outcome measure: A conceptual model emerged, and outcomes of item-total correlations were then examined again using the conceptual model. Results: Seven distress clusters were identified, namely, loss of control, sexual distress, feeling insecure, feeling wronged, feeling helpless, feeling angry, and feeling disappointed. Feeling insecure appeared more pervasive than other distresses. Furthermore, 33 statements were identified that can be used in future research to develop an instrument to assess sexual and psychological burden representing both women's and health care providers' perspectives. Conclusion: The conceptual model and list of statements may concisely represent the sexual and psychological burden of women with pelvic floor complaints from both women's and health care providers' perspectives on this topic. Brand AM, Rosas S, Waterink W, et al. Conceptualization and Inventory of the Sexual and Psychological Burden of Women With Pelvic Floor Complaints; A Mixed-Method Study. Sex Med 2022;10:100504. Keywords: Distress; Group Concept Mapping; Pelvic Floor Complaints; Restrictions; Sexual and Psychological Burden.
Women's Wellness	Daoud, N., Carmi, A., Bolton, R., Cerdán-Torregrosa, A.	2022	Promoting Positive Masculinities to Address Violence Against Women: A Multicountry Concept Mapping Study	Journal of Interpersonal Violence	https://doi.org/10.1177/08862605221134641	https://journals.sagepub.com/doi/pdf/10.1177/08862605221134641	Ben-Gurion University	Interventions engaging men that challenge unequal gender norms have been shown to be effective in reducing violence against women (VAW). However, few studies have explored how to promote anti-VAW positive masculinity in young adults. This study aims to identify key multicountry strategies, as conceived by young adults and other stakeholders, for promoting positive masculinities to improve gender equity and prevent and target VAW. This study (2019–2021) involved young adults (aged 18–24 years) and stakeholders from Ireland, Israel, Spain, and Sweden. We applied
Women's Wellness	Yu, J., Wallace, S., & Kenkre, J.	2023	A consensus approach: Understanding the support needs of women in Newport West, Wales, to participate in breast screening		https://doi.org/10.1111/hex.13720	https://onlinelibrary.wiley.com/doi/epdf/10.1111/hex.13720	University of South Wales	Breast screening is an effective way to improve the early detection of breast cancer and reduce mortality. Unfortunately, low uptake of screening is often reported. This study aimed to explore the support needs of women residing in Newport West, Wales, to participate in breast screening. Methods Group Concept Mapping, a structured participatory consensus approach, was used as the method. Participants completed three activities either online or offline: brainstorming to generate statements, sorting statements into themed categories; rating statements for perceived importance and accessibility (easy to get). Results Thirty-seven participants from seven ethnic groups took part. Sixty-three statements (items of support) were generated and sorted into seven conceptually similar clusters (themes) (Trusting that I will be respected; Reassurance about my experience; Accessibility and convenience; Practical support; Addressing cultural diversity; Information tailored to individual needs; Raising awareness and understanding of breast screening). The ‘Trusting that I will be respected’ cluster was rated most important, while the ‘Practical support’ cluster was rated least accessible. Some disparity between responses was found based on ethnicity, language, disability and previous attendance of breast screening. Conclusions Women require a range of support to participate in breast screening. The results highlight the importance of ensuring women feel and are respected, instilling trust in the staff performing the screening, offering reassurance about positive experiences of breast screening and providing practical support, especially individualized/targeted support for people who do not speak and/or read English and those with a disability. Patient or Public Contribution The public contributed to the development of the information sheet, consent form, recruitment and data collection method.
Chronic Disease Research	ZR Stisen, M Skougaard, KR Christensen…	2023	Exploring disease-related and treatment-related issues and concerns experienced by adults with spondyloarthritis, inflammatory bowel disease and psoriasis to …	BMJ Open	https://doi.org/10.1136/bmjopen-2023-071586	https://bmjopen.bmj.com/content/bmjopen/13/12/e071586.full.pdf	The Parker Institute, Bispebjerg and Frederiksberg Hospital, University of Copenhagen	Exploring patients’ perspectives for significant factors of relevance in living with a chronic disease is important to discover unmet needs and challenges. The primary objective of this study was to explore disease-related and treatment-related issues and concerns experienced by adults with spondyloarthropathies (SpA) and associated diseases. As a secondary objective, we wanted to explore whether these factors were generic or disease dependent.
Chronic Disease Research	J Brown-Walkus, J Smylie, CM Borkhoff, BJ Hardy…	2023	Defining quality of preventive oral health services in a northern First Nations community: a concept mapping study.	Rural & Remote Health	https://doi.org/10.22605/rrh7910	https://www.rrh.org.au/journal/download/pdf/7910/	Squamish, Heiltsuk, and Gwa'sala First Nations	In partnership with the Norway House Cree Nation (NHCN) in Manitoba, Canada, this study developed a framework based on how Indigenous parents/caregivers of young children and community-based oral health decision-makers perceive ‘quality of preventive oral health services’.
Child & Adolescent Health;Counseling and Mental Well Being	L Bosakova, Z Dankulincova Veselska…	2024	How to improve the system of care for adolescents with emotional and behavioural problems from the perspective of care providers: a concept mapping approach	Health Research Policy and Systems	https://doi.org/10.1186/s12961-023-01096-1	https://health-policy-systems.biomedcentral.com/counter/pdf/10.1186/s12961-023-01096-1.pdf	Department of Health Psychology and Research Methodology, Faculty of Medicine, P.J. Safarik University in Kosice	Emotional and behavioural problems (EBP) are the most common mental health issues during adolescence, and their incidence has increased in recent years. The system of care for adolescents with EBP is known to have several problems, making the provision of care less than optimal, and attention needs to be given to potential improvements. We, therefore, aimed to examine what needs to be done to improve the system of care for adolescents with EBP and to assess the urgency and feasibility of the proposed measures from the perspective of care providers.
Chronic Disease Research	J Gray, N Buermyer, C Petrucci, C Engel…	2024	Development of Systemic Interventions to Decrease Breast Cancer Risk: A Group Concept Mapping Study	International Journal of Environmental Research and Public Health	https://doi.org/10.3390/ijerph21030318	https://www.mdpi.com/1660-4601/21/3/318/pdf?version=1709969942	Breast Cancer Prevention Partners	As breast cancer continues to take a devasting public health toll, most primary prevention approaches are targeted at individual actions. We have proposed, instead, developing systemic, population approaches to preventing the disease. We used a combined qualitative–quantitative methodology, group concept mapping (GCM), to identify Importance and Feasibility ratings of systemic interventions across a wide spectrum of approaches and stakeholders. Participants (n = 351) from across the state of California sorted 84 potential interventions into topical piles, and then rated each intervention on perceived Importance and Feasibility. Multidimensional scaling and a cluster analysis identified eleven clusters or themes of interventions. Participants rated interventions on Importance and Feasibility differently depending on the region of the state in which they lived. The results of this study underscore the importance of sharing health information with and seeking public health solutions from community partners in general and from beyond the urban areas usually studied.
Chronic Disease Research	C Carmack, A Roncancio, TM Coleman, S McKay	2024	Concept mapping sociocultural aspects of cervical cancer prevention among African American women	Frontiers in Public Health	https://doi.org/10.3389%2Ffpubh.2023.1311286	https://www.frontiersin.org/journals/public-health/articles/10.3389/fpubh.2023.1311286/pdf?isPublishedV2=false	HEALTH Research Institute—RCMI, University of Houston	For African American women in Houston, cervical cancer mortality is disproportionate to their racial and ethnic counterparts. Most notably, lack of human papillomavirus (HPV) screening and vaccination as well as late diagnosis increase cervical cancer mortality. However, cervical cancer is largely preventable. While previous research has identified a few social determinants that are specifically related to cervical cancer (e.g., education, income, neighborhood), there may be a host of additional social and cultural factors that contribute to a lack of preventative behavior.
Nutrition & Physical Activity	R Dann, J Headrick, L Roberts, V Kelly, A Donaldson…	2024	Athlete and Support Staff Perceptions of Training Modalities for the Development of Surfing-Specific Manoeuvres: A Concept Mapping Approach	Journal of Coaching and Sports Science	https://doi.org/10.58524/002024334200	https://journal.foundae.com/index.php/jcss/article/view/342/174	Griffith University	This study investigated the perspectives of surfers and support staff on the importance and feasibility of common surfing training modalities. The Concept Systems groupwisdomTM web platform was used to collect and analyse data from 29 participants (18 support staff and 11 surfers). The concept mapping methodology was employed due to its effectiveness in identifying context-specific factors and real-world perspectives. Participants brainstormed statements identifying training modalities that should be incorporated in training to develop surfing-specific manoeuvres. Participants then sorted statements into clusters before rating them on importance and feasibility using a 10-point scale. Twenty-nine participants brainstormed 101 statements, which the research team synthesised and condensed to 58. Following multidimensional scaling and hierarchical cluster analysis, a 4-cluster solution was identified as the most appropriate representation of the participants sorting data: education and mindset (8 statements), physical preparation (24), in-water training (13) and dry-land training (13). Mean ratings for each cluster and statement determined the education and mindset cluster as the most important (mean = 7.5) and feasible (8.1), while the dry-land training cluster was the least important (mean = 5.9), and feasible (mean =6.0). A significant difference was found (< 0.001) between the surfers’ (mean = 6.48) and coaching staff’s (mean = 5.61) perceived importance of dry-land training. The four modalities of surfing-specific training, rated from most to least important were: education and mindset, physical preparation, in-water training and dry-land training. Support staff should factor these four key areas into training program design and consider the potential differing views when it comes to implementing dry-land training. Additionally, these findings highlight the unique environment, task and individual constraints found within surf-training and promote the integration of a constraints led approach to training designs. This study is the first to report on the perceptions of competitive surfers and should inform both research and practice regarding the design of training environments for the development of skill-based surfing-specific manoeuvres.
Topic	Authors	Year	Title	Journal	DOI Link		Lead Author Org	Abstract

Looking to cite the technology? Samples are located here.

Let’s connect! Fill out the form below or call us at (607) 272-1206.

^* These fields are required.

Cookie	Duration	Description
cookielawinfo-checkbox-advertisement	1 year	Set by the GDPR Cookie Consent plugin, this cookie is used to record the user consent for the cookies in the "Advertisement" category .
cookielawinfo-checkbox-analytics	11 months	This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional	11 months	The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary	11 months	This cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others	11 months	This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance	11 months	This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
CookieLawInfoConsent	1 year	Records the default button state of the corresponding category & the status of CCPA. It works only in coordination with the primary cookie.
JSESSIONID	session	Used by sites written in JSP. General purpose platform session cookies that are used to maintain users' state across page requests.
viewed_cookie_policy	11 months	The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.

Cookie	Duration	Description
bcookie	2 years	LinkedIn sets this cookie from LinkedIn share buttons and ad tags to recognize browser ID.
lang	session	This cookie is used to store the language preferences of a user to serve up content in that stored language the next time user visit the website.
lidc	1 day	LinkedIn sets the lidc cookie to facilitate data center selection.

Cookie	Duration	Description
_ga	2 years	The _ga cookie, installed by Google Analytics, calculates visitor, session and campaign data and also keeps track of site usage for the site's analytics report. The cookie stores information anonymously and assigns a randomly generated number to recognize unique visitors.
_gat_gtag_UA_11036077_3	1 minute	Set by Google to distinguish users.
_gid	1 day	Installed by Google Analytics, _gid cookie stores information on how visitors use a website, while also creating an analytics report of the website's performance. Some of the data that are collected include the number of visitors, their source, and the pages they visit anonymously.

Cookie	Duration	Description
ccookie	session	No description
fcsid	session	No description available.
li_gc	2 years	No description