From ec0c3a7fc1fbc5182814c19c76d2516739010a99 Mon Sep 17 00:00:00 2001 From: Marty Oehme Date: Wed, 27 Sep 2023 12:44:26 +0200 Subject: [PATCH] Add simple scoping review methodology --- _quarto.yml | 5 +-- scoping_review.md | 90 +++++++++++++++++++++++++++++++++++++++++++---- 2 files changed, 85 insertions(+), 10 deletions(-) diff --git a/_quarto.yml b/_quarto.yml index 3cada5b..ed3be3d 100644 --- a/_quarto.yml +++ b/_quarto.yml @@ -3,13 +3,10 @@ project: output-dir: 04-outputs render: - concepts.md + - scoping_review.md format: docx: echo: false pdf: pdf-engine: tectonic - - - - diff --git a/scoping_review.md b/scoping_review.md index 7ae5ca1..0ad23c9 100644 --- a/scoping_review.md +++ b/scoping_review.md @@ -1,11 +1,30 @@ -# Scoping review on 'what works' to address inequalities in the World of Work +--- +bibliography: 03-supplementary_data/lib.bib +csl: /home/marty/documents/library/utilities/styles/APA-7.csl +papersize: A4 +linestretch: 1.5 +fontfamily: lmodern +fontsize: "12" +geometry: + - left=2.2cm + - right=3.5cm + - top=2.5cm + - bottom=2.5cm +toc: false +link-citations: true +link-bibliography: true +number-sections: false +lang: en +title: Scoping review on 'what works' +subtitle: Addressing inequalities in the World of Work +--- -## Introduction +# Introduction This section will introduce the reader to the concern of inequality in the World of Work (WoW), and present a discussion on why policy interventions are needed to address these disparities. -## Labour market policies: concepts, functions, typologies and actors +# Labour market policies: concepts, functions, typologies and actors This section will present a typology of policies that directly or indirectly tackle inequalities in the WoW both within the labour market and outside this domain (e.g. education policy). In order to define the typology of policy areas, @@ -13,7 +32,7 @@ it will be critical to review previous ILO work, in particular de documents outl Based on this typology, we will then develop a theory of change to depict policy objectives, components, inputs and functions of distinct types of interventions outlined in the typology. The section will also identify the theoretical mechanisms and channels through which policies are expected to impact inequalities in forms of work and labour market outcomes. -## Scoping Review methodology +# Scoping Review methodology This section will discuss the systematic scoping review methodology that is proposed to conduct the review of the literature on policy interventions that are expected to address inequalities in forms of work and labour market outcomes. Unlike systematic reviews, which typically focus on specific policy questions and interventions, @@ -23,13 +42,72 @@ Since scoping reviews allow both broad and in-depth analyses, they are the most appropriate rigorous method to make a synthesis of the current evidence in this area. The search protocol will be carried out based on the typology of policies as well as the possible combination of definitions and outcomes in the WoW. +For each dimension of definitions, +a cluster containing possible utilized terms will be created, that is for: +definitions of work and labour, forms of work, definitions of inequality, forms of vertical and forms of horizontal inequalities, labour market outcomes, and definitions of policy. +Each of the clusters contains synonymous terms as well as term-adjacent phrase combinations which are in turn used to refine or broaden the search scope to best encapsulate each respective cluster, +based on the above definitions. + -## Synthesis of Evidence +The search protocol then follows a three-staged process of execution: identification, screening and extraction. +First, in identification, the above categorizations are combined through Boolean operators to conduct a search through the database repository Web of Science. + +The search istelf is conducted with English-language search queries only. + +Relevant results are then complemented through the adoption of a 'snowballing' technique, +which analyzes an array of published reviews for their reference lists to find cross-references of potentially missing literature. + + +The execution of queries results in an initial sample of 2169 studies after the identification process. +The majority of studies result from the 'income' inequality cluster of the boolean search, +with horizontal cluster terms used often but rarely on their own. + +Second, in screening, duplicate results are removed and the resulting literature sample is sorted based on a variety of excluding characteristics based on: language, title, abstract, full text and literature supersession through newer publications. +Properties in these characteristics are used to assess an individual study on its suitability for further review. + +Narrowing criteria are applied to restrict the sample to studies looking at +i) the effects of individual evidence-based policy measures or intervention initiatives +ii) attempting to address a single or multiple of the defined inequalities in the world of work. +iii) using appropriate quantitative methods to examine the links of intervention and impact on the given inequalities. + +To facilitate this screening process, a system of keywords is used to tag individual studies in the sample with their reason for exclusion, +such as 'excluded::language', 'excluded::title', 'excluded::abstract', 'excluded::superseded'. +This keyword-based system is equally used to further categorize the sample studies not falling into an exclusion criteria, +based on primary country of analysis, world region, as well as income level classification. +To that end, a 'country::', 'region::' and 'income::' are used to disambiguate between the respective characteristics, +such as 'region::LAC' for Latin America and the Caribbean, +'region::SSA' for Sub-Saharan Afraca; +as well as for example 'income::low-middle', 'income::upper-middle' or 'income::high'. +These two delineations follow the ILO categorizations on world regions and the country income classifications based on World Bank income groupings [@ilo22countrygroupings]. + +Similarly, if a specific type of inequality, +or a specific intervention, represents the focus of a study, +these will be reflected in the same keyword system, through for example 'inequality::income' or 'inequality::gender'. +The complete process of identification and screening is undertaken with the help of the Zotero reference manager, +ultimately leaving only publications which are relevant for final full-text review and analysis. + +Last, for extraction, studies are screened for their full-texts, +irrelevant studies excluded with 'excluded:full-text' as explained above and relevant studies then ingested into the final sample pool. +All relevant information concerning both their major findings and statistical significance are then extracted from the individual studies into a collective results matrix. + +The results to be identified in the matrix include a study's: +i) key outcome measures (dependent variables), +ii) main findings, +iii) main policy recommendations, +iv) study design and sample size, +v) dataset and methods of evaluation, +vi) direction of relation and level of representativeness, +vii) level of statistical significance, +viii) main limitations. + +# Synthesis of Evidence This section will present a synthesis of evidence from the scoping review. The evidence will be presented by type of policies and world regions. The section will also present a discussion on the implications of the current evidence base for policy and underscore key knowledge gaps. -## Conclusion +# Conclusion The section with conclude with reflections on the implications of findings for policy. + +\pagebreak