Design and Implementation of Survey Quality Control System for Qatar’s First National Mental Health Survey: Case Study.

Publication date: Nov 27, 2023

All World Mental Health (WMH) Surveys apply high standards of data quality. To date, most of the published quality control (QC) procedures for these surveys were in relation to face-to-face interviews. However, owing to the social restrictions that emerged from the COVID-19 pandemic, telephone interviews are the most effective alternative for conducting complex probability-based large-scale surveys. In this paper, we present the QC system implemented in the WMH Qatar Survey, the first WMH Survey conducted during the COVID-19 pandemic in the Middle East. The objective of the QC process was to acquire high data quality through the reduction of random errors and bias in data collection. The QC design and procedures in this study were adapted to the telephone survey mode in response to the COVID-19 pandemic. We focus on the design of the QC indicator system and its implementation, including the investigation process, monitoring interviewers’ performance during survey fielding and applying quality-informed interventions. The study team investigated 11,035 flags triggered during the 2 waves of the survey data collection. The most triggered flags were related to short question administration duration and multiple visits to the same survey questions or responses. Live monitoring of the interviews helped in understanding why certain duration-related flags were triggered and the interviewing patterns of the interviewers. Corrective and preventive actions were taken against interviewers’ behaviors based on the investigation of triggered flags per interviewer and live call monitoring of interviews. Although, in most cases, the interviewers required refresher training sessions and feedback to improve their performance, several interviewers discontinued work because of low productivity and a high number of triggered flags. The specific QC procedures implemented in the course of the WMH Qatar Survey were essential for successfully meeting the target number of interviews (N=5000). The QC strategies and the new indicators customized for telephone interviews contributed to the flag investigation and verification process. The QC data presented in this study shed light on the rigorous methods and quality monitoring processes in the course of conducting a large-scale national survey on sensitive topics during the COVID-19 pandemic.

Open Access PDF

Concepts Keywords
Conducting case study
Interviewers COVID-19
Pandemic Middle East
Qatar phone interview
quality control indicators

Semantics

Type Source Name
disease IDO quality
disease MESH COVID-19 pandemic
disease VO effective
disease IDO process
disease VO Imovax ID
drug DRUGBANK Phosmet
disease VO protocol
disease IDO disposition
disease MESH mental disorders
disease VO organization
disease VO Canada
drug DRUGBANK Etoperidone
disease VO efficient
disease VO population
disease IDO production
disease VO device
disease VO Gap
disease VO frequency
disease VO efficiency
disease VO time
disease IDO history
drug DRUGBANK Ranitidine
drug DRUGBANK Methionine
disease IDO country
disease VO document
disease VO biweekly
disease MESH anomalies
drug DRUGBANK Hexachlorophene
disease VO monthly
drug DRUGBANK Nonoxynol-9
disease MESH Comorbidity
disease IDO replication
disease MESH morbidity
drug DRUGBANK Trestolone
disease MESH major depressive disorder
drug DRUGBANK Medrysone
disease MESH Psychological distress
disease IDO intervention
drug DRUGBANK Coenzyme M
drug DRUGBANK Serine
pathway REACTOME Reproduction

Original Article

(Visited 1 times, 1 visits today)