Journal article
From text to codings: intercoder reliability assessment in qualitative content analysis.
- Burla L Institute of Social and Preventive Medicine, University of Bern, Switzerland. bula@zhaw.ch
- Knierim B
- Barth J
- Liewald K
- Duetz M
- Abel T
- 2008-03-19
Published in:
- Nursing research. - 2008
Adult
Clinical Nursing Research
Data Collection
Female
Humans
Interviews as Topic
Low Back Pain
Male
Middle Aged
Observer Variation
Qualitative Research
Quality Control
Reproducibility of Results
English
BACKGROUND
High intercoder reliability (ICR) is required in qualitative content analysis for assuring quality when more than one coder is involved in data analysis. The literature is short of standardized procedures for ICR procedures in qualitative content analysis.
OBJECTIVE
To illustrate how ICR assessment can be used to improve codings in qualitative content analysis.
METHODS
Key steps of the procedure are presented, drawing on data from a qualitative study on patients' perspectives on low back pain.
RESULTS
First, a coding scheme was developed using a comprehensive inductive and deductive approach. Second, 10 transcripts were coded independently by two researchers, and ICR was calculated. A resulting kappa value of .67 can be regarded as satisfactory to solid. Moreover, varying agreement rates helped to identify problems in the coding scheme. Low agreement rates, for instance, indicated that respective codes were defined too broadly and would need clarification. In a third step, the results of the analysis were used to improve the coding scheme, leading to consistent and high-quality results.
DISCUSSION
The quantitative approach of ICR assessment is a viable instrument for quality assurance in qualitative content analysis. Kappa values and close inspection of agreement rates help to estimate and increase quality of codings. This approach facilitates good practice in coding and enhances credibility of analysis, especially when large samples are interviewed, different coders are involved, and quantitative results are presented.
High intercoder reliability (ICR) is required in qualitative content analysis for assuring quality when more than one coder is involved in data analysis. The literature is short of standardized procedures for ICR procedures in qualitative content analysis.
OBJECTIVE
To illustrate how ICR assessment can be used to improve codings in qualitative content analysis.
METHODS
Key steps of the procedure are presented, drawing on data from a qualitative study on patients' perspectives on low back pain.
RESULTS
First, a coding scheme was developed using a comprehensive inductive and deductive approach. Second, 10 transcripts were coded independently by two researchers, and ICR was calculated. A resulting kappa value of .67 can be regarded as satisfactory to solid. Moreover, varying agreement rates helped to identify problems in the coding scheme. Low agreement rates, for instance, indicated that respective codes were defined too broadly and would need clarification. In a third step, the results of the analysis were used to improve the coding scheme, leading to consistent and high-quality results.
DISCUSSION
The quantitative approach of ICR assessment is a viable instrument for quality assurance in qualitative content analysis. Kappa values and close inspection of agreement rates help to estimate and increase quality of codings. This approach facilitates good practice in coding and enhances credibility of analysis, especially when large samples are interviewed, different coders are involved, and quantitative results are presented.
- Language
-
- English
- Open access status
- closed
- Identifiers
-
- DOI 10.1097/01.NNR.0000313482.33917.7d
- PMID 18347483
- Persistent URL
- https://sonar.ch/global/documents/192255
Statistics
Document views: 21
File downloads: