Online versus paper evaluations

Differences in both quantitative and qualitative data

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

This study sought to determine if differences exist in the quantitative and qualitative data collected with paper and online versions of a medical school clerkship evaluation form. Data from six-and-a-half years of clerkship evaluations were used, some collected before and some after the conversion from a paper to an online evaluation system. The quantitative data consisted of a composite score based on the average of several Likert-type items; the qualitative data consisted of open-ended comments about the clerkships. Clerkship ratings were more positive in the online version. Students made significantly longer comments about both strengths and weaknesses on the online form than on the paper form. In addition, comments made on the online form were judged to be more informative and showed less evidence of "negativity" than those made on the paper form. The findings suggest that both quantitative and qualitative data obtained with online evaluation forms can differ in important ways from data collected with paper forms.

Original languageEnglish (US)
Pages (from-to)58-69
Number of pages12
JournalJournal of Computing in Higher Education
Volume24
Issue number1
DOIs
StatePublished - 2012

Fingerprint

evaluation
rating
school
evidence
student

Keywords

  • Course evaluation questionnaires
  • Factor analysis
  • Inter-rater reliability
  • Qualitative data
  • Student feedback

ASJC Scopus subject areas

  • Education

Cite this

@article{4a3d08f0ba964608a5e0ff6b6914dade,
title = "Online versus paper evaluations: Differences in both quantitative and qualitative data",
abstract = "This study sought to determine if differences exist in the quantitative and qualitative data collected with paper and online versions of a medical school clerkship evaluation form. Data from six-and-a-half years of clerkship evaluations were used, some collected before and some after the conversion from a paper to an online evaluation system. The quantitative data consisted of a composite score based on the average of several Likert-type items; the qualitative data consisted of open-ended comments about the clerkships. Clerkship ratings were more positive in the online version. Students made significantly longer comments about both strengths and weaknesses on the online form than on the paper form. In addition, comments made on the online form were judged to be more informative and showed less evidence of {"}negativity{"} than those made on the paper form. The findings suggest that both quantitative and qualitative data obtained with online evaluation forms can differ in important ways from data collected with paper forms.",
keywords = "Course evaluation questionnaires, Factor analysis, Inter-rater reliability, Qualitative data, Student feedback",
author = "Burton, {William B.} and Adele Civitano and Penny Steiner-Grossman",
year = "2012",
doi = "10.1007/s12528-012-9053-3",
language = "English (US)",
volume = "24",
pages = "58--69",
journal = "Journal of Computing in Higher Education",
issn = "1042-1726",
publisher = "Paideia Publishers",
number = "1",

}

TY - JOUR

T1 - Online versus paper evaluations

T2 - Differences in both quantitative and qualitative data

AU - Burton, William B.

AU - Civitano, Adele

AU - Steiner-Grossman, Penny

PY - 2012

Y1 - 2012

N2 - This study sought to determine if differences exist in the quantitative and qualitative data collected with paper and online versions of a medical school clerkship evaluation form. Data from six-and-a-half years of clerkship evaluations were used, some collected before and some after the conversion from a paper to an online evaluation system. The quantitative data consisted of a composite score based on the average of several Likert-type items; the qualitative data consisted of open-ended comments about the clerkships. Clerkship ratings were more positive in the online version. Students made significantly longer comments about both strengths and weaknesses on the online form than on the paper form. In addition, comments made on the online form were judged to be more informative and showed less evidence of "negativity" than those made on the paper form. The findings suggest that both quantitative and qualitative data obtained with online evaluation forms can differ in important ways from data collected with paper forms.

AB - This study sought to determine if differences exist in the quantitative and qualitative data collected with paper and online versions of a medical school clerkship evaluation form. Data from six-and-a-half years of clerkship evaluations were used, some collected before and some after the conversion from a paper to an online evaluation system. The quantitative data consisted of a composite score based on the average of several Likert-type items; the qualitative data consisted of open-ended comments about the clerkships. Clerkship ratings were more positive in the online version. Students made significantly longer comments about both strengths and weaknesses on the online form than on the paper form. In addition, comments made on the online form were judged to be more informative and showed less evidence of "negativity" than those made on the paper form. The findings suggest that both quantitative and qualitative data obtained with online evaluation forms can differ in important ways from data collected with paper forms.

KW - Course evaluation questionnaires

KW - Factor analysis

KW - Inter-rater reliability

KW - Qualitative data

KW - Student feedback

UR - http://www.scopus.com/inward/record.url?scp=84873028329&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84873028329&partnerID=8YFLogxK

U2 - 10.1007/s12528-012-9053-3

DO - 10.1007/s12528-012-9053-3

M3 - Article

VL - 24

SP - 58

EP - 69

JO - Journal of Computing in Higher Education

JF - Journal of Computing in Higher Education

SN - 1042-1726

IS - 1

ER -