A comparison of web-based and paper-and-pencil job satisfaction surveys

Abstract

Parallel to the rising availability and application of Web-based organizational research, the issue of its validity becomes increasingly important. The research was designed to reveal any existing differences in job satisfaction survey data gathered using Intranet and paper-and-pencil administration modes. A sample of employees in one large organization in Serbia (N = 1923), answered either Intranet (N = 425) or paper-based job satisfaction survey (N = 1498). A 50-item version of a Job Satisfaction Scale was highly reliable for both data collection techniques. There was a significant method effect on all the checked indicators: demographic characteristics of Intranet and paper sub-samples based (gender, age, length of service and educational level); proportion of missing answers (on items about job satisfaction and demographic data), satisfaction with specific items and dimensions of job satisfaction, as well as overall job satisfaction. Interaction effects of administration mode by gender, age, length of service and education were not significant. Results stress that before accepting Webbased organizational surveys as a new gold standard we need empirical evidence that Web-based data can be combined and/or compared with paper-based data.