Surveys can be an effective means to collect data needed for research and evaluation. However, the method is often misused and abused. The challenge is to design a survey that accomplishes its purpose and avoids the following common errors: Show
This fact sheet provides guidance for constructing questionnaires and developing procedures to administer them so they achieve valid and reliable results. This is not difficult if a logical process is followed. 1. Determine the purposeQuestionnaires are typically used for survey research, to determine the current status or "situation." They are also used to measure the difference in status "before" and "after" to determine changes that may be attributed to an educational program. Before creating a questionnaire, start by asking yourself a few important questions:
It's a good idea to start with research questions or objectives. Here are some examples: Research Questions:
Research Objectives:
2. Decide what you are measuringAs with determining the purpose, this should be based on the objectives of your educational program and the evaluation of its outcomes and impact. Consider which of the following you are aiming to measure:
Of course, it's possible that you might measure more than one . But the questions will be clearly different based on the information you are trying to gather. Refer to the RCE fact sheet FS869, "Measuring Impact of Educational Programs," to learn more about the types of outcomes that can be measured. 3. Who should be asked?
4. Consider the audience
To ensure that the survey instrument you develop is appropriate for your audience, "field test" your questionnaire with other people similar to your respondents before administering the final version. This will allow you to improve unclear questions or procedures and detect errors beforehand. Following recommendations in this guide pertaining to questionnaire design and wording of questions will reduce systematic "measurement" error, which will improve the internal validity of your study. 5. Choose an appropriate data collection method.
See the RCE fact sheet FS996, "Choosing a Data Collection Method for Survey Research," for more information about the advantages and disadvantages of each method. 6. Choose a collection procedure: anonymous vs. confidentialConfidential
Anonymous
7. Choose measurement scale and scoringUse scales that provide the information needed and are appropriate for respondents. Some choices are:
8. Title the questionnaire
9. Start with non-threatening questions
10. Include simple instructions
11. Use plain language
12. Be brief
13. Put most important questions up front
14. Make sure questions match the measurement scale selected, and answer categories are precise
15. Ask only one question at a time
16. Avoid "loaded" questions
17. Arrange in a logical order
18. Minimize open-ended questions
19. Provide space to tell more
20. Make sure it looks professional!
21. Use a cover letter
22. What to do when questionnaire is complete?
23. Thank respondents!
24. Check reliabilityReliability is a measure of how consistent the results of using a measurement instrument (e.g. a test, questionnaire) will be. Reducing "random" error in questionnaires by removing "quirky" questions or changing their arrangement improves reliability. Various methods are available to measure the reliability of an instrument, based on the type of instrument and its purpose. Major statistics software packages provide support for reliability. The method used depends on the type of questionnaire used. Reliability is often first determined using a "pilot test" with the proposed questionnaire and might also be repeated with the final version. When using an existing, commercially available instrument, reliability measures are generally reported for the audience for which it was intended. Examples of reliability measures are:
25. Determine the need to obtain Institutional Review Board (IRB) approval before administering a questionnaire to human subjects.
26. Conduct evaluation as planned
ReferencesFebruary 2002 Copyright © 2022 Rutgers, The State University of New Jersey. All rights reserved. For more information: njaes.rutgers.edu. Cooperating Agencies: Rutgers, The State University of New Jersey, U.S. Department of Agriculture, and Boards of County Commissioners. Rutgers Cooperative Extension, a unit of the Rutgers New Jersey Agricultural Experiment Station, is an equal opportunity program provider and employer. What is the first step to make a questionnaire?Six steps to good questionnaire design. #1: Identify your research aims and the goal of your questionnaire. ... . #2: Define your target respondents. ... . #3: Develop questions. ... . #4: Choose your question type. ... . #5: Design question sequence and overall layout. ... . #6: Run a pilot.. What are the steps for an effective questionnaire?Six Steps to Creating an Effective Questionnaire. Work as a Partner. ... . Keep it Simple. ... . Choose the Best Delivery Method. ... . Ask the Same Question Twice but in Different Ways. ... . Be Selective From the Start. ... . Pilot the Questionnaire.. What are the 4 parts of questionnaire?Four main parts of a survey questionnaire. Invitation. Invitation involves identifying how you are going to invite your respondents to answer the survey questionnaire. ... . Introduction. ... . Question types. ... . Close.. How to design and create an effective survey questionnaire a step by step guide?Essentials of business research: a guide to doing your research project, SAGE Publication.. Determine. Methodology.. Determine. Feasibility.. Develop. Instrument.. Select sample.. Conduct Pilot. Test (academics). Revise. Instrument.. Conduct. Survey.. Record. Data.. |