What kind of questions do we ask?
In general, there are two types of questions one will ask, open format or closed format.
Open format questions are those that ask for unprompted opinions. In other words, there are no predetermined set of responses, and the participant is free to answer however he chooses. Open format questions are good for soliciting subjective data or when the range of responses is not tightly defined. An obvious advantage is that the variety of responses should be wider and more truly reflect the opinions of the respondents. This increases the likelihood of you receiving unexpected and insightful suggestions, for it is impossible to predict the full range of opinion. It is common for a questionnaire to end with and open format question asking the respondent for her unabashed ideas for changes or improvements.
Open format questions have several disadvantages. First, their very nature requires them to be read individually. There is no way to automatically tabulate or perform statistical analysis on them. This is obviously more costly in both time and money, and may not be practical for lower budget or time sensitive evaluations. They are also open to the influence of the reader, for no two people will interpret an answer in precisely the same way. This conflict can be eliminated by using a single reader, but a large number of responses can make this impossible. Finally, open format questions require more thought and time on the part of the respondent. Whenever more is asked of the respondent, the chance of tiring or boring the respondent increases.
Closed format questions usually take the form of a multiple-choice question. They are easy for the respondent, give
There is no clear consensus on the number of options that should be given in an closed format question. Obviously, there needs to be sufficient choices to fully cover the range of answers but not so many that the distinction between them becomes blurred. Usually this translates into five to ten possible answers per questions. For questions that measure a single variable or opinion, such as ease of use or liability, over a complete range (easy to difficult, like to dislike), conventional wisdom says that there should be an odd number of alternatives. This allows a neutral or no opinion response. Other schools of thought contend that an even number of choices is best because it forces the respondent to get off the fence. This may induce the some inaccuracies for often the respondent may actually have no opinion. However, it is equally arguable that the neutral answer is over utilized, especially by bored questionnaire takers. For larger questionnaires that test opinions on a very large number of items, such as a music test, it may be best to use an even number of choices to prevent large numbers of no-thought neutral answers.
Closed format questions offer many advantages in time and money. By restricting the answer set, it is easy to calculate percentages and other hard statistical data over the whole group or over any subgroup of participants. Modern scanners and computers make it possible to administer, tabulate, and perform preliminary analysis in a matter of days. Closed format questions also make it easier to track opinion over time by administering the same questionnaire to different but similar participant groups at regular intervals. Finally closed format questions allow the researcher to filter out useless or extreme answers that might occur in an open format question.
Whether your questions are open or closed format, there are several points that must by considered when writing and interpreting questionnaires: 1. Clarity: This is probably the area that causes the greatest source of mistakes in questionnaires. Questions must be clear, succinct, and unambiguous. The goal is to eliminate the chance that the question will mean different things to different people. If the designers fails to do this, then essentially participants will be answering different questions. To this end, it is best to phrase your questions empirically if possible and to avoid the use of necessary adjectives. For example, it asking a question about frequency, rather than supplying choices that are open to interpretation such as: 1. Very Often 2. Often 3. Sometimes 4. Rarely 5. Never
It is better to quantify the choices, such as: 6. Every Day or More 7. 2-6 Times a Week 8. About Once a Week 9. About Once a Month 10. Never
There are other more subtle aspects to consider such as language and culture. Avoid the use of colloquial or ethnic expressions that might not be equally used by all participants. Technical terms that assume a certain background should also be avoided.
2. Leading Questions: A leading question is one that forces or implies a certain type of answer. It is easy to make this mistake not in the question, but in the choice of answers. A closed format question must supply answers that not only cover the whole range of responses, but that are also equally distributed throughout the range. All answers should be equally likely. An obvious, nearly comical, example would be a question that supplied these answer choices: 1. Superb 2. Excellent 3. Great 4. Good 5. Fair 6. Not so Great
A less blatant example would be a Yes/No question that asked: 7. Is this the best CAD interface you have every used?
In this case, even if the participant loved the interface, but had an favorite that was preferred, she would be forced to answer No. Clearly, the negative response covers too wide a range of opinions. A better way would be to ask the same question but supply the following choices: 8. Totally Agree 9. Partially Agree 10. Neither Agree or Disagree 11. Partially Disagree 12. Totally Disagree
This example is also poor in the way it asks the question. It's choice of words makes it a leading question and a good example for the next section on phrasing.
3. Phrasing: Most adjectives, verbs, and nouns in English have either a positive or negative connotation. Two words may have equivalent meaning, yet one may be a compliment and the other an insult. Consider the two words "child-like" and "childish", which have virtually identical meaning. Child-like is an affectionate term that can be applied to both men and women, and young and old, yet no one wishes to be thought of as childish. In the above example of "Is this the best CAD interface you have every used?" clearly "best" has strong overtones that deny the participant an objective environment to consider the interface. The signal sent the reader is that the designers surely think it is the best interface, and so should everyone else. Though this may seem like an extreme example, this kind of superlative question is common practice. A more subtle, but no less troublesome, example can be made with verbs that have neither strong negative or positive overtones. Consider the following two questions: 1. Do you agree with the Governor's plan to oppose increased development of wetlands? 2. Do you agree with the Governor's plan to support curtailed development of wetlands? They both ask the same thing, but will likely produce different data. One asks in a positive way, and the other in a negative. It is impossible to predict how the outcomes will vary, so one method to counter this is to be aware of different ways to word questions and provide a mix in your questionnaire. If the participant pool is very large, several versions may be prepared and distributed to cancel out these effects.
4. Embarrassing Questions: Embarrassing questions dealing with personal or private matters should be avoided. Your data is only as good as the trust and care that your respondents give you. If you make them feel uncomfortable, you will lose their trust. Do not ask embarrassing questions.
5. Hypothetical Questions Hypothetical are based, at best, on conjecture and, at worst, on fantasy. I simple question such as: 1. If you were governor, what would you do to stop crime? This forces the respondent to give thought to something he may have never considered. This does not produce clear and consistent data representing real opinion. Do not ask hypothetical questions.
6. Prestige Bias: Prestige bias is the tendency for respondents to answer in a way that make them feel better. People may not lie directly, but may try to put a better light on themselves. For example, it is not uncommon for people to respond to a political opinion poll by saying they support Samaritan social programs, such as food stamps, but then go on to vote for candidates who oppose those very programs. Data from other questions, such as those that ask how long it takes to learn an interface, must be viewed with a little skepticism. People tend to say they are faster learners than they are. There is little that can be done to prevent prestige bias. Sometimes there just is no way to phrase a question so that all the answers are noble. The best means to deal with prestige bias is to make the questionnaire as private as possible. Telephone interviews are better than person-to-person interviews, and written questionnaires mailed to participants are even better still. The farther away the critical eye of the researcher is, the more honest the answers.
You May Also Find These Documents Helpful
-
Short answer questions – generally complex by their nature and require knowledge and integration of several different concepts…
- 3867 Words
- 16 Pages
Good Essays -
3) Open ended questions elicit specific information are useful for point clarification and when time is limited. However, they questions restrict the interviewee’s freedom. True / False…
- 365 Words
- 2 Pages
Satisfactory Essays -
4) An ordered series of closed ended questions intended to elicit descriptive data from research respondents is known as…
- 3570 Words
- 18 Pages
Good Essays -
2. Contrast open-ended and closed-ended questions during an unstructured clinical interview. Define and provide two advantages of each.…
- 2090 Words
- 9 Pages
Good Essays -
Questionnaires are written questions; these questions are given out to a number of respondents for a researcher to find out certain information. When the researcher sends out a questionnaire each one is written in the same order so that it is easier for the information to be collected and collated. Once the results have been collected and collated they can be analysed using computers and you can also use large samples and surveys. They are made for a purpose of gathering information for a survey or a statistical study. Most of the time questionnaires use quantitative data which means numbers and statistics are mainly used. This is positive because when we have numbers and statistics we are able to see different trends and patterns which is really helpful when trying to find out particular results. The most common type of questionnaire used for sociological research would be the self- completion questionnaire where it is given out for people to complete. When structured interviews are taken place it is normally by a researcher that is highly trained and this means that they guide the respondent through the question preventing any errors or misunderstandings that could be…
- 1272 Words
- 6 Pages
Powerful Essays -
An open question can’t be answered with a simple one word answer. It forces the person to give a longer more detailed answer. Example : Closed question : do you like school? Open question : How do you feel about school?…
- 526 Words
- 3 Pages
Good Essays -
On the examination you will be required to respond to one of two essay questions. The essay questions on the examination will test essentially the same ideas as these study questions. Parts of study questions may be combined to form an essay appearing on the examination. More typically, a shortened or edited version of a study question will appear as an essay question on the examination.…
- 2187 Words
- 8 Pages
Better Essays -
Include how you think the advantages and disadvantages of each record format affect everyday work—remember to think about retrieving records as well as filing them.…
- 707 Words
- 3 Pages
Good Essays -
In all the cases, the questioning elicited oral admissions…
- 691 Words
- 3 Pages
Good Essays -
The questions ask for objective demonstration of your knowledge and subjective discussions/analyses. BOTH types are needed.…
- 525 Words
- 3 Pages
Satisfactory Essays -
A questionnaire is a set list of questions. Positivists see questionnaires as useful because they produce statistical data which correlations and cause and effect relationships can be drawn. Positivists in particular see questionnaires because they produce statistical data from which correlations and cause and effects relationships can be drawn.…
- 450 Words
- 2 Pages
Good Essays -
Open Questions – This is the chance to ask a question on what the Client has talked about and in turn gives the Client an opportunity to think about the situation in another way. A skilled Counsellor will ask open questions and insightful questions to gather more information.…
- 480 Words
- 2 Pages
Satisfactory Essays -
Asking open questions is an important technique that encourages the pupils to express their thoughts and ideas and helps to test their understanding. How, why and what questions encourage the pupil to respond with more than a one word answer.…
- 4261 Words
- 18 Pages
Powerful Essays -
All the questions will be very open thus allowing you options regarding which texts you have studied this year to use in your response.…
- 3400 Words
- 14 Pages
Powerful Essays -
▪ Generally, an open –ended form asking for specific info on strengths and weaknesses across all four areas was used.…
- 513 Words
- 3 Pages
Satisfactory Essays