Discuss the importance of
developing a questionnaire in a research project. What are the do’s and dont’s
that should be considered while
designing the questionnair
The
questionnaire is a structured technique for collecting primary data in a
marketing survey. It is a series of written or verbal questions for which the
respondent provides answers. A well-designed questionnaire motivates the
respondent to provide complete and accurate information.
The survey questionnaire should not be viewed as a
stand-alone tool. Along with the questionnaire there is field work, rewards for
the respondents, and communication aids, all of which are important components
of the questionnaire process.
Steps
to Developing a Questionnaire
The
following are steps to developing a questionnaire - the exact order may vary somewhat.
·
Determine which information is being sought.
·
Choose a question type (structure and amount of
disguise) and method of administration (for example, written form, email or web
form, telephone interview, verbal interview).
·
Determine the general question content needed to
obtain the desired information.
·
Determine the form of response.
·
Choose the exact question wording.
·
Arrange the questions into an effective
sequence.
·
Specify the physical characteristics of the
questionnaire (paper type, number of questions per page, etc.)
Test the questionnaire and revise it as needed.
Required
Information
To determine exactly which information is needed,
it is useful to construct tables into which the data will be placed once it is
collected. The tables will help to define what data is needed and what is not
needed.
Question
Type and Administration Method
Some
question types include fixed alternative, open ended, and projective:
·
Fixed-alternative questions provide
multiple-choice answers. These types of questions are good when the possible
replies are few and clear-cut, such as age, car ownership, etc.
·
Open-ended questions allow the
respondent to better express his/her answer, but are more difficult to
administer and analyze. Often, open-ended questions are administered in a depth
interview. This technique is most appropriate for exploratory research.
Projective methods use a vague question or stimulus and attempt
to project a person's attitudes from the response. The questionnaire could use
techniques such as word associations and fill-in-the-blank sentences.
Projective methods are difficult to analyze and are better suited for
exploratory research than for descriptive or causal research.
There
are three commonly used rating scales: graphic, itemized, and comparative.
·
Graphic - simply a line on which one marks an X
anywhere between the extremes with an infinite number of places where the X can
be placed.
·
Itemized - similar to graphic except there are a
limited number of categories that can be marked.
·
Comparative - the respondent compares one
attribute to others. Examples include the Q-sort technique and the constant sum
method, which requires one to divide a fixed number of points among the
alternatives.
· group or focus interviews
· mailed questionnaires
· telephone interviews.
Choose
the method(s) of reaching target respondents
It may seem strange to be suggesting that the
method of reaching the intended respondents should constitute part of the
questionnaire design process. However, a moment's reflection is sufficient to
conclude that the method of contact will influence not only the questions the
researcher is able to ask but the phrasing of those questions. The main methods
available in survey research are:
· personal
interviews
Within
this region the first two mentioned are used much more extensively than the
second pair. However, each has its advantages and disadvantages. A general rule
is that the more sensitive or personal the information, the more personal the
form of data collection should be.
Decide
on question content
Researchers
must always be prepared to ask, "Is this question really needed?" The
temptation to include questions without critically evaluating their
contribution towards the achievement of the research objectives, as they are
specified in the research proposal, is surprisingly strong. No question should
be included unless the data it gives rise to is directly of use in testing one
or more of the hypotheses established during the research design.
There
are only two occasions when seemingly "redundant" questions might be
included:
· Opening
questions that are easy to answer and which are not perceived as being
"threatening", and/or are perceived as being interesting, can greatly
assist in gaining the respondent's involvement in the survey and help to
establish a rapport.
This,
however, should not be an approach that should be overly used. It is almost
always the case that questions which are of use in testing hypotheses can also
serve the same functions.
· "Dummy" questions can disguise the
purpose of the survey and/or the sponsorship of a study. For example, if a
manufacturer wanted to find out whether its distributors were giving the
consumers or end-users of its products a reasonable level of service, the
researcher would want to disguise the fact that the distributors' service level
was being investigated. If he/she did not, then rumours would abound that there
was something wrong with the distributor.
Question
Content
Each
question should have a specific purpose or should not be included in the
questionnaire. The goal of the questions is to obtain the required information.
This is not to say that all questions directly must ask for the desired data.
In some cases questions can be used to establish rapport with the respondent,
especially when sensitive information is being sought.
Sensitive
questions can be posed in ways to increase response likelihood and to
facilitate more honest responses. Some techniques are:
·
Place the question in a series of less personal
questions.
·
State that the behavior or attitude is not so
unusual.
·
Phrase the question in terms of other people,
not the respondent.
·
Provide response choices that specify ranges,
not exact numbers.
·
Use a randomized response model giving the
respondent pairs of questions with a randomly assigned one to answer. The
interviewer does not know which question the person is answering, but the
overall percentage of people assigned to the sensitive question is known and
statistics can be calculated.
Form
of Question Response
Questions
can be designed for open-ended, dichotomous, or multichotomous responses.
·
Open-ended responses are difficult
to evaluate, but are useful early in the research process for determining the
possible range of responses.
·
Dichotomous questions have two
possible opposing responses, for example, "Yes" and "No".
Multichotomous questions have a range of responses as in a
multiple choice test.
The
questionnaire designer should consider that respondents may not be able to
answer some questions accurately. Two types of error are telescoping error and
recall loss.
·
Telescoping error is an error
resulting from the tendency of people to remember events as occurring more
recently than they actually did.
Recall loss occurs when people forget that an event even occurred. For recent
events, telescoping error dominates; for events that happened in the distant
past, recall loss dominates.
Sequence
the Questions
Some
neutral questions should be placed at the beginning of the questionnaire in
order to establish rapport and put the respondent at ease. Effective opening
questions are simple and non-threatening.
When sequencing the questions, keep in mind that
their order can affect the response. One way to correct for this effect is to
distribute half of the questionnaires with one order, and the other half with
another order.
Physical
Characteristics of the Questionnaire
Physical aspects such as the page layout, font type
and size, question spacing, and type of paper should be considered. In order to
eliminate the need to flip back and forth between pages, the layout should be
designed so that a question at the bottom of the page does not need to be
continued onto the next page. The font should be readable by respondents who
have less-than-perfect visual acuity. The paper stock should be good quality to
project the image that the questionnaire is important enough to warrant the
respondents' time. Each questionnaire should have a unique number in order to
better account for it and to know if any have been lost.
Test
and Revise the Questionnaire
The
questionnaire should be pre-tested in two stages before distributing. In the
first stage, it should be administered using personal interviews in order to
get better feedback on problems such as ambiguous questions. Then, it should be
tested in the same way it will be administered. The data from the test should
be analyzed the same way the administered data is to be analyzed in order to
uncover any unanticipated shortcomings.
Different
respondents will answer the same questionnaire differently. One hopes that the
differences are due to real differences in the measured characteristics, but
that often is not the case. Some sources of the differences between scores of
different respondents are:
·
True differences in the characteristic being
measured.
·
Differences in other characteristics such as
response styles.
·
Differences in transient personal factors such
as fatigue, etc.
·
Differences in situation, such as whether spouse
is present.
Differences in the administration, such as
interviewer tone of voice.
·
Differences resulting from sampling of items
relevant toward the characteristic being measured.
·
Differences resulting from lack of clarity of
the question - may mean different things to different people.
Differences caused by mechanical factors such as
space to answer, inadvertent check marks, etc.
No comments:
Post a Comment