When designing a questionnaire it is important to do each of the following EXCEPT

a.  A statistical technique that can be used to help equate groups on specific variables

b.  A statistical technique that can be used to control sequencing effects

c.  A statistical technique that substitutes for random assignment to groups

d.  Adjusts scores on the independent variable to control for extraneous variables

2. To determine whether noise affects the ability to solve math problems, a researcher has one group solve math problems in a quiet room and another group solve math problems in a noisy room. The group solving problems in the noisy room completes 15 problems in one hour and the group solving problems in the quiet room completes 22 problems in one hour. In this experiment, the independent variable is ____________ and the dependent variable is _____________.

a.  The number of problems solves; the difficulty of the problems

b.  The number of problems solved; the noise level in the room

c.  The noise level in the room; the number of problems solved

d.  The noise level in the room; the difficulty of the problems

3. The posttest-only design with nonequivalent groups is likely to control for which of the  following threats to internal validity:

a.  History

b.  Differential selection

c.  Additive and interactive effects

d.  Differential attrition

a.  Order effects

b.  Carryover effects

c.  Analysis of covariance

d.  a and b

5. A researcher is interested in the effects of a preschool program on later school performance. Because she is concerned that socio-economic-status (SES) is a potential extraneous variable in her study, she picks children to study who are only from low SES homes. The control technique she used in this study was:

a.  Matching

b.  Random assignment

c.  Holding the extraneous variable constant

d.  Statistically controlling the extraneous variable

6. Which of the following terms best describes an interaction effect?

a.  The effect of one independent variable (on a DV) depends on the level of another independent  variable

b.  Eliminating any differential influence of extraneous variables

c.  Sequencing effect that occurs from the order in which the treatment conditions are

d.  The effect of one independent variable on the dependent variable

a.  Experimental control

b.  Differential influence

c.  Matching

d.  Analysis of covariance

8. Which of the following is not a way to manipulate an independent variable?
a. Presence technique
b. Amount technique
c. Type technique

d. Random technique

9. Which of the following designs permits a comparison of pretest scores to determine the initial equivalence of groups on the pretest before the treatment variable is introduced into the research setting.

a. One-group pretest-posttest design

b. Pretest-posttest control group design

c. Posttest-only design with nonequivalent groups

d. Both b and c

10. Counterbalancing is _________.

a.       Usually based on random selection of participants

b.      Only used when one pretest variable needs to be controlled

c.       Chosen to control for such things as order and carryover effects*

d.      All of the above

11. The group that receives the experimental treatment condition is the _____.

a. Experimental group

b. Control group

c. Participant group

d. Independent group

12. Which of the following control techniques available to the researcher controls for both known and unknown variables?

a. Building the extraneous variable into the design

b. Matching

c. Random assignment

d. Analysis of covariance

13. The group that does not receive the experimental treatment condition is the ________.

a. Experimental group

b. Control group

c. Treatment group

d. Independent group

14. There are a number of ways in which confounding extraneous variables can be controlled. Which control technique is considered to be the best?

a. Random assignment

b. Matching

c. Counterbalancing

d. None of the above

15. Which of the following could be used for randomly assigning participants to groups in an experimental study?

a.  Split-half (e.g., first half versus second half of a school directory)

b.  Even versus odd numbers

c.  Use a list of random numbers or a computer randomization program

d.  Let the researcher decide which group will be the best

16. Which term is not a related to counterbalancing?

a.  Carryover effect

b.  Order effect

c.  Sequencing effects

d.  Matching

17. A cell is a combination of two or more ____  in a factorial design.

a.  Research designs

b.  Research measurements

c.  Dependent variables

d.  Independent variables

18. Which of the following designs does an excellent job of controlling for rival hypotheses that threaten the internal validity of an experiment? 

a.   Posttest-only design with nonequivalent groups

b.   Posttest-only control-group design

c.   Pretest-posttest control-group design

d.   Both b and c are excellent designs

19. Manipulating the independent variable by varying the type on the independent variable that is presented to the different comparison groups is known as _____.
a.  Amount technique
b.  Absence technique
c.  Type technique
d.  Presence technique

20. Which of the following terms is a sequencing effect that occurs from the order in which the treatment conditions are administered?
a.  Carry-over effect
b.  Order effect
c.  Sequencing effects
d.  None of the above

21. When manipulating the independent variable in an educational experiment, which of the following describes this method?

a. An independent variable is manipulated using the presence or absence technique

b. The researchers varies the amount of the independent variable that is administered

c. The researcher varies the type of the independent variable

d. All of the above are possible

22. Which method of controlling confounding extraneous variables takes precedence over all other methods?

a. Matching individual participants

b. Holding extraneous variables

c. Building the extraneous variable into the research design

d. Counterbalancing

e. Randomly assign research participants to the groups

23. In an experimental research study, the primary goal is to isolate and identify the effect produced by the ____.

a. Dependent variable

b. Extraneous variable

c. Independent variable

d. Confounding variable

24. This type of design is one where all participants participate in all experimental treatment conditions.

a. Factorial design

b. Repeated measures design

c. Replicated design

d. Pretest-posttest control-group design

25. A factorial design is one in which ____.

a. Only one independent variable is studied to determine its effect on the dependent variable

b. Only two independent variables are simultaneously studied to determine their independent

c. Two or more independent variables are simultaneously studied to determine their independent and interactive effects on the dependent variable

d. Two dependent variables are studied to determine their interactive effects

26. The design in which one group of research participants is administered a treatment and is then compared, on the dependent variable, with another group of research participants who did not receive the experimental treatment is ____.

a. One-group posttest-only design

b. One-group pretest-posttest design

c. Posttest-only design with nonequivalent groups

d. time series design

27. _____ refers to the influence of a single independent variable.

a. Interaction effect

b. Reactive effect

c. Main effect

d. Proactive effect

28. A sequencing effect that occurs when performance in one treatment condition is influenced by participation in a prior treatment condition is known as ____.

a. Counterbalancing effect
b. Carryover effect
c. Treatment effect
d. Order effect

29. Which of the following is possible in a factorial design with two independent variables?

a. There is only one main effect present               
b. There are two main effects present

c. There are two main effects and an interaction effect present

d. All of the above are possible

30. Which of the following is a factorial design where different participants are randomly assigned to the levels of one independent variable but participants take all levels on another independent variable?

a. One-group pretest-posttest

b. Pretest-posttest control-group design

c. Factorial design

d. Factorial design based on a mixed model

Chapter 18

Multiple Choice Questions

1. When a citation includes more than ____ authors, only the surname of the first author is cited followed by et al.

a.  3

b.  4

c.  5

d.  6

2. When referencing other works you have cited within the text of the report you should

a.  State the first and last name of the author

b.  Use the author, date citation method

c.  Use an asterisk and a footnote

d.  Insert the complete citation in parenthesis

3. Which of the following abbreviations can be used in a research report?

a.   IQ

b.   sec. for second

c.   yr. for year

d.  mo. for month

4. Editorial style specifies that ______ should be used infrequently or sparingly.

a.   Italics

b.   Abbreviations

c.   Headings

d.   Both a and b

5. The factor that should determine whether you decide to prepare a research report of you study for a conference or for publication is

a.   Whether the study is free from flaws

b.   Whether the study is important enough to justify presentation or publication

c.   Whether others would be interested in the work

d.   All of the above

6. Which of the following is not true about the use of language in research reports?

a.  You should choose accurate and clear words that are free from bias.

b.  You should avoid labeling people whenever possible

c.  You should avoid using the term “subjects” whenever possible

d.  All of the above are true according to the APA Guidelines

7. Regarding disabilities, writers should “avoid equating people with their disabilities” such as in mentally retarded people.

a.  True

b.  False

8. You should avoid the use of sexist language in research reports.

a.  True

b.  False

9. Which is more appropriate when referring to someone with a disability?

a.  A stroke victim

b.  A person who has had a stroke

10. You should try to use italics frequently when writing a report.

a.  True

b.  False

11. You should try to use abbreviations sparingly.

a.  True

b.  False

12. Use words for numbers that begin a sentence and for numbers that are below ten.

a.  True

b.  False

13. You should double space all material in the manuscript.

a.  True

b.  False

14. Which of the following is not one of the seven major parts to the research report?

a.  Results

b.  Abstract

c.  Method

d.  Footnotes

15. The Introduction section should not be labeled.

a.  True

b.  False

16. The abstract should be about how many words?

a.  50

b.  75

c.  120

d.  300

17. The Method section should start on a separate page in a manuscript.

a. True

b. False

18. It is in this section that you fully interpret and evaluate your results.

a.  Introduction

b.  Method

c.  Results

d.  Discussion

19. Where do you provide a step-by-step account of what the researcher and participants did during the research study?

a.  Introduction

b.  Abstract

c.  Procedure

d.  Design

20. References should be single spaced.

a.  True

b.  False

21. Qualitative research reports do not need a Method section.

a. True

b. False

22. When writing the qualitative results section, an overriding concern should be to provide sufficient and convincing evidence to back up your assertions.

a.  True

b.  False

23. When writing the qualitative results section, you will need to find an appropriate balance between description and interpretation.

a.  True

b.  False

24. Diagrams, matrices, tables, and figures should never be used in qualitative research reports.

a.  True

b.  False

25. Your textbook authors argued that in qualitative research it is important to fit the research findings back into the relevant research literature even if the study is exploratory.

a.  True

b.  False

Chapter 6

Multiple Choice Questions

(The answers are provided after the last question.)

1. According to your text, how many points should a rating scale have?

a. Five

b. Four

c. Ten

d. Somewhere from 4 to 11 points

2. What is the problem(s) with this set of response categories to the question “What is your current age?”

1-5

5-10

10-20

20-30

30-40

a. The categories are not mutually exclusive

b. The categories are not exhaustive

c. Both a and b are problems

d. There is no problem with the above set of response categories

3. You should mix methods in a way that provides complementary strengths and nonoverlapping weaknesses. This is known as the fundamental principle of mixed research.

a. True

b. False

4. According to the text, questionnaires can address events and characteristics taking place when?

a. In the past (retrospective questions)

b. In the present (current time questions)

c. In the future (prospective questions)

d. All of the above

5. Which of the following are principles of questionnaire construction?

a. Consider using multiple methods when measuring abstract constructs

b. Use multiple items to measure abstract constructs

c. Avoid double-barreled questions

d. All of the above

e. Only  b and c

6. Which of these is not a method of data collection.
a. Questionnaires
b. Interviews
c. Experiments

d. Observations

7. Secondary/existing data may include which of the following?
a. Official documents
b. Personal documents

c. Archived research data

d. All of the above

8. An item that directs participants to different follow-up questions depending on their response is called a ____________.

a. Response set

b. Probe

c. Semantic differential

d. Contingency question

9. Which of the following terms best describes data that were originally collected at an earlier time by a different person for a different purpose?

a. Primary data

b. Secondary data

c. Experimental data

d. Field notes

10. Researchers use both open-ended and closed-ended questions to collect data. Which of the following statements is true?

a. Open-ended questions directly provide quantitative data based on the researcher’s predetermined response categories

b. Closed-ended questions provide quantitative data in the participant’s own words

c. Open-ended questions provide qualitative data in the participant’s own words

d. Closed-ended questions directly provide qualitative data in the participants’ own words

11. Open-ended questions provide primarily ______ data.

a.  Confirmatory data

b.  Qualitative data

c.  Predictive data

d.  None of the above

12. Which of the following is true concerning observation?

a. It takes less time than self-report approaches

b. It costs less money than self-report approaches

c. It is often not possible to determine exactly why the people behave as they do

d. All of the above

13. Qualitative observation is usually done for exploratory purposes; it is also called ___________ observation.

a. Structured

b. Naturalistic

c. Complete

d. Probed

14. As discussed in chapter 6, when constructing a questionnaire it is important to do each of the following except  ______.

a. Use "leading" or "loaded" questions

b. Use natural language

c. Understand your research participants

d. Pilot your test questionnaire

15. Another name for a Likert Scale is a(n):

a. Interview protocol

b. Event sampling

c. Summated rating scale

d. Ranking

16. Which of the following is not one of the six major methods of data collection that are used by educational researchers?

a.  Observation

b.  Interviews

c.  Questionnaires

d.  Checklists

17. The type of interview in which the specific topics are decided in advance but the sequence and wording can be modified during the interview is called:

a. The interview guide approach

b. The informal conversational interview

c. A closed quantitative interview

d. The standardized open-ended interview

18. Which one of the following in not a major method of data collection:

a. Questionnaires

b. Interviews

c. Secondary data

d. Focus groups

e. All of the above are methods of data collection

19. A question during an interview such as “Why do you feel that way?” is known as a:

a. Probe

b. Filter question

c. Response

d. Pilot

20. A census taker often collects data through which of the following?

a. Standardized tests

b. Interviews

c. Secondary data

d. Observations

21. The researcher has secretly placed him or herself (as a member) in the group that is being studied. This researcher may be which of the following?

a. A complete participant

b. An observer-as-participant

c. A participant-as-observer

d. None of the above

22. Which of the following is not a major method of data collection?
a. Questionnaires
b. Focus groups
c. Correlational method
d. Secondary data

23. Which type of interview allows the questions to emerge from the immediate context or course of things?
a. Interview guide approach
b. Informal conversational interview
c. Closed quantitative interview
d. Standardized open-ended interview

24. When conducting an interview, asking "Anything else?, What do you mean?, Why do you feel that way?," etc, are all forms of:

a. Contingency questions

b. Probes

c. Protocols

d. Response categories

25. When constructing a questionnaire, there are 15 principles to which you should adhere. Which of the following is not one of those principles?

a. Do not use "leading" or "loaded" questions

b. Avoid double-barreled questions

c. Avoid double negatives

d. Avoid using multiple items to measure a single construct

Chapter 7

Multiple Choice Questions

1. When each member of a population has an equally likely chance of being selected, this is called:

a. A nonrandom sampling method

b. A quota sample

c. A snowball sample

d. An Equal probability selection method

2. Which of the following techniques yields a simple random sample?

a. Choosing volunteers from an introductory psychology class to participate

b. Listing the individuals by ethnic group and choosing a proportion from within

each ethnic group at random.

c. Numbering all the elements of a sampling frame and then using a random number

table to pick cases from the table.

d. Randomly selecting schools, and then sampling everyone within the school.

3. Which of the following is not true about stratified random sampling?

a. It involves a random selection process from identified subgroups

b. Proportions of groups in the sample must always match their population proportions

c. Disproportional stratified random sampling is especially helpful for getting large enough

       subgroup samples when subgroup comparisons are to be done

d. Proportional stratified random sampling yields a representative sample  

4. Which of the following statements are true?

a. The larger the sample size, the greater the sampling error

b. The more categories or breakdowns you want to make in your data analysis, the larger

 the sample needed

c. The fewer categories or breakdowns you want to make in your data analysis, the larger

 the sample needed

d. As sample size decreases, so does the size of the confidence interval

5. Which of the following formulae is used to determine how many people to include in the original sampling?

a. Desired sample size/Desired sample size + 1

b. Proportion likely to respond/desired sample size

c. Proportion likely to respond/population size

d. Desired sample size/Proportion likely to respond

6. Which of the following sampling techniques is an equal probability selection method (i.e., EPSEM) in which every individual in the population has an equal chance of being selected?

a. Simple random sampling

b. Systematic sampling

c. Proportional stratified sampling

d. Cluster sampling using the PPS technique

e. All of the above are EPSEM

7. Which of the following is not a form of nonrandom sampling?

a. Snowball sampling

b. Convenience sampling

c. Quota sampling

d. Purposive sampling

e. They are all forms of nonrandom sampling

8. Which of the following will give a more “accurate” representation of the population from which a sample has been taken?

a. A large sample based on the convenience sampling technique

b. A small sample based on simple random sampling

c. A large sample based on simple random sampling

d. A small cluster sample

9. Sampling in qualitative research is similar to which type of sampling in quantitative research?

a. Simple random sampling

b. Systematic sampling

c. Quota sampling

d. Purposive sampling

10. Which of the following would generally require the largest sample size?

a. Cluster sampling

b. Simple random sampling

c. Systematic sampling

d. Proportional stratified sampling

11. How often does the Census Bureau take a complete population count?

a. Every year

b. Every five years

c. Every ten years

d. Twice a year

12. People who are available, volunteer, or can be easily recruited are used in the sampling method called ______.

a.  Simple random sampling

b.  Cluster sampling

c.  Systematic sampling

d.  Convenience sampling

13. Which of the following types of sampling involves the researcher determining the appropriate sample sizes for the groups identified as important, and then taking convenience samples from those groups?

a.  Proportional stratified sampling

b.  Quota sampling

c.  One-stage cluster sampling

d.  Two-stage cluster sampling

14. A type of sampling used in qualitative research that involves selecting cases that disconfirm the researcher's expectations and generalizations is referred to as _______________.

a.  Extreme case sampling

b.  Typical-case sampling

c.  Critical-case sampling

d.  Negative-case sampling

15. Using Figure 6.6 (pg. 178), how many participants will you need for a research study with a population of 120,000?

a. 242

b. 331
c. 377

d. 384

16. In which of the following nonrandom sampling techniques does the researcher ask the research participants to identify other potential research participants?
a. Snowball

b. Convenience
c. Purposive

d. Quota

17. Which of the following is the most efficient random sampling technique discussed in your chapter?

a. Simple random sampling
b. Proportional stratified sampling
c. Cluster random sampling
d. Systematic sampling

18. If we took the 500 people attending a school in New York City, divided them by gender, and then took a random sample of the males and a random sampling of the females, the variable on which we would divide the population is called the _____.
a. Independent variable
b. Dependent variable
c. Stratification variable
d. Sampling variable

19. A number calculated with complete population data and quantifies a characteristic of the population is called which of the following?
a. A datum
b. A statistic
c. A parameter
d. A population


20. The type of sampling in which each member of the population selected for the sample is returned to the population before the next member is selected is called _________.
a. Sampling without replacement
b. Sampling with replacement
c. Simple random sampling

d. Systematic sampling

21. Which of the following is not a type of nonrandom sampling?

a.  Cluster sampling

b.  Convenience sampling

c.  Quota sampling

d.  Purposive sampling

e.  They are all type of nonrandom sampling

22. Which of the following would usually require the smallest sample size because of its efficiency?

a. One stage cluster sampling

b. Simple random sampling

c. Two stage cluster sampling

d. Quota sampling

23. A technique used when selecting clusters of different sizes is called _____.

a. Cluster sampling

b. One-stage sampling

c. Two-stage sampling

d. Probability proportional to size or PPS

24. The process of drawing a sample from a population is known as _________.

a. Sampling

b. Census

c. Survey research

d. None of the above

25. It is recommended to use the whole population rather than a sample when the population size is of what size?

a. 500 or less

b. 100 or less

c. 1000 or less

d. you should always use a sample

26. Which of the following is not an example of a nonrandom sampling technique?

a. Purposive

b. Quota

c. Convenience

d. Cluster

27. Which of the following sampling methods is the best way to select a group of people for a study if you are interested in making statements about the larger population?

a.  Convenience sampling

b.  Quota sampling

c.  Purposive sampling

d.  Random sampling

28. ___________ is a set of elements taken from a larger population according to certain rules.

a.  Sample

b.  Population

c.  Statistic

d.  Element

29. Determining the sample interval (represented by k), randomly selecting a number between 1 and k, and including each kth element in your sample are the steps for which form of sampling?

a. Simple Random Sampling

b. Stratified Random Sampling

c. Systematic Sampling

d. Cluster sampling

30. The nonrandom sampling type that involves selecting a convenience sample from a population with a specific set of characteristics for your research study is called _____.

a. Convenience sampling

b. Quota sampling

c. Purposive sampling

d. Snowball sampling

What is the 6 steps in designing questionnaire?

Six steps to good questionnaire design.
#1: Identify your research aims and the goal of your questionnaire. ... .
#2: Define your target respondents. ... .
#3: Develop questions. ... .
#4: Choose your question type. ... .
#5: Design question sequence and overall layout. ... .
#6: Run a pilot..

What are the steps of design a questionnaire?

There are at least nine distinct steps: decide on the information required; define the target respondents, select the method(s) of reaching the respondents; determine question content; word the questions; sequence the questions; check questionnaire length; pre-test the questionnaire and develop the final questionnaire.

What are the five basic principles for designing a good questionnaire?

Here you go with five basic principles every researcher should follow to become better in writing questionnaires..
Be comprehensible! Use a clear and comprehensible language to ease the cognitive burden for the respondents. ... .
Be clear! ... .
Be neutral! ... .
Operationalize! ... .
Mind the order!.

Which of the following should be done when preparing questionnaire?

Questionnaire Design.
Step 1: Determine the Survey Objectives, Resources, and Time Constraints. ... .
Step 2: Determine How The Questionnaire Will Be Administered. ... .
Step 3: Determine the Question Format. ... .
Step 4: Writing Clear Questions. ... .
Step 5: Designing the Question Flow. ... .
Step 6: Questionnaire Evaluation..