Intakewise Get the app

NCE practice questions: research and program evaluation

Last updated ยท Published by Certloom Learning

Home / NCE practice questions / Research practice

Short answer. Research and program evaluation questions cover designs, sampling, threats to validity, which statistical test fits which question, qualitative approaches and outcome evaluation. The NCE handbook describes the area as research methods, basic statistics, and ethical and legal considerations in research.

Source: Candidate Handbook for State Licensure: National Counselor Examination (NCE), PDF dated October 2024 (checked 2026-11-12).

What does the NCE ask about research and program evaluation?

The NCE is aligned with eight CACREP areas, and this is one of them (source: NCE candidate handbook, checked 2026-11-12). The handbook describes it as: “Studies that provide an understanding of types of research methods, basic statistics, and ethical and legal considerations in research”. Intakewise has 108 questions in this area, covering topics such as true experimental design, Quasi-experimental design, Causal-comparative design, ABAB reversal design, Multiple-baseline design, Cross-sectional design and cohort effects, Longitudinal design, Phenomenology, Grounded theory, Ethnography, Case study research, Narrative research, Explanatory sequential mixed methods, Exploratory sequential mixed methods, Solomon four-group design, Independent variable, Dependent variable, Confounding variables. The handbook and outline we read give no question count per area, so expect these ideas to appear mixed in with the other seven (NCE format and scoring).

What should you know about research and program evaluation?

The table is a quick reference we wrote from standard counseling texts, not an NBCC list.

TopicQuick reference
DesignsTrue experiments use random assignment; quasi-experiments do not; single-case designs (ABAB, multiple baseline) track one participant over phases.
Internal validity threatsHistory, maturation, testing, instrumentation, regression to the mean, selection, attrition, diffusion of treatment, Hawthorne effect.
SamplingProbability: simple random, stratified, cluster. Non-probability: convenience, purposive, snowball.
Which test?Compare two means: t-test. Three or more means: ANOVA. Association between categories: chi-square. Linear relationship: Pearson r.
ErrorsType I: rejecting a true null hypothesis (false positive). Type II: failing to reject a false null (false negative).
Qualitative approachesPhenomenology (lived experience), grounded theory (theory from data), ethnography (culture), case study, narrative. Trustworthiness: credibility, transferability, dependability, confirmability.

How should you study research and program evaluation?

Frequently asked questions

How many research and program evaluation questions are free?

10 are on this page, and 12 are free in the Intakewise app. The app has 108 in this area; one payment for full access opens the rest.

Are these real NCE questions?

No. They are original practice questions written for Intakewise, each checked by a second, independent solve. NBCC does not publish its exam items.

Free practice questions

10 original questions from the Intakewise bank. Every one is marked free in the app. Pick your answer, then open it to check.

  1. Moderating variables

    Researchers find that perceived social support is strongly related to lower depression among older adults but only weakly related among adolescents. In this case, age group functions as a:

    1. mediating variable
    2. dependent variable
    3. confounding variable
    4. moderating variable
    Show answer

    Answer: D. A moderator changes the strength or direction of the relationship between two other variables; here the support-depression link depends on age group. A mediator would explain how or why support affects depression, acting as the pathway between them.

    Item research-x1-019

  2. Snowball sampling

    A researcher studying the counseling needs of undocumented immigrant farmworkers has difficulty locating participants. She asks each person she interviews to refer others who might take part. Which sampling method is she using?

    1. Snowball sampling
    2. Cluster sampling
    3. Stratified sampling
    4. Simple random sampling
    Show answer

    Answer: A. Snowball sampling relies on participants referring others, which is useful for hidden or hard-to-reach populations. Cluster sampling selects whole preexisting groups, which is not what is happening here.

    Item research-x1-029

  3. Differential attrition

    In a 12-week study of a treatment for social anxiety, clients with the most severe symptoms drop out of the treatment group at much higher rates than from the waitlist group. The treatment group's posttest mean looks better than the waitlist group's. What is the main concern?

    1. Differential attrition may have made the treatment appear more effective than it was
    2. Maturation affected only the waitlist group
    3. The study has too much statistical power
    4. The treatment group experienced a placebo effect
    Show answer

    Answer: A. Differential attrition (mortality) changes group composition; if the most severe clients leave the treatment group, its remaining average looks better regardless of any treatment effect. Maturation would affect both groups similarly over the same period, so it does not explain this pattern.

    Item research-x1-038

  4. Alpha level

    When a researcher sets alpha at .05, what does this mean?

    1. There is a 5% chance the research hypothesis is true
    2. The study will have 95% statistical power
    3. The effect size must be at least .05 to be meaningful
    4. The researcher accepts a 5% risk of rejecting the null hypothesis when it is actually true
    Show answer

    Answer: D. Alpha is the probability of a Type I error the researcher is willing to accept, set before data collection. Power is a separate quantity, the probability of detecting a true effect, and is not determined by alpha alone.

    Item research-x1-047

  5. Paired-samples t test

    A school counselor measures 25 sixth graders' self-concept before and after an eight-week group and wants to know whether their mean scores changed. Which test is most appropriate?

    1. Dependent (paired-samples) t test
    2. Independent-samples t test
    3. One-way ANOVA
    4. Chi-square goodness-of-fit test
    Show answer

    Answer: A. When the same participants are measured twice, the scores are related, and a dependent (paired) t test compares the two means. An independent-samples t test assumes two separate groups and would ignore the pairing.

    Item research-x1-056

  6. Multiple regression

    A researcher wants to predict counselor trainees' end-of-program clinical evaluation scores from their undergraduate GPA, empathy scores, and years of prior human services experience. Which analysis is most appropriate?

    1. Chi-square test
    2. Paired-samples t test
    3. One-way ANOVA
    4. Multiple regression
    Show answer

    Answer: D. Multiple regression uses two or more predictors to predict a continuous outcome and shows how much each contributes. One-way ANOVA compares group means across levels of one categorical factor and is not designed to combine several continuous predictors.

    Item research-x1-065

  7. Correlation strength and direction

    Which correlation coefficient indicates the strongest relationship between two variables?

    1. +.45
    2. +.08
    3. -.72
    4. -.30
    Show answer

    Answer: C. The strength of a correlation is shown by its absolute value, and .72 is the largest here. The sign indicates direction only, so a negative correlation can be stronger than a positive one.

    Item research-x1-075

  8. Member checking

    After analyzing interviews with Latina mothers about seeking counseling for their children, a researcher shares her preliminary themes with participants and asks whether the themes accurately reflect their experiences. This strategy is called:

    1. member checking
    2. peer debriefing
    3. negative case analysis
    4. bracketing
    Show answer

    Answer: A. Member checking returns data or interpretations to participants to verify accuracy, strengthening credibility. Peer debriefing involves reviewing the analysis with a knowledgeable colleague, not with the participants themselves.

    Item research-x1-084

  9. CIPP evaluation model

    Stufflebeam's CIPP model of program evaluation includes which four components?

    1. Context, input, process, product
    2. Cost, impact, planning, performance
    3. Clients, interventions, providers, policies
    4. Collaboration, implementation, practice, prevention
    Show answer

    Answer: A. The CIPP model evaluates a program's context (needs and goals), inputs (resources and plans), process (implementation), and product (outcomes). The other options sound plausible but are not the components of this widely taught model.

    Item research-x1-093

  10. Publication bias

    A meta-analysis of a popular counseling intervention includes only published journal articles. Studies that found no significant effects were less likely to be published. What problem does this create?

    1. Publication bias (the file drawer problem) may inflate the estimated effect
    2. The Hawthorne effect may reduce the estimated effect
    3. Restriction of range may make the effect appear negative
    4. Diffusion of treatment may eliminate the effect
    Show answer

    Answer: A. When nonsignificant studies stay unpublished, a meta-analysis drawing only on published work tends to overestimate effects; this is called publication bias or the file drawer problem. The Hawthorne effect concerns participants reacting to observation within a study, not which studies get published.

    Item research-x1-102

The Intakewise app has the full question bank across all eight core areas, plus clinical sessions you walk from intake to treatment.

Get it onGoogle Play Practice free first

iPhone app coming soon. Until then, the free practice works in any phone browser.

Sources

Exam formats and licensing rules change. Confirm details with NBCC, CCE and your state board.

How this page was made: Area definition quoted from the NCE candidate handbook, checked 2026-11-12. The quick-reference table is Intakewise's own summary of standard counseling texts. Questions come from the Intakewise bank, where every item was checked by a second, independent solve. Not reviewed or endorsed by NBCC, CCE, CACREP or the ACA.