Skip to contents

Flagship workflows

Recommended user-facing analyses for scale content pretesting.

sort_validity()
Analyze an item-sort content-validity pretest
rating_validity()
Analyze a Hinkin-Tracey construct-rating content-validity pretest
expert_validity()
Analyze expert-panel content-validity evidence

Workflow plotting methods

Diagnostic plots for the flagship workflow objects and exact sort-power plans.

plot(<contentvalid_sort>)
Plot item-sort evidence
plot(<contentvalid_rating>)
Plot Hinkin-Tracey rating evidence
plot(<contentvalid_expert>)
Plot expert-panel content-validity results
plot(<contentvalid_sort_power>)
Plot exact item-sort planning evidence

Item-sort components and planning

compute_psa()
Proportion of Substantive Agreement (Psa)
compute_csv()
Substantive Validity Coefficient (Csv)
csv_binom_test()
Exact item-sort significance test
sort_power()
Exact power for the item-sort target-count rule
colquitt_benchmarks()
Colquitt et al. (2019) empirical content-validation benchmarks
interpret_colquitt()
Interpret a statistic using Colquitt et al. (2019) norms

Construct-rating components

htc()
Hinkin-Tracey correspondence (HTC)
htd()
Hinkin-Tracey distinctiveness (HTD)
anova_content()
Hinkin-Tracey ANOVA content test

Expert-panel indices

aikens_v()
Aiken's V for expert content-relevance ratings
cvi()
Content Validity Index (CVI)
cvr()
Lawshe's Content Validity Ratio (CVR)
ioc()
Item-Objective Congruence (IOC)

Auxiliary and compatibility helpers

Retained utilities that are not flagship v0.1.0 workflows.

agreement_summary()
Agreement summary (auxiliary)
qfactor_content()
Q-factor helper for content adequacy (comparator)
signal_detection()
Signal-detection summary for binary retention decisions
reproducibility_phi()
Between-pretest reproducibility (phi) of binary decisions
simulate_anova_power()
Legacy independent-groups ANOVA power simulator
simulate_csv_power()
Legacy simulation of item-sort target-count power