Package index • contentvalidR

About the package

How to read the output, what the package promises, and what you can rely on across versions.

contentvalidR contentvalidR-package: contentvalidR: Tools for Substantive and Content Validity Pretesting

Flagship workflows

Recommended user-facing analyses for scale content pretesting.

sort_validity(): Analyze an item-sort content-validity pretest
rating_validity(): Analyze a Hinkin-Tracey construct-rating content-validity pretest
expert_validity(): Analyze expert-panel content-validity evidence
delphi_validity(): Delphi consensus and stability across rounds
judge_validity(): Analyze judge and rater heterogeneity in content-validity ratings
domain_validity(): Analyze content-domain coverage and structure

Workflow plotting methods

Diagnostic plots for the flagship workflow objects and exact sort-power plans.

plot(<contentvalid_sort>): Plot item-sort evidence
plot(<contentvalid_rating>): Plot Hinkin-Tracey rating evidence
plot(<contentvalid_expert>): Plot expert-panel content-validity results
plot(<contentvalid_delphi>): Plot a Delphi analysis
plot(<contentvalid_sort_power>): Plot exact item-sort planning evidence
plot(<contentvalid_structure>): Plot an expert content map
plot(<contentvalid_expert_power>): Plot an expert-panel planning curve
plot(<contentvalid_evidence>): Plot content evidence across review stages

Reading and reporting results

What print(), summary(), plot(), and as.data.frame() do for each result; definitions of every index and status label, plus extraction into reports and downstream workflows.

contentvalid-methods print.contentvalid_sort print.contentvalid_rating print.contentvalid_expert print.contentvalid_delphi print.contentvalid_judge print.contentvalid_domain print.summary.contentvalid_sort print.summary.contentvalid_rating print.summary.contentvalid_expert print.summary.contentvalid_delphi print.summary.contentvalid_judge print.summary.contentvalid_domain print.summary.contentvalid_rounds summary.contentvalid_sort summary.contentvalid_rating summary.contentvalid_expert summary.contentvalid_delphi summary.contentvalid_judge summary.contentvalid_domain summary.contentvalid_rounds print.contentvalid_psa print.contentvalid_csv print.contentvalid_htc print.contentvalid_htd print.contentvalid_anova print.contentvalid_aiken print.contentvalid_cvr print.contentvalid_ioc print.contentvalid_cvi print.contentvalid_agreement print.contentvalid_binom print.contentvalid_colquitt print.contentvalid_colquitt_norms print.contentvalid_similarity print.contentvalid_sort_power print.contentvalid_expert_power print.contentvalid_gtheory print.contentvalid_structure print.contentvalid_signal print.contentvalid_reproducibility print.contentvalid_report print.contentvalid_markdown print.contentvalid_evidence print.contentvalid_handoff print.contentvalid_rounds print.contentvalid_glossary plot.contentvalid_judge plot.contentvalid_domain plot.contentvalid_rounds as.data.frame.contentvalid_component as.data.frame.contentvalid_report as.data.frame.contentvalid_evidence: Printing, summarizing, and plotting contentvalidR results
contentvalid_glossary(): Glossary of contentvalidR indices and status terms
as.data.frame(<contentvalid_workflow>): Extract workflow results as a plain data frame
as.data.frame(<contentvalid_cvi>) as.data.frame(<contentvalid_gtheory>) as.data.frame(<contentvalid_structure>) as.data.frame(<contentvalid_rounds>) as.data.frame(<contentvalid_handoff>) as.data.frame(<contentvalid_sort_power>) as.data.frame(<contentvalid_expert_power>) as.data.frame(<contentvalid_agreement>) as.data.frame(<contentvalid_binom>) as.data.frame(<contentvalid_signal>) as.data.frame(<contentvalid_reproducibility>): Tables from contentvalidR results
content_report(): Build a manuscript-ready results table
content_handoff(): Carry content-validity decisions into empirical validation
content_evidence(): Combine content evidence across review stages
compare_rounds(): Compare content-validity evidence across pretest rounds

Item-sort components and planning

compute_psa(): Proportion of Substantive Agreement (Psa)
compute_csv(): Substantive Validity Coefficient (Csv)
csv_binom_test(): Exact item-sort significance test
sort_power(): Exact power for the item-sort target-count rule
colquitt_benchmarks(): Colquitt et al. (2019) empirical content-validation benchmarks
interpret_colquitt(): Interpret a statistic using Colquitt et al. (2019) norms

Expert-panel planning

Probability of clearing an explicit decision criterion at a given panel size.

expert_power(): Plan an expert panel against an explicit decision criterion

Construct-rating components

htc(): Hinkin-Tracey correspondence (HTC)
htd(): Hinkin-Tracey distinctiveness (HTD)
anova_content(): Repeated-measures ANOVA content test for construct ratings

Expert-panel indices

aikens_v(): Aiken's V for expert content-relevance ratings
cvi(): Content Validity Index (CVI)
cvr(): Lawshe's Content Validity Ratio (CVR)
ioc(): Index of item-objective congruence (IOC)
panel_agreement(): Panel-level agreement among expert raters

Judge and rater heterogeneity

Evidence about how far conclusions depend on the particular judges used.

gtheory_content(): Generalizability analysis of content-validity ratings

Domain coverage and content structure

Whether the item set spans the blueprint, and whether experts group items as the blueprint expects.

content_structure(): Item-similarity structure of a content domain
similarity_from_sort(): Derive item similarities from an item-sort task

Auxiliary and compatibility helpers

Kept for older analyses and sensitivity checks; not recommended workflows.

qfactor_content(): Q-factor helper for content adequacy (comparator)
signal_detection(): Signal-detection summary for binary retention decisions
reproducibility_phi(): Between-pretest reproducibility (phi) of binary decisions
simulate_anova_power(): Legacy independent-groups ANOVA power simulator
simulate_csv_power(): Legacy simulation of item-sort target-count power