The Currency of Credentials
Quality intent is outpacing quality infrastructure.
For a credential to retain credibility, its quality system must evolve alongside the work itself. That means aligning evidence to claimed competencies, protecting assessment integrity as artificial intelligence changes the environment, creating a signal employers can trust, and ensuring learners receive meaningful value in return.
The providers surveyed appear broadly aligned with that standard. They describe competency frameworks, formal standard-setting, human oversight, employer input, flexible delivery, and ambitions for richer assessment. What remains underdeveloped is the institutional machinery behind those practices: the systems needed to maintain standards, demonstrate quality, govern decisions, and measure outcomes consistently.
Intent outpaces infrastructure across five operating domains
Across seemingly unrelated dimensions of credential quality, the same structural pattern repeats. Viewed together, these are not five independent quality problems, but manifestations of the same underlying capacity gap: the distance between understanding what quality requires and building the systems needed to sustain it.
Six findings, read in sequence
Confidence in current relevance is high; verification mechanisms are less consistent
87.5% of respondents agree that program competencies reflect the work people in the role actually perform today. Formal maintenance practices are less consistent: only half report using a systematic process to monitor labor-market change, and four in ten programs were last substantially updated three or more years ago.
Each measure addresses a different aspect of relevance. Across the section a consistent pattern emerges: confidence in relevance is strong, while the mechanisms used to verify, document, and maintain it are less consistently developed.
“The single biggest barrier is securing sufficient subject-matter expert time to continuously identify, evaluate, and translate changes in practice into validated exam content.”
Credential provider — professional certification programSelected-response testing remains the dominant evidence of competence
Applied competence is central to the credential claim, while the evidence base remains dominated by selected-response assessment. That does not make multiple-choice assessment weak: well-designed items can assess application, analysis, evaluation, and judgment, and 80% of programs with a formal assessment use a formal method to establish cut scores.
The issue is construct-to-evidence alignment. The strength of the credential signal ultimately depends on how closely the evidence matches the claim.
Assessment aspirations are advancing faster than implementation capacity
Providers can describe the assessment they would prefer. What they cannot always do is deliver it reliably and at scale. Every desired method meets a specific operational constraint: scenario items need trained scorers, portfolios need rubrics and moderation, observation is labor-intensive, video raises technology and privacy demands, and adaptive testing requires item-bank depth and psychometric cost.
The practical implication is not to replace multiple-choice items indiscriminately, but to use the least burdensome evidence that validly supports the claim.
“Would like to use more scenario-type questions that allow flexibility in the examinee’s approach to solve the problem, but don’t have anyone available to grade such an exam.”
Credential provider — professional certification programHuman supervision is leading the transition to formal AI governance
Every clear AI user answering the item confirms that final credential decisions are reviewed by a human. Formal governance is less mature: half report defined protocols, four in ten report a governance framework, and half report that informal individual staff use continues.
Providers are applying human review as AI use expands, even where formal policies remain incomplete. Governance is developing alongside practice rather than preceding it. The safeguards exist; what is missing is the written record that makes them auditable.
Providers report strong market value without equivalent downstream outcome evidence
Confidence in external value is strikingly high. The outcome-evidence infrastructure is substantially less developed. The distinction is between market-signal evidence and longitudinal holder evidence: a provider may know employers want the credential without knowing whether holders advance, stay in the field, use the skills, or earn more after earning it.
Flexible access is more common than systematic equity measurement
Flexible scheduling, asynchronous options, remote delivery, and additional languages remove genuine barriers. The limitation is evidentiary: without monitoring, organizations cannot determine whether access improvements change who enters, persists, completes, or benefits afterward.
The goal is not a universal equity dashboard. It is a proportionate measurement system — identify the barrier the program is trying to reduce, collect the minimum data needed to test whether it is changing, and use privacy-safe thresholds.
The field has a clear view of quality. Infrastructure remains the constraint.
The qualitative data place operational capacity at the center of the implementation challenge. 70% of substantive barrier responses mention staffing, time, funding, or related resources; 14 of 20 answers about content currency name capacity or resource constraints directly.
The implication is one of ownership. A construct-to-evidence gap can originate within assessment design, while persistent inability to close it reflects a wider organizational challenge. Budget, governance, and accountability therefore become part of the quality system. The literature offers limited direct evidence on operating capacity as a cross-cutting constraint, so the capacity explanation should be treated as an empirically grounded hypothesis rather than an established result.
Build quality infrastructure that can be maintained, measured, and defended
Six operating priorities. They are not universal standards and do not replace accreditation requirements, psychometric standards, or sector-specific governance.
Build a formal process for maintaining credential currency
Named owner, defined external signals, review triggers, a maximum interval, and a documented path from detected change to revised competencies.
Align every competency claim with sufficient evidence
Map every competency claim to the evidence used to support it. Add richer evidence only where the construct requires it.
Formalize AI governance around established safeguards
Inventory current use, then convert existing human-review habits into approved uses, prohibited uses, validation criteria, and named accountability.
Measure the outcomes most closely tied to the claim
Follow holders six to twelve months after completion and collect a focused set of outcomes tied to the credential’s stated purpose.
Connect access strategies to measurable equity outcomes
Identify the barriers being reduced, then measure whether the intervention changes participation, completion, or pass rates.
Make quality infrastructure a recurring investment
Treat maintenance, psychometrics, SME review, outcome tracking, and governance as recurring operating functions rather than one-time projects.
Sequence quality improvements around evidence generation
Not a transformation program. A disciplined baseline, a small number of design decisions, and one or two systems that begin producing evidence within ninety days.
- Inventory credential claims, current update cycle, and assessment methods
- List every AI use case, including informal individual staff use
- Identify what outcome, access, and equity data already exists
- Name the three highest-risk gaps
- Define currency triggers, owners, and a maximum review interval
- Complete the construct-to-evidence audit
- Draft the AI use protocol and approve the accountable owner
- Select three to five outcome measures tied to the value claim
- Pilot one richer assessment element on the weakest claim
- Launch the six-to-twelve month holder follow-up
- Run the first documented currency review and log the decision
- Establish a dashboard cadence and a decision forum
The missing perspective is what credentials actually change for learners
This study was designed as a two-sided provider-and-learner investigation. Learner response volume was too small to support trustworthy aggregate claims, so those responses were removed from the primary findings rather than stretched into percentages.
That limitation points directly at the most important next study: a learner-first investigation focused not on satisfaction but on real-world outcomes. What does earning a credential actually change in a person’s work and life? Selected individual cases will continue to be published as JANSON Research & Strategy Field Notes.
About the study
An exploratory provider-side analysis. Findings describe this sample and identify patterns worth testing in larger research. Percentages should not be read as population estimates.
Forty-six pages, twelve exhibits, and a ninety-day roadmap.
The complete report carries the full evidence base, the construct-to-evidence argument, implementation risks, measures and decision points, and the technical appendix.