2016 and 2026 by sector

The 21 pairs comprise 4 federal or cantonal administration websites, 2 federal-related organisations, 1 higher-education website and 14 media websites. No online-retail pairs are available for this comparison. Statements about change apply only to these matched websites, not to every website in a sector. Individual values appear in the paired comparison below.

The same websites in 2016 and 2026

21 websites have numerical ratings from both years: 13 are rated higher in 2026, 4 are practically unchanged and 4 are rated lower. “Practically unchanged” means a difference from −0.5 to +0.5 points, including both boundaries.

The median of the 21 individual changes is +2.61 points. Each change is calculated for the same website: the 2026 rating minus the converted 2016 rating.

The 2016 star rating is multiplied by 2. For example, 3 stars → 6 points; a 2026 rating of 8 points gives a change of +2 points. The 2026 value is the stored manual rating on the 1–10 scale, or the equally weighted mean where several matching tests contribute.

Higher values mean a more favourable rating. This compares recorded ratings from two assessment approaches and years; testing conditions need not be identical. The change is not a percentage and does not determine the current accessibility class G. All 13 higher ratings concern media websites.

Historical and current manual ratings

Website hosts are paired exactly after normalization; duplicate and unmatched hosts remain unpaired. The table retains missing and conflicting values. Ratings use the configured 1–10 comparison scale. Differences use unrounded values; values within ±0.5 points are within the configured band.

Current manual rating / 2016 recorded overall rating

Eligible Domains: 102; Matched hosts: 78

Captured scale: 1–10; Unchanged band: ±0.5

2016 stars × 2 / mean observation rating 2026 (1–10)
PopulationNumeric pairsMedian difference1. Increase2. Within the configured band3. Decrease
Completed evidence212.611344
Provisional: live ratings0Unavailable000
Compare individual websites: 2016 and 2026

Completed evidence

2016 stars × 2 / mean observation rating 2026 (1–10)

Captured scale: 1–10

  • Participant 29

    2016 recorded overall rating: 2
    Current manual rating: 8.26
  • Participant 163

    2016 recorded overall rating: 10
    Current manual rating: 9.64
  • Participant 76

    2016 recorded overall rating: 8
    Current manual rating: 8.46
  • Participant 149

    2016 recorded overall rating: 2
    Current manual rating: 7.99
  • Participant 42

    2016 recorded overall rating: 2
    Current manual rating: 7.99
  • Participant 19

    2016 recorded overall rating: 8
    Current manual rating: 7.89
  • Participant 109

    2016 recorded overall rating: 10
    Current manual rating: 7.65
  • Participant 30

    2016 recorded overall rating: 6
    Current manual rating: 7.33
  • Participant 102

    2016 recorded overall rating: 10
    Current manual rating: 9.16
  • Participant 123

    2016 recorded overall rating: 2
    Current manual rating: 6.66
  • Participant 50

    2016 recorded overall rating: 2
    Current manual rating: 8.16
  • Participant 95

    2016 recorded overall rating: 4
    Current manual rating: 7.6
  • Participant 122

    2016 recorded overall rating: 2
    Current manual rating: 6.92
  • Participant 178

    2016 recorded overall rating: 10
    Current manual rating: 8.56
  • Participant 87

    2016 recorded overall rating: 2
    Current manual rating: 7.18
  • Participant 172

    2016 recorded overall rating: 6
    Current manual rating: 7.92
  • Participant 169

    2016 recorded overall rating: 10
    Current manual rating: 9.14
  • Participant 121

    2016 recorded overall rating: 10
    Current manual rating: 9.64
  • Participant 08

    2016 recorded overall rating: 2
    Current manual rating: 8.04
  • Participant 86

    2016 recorded overall rating: 2
    Current manual rating: 8.26
  • Participant 51

    2016 recorded overall rating: 4
    Current manual rating: 6.61
Show data table
2016 stars × 2 / mean observation rating 2026 (1–10)
WebsitePopulation2016 recorded overall ratingCurrent manual ratingDifferenceEvidence state
Participant 75Unavailable4UnavailableUnavailableCurrent rating unavailable
Participant 29Completed evidence28.266.26Paired
Participant 163Completed evidence109.64-0.36Paired
Participant 09Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 05Completed evidenceUnavailable8.09UnavailableNo matching reference host
Participant 76Completed evidence88.460.46Paired
Participant 149Completed evidence27.995.99Paired
Participant 24Unavailable10UnavailableUnavailableCurrent rating unavailable
Participant 105UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 02Unavailable10UnavailableUnavailableCurrent rating unavailable
Participant 42Completed evidence27.995.99Paired
Participant 157UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 19Completed evidence87.89-0.11Paired
Participant 109Completed evidence107.65-2.35Paired
Participant 143Unavailable4UnavailableUnavailableCurrent rating unavailable
Participant 84Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 30Completed evidence67.331.33Paired
Participant 185Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 190UnavailableUnavailableUnavailableUnavailableDuplicate host; not paired
Participant 102Completed evidence109.16-0.84Paired
Participant 127Completed evidenceUnavailable6.85UnavailableNo matching reference host
Participant 123Completed evidence26.664.66Paired
Participant 56Unavailable10UnavailableUnavailableCurrent rating unavailable
Participant 129Unavailable4UnavailableUnavailableCurrent rating unavailable
Participant 195Completed evidenceUnavailable8.23UnavailableNo matching reference host
Participant 50Completed evidence28.166.16Paired
Participant 80Unavailable2UnavailableUnavailableCurrent rating unavailable
Participant 07Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 120Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 60Unavailable4UnavailableUnavailableCurrent rating unavailable
Participant 142Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 152Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 06Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 73Completed evidenceUnavailable7.02UnavailableNo matching reference host
Participant 160Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 101UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 186Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 89UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 43Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 62UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 48UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 113Unavailable4UnavailableUnavailableCurrent rating unavailable
Participant 151UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 95Completed evidence47.63.6Paired
Participant 46Unavailable4UnavailableUnavailableCurrent rating unavailable
Participant 122Completed evidence26.924.92Paired
Participant 178Completed evidence108.56-1.44Paired
Participant 96Unavailable4UnavailableUnavailableCurrent rating unavailable
Participant 39Unavailable4UnavailableUnavailableCurrent rating unavailable
Participant 87Completed evidence27.185.18Paired
Participant 144Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 17Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 132Unavailable4UnavailableUnavailableCurrent rating unavailable
Participant 172Completed evidence67.921.92Paired
Participant 45UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 71Unavailable4UnavailableUnavailableCurrent rating unavailable
Participant 169Completed evidence109.14-0.86Paired
Participant 121Completed evidence109.64-0.36Paired
Participant 197UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 193UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 59Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 138Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 63Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 173Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 58Unavailable10UnavailableUnavailableCurrent rating unavailable
Participant 171Unavailable10UnavailableUnavailableCurrent rating unavailable
Participant 150Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 184Unavailable10UnavailableUnavailableCurrent rating unavailable
Participant 52Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 34Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 175UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 92Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 201Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 41UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 08Completed evidence28.046.04Paired
Participant 86Completed evidence28.266.26Paired
Participant 134Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 78Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 98UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 66Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 168Unavailable4UnavailableUnavailableCurrent rating unavailable
Participant 26Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 198Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 100Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 117Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 180UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 94Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 74Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 55Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 118Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 189UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 161Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 38Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 51Completed evidence46.612.61Paired
Participant 187UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 155UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 22UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 14Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 140Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 01Unavailable6UnavailableUnavailableCurrent rating unavailable
Participant 164Unavailable8UnavailableUnavailableCurrent rating unavailable
Participant 114UnavailableUnavailableUnavailableUnavailableNo matching reference host
Participant 133Reference only4UnavailableUnavailableReference host without a unique current counterpart
Participant 147Reference only4UnavailableUnavailableReference host without a unique current counterpart
Participant 177Reference only4UnavailableUnavailableReference host without a unique current counterpart
Participant 146Reference only4UnavailableUnavailableReference host without a unique current counterpart
Participant 103Reference only6UnavailableUnavailableReference host without a unique current counterpart
Participant 16Reference only8UnavailableUnavailableReference host without a unique current counterpart
Participant 154Reference only10UnavailableUnavailableReference host without a unique current counterpart
Participant 18Reference only6UnavailableUnavailableReference host without a unique current counterpart
Participant 166Reference only8UnavailableUnavailableReference host without a unique current counterpart
Participant 32Reference only8UnavailableUnavailableReference host without a unique current counterpart
Participant 119Reference only8UnavailableUnavailableReference host without a unique current counterpart
Participant 53Reference only8UnavailableUnavailableReference host without a unique current counterpart
Participant 10Reference only10UnavailableUnavailableReference host without a unique current counterpart
Participant 131Reference only8UnavailableUnavailableReference host without a unique current counterpart
Participant 35Reference only6UnavailableUnavailableReference host without a unique current counterpart
Participant 104Reference only4UnavailableUnavailableReference host without a unique current counterpart
Participant 191Reference only6UnavailableUnavailableReference host without a unique current counterpart
Participant 91Reference only6UnavailableUnavailableReference host without a unique current counterpart
Participant 99Reference only4UnavailableUnavailableReference host without a unique current counterpart
Participant 174Reference only10UnavailableUnavailableReference host without a unique current counterpart
Participant 115Reference only10UnavailableUnavailableReference host without a unique current counterpart

Overview: sectors and testing scope

The 2026 pilot study covers 102 websites in four sectors.

Sector Websites
Public administration and public-sector-related organisations 59
of which federal government 4
of which federal-related organisations 5
of which cantons 26
of which canton-related organisations 6
of which towns and municipalities 18
Higher education 19
Media 15
Online shops 9

78 of the 102 websites can be matched to a website in the 2016 study.

The easy-to-read and accessibility-statement quick checks are still outstanding for one newly included website. These two surveys therefore continue to cover 101 websites.

The methods examine the websites at different levels of depth:

Testing method Scope What is counted
Manual web testing 25 selected manual Web assessment; 22 sites also have a selected axe result
Automated web testing 94 selected result; known scope shown separately
Manual PDF testing 25 assessments 20 distinct documents; identical content counted once
Automated PDF testing 98 runs 93 distinct documents; all selected executions completed
Easy-to-read language 101 home-page quick check for 101; criterion assessment for 33, of which 6 have content
Accessibility statements 101 automated collection for criteria 16.1–16.8

Manual testing is the most demanding and informative method. The selection comprises 25 websites; 22 also have a selected axe result. Each analysis states its calculable result population.

Manual web testing results

The overall score G combines criterion assessment with tested user scenarios. It determines the accessibility class of each evaluable website. The accessibility results show the class distribution and proportion of insufficiently accessible websites; the Methodology explains the calculation and thresholds.

In the manually selected group, seven of the nine public administration websites are insufficiently accessible; their median G is 72.6 points. Among the 14 media websites, all 14 are insufficiently accessible, with a median G of 66.3 points. These figures describe the websites examined in these sectors.

The average observation rating remains a separate indicator: for the 25 websites it ranges from 6.6 to 9.6 on the 1–10 scale, with a median of 8.0 and a mean of 8.0. No accessibility class is derived from it.

At least one deficiency was observed on every one of the 25 websites. Basic requirements for structure, controls, alternative text and keyboard use are regularly missed.

The Findings page shows which criteria most often fail.

Accessibility of manually tested websites

Three scores, three roles: K is the WCAG criterion score from manual testing: applicable criteria are averaged within each user aspect, then the aspects receive equal weight. S describes the weakest recorded user scenario. G combines both into our overall assessment: G = 0.5 × K + 0.5 × min(K, S). All three scores use a scale from 0 to 100 points. Scenarios can lower G relative to K, but cannot raise it. The overall classification below uses G; the following table shows K, S and G separately for each website.

Insufficient accessibility

23 / 25 (92.0 %)

Assessable offers

At least one observed defect

25 / 25 (100.0 %)

Offers assessable for defect prevalence

Median G (points)

68.43

Minimum G (points)
48.4
Maximum G (points)
86.2
Selected offers
25
Assessable offers
25
Not assessable
0
Not assessable for defect prevalence
0

Evaluation method

Overall G assessment: classes and distribution
Overall class from GOffers / assessable offers
Good accessibilityScore interval (points): 90 ≤ G ≤ 1000 / 25 (0.0 %)
Conditional accessibilityScore interval (points): 80 ≤ G < 902 / 25 (8.0 %)
Insufficient accessibilityScore interval (points): 60 ≤ G < 8017 / 25 (68.0 %)
Poor accessibilityScore interval (points): 0 ≤ G < 606 / 25 (24.0 %)
K, S and G for each website
K, S and G for each website
OfferK: criteria score (points)S: user scenarios (points)G: overall score (points)Overall class from G
Participant 16392.9266.6779.79Insufficient accessibility
Participant 12186.210086.2Conditional accessibility
Participant 16980.7310080.73Conditional accessibility
Participant 7678.566.6772.58Insufficient accessibility
Participant 10277.7910077.79Insufficient accessibility
Participant 17872.9310072.93Insufficient accessibility
Participant 5072.6910072.69Insufficient accessibility
Participant 19572.2366.6769.45Insufficient accessibility
Participant 0570.7310070.73Insufficient accessibility
Participant 17270.2910070.29Insufficient accessibility
Participant 8670.1110070.11Insufficient accessibility
Participant 2968.9810068.98Insufficient accessibility
Participant 14968.4310068.43Insufficient accessibility
Participant 1968.2966.6767.48Insufficient accessibility
Participant 4267.3210067.32Insufficient accessibility
Participant 0865.3710065.37Insufficient accessibility
Participant 10964.7110064.71Insufficient accessibility
Participant 9563.3810063.38Insufficient accessibility
Participant 3061.4210061.42Insufficient accessibility
Participant 8758.3266.6758.32Poor accessibility
Participant 12758.1766.6758.17Poor accessibility
Participant 12357.3310057.33Poor accessibility
Participant 5155.2210055.22Poor accessibility
Participant 12252.7110052.71Poor accessibility
Participant 7348.466.6748.4Poor accessibility
Scenario results
Scenario resultsScenariosOffersNot assessable
Accomplished18180
Partially accomplished770
Category comparison
Category comparison
Category comparisonSelected offersAssessable offersInsufficiently accessible offers / assessable offersMedian G (points)
Verwaltung / Public administration / Administration997 / 9 (77.8 %)72.58
Medien / Media / Médias141414 / 14 (100.0 %)66.34
Hochschulen / Higher education / Hautes écoles111 / 1 (100.0 %)67.48
Onlinehandel / Online retail / Commerce en ligne111 / 1 (100.0 %)70.73

What does the overall score G mean?

G ranges from 0 to 100 points. It combines criterion ratings and tested usage scenarios; it is not a percentage of fulfilled criteria. The class boundaries explain the classification. The accessibility profile shows the share of fulfilled, sufficiently assessed criteria in each area.

Criteria score K — without scenarios

This supplementary view uses the existing K scores, without incorporating the scenario score S. The class thresholds remain the same: good from 90, conditional from 80, insufficient from 60, poor below 60 points. It shows the criterion assessment without scenarios. K is a criterion score aggregated by aspect, not the percentage of WCAG criteria passed or a statement of conformance. Each website with a fully assessable K counts once. Percentages use these websites as their denominator; unavailable K scores remain outside the classes. Missing scenario results do not prevent this K-only classification. The overall G assessment above remains unchanged.

Selected offers
25
Websites with an assessable K score
25
Websites without an assessable K score
0
Criteria score K: classes and distribution
Class from K aloneOffers / assessable offers
Criteria score: goodScore interval (points): 90 ≤ K ≤ 1001 / 25 (4.0 %)
Criteria score: conditionalScore interval (points): 80 ≤ K < 902 / 25 (8.0 %)
Criteria score: insufficientScore interval (points): 60 ≤ K < 8016 / 25 (64.0 %)
Criteria score: poorScore interval (points): 0 ≤ K < 606 / 25 (24.0 %)
Criteria score K for each website
Criteria score K for each website
OfferK: criteria score (points)Class from K alone
Participant 16392.92Criteria score: good
Participant 12186.2Criteria score: conditional
Participant 16980.73Criteria score: conditional
Participant 7678.5Criteria score: insufficient
Participant 10277.79Criteria score: insufficient
Participant 17872.93Criteria score: insufficient
Participant 5072.69Criteria score: insufficient
Participant 19572.23Criteria score: insufficient
Participant 0570.73Criteria score: insufficient
Participant 17270.29Criteria score: insufficient
Participant 8670.11Criteria score: insufficient
Participant 2968.98Criteria score: insufficient
Participant 14968.43Criteria score: insufficient
Participant 1968.29Criteria score: insufficient
Participant 4267.32Criteria score: insufficient
Participant 0865.37Criteria score: insufficient
Participant 10964.71Criteria score: insufficient
Participant 9563.38Criteria score: insufficient
Participant 3061.42Criteria score: insufficient
Participant 8758.32Criteria score: poor
Participant 12758.17Criteria score: poor
Participant 12357.33Criteria score: poor
Participant 5155.22Criteria score: poor
Participant 12252.71Criteria score: poor
Participant 7348.4Criteria score: poor

Automated web testing results

89 of 94 websites with a selected automated result have at least one reported violation. Automated testing covers only machine-testable requirements.

The 94 selected automated Web test runs contain 962 violation reports, counted by rule and assessed page. A further 1798 results are marked “Review required”. These require human assessment and are not counted as violations.

One test run may contain several violation reports. Their number is therefore neither the number of affected websites nor the number of distinct barriers. Recorded results and known test scope are shown separately; missing results are not passed tests.

The Findings page shows which criteria most often fail.

The criterion rankings include 93 of the 94 websites with automated results; one result from an earlier test-method version is not included in the configured comparison.

Contrast and comparison: manual and automated

Criterion coverage and results answer different questions. Manual assessment evaluates criteria using the defined sample. Automated rules can test only part of these requirements; a mapped rule does not establish a complete assessment of a criterion.

The following tables show coverage and each method’s contribution using selected results. Comparisons requiring evidence from both methods use only the explicitly stated shared subset. The paired rankings on the Findings page remain anchored to the manual selection and retain websites without automated results.

Counts refer to website–criterion combinations, not identical individual defects. “Review required”, incomplete results and missing evidence remain distinct from confirmed violation reports.

Weights for the reliability of automated results can be derived from accumulated data by comparing manual and automated test runs.

Results from embedded content

For the three rules below, false positives about the whole page arise when the software applies them to embedded content such as advertising, cookie dialogs or social-media elements. For the 94 selected axe runs, the table shows how many websites are affected and how many have an affected node in the main document.

Test rule (mapped criterion) With a report Of these, in the main document Only in embedded content
Page language — html-has-lang (3.1.1) 52 7 45
Page title — document-title (2.4.2) 47 3 44
Zooming — meta-viewport (1.4.4) 15 10 5

Among the 22 manually tested websites with an axe result, counts fall from 16 to 1 for html-has-lang, from 15 to 2 for document-title, and from 5 to 2 for meta-viewport when only the main document is considered. In total, 25 manual Web runs are selected; 3 of those websites have no selected axe result.

These are rule-level counts, not recalculated criterion values: other rules may contribute to the same criterion. Across all rules, 285 of 962 violation findings concern embedded content only; they are not all false positives. Bars and rankings retain the recorded results. A correction to the integration for the named page-level rules is planned for future runs.

Manual and automated: coverage and contribution

Manually assessed Domains and automatically assessed Domains are shown separately first. The comparison uses only Domains assessed by both methods, at criterion level within the declared projections. The same Domain does not imply the same pages, documents or individual defects; recorded scope differences remain visible.

Manual eCH Web assessment / Automated WCAG checks (axe)

Testing methods for the websites (102)
MeasureWebsites
Manually tested only4
Tested by both methods21
Automatically tested only72
Neither of the two selected web testing methods5
Data basis and method details

Eligible Domains: 102

Criteria per study subject

Criterion projection: WCAG A/AA — eCH Web · 2026-11-07.1

Criterion projection: WCAG A/AA — axe · 2026-11-07.1

Manually tested subset: 25

Automatically tested set: 93

Subjects tested by both methods: 21

Only manually tested: 4

Only automatically tested: 72

Manual violations by automated observation · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 5208

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks1674 / 5208 (32.1%)
Comparison units with complete mapped checks0 / 5208 (0%)
Failure observed368 / 5208 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks1674 / 5208 (32.1%)
Comparison units with complete mapped checks0 / 5208 (0%)
Execution progress of mapped checks0 / 1674 (0%)
Failure observed368 / 5208 (7.1%)
Mapped checks passed0 / 5208 (0%)
No failure reported by validator0 / 5208 (0%)
Not applicable0 / 5208 (0%)
Review needed98 / 5208 (1.9%)
Partly assessed1147 / 5208 (22%)
Result unknown61 / 5208 (1.2%)
No mapped check3534 / 5208 (67.9%)
Criteria in equivalent relationships5208 / 5208 (100%)
Criteria in related relationships0 / 5208 (0%)
Criteria without a crosswalk relationship0 / 5208 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)

Manual violations by automated observation · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 1400

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations1393 / 1400 (99.5%)
Failure observed392 / 1400 (28%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations1393 / 1400 (99.5%)
Failure observed392 / 1400 (28%)
No manual failure observed636 / 1400 (45.4%)
Not applicable365 / 1400 (26.1%)
Review needed0 / 1400 (0%)
Result unknown7 / 1400 (0.5%)
Criteria in equivalent relationships1400 / 1400 (100%)
Criteria in related relationships0 / 1400 (0%)
Criteria without a crosswalk relationship0 / 1400 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Common subjects – manual

Manual violations by automated observation · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 1176

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations1170 / 1176 (99.5%)
Failure observed331 / 1176 (28.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations1170 / 1176 (99.5%)
Failure observed331 / 1176 (28.1%)
No manual failure observed533 / 1176 (45.3%)
Not applicable306 / 1176 (26%)
Review needed0 / 1176 (0%)
Result unknown6 / 1176 (0.5%)
Criteria in equivalent relationships1176 / 1176 (100%)
Criteria in related relationships0 / 1176 (0%)
Criteria without a crosswalk relationship0 / 1176 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Common subjects – automated

Manual violations by automated observation · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 1176

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks378 / 1176 (32.1%)
Comparison units with complete mapped checks0 / 1176 (0%)
Failure observed102 / 1176 (8.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks378 / 1176 (32.1%)
Comparison units with complete mapped checks0 / 1176 (0%)
Execution progress of mapped checks0 / 378 (0%)
Failure observed102 / 1176 (8.7%)
Mapped checks passed0 / 1176 (0%)
No failure reported by validator0 / 1176 (0%)
Not applicable0 / 1176 (0%)
Review needed27 / 1176 (2.3%)
Partly assessed233 / 1176 (19.8%)
Result unknown16 / 1176 (1.4%)
No mapped check798 / 1176 (67.9%)
Criteria in equivalent relationships1176 / 1176 (100%)
Criteria in related relationships0 / 1176 (0%)
Criteria without a crosswalk relationship0 / 1176 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)

Manual violations by automated observation · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 1176

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results77 / 77 (100%)
No automated check mapped159 / 331 (48%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation77 / 331 (23.3%)
Manual failure; all mapped automated checks passed0 / 331 (0%)
Manual failure; automated checks inapplicable0 / 331 (0%)
Manual violation; no configured automated rule159 / 331 (48%)
Manual violation; automated review required7 / 331 (2.1%)
Manual violation; automated evidence unavailable88 / 331 (26.6%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually254 / 356 (71.3%)
Failure recorded by both methods77 / 356 (21.6%)
Violation recorded only automatically25 / 356 (7%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations1170 / 1176 (99.5%)
Shared criteria with automated checks378 / 1176 (32.1%)
Shared criteria with complete automated checks0 / 1176 (0%)
Comparison units with manual observations1170 / 1176 (99.5%)
Comparison units with mapped automated checks378 / 1176 (32.1%)
Comparison units with complete mapped checks0 / 1176 (0%)
Comparison units observed by both methods378 / 1176 (32.1%)
Automated violation among manual failures77 / 331 (23.3%)
Agreement among violation or passed-check results77 / 77 (100%)
Manual failure with passed checks (conditional share)0 / 77 (0%)
Failure recorded only manually254 / 356 (71.3%)
Failure recorded by both methods77 / 356 (21.6%)
Violation recorded only automatically25 / 356 (7%)
Comparison units with manual failures331 / 1176 (28.1%)
Review needed or insufficient evidence95 / 331 (28.7%)
No automated check mapped159 / 331 (48%)
Applicability disagreement0 / 331 (0%)
Execution progress of mapped checks0 / 378 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Detailed comparisons (300)
Study subject · Participant 89 · Selected runs

Study subject · Participant 89 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 117 · Selected runs

Study subject · Participant 117 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed7 / 56 (12.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed7 / 56 (12.5%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed11 / 56 (19.6%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 123 · Selected runs

Study subject · Participant 123 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed10 / 56 (17.9%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 161 · Selected runs

Study subject · Participant 161 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed13 / 56 (23.2%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 87 · Selected runs

Study subject · Participant 87 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed8 / 56 (14.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed8 / 56 (14.3%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed10 / 56 (17.9%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 29 · Selected runs

Study subject · Participant 29 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 113 · Selected runs

Study subject · Participant 113 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 02 · Selected runs

Study subject · Participant 02 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed12 / 56 (21.4%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 48 · Selected runs

Study subject · Participant 48 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 164 · Selected runs

Study subject · Participant 164 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 198 · Selected runs

Study subject · Participant 198 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed8 / 56 (14.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed8 / 56 (14.3%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed3 / 56 (5.4%)
Partly assessed7 / 56 (12.5%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 114 · Selected runs

Study subject · Participant 114 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed12 / 56 (21.4%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 189 · Selected runs

Study subject · Participant 189 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed13 / 56 (23.2%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 63 · Selected runs

Study subject · Participant 63 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed13 / 56 (23.2%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 132 · Selected runs

Study subject · Participant 132 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 151 · Selected runs

Study subject · Participant 151 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed12 / 56 (21.4%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 73 · Selected runs

Study subject · Participant 73 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed13 / 56 (23.2%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 09 · Selected runs

Study subject · Participant 09 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed8 / 56 (14.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed8 / 56 (14.3%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed10 / 56 (17.9%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 45 · Selected runs

Study subject · Participant 45 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed11 / 56 (19.6%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 71 · Selected runs

Study subject · Participant 71 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed14 / 56 (25%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 120 · Selected runs

Study subject · Participant 120 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed1 / 56 (1.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed1 / 56 (1.8%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 195 · Selected runs

Study subject · Participant 195 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 127 · Selected runs

Study subject · Participant 127 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 60 · Selected runs

Study subject · Participant 60 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed7 / 56 (12.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed7 / 56 (12.5%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed3 / 56 (5.4%)
Partly assessed8 / 56 (14.3%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 155 · Selected runs

Study subject · Participant 155 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed12 / 56 (21.4%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 193 · Selected runs

Study subject · Participant 193 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 197 · Selected runs

Study subject · Participant 197 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed0 / 56 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed0 / 56 (0%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed15 / 56 (26.8%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 75 · Selected runs

Study subject · Participant 75 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed3 / 56 (5.4%)
Partly assessed9 / 56 (16.1%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 185 · Selected runs

Study subject · Participant 185 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed11 / 56 (19.6%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 06 · Selected runs

Study subject · Participant 06 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed3 / 56 (5.4%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 95 · Selected runs

Study subject · Participant 95 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed9 / 56 (16.1%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 43 · Selected runs

Study subject · Participant 43 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed15 / 56 (26.8%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 34 · Selected runs

Study subject · Participant 34 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed16 / 56 (28.6%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 152 · Selected runs

Study subject · Participant 152 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed7 / 56 (12.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed7 / 56 (12.5%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed9 / 56 (16.1%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 144 · Selected runs

Study subject · Participant 144 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed12 / 56 (21.4%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 66 · Selected runs

Study subject · Participant 66 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed3 / 56 (5.4%)
Partly assessed9 / 56 (16.1%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 94 · Selected runs

Study subject · Participant 94 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed4 / 56 (7.1%)
Partly assessed8 / 56 (14.3%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 142 · Selected runs

Study subject · Participant 142 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed3 / 56 (5.4%)
Partly assessed12 / 56 (21.4%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 168 · Selected runs

Study subject · Participant 168 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed14 / 56 (25%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 143 · Selected runs

Study subject · Participant 143 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed0 / 56 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed0 / 56 (0%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed15 / 56 (26.8%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 109 · Selected runs

Study subject · Participant 109 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed10 / 56 (17.9%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 169 · Selected runs

Study subject · Participant 169 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed10 / 56 (17.9%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 163 · Selected runs

Study subject · Participant 163 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed0 / 56 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed0 / 56 (0%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed4 / 56 (7.1%)
Partly assessed13 / 56 (23.2%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 55 · Selected runs

Study subject · Participant 55 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed14 / 56 (25%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 101 · Selected runs

Study subject · Participant 101 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed12 / 56 (21.4%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 201 · Selected runs

Study subject · Participant 201 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed0 / 56 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed0 / 56 (0%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed16 / 56 (28.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 121 · Selected runs

Study subject · Participant 121 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed1 / 56 (1.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed1 / 56 (1.8%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed15 / 56 (26.8%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 173 · Selected runs

Study subject · Participant 173 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed14 / 56 (25%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 17 · Selected runs

Study subject · Participant 17 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 07 · Selected runs

Study subject · Participant 07 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed13 / 56 (23.2%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 30 · Selected runs

Study subject · Participant 30 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 100 · Selected runs

Study subject · Participant 100 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 51 · Selected runs

Study subject · Participant 51 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed7 / 56 (12.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed7 / 56 (12.5%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed9 / 56 (16.1%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 140 · Selected runs

Study subject · Participant 140 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed12 / 56 (21.4%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 46 · Selected runs

Study subject · Participant 46 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed10 / 56 (17.9%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 41 · Selected runs

Study subject · Participant 41 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed15 / 56 (26.8%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 59 · Selected runs

Study subject · Participant 59 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed13 / 56 (23.2%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 134 · Selected runs

Study subject · Participant 134 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed1 / 56 (1.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed1 / 56 (1.8%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed15 / 56 (26.8%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 58 · Selected runs

Study subject · Participant 58 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed13 / 56 (23.2%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 190 · Selected runs

Study subject · Participant 190 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed1 / 56 (1.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed1 / 56 (1.8%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed15 / 56 (26.8%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 01 · Selected runs

Study subject · Participant 01 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 157 · Selected runs

Study subject · Participant 157 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed13 / 56 (23.2%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 38 · Selected runs

Study subject · Participant 38 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed1 / 56 (1.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed1 / 56 (1.8%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed15 / 56 (26.8%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 05 · Selected runs

Study subject · Participant 05 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed12 / 56 (21.4%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 184 · Selected runs

Study subject · Participant 184 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed0 / 56 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed0 / 56 (0%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed16 / 56 (28.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 78 · Selected runs

Study subject · Participant 78 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed12 / 56 (21.4%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 42 · Selected runs

Study subject · Participant 42 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed10 / 56 (17.9%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 178 · Selected runs

Study subject · Participant 178 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 186 · Selected runs

Study subject · Participant 186 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed13 / 56 (23.2%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 149 · Selected runs

Study subject · Participant 149 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 62 · Selected runs

Study subject · Participant 62 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed13 / 56 (23.2%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 105 · Selected runs

Study subject · Participant 105 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed7 / 56 (12.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed7 / 56 (12.5%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed9 / 56 (16.1%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 160 · Selected runs

Study subject · Participant 160 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed1 / 56 (1.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed1 / 56 (1.8%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed15 / 56 (26.8%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 175 · Selected runs

Study subject · Participant 175 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed1 / 56 (1.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed1 / 56 (1.8%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed15 / 56 (26.8%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 39 · Selected runs

Study subject · Participant 39 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed9 / 56 (16.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed9 / 56 (16.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed9 / 56 (16.1%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 150 · Selected runs

Study subject · Participant 150 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed13 / 56 (23.2%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 76 · Selected runs

Study subject · Participant 76 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed14 / 56 (25%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 187 · Selected runs

Study subject · Participant 187 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed12 / 56 (21.4%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 92 · Selected runs

Study subject · Participant 92 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed13 / 56 (23.2%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 171 · Selected runs

Study subject · Participant 171 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed15 / 56 (26.8%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 118 · Selected runs

Study subject · Participant 118 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 172 · Selected runs

Study subject · Participant 172 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed9 / 56 (16.1%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 102 · Selected runs

Study subject · Participant 102 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 52 · Selected runs

Study subject · Participant 52 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 24 · Selected runs

Study subject · Participant 24 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed13 / 56 (23.2%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 122 · Selected runs

Study subject · Participant 122 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed7 / 56 (12.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed7 / 56 (12.5%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed9 / 56 (16.1%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 96 · Selected runs

Study subject · Participant 96 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed15 / 56 (26.8%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 74 · Selected runs

Study subject · Participant 74 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed14 / 56 (25%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 56 · Selected runs

Study subject · Participant 56 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 22 · Selected runs

Study subject · Participant 22 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed7 / 56 (12.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed7 / 56 (12.5%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed3 / 56 (5.4%)
Partly assessed8 / 56 (14.3%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 26 · Selected runs

Study subject · Participant 26 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed13 / 56 (23.2%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 138 · Selected runs

Study subject · Participant 138 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed3 / 56 (5.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed3 / 56 (5.4%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed12 / 56 (21.4%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 180 · Selected runs

Study subject · Participant 180 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Group · Gesamte Studie · Selected runs

Group · Gesamte Studie · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 5208

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks1674 / 5208 (32.1%)
Comparison units with complete mapped checks0 / 5208 (0%)
Failure observed368 / 5208 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks1674 / 5208 (32.1%)
Comparison units with complete mapped checks0 / 5208 (0%)
Execution progress of mapped checks0 / 1674 (0%)
Failure observed368 / 5208 (7.1%)
Mapped checks passed0 / 5208 (0%)
No failure reported by validator0 / 5208 (0%)
Not applicable0 / 5208 (0%)
Review needed98 / 5208 (1.9%)
Partly assessed1147 / 5208 (22%)
Result unknown61 / 5208 (1.2%)
No mapped check3534 / 5208 (67.9%)
Criteria in equivalent relationships5208 / 5208 (100%)
Criteria in related relationships0 / 5208 (0%)
Criteria without a crosswalk relationship0 / 5208 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Group · Medien · Selected runs

Group · Medien · Automatically tested set · Own criterion set · Selected runs

Study subjects: 12; Criterion comparison units: 672

Same recorded scope: 11

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks216 / 672 (32.1%)
Comparison units with complete mapped checks0 / 672 (0%)
Failure observed71 / 672 (10.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks216 / 672 (32.1%)
Comparison units with complete mapped checks0 / 672 (0%)
Execution progress of mapped checks0 / 216 (0%)
Failure observed71 / 672 (10.6%)
Mapped checks passed0 / 672 (0%)
No failure reported by validator0 / 672 (0%)
Not applicable0 / 672 (0%)
Review needed17 / 672 (2.5%)
Partly assessed119 / 672 (17.7%)
Result unknown9 / 672 (1.3%)
No mapped check456 / 672 (67.9%)
Criteria in equivalent relationships672 / 672 (100%)
Criteria in related relationships0 / 672 (0%)
Criteria without a crosswalk relationship0 / 672 (0%)
Subjects with unknown manual criterion scope0 / 12 (0%)
Subjects with unknown automated criterion scope0 / 12 (0%)
Group · Verwaltung · Selected runs

Group · Verwaltung · Automatically tested set · Own criterion set · Selected runs

Study subjects: 57; Criterion comparison units: 3192

Scope correspondence unknown: 48

Same recorded scope: 6

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks1026 / 3192 (32.1%)
Comparison units with complete mapped checks0 / 3192 (0%)
Failure observed196 / 3192 (6.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks1026 / 3192 (32.1%)
Comparison units with complete mapped checks0 / 3192 (0%)
Execution progress of mapped checks0 / 1026 (0%)
Failure observed196 / 3192 (6.1%)
Mapped checks passed0 / 3192 (0%)
No failure reported by validator0 / 3192 (0%)
Not applicable0 / 3192 (0%)
Review needed52 / 3192 (1.6%)
Partly assessed739 / 3192 (23.2%)
Result unknown39 / 3192 (1.2%)
No mapped check2166 / 3192 (67.9%)
Criteria in equivalent relationships3192 / 3192 (100%)
Criteria in related relationships0 / 3192 (0%)
Criteria without a crosswalk relationship0 / 3192 (0%)
Subjects with unknown manual criterion scope0 / 57 (0%)
Subjects with unknown automated criterion scope0 / 57 (0%)
Dimension · Mobile operability · Selected runs

Dimension · Mobile operability · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 465

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks0 / 465 (0%)
Comparison units with complete mapped checks0 / 465 (0%)
Failure observed0 / 465 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks0 / 465 (0%)
Comparison units with complete mapped checks0 / 465 (0%)
Execution progress of mapped checks0 / 0 (Unknown)
Failure observed0 / 465 (0%)
Mapped checks passed0 / 465 (0%)
No failure reported by validator0 / 465 (0%)
Not applicable0 / 465 (0%)
Review needed0 / 465 (0%)
Partly assessed0 / 465 (0%)
Result unknown0 / 465 (0%)
No mapped check465 / 465 (100%)
Criteria in equivalent relationships465 / 465 (100%)
Criteria in related relationships0 / 465 (0%)
Criteria without a crosswalk relationship0 / 465 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Keyboard operability · Selected runs

Dimension · Keyboard operability · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 558

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks186 / 558 (33.3%)
Comparison units with complete mapped checks0 / 558 (0%)
Failure observed2 / 558 (0.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks186 / 558 (33.3%)
Comparison units with complete mapped checks0 / 558 (0%)
Execution progress of mapped checks0 / 186 (0%)
Failure observed2 / 558 (0.4%)
Mapped checks passed0 / 558 (0%)
No failure reported by validator0 / 558 (0%)
Not applicable0 / 558 (0%)
Review needed17 / 558 (3%)
Partly assessed167 / 558 (29.9%)
Result unknown0 / 558 (0%)
No mapped check372 / 558 (66.7%)
Criteria in equivalent relationships558 / 558 (100%)
Criteria in related relationships0 / 558 (0%)
Criteria without a crosswalk relationship0 / 558 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Voice control · Selected runs

Dimension · Voice control · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 186

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks0 / 186 (0%)
Comparison units with complete mapped checks0 / 186 (0%)
Failure observed0 / 186 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks0 / 186 (0%)
Comparison units with complete mapped checks0 / 186 (0%)
Execution progress of mapped checks0 / 0 (Unknown)
Failure observed0 / 186 (0%)
Mapped checks passed0 / 186 (0%)
No failure reported by validator0 / 186 (0%)
Not applicable0 / 186 (0%)
Review needed0 / 186 (0%)
Partly assessed0 / 186 (0%)
Result unknown0 / 186 (0%)
No mapped check186 / 186 (100%)
Criteria in equivalent relationships186 / 186 (100%)
Criteria in related relationships0 / 186 (0%)
Criteria without a crosswalk relationship0 / 186 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Compatibility with user agents · Selected runs

Dimension · Compatibility with user agents · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 279

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks93 / 279 (33.3%)
Comparison units with complete mapped checks0 / 279 (0%)
Failure observed72 / 279 (25.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks93 / 279 (33.3%)
Comparison units with complete mapped checks0 / 279 (0%)
Execution progress of mapped checks0 / 93 (0%)
Failure observed72 / 279 (25.8%)
Mapped checks passed0 / 279 (0%)
No failure reported by validator0 / 279 (0%)
Not applicable0 / 279 (0%)
Review needed10 / 279 (3.6%)
Partly assessed11 / 279 (3.9%)
Result unknown0 / 279 (0%)
No mapped check186 / 279 (66.7%)
Criteria in equivalent relationships279 / 279 (100%)
Criteria in related relationships0 / 279 (0%)
Criteria without a crosswalk relationship0 / 279 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Interaction assistance · Selected runs

Dimension · Interaction assistance · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 837

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks186 / 837 (22.2%)
Comparison units with complete mapped checks0 / 837 (0%)
Failure observed0 / 837 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks186 / 837 (22.2%)
Comparison units with complete mapped checks0 / 837 (0%)
Execution progress of mapped checks0 / 186 (0%)
Failure observed0 / 837 (0%)
Mapped checks passed0 / 837 (0%)
No failure reported by validator0 / 837 (0%)
Not applicable0 / 837 (0%)
Review needed6 / 837 (0.7%)
Partly assessed180 / 837 (21.5%)
Result unknown0 / 837 (0%)
No mapped check651 / 837 (77.8%)
Criteria in equivalent relationships837 / 837 (100%)
Criteria in related relationships0 / 837 (0%)
Criteria without a crosswalk relationship0 / 837 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Consistency and predictability · Selected runs

Dimension · Consistency and predictability · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 465

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks0 / 465 (0%)
Comparison units with complete mapped checks0 / 465 (0%)
Failure observed0 / 465 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks0 / 465 (0%)
Comparison units with complete mapped checks0 / 465 (0%)
Execution progress of mapped checks0 / 0 (Unknown)
Failure observed0 / 465 (0%)
Mapped checks passed0 / 465 (0%)
No failure reported by validator0 / 465 (0%)
Not applicable0 / 465 (0%)
Review needed0 / 465 (0%)
Partly assessed0 / 465 (0%)
Result unknown0 / 465 (0%)
No mapped check465 / 465 (100%)
Criteria in equivalent relationships465 / 465 (100%)
Criteria in related relationships0 / 465 (0%)
Criteria without a crosswalk relationship0 / 465 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Semantic structure · Selected runs

Dimension · Semantic structure · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 186

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks93 / 186 (50%)
Comparison units with complete mapped checks0 / 186 (0%)
Failure observed29 / 186 (15.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks93 / 186 (50%)
Comparison units with complete mapped checks0 / 186 (0%)
Execution progress of mapped checks0 / 93 (0%)
Failure observed29 / 186 (15.6%)
Mapped checks passed0 / 186 (0%)
No failure reported by validator0 / 186 (0%)
Not applicable0 / 186 (0%)
Review needed3 / 186 (1.6%)
Partly assessed0 / 186 (0%)
Result unknown61 / 186 (32.8%)
No mapped check93 / 186 (50%)
Criteria in equivalent relationships186 / 186 (100%)
Criteria in related relationships0 / 186 (0%)
Criteria without a crosswalk relationship0 / 186 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Understandability · Selected runs

Dimension · Understandability · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 558

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks372 / 558 (66.7%)
Comparison units with complete mapped checks0 / 558 (0%)
Failure observed149 / 558 (26.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks372 / 558 (66.7%)
Comparison units with complete mapped checks0 / 558 (0%)
Execution progress of mapped checks0 / 372 (0%)
Failure observed149 / 558 (26.7%)
Mapped checks passed0 / 558 (0%)
No failure reported by validator0 / 558 (0%)
Not applicable0 / 558 (0%)
Review needed0 / 558 (0%)
Partly assessed223 / 558 (40%)
Result unknown0 / 558 (0%)
No mapped check186 / 558 (33.3%)
Criteria in equivalent relationships558 / 558 (100%)
Criteria in related relationships0 / 558 (0%)
Criteria without a crosswalk relationship0 / 558 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Display flexibility · Selected runs

Dimension · Display flexibility · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 744

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks279 / 744 (37.5%)
Comparison units with complete mapped checks0 / 744 (0%)
Failure observed15 / 744 (2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks279 / 744 (37.5%)
Comparison units with complete mapped checks0 / 744 (0%)
Execution progress of mapped checks0 / 279 (0%)
Failure observed15 / 744 (2%)
Mapped checks passed0 / 744 (0%)
No failure reported by validator0 / 744 (0%)
Not applicable0 / 744 (0%)
Review needed3 / 744 (0.4%)
Partly assessed261 / 744 (35.1%)
Result unknown0 / 744 (0%)
No mapped check465 / 744 (62.5%)
Criteria in equivalent relationships744 / 744 (100%)
Criteria in related relationships0 / 744 (0%)
Criteria without a crosswalk relationship0 / 744 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Contrast and sensory characteristics · Selected runs

Dimension · Contrast and sensory characteristics · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 372

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks186 / 372 (50%)
Comparison units with complete mapped checks0 / 372 (0%)
Failure observed67 / 372 (18%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks186 / 372 (50%)
Comparison units with complete mapped checks0 / 372 (0%)
Execution progress of mapped checks0 / 186 (0%)
Failure observed67 / 372 (18%)
Mapped checks passed0 / 372 (0%)
No failure reported by validator0 / 372 (0%)
Not applicable0 / 372 (0%)
Review needed46 / 372 (12.4%)
Partly assessed73 / 372 (19.6%)
Result unknown0 / 372 (0%)
No mapped check186 / 372 (50%)
Criteria in equivalent relationships372 / 372 (100%)
Criteria in related relationships0 / 372 (0%)
Criteria without a crosswalk relationship0 / 372 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Non-text content (graphics) · Selected runs

Dimension · Non-text content (graphics) · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 93

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks93 / 93 (100%)
Comparison units with complete mapped checks0 / 93 (0%)
Failure observed34 / 93 (36.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks93 / 93 (100%)
Comparison units with complete mapped checks0 / 93 (0%)
Execution progress of mapped checks0 / 93 (0%)
Failure observed34 / 93 (36.6%)
Mapped checks passed0 / 93 (0%)
No failure reported by validator0 / 93 (0%)
Not applicable0 / 93 (0%)
Review needed0 / 93 (0%)
Partly assessed59 / 93 (63.4%)
Result unknown0 / 93 (0%)
No mapped check0 / 93 (0%)
Criteria in equivalent relationships93 / 93 (100%)
Criteria in related relationships0 / 93 (0%)
Criteria without a crosswalk relationship0 / 93 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Multimedia and two-senses principle (audio/video) · Selected runs

Dimension · Multimedia and two-senses principle (audio/video) · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 465

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks186 / 465 (40%)
Comparison units with complete mapped checks0 / 465 (0%)
Failure observed0 / 465 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks186 / 465 (40%)
Comparison units with complete mapped checks0 / 465 (0%)
Execution progress of mapped checks0 / 186 (0%)
Failure observed0 / 465 (0%)
Mapped checks passed0 / 465 (0%)
No failure reported by validator0 / 465 (0%)
Not applicable0 / 465 (0%)
Review needed13 / 465 (2.8%)
Partly assessed173 / 465 (37.2%)
Result unknown0 / 465 (0%)
No mapped check279 / 465 (60%)
Criteria in equivalent relationships465 / 465 (100%)
Criteria in related relationships0 / 465 (0%)
Criteria without a crosswalk relationship0 / 465 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Motor skills · Selected runs

Dimension · Motor skills · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 2418

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks558 / 2418 (23.1%)
Comparison units with complete mapped checks0 / 2418 (0%)
Failure observed123 / 2418 (5.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks558 / 2418 (23.1%)
Comparison units with complete mapped checks0 / 2418 (0%)
Execution progress of mapped checks0 / 558 (0%)
Failure observed123 / 2418 (5.1%)
Mapped checks passed0 / 2418 (0%)
No failure reported by validator0 / 2418 (0%)
Not applicable0 / 2418 (0%)
Review needed33 / 2418 (1.4%)
Partly assessed402 / 2418 (16.6%)
Result unknown0 / 2418 (0%)
No mapped check1860 / 2418 (76.9%)
Criteria in equivalent relationships2418 / 2418 (100%)
Criteria in related relationships0 / 2418 (0%)
Criteria without a crosswalk relationship0 / 2418 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Vision · Selected runs

Dimension · Vision · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 4278

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks1581 / 4278 (37%)
Comparison units with complete mapped checks0 / 4278 (0%)
Failure observed368 / 4278 (8.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks1581 / 4278 (37%)
Comparison units with complete mapped checks0 / 4278 (0%)
Execution progress of mapped checks0 / 1581 (0%)
Failure observed368 / 4278 (8.6%)
Mapped checks passed0 / 4278 (0%)
No failure reported by validator0 / 4278 (0%)
Not applicable0 / 4278 (0%)
Review needed88 / 4278 (2.1%)
Partly assessed1064 / 4278 (24.9%)
Result unknown61 / 4278 (1.4%)
No mapped check2697 / 4278 (63%)
Criteria in equivalent relationships4278 / 4278 (100%)
Criteria in related relationships0 / 4278 (0%)
Criteria without a crosswalk relationship0 / 4278 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Hearing · Selected runs

Dimension · Hearing · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 651

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks372 / 651 (57.1%)
Comparison units with complete mapped checks0 / 651 (0%)
Failure observed0 / 651 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks372 / 651 (57.1%)
Comparison units with complete mapped checks0 / 651 (0%)
Execution progress of mapped checks0 / 372 (0%)
Failure observed0 / 651 (0%)
Mapped checks passed0 / 651 (0%)
No failure reported by validator0 / 651 (0%)
Not applicable0 / 651 (0%)
Review needed16 / 651 (2.5%)
Partly assessed356 / 651 (54.7%)
Result unknown0 / 651 (0%)
No mapped check279 / 651 (42.9%)
Criteria in equivalent relationships651 / 651 (100%)
Criteria in related relationships0 / 651 (0%)
Criteria without a crosswalk relationship0 / 651 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Dimension · Cognition · Selected runs

Dimension · Cognition · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 3255

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks1116 / 3255 (34.3%)
Comparison units with complete mapped checks0 / 3255 (0%)
Failure observed284 / 3255 (8.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks1116 / 3255 (34.3%)
Comparison units with complete mapped checks0 / 3255 (0%)
Execution progress of mapped checks0 / 1116 (0%)
Failure observed284 / 3255 (8.7%)
Mapped checks passed0 / 3255 (0%)
No failure reported by validator0 / 3255 (0%)
Not applicable0 / 3255 (0%)
Review needed39 / 3255 (1.2%)
Partly assessed732 / 3255 (22.5%)
Result unknown61 / 3255 (1.9%)
No mapped check2139 / 3255 (65.7%)
Criteria in equivalent relationships3255 / 3255 (100%)
Criteria in related relationships0 / 3255 (0%)
Criteria without a crosswalk relationship0 / 3255 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Automated requirement group · 1 · Selected runs

Automated requirement group · 1 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 1860

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks744 / 1860 (40%)
Comparison units with complete mapped checks0 / 1860 (0%)
Failure observed145 / 1860 (7.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks744 / 1860 (40%)
Comparison units with complete mapped checks0 / 1860 (0%)
Execution progress of mapped checks0 / 744 (0%)
Failure observed145 / 1860 (7.8%)
Mapped checks passed0 / 1860 (0%)
No failure reported by validator0 / 1860 (0%)
Not applicable0 / 1860 (0%)
Review needed65 / 1860 (3.5%)
Partly assessed473 / 1860 (25.4%)
Result unknown61 / 1860 (3.3%)
No mapped check1116 / 1860 (60%)
Criteria in equivalent relationships1860 / 1860 (100%)
Criteria in related relationships0 / 1860 (0%)
Criteria without a crosswalk relationship0 / 1860 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Automated requirement group · 3 · Selected runs

Automated requirement group · 3 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 1209

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks279 / 1209 (23.1%)
Comparison units with complete mapped checks0 / 1209 (0%)
Failure observed53 / 1209 (4.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks279 / 1209 (23.1%)
Comparison units with complete mapped checks0 / 1209 (0%)
Execution progress of mapped checks0 / 279 (0%)
Failure observed53 / 1209 (4.4%)
Mapped checks passed0 / 1209 (0%)
No failure reported by validator0 / 1209 (0%)
Not applicable0 / 1209 (0%)
Review needed6 / 1209 (0.5%)
Partly assessed220 / 1209 (18.2%)
Result unknown0 / 1209 (0%)
No mapped check930 / 1209 (76.9%)
Criteria in equivalent relationships1209 / 1209 (100%)
Criteria in related relationships0 / 1209 (0%)
Criteria without a crosswalk relationship0 / 1209 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Automated requirement group · 4 · Selected runs

Automated requirement group · 4 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 279

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks93 / 279 (33.3%)
Comparison units with complete mapped checks0 / 279 (0%)
Failure observed72 / 279 (25.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks93 / 279 (33.3%)
Comparison units with complete mapped checks0 / 279 (0%)
Execution progress of mapped checks0 / 93 (0%)
Failure observed72 / 279 (25.8%)
Mapped checks passed0 / 279 (0%)
No failure reported by validator0 / 279 (0%)
Not applicable0 / 279 (0%)
Review needed10 / 279 (3.6%)
Partly assessed11 / 279 (3.9%)
Result unknown0 / 279 (0%)
No mapped check186 / 279 (66.7%)
Criteria in equivalent relationships279 / 279 (100%)
Criteria in related relationships0 / 279 (0%)
Criteria without a crosswalk relationship0 / 279 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Automated requirement group · 2 · Selected runs

Automated requirement group · 2 · Automatically tested set · Own criterion set · Selected runs

Study subjects: 93; Criterion comparison units: 1860

Scope correspondence unknown: 72

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks558 / 1860 (30%)
Comparison units with complete mapped checks0 / 1860 (0%)
Failure observed98 / 1860 (5.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks558 / 1860 (30%)
Comparison units with complete mapped checks0 / 1860 (0%)
Execution progress of mapped checks0 / 558 (0%)
Failure observed98 / 1860 (5.3%)
Mapped checks passed0 / 1860 (0%)
No failure reported by validator0 / 1860 (0%)
Not applicable0 / 1860 (0%)
Review needed17 / 1860 (0.9%)
Partly assessed443 / 1860 (23.8%)
Result unknown0 / 1860 (0%)
No mapped check1302 / 1860 (70%)
Criteria in equivalent relationships1860 / 1860 (100%)
Criteria in related relationships0 / 1860 (0%)
Criteria without a crosswalk relationship0 / 1860 (0%)
Subjects with unknown manual criterion scope0 / 93 (0%)
Subjects with unknown automated criterion scope0 / 93 (0%)
Study subject · Participant 123 · Completed evidence

Study subject · Participant 123 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed22 / 56 (39.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed22 / 56 (39.3%)
No manual failure observed24 / 56 (42.9%)
Not applicable10 / 56 (17.9%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 87 · Completed evidence

Study subject · Participant 87 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed19 / 56 (33.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed19 / 56 (33.9%)
No manual failure observed22 / 56 (39.3%)
Not applicable15 / 56 (26.8%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 29 · Completed evidence

Study subject · Participant 29 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed16 / 56 (28.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed16 / 56 (28.6%)
No manual failure observed25 / 56 (44.6%)
Not applicable15 / 56 (26.8%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 50 · Completed evidence

Study subject · Participant 50 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed14 / 56 (25%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed14 / 56 (25%)
No manual failure observed27 / 56 (48.2%)
Not applicable15 / 56 (26.8%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 73 · Completed evidence

Study subject · Participant 73 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed23 / 56 (41.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed23 / 56 (41.1%)
No manual failure observed17 / 56 (30.4%)
Not applicable16 / 56 (28.6%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 195 · Completed evidence

Study subject · Participant 195 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed13 / 56 (23.2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed13 / 56 (23.2%)
No manual failure observed23 / 56 (41.1%)
Not applicable19 / 56 (33.9%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 127 · Completed evidence

Study subject · Participant 127 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed22 / 56 (39.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed22 / 56 (39.3%)
No manual failure observed17 / 56 (30.4%)
Not applicable16 / 56 (28.6%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 19 · Completed evidence

Study subject · Participant 19 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed15 / 56 (26.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed15 / 56 (26.8%)
No manual failure observed21 / 56 (37.5%)
Not applicable19 / 56 (33.9%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 95 · Completed evidence

Study subject · Participant 95 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed17 / 56 (30.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed17 / 56 (30.4%)
No manual failure observed25 / 56 (44.6%)
Not applicable14 / 56 (25%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 109 · Completed evidence

Study subject · Participant 109 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed17 / 56 (30.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed17 / 56 (30.4%)
No manual failure observed26 / 56 (46.4%)
Not applicable13 / 56 (23.2%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 169 · Completed evidence

Study subject · Participant 169 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed11 / 56 (19.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed11 / 56 (19.6%)
No manual failure observed29 / 56 (51.8%)
Not applicable15 / 56 (26.8%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 163 · Completed evidence

Study subject · Participant 163 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed6 / 56 (10.7%)
No manual failure observed34 / 56 (60.7%)
Not applicable15 / 56 (26.8%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 121 · Completed evidence

Study subject · Participant 121 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed6 / 56 (10.7%)
No manual failure observed34 / 56 (60.7%)
Not applicable16 / 56 (28.6%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 30 · Completed evidence

Study subject · Participant 30 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed21 / 56 (37.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed21 / 56 (37.5%)
No manual failure observed23 / 56 (41.1%)
Not applicable12 / 56 (21.4%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 51 · Completed evidence

Study subject · Participant 51 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed23 / 56 (41.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed23 / 56 (41.1%)
No manual failure observed20 / 56 (35.7%)
Not applicable13 / 56 (23.2%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 08 · Completed evidence

Study subject · Participant 08 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed18 / 56 (32.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed18 / 56 (32.1%)
No manual failure observed27 / 56 (48.2%)
Not applicable11 / 56 (19.6%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 86 · Completed evidence

Study subject · Participant 86 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Scope correspondence unknown: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed14 / 56 (25%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed14 / 56 (25%)
No manual failure observed28 / 56 (50%)
Not applicable14 / 56 (25%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 05 · Completed evidence

Study subject · Participant 05 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed13 / 56 (23.2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed13 / 56 (23.2%)
No manual failure observed25 / 56 (44.6%)
Not applicable17 / 56 (30.4%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 42 · Completed evidence

Study subject · Participant 42 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed16 / 56 (28.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed16 / 56 (28.6%)
No manual failure observed24 / 56 (42.9%)
Not applicable16 / 56 (28.6%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 178 · Completed evidence

Study subject · Participant 178 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed13 / 56 (23.2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed13 / 56 (23.2%)
No manual failure observed26 / 56 (46.4%)
Not applicable17 / 56 (30.4%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 149 · Completed evidence

Study subject · Participant 149 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed16 / 56 (28.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed16 / 56 (28.6%)
No manual failure observed26 / 56 (46.4%)
Not applicable14 / 56 (25%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 76 · Completed evidence

Study subject · Participant 76 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed12 / 56 (21.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed12 / 56 (21.4%)
No manual failure observed27 / 56 (48.2%)
Not applicable17 / 56 (30.4%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 172 · Completed evidence

Study subject · Participant 172 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed14 / 56 (25%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed14 / 56 (25%)
No manual failure observed31 / 56 (55.4%)
Not applicable11 / 56 (19.6%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 102 · Completed evidence

Study subject · Participant 102 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed11 / 56 (19.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed11 / 56 (19.6%)
No manual failure observed31 / 56 (55.4%)
Not applicable13 / 56 (23.2%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 122 · Completed evidence

Study subject · Participant 122 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed20 / 56 (35.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed20 / 56 (35.7%)
No manual failure observed24 / 56 (42.9%)
Not applicable12 / 56 (21.4%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Group · Gesamte Studie · Completed evidence

Group · Gesamte Studie · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 1400

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations1393 / 1400 (99.5%)
Failure observed392 / 1400 (28%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations1393 / 1400 (99.5%)
Failure observed392 / 1400 (28%)
No manual failure observed636 / 1400 (45.4%)
Not applicable365 / 1400 (26.1%)
Review needed0 / 1400 (0%)
Result unknown7 / 1400 (0.5%)
Criteria in equivalent relationships1400 / 1400 (100%)
Criteria in related relationships0 / 1400 (0%)
Criteria without a crosswalk relationship0 / 1400 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Group · Medien · Completed evidence

Group · Medien · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 14; Criterion comparison units: 784

Same recorded scope: 11

Scope correspondence unknown: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations784 / 784 (100%)
Failure observed243 / 784 (31%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations784 / 784 (100%)
Failure observed243 / 784 (31%)
No manual failure observed352 / 784 (44.9%)
Not applicable189 / 784 (24.1%)
Review needed0 / 784 (0%)
Result unknown0 / 784 (0%)
Criteria in equivalent relationships784 / 784 (100%)
Criteria in related relationships0 / 784 (0%)
Criteria without a crosswalk relationship0 / 784 (0%)
Subjects with unknown manual criterion scope0 / 14 (0%)
Subjects with unknown automated criterion scope0 / 14 (0%)
Group · Verwaltung · Completed evidence

Group · Verwaltung · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 9; Criterion comparison units: 504

Same recorded scope: 6

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations499 / 504 (99%)
Failure observed121 / 504 (24%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations499 / 504 (99%)
Failure observed121 / 504 (24%)
No manual failure observed238 / 504 (47.2%)
Not applicable140 / 504 (27.8%)
Review needed0 / 504 (0%)
Result unknown5 / 504 (1%)
Criteria in equivalent relationships504 / 504 (100%)
Criteria in related relationships0 / 504 (0%)
Criteria without a crosswalk relationship0 / 504 (0%)
Subjects with unknown manual criterion scope0 / 9 (0%)
Subjects with unknown automated criterion scope0 / 9 (0%)
Dimension · Mobile operability · Completed evidence

Dimension · Mobile operability · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 125

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations125 / 125 (100%)
Failure observed0 / 125 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations125 / 125 (100%)
Failure observed0 / 125 (0%)
No manual failure observed26 / 125 (20.8%)
Not applicable99 / 125 (79.2%)
Review needed0 / 125 (0%)
Result unknown0 / 125 (0%)
Criteria in equivalent relationships125 / 125 (100%)
Criteria in related relationships0 / 125 (0%)
Criteria without a crosswalk relationship0 / 125 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Keyboard operability · Completed evidence

Dimension · Keyboard operability · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 150

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations150 / 150 (100%)
Failure observed82 / 150 (54.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations150 / 150 (100%)
Failure observed82 / 150 (54.7%)
No manual failure observed67 / 150 (44.7%)
Not applicable1 / 150 (0.7%)
Review needed0 / 150 (0%)
Result unknown0 / 150 (0%)
Criteria in equivalent relationships150 / 150 (100%)
Criteria in related relationships0 / 150 (0%)
Criteria without a crosswalk relationship0 / 150 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Voice control · Completed evidence

Dimension · Voice control · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 50

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations50 / 50 (100%)
Failure observed13 / 50 (26%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations50 / 50 (100%)
Failure observed13 / 50 (26%)
No manual failure observed34 / 50 (68%)
Not applicable3 / 50 (6%)
Review needed0 / 50 (0%)
Result unknown0 / 50 (0%)
Criteria in equivalent relationships50 / 50 (100%)
Criteria in related relationships0 / 50 (0%)
Criteria without a crosswalk relationship0 / 50 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Compatibility with user agents · Completed evidence

Dimension · Compatibility with user agents · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 75

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations68 / 75 (90.7%)
Failure observed35 / 75 (46.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations68 / 75 (90.7%)
Failure observed35 / 75 (46.7%)
No manual failure observed16 / 75 (21.3%)
Not applicable17 / 75 (22.7%)
Review needed0 / 75 (0%)
Result unknown7 / 75 (9.3%)
Criteria in equivalent relationships75 / 75 (100%)
Criteria in related relationships0 / 75 (0%)
Criteria without a crosswalk relationship0 / 75 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Interaction assistance · Completed evidence

Dimension · Interaction assistance · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 225

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations225 / 225 (100%)
Failure observed55 / 225 (24.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations225 / 225 (100%)
Failure observed55 / 225 (24.4%)
No manual failure observed93 / 225 (41.3%)
Not applicable77 / 225 (34.2%)
Review needed0 / 225 (0%)
Result unknown0 / 225 (0%)
Criteria in equivalent relationships225 / 225 (100%)
Criteria in related relationships0 / 225 (0%)
Criteria without a crosswalk relationship0 / 225 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Consistency and predictability · Completed evidence

Dimension · Consistency and predictability · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 125

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations125 / 125 (100%)
Failure observed2 / 125 (1.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations125 / 125 (100%)
Failure observed2 / 125 (1.6%)
No manual failure observed120 / 125 (96%)
Not applicable3 / 125 (2.4%)
Review needed0 / 125 (0%)
Result unknown0 / 125 (0%)
Criteria in equivalent relationships125 / 125 (100%)
Criteria in related relationships0 / 125 (0%)
Criteria without a crosswalk relationship0 / 125 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Semantic structure · Completed evidence

Dimension · Semantic structure · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 50

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations50 / 50 (100%)
Failure observed29 / 50 (58%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations50 / 50 (100%)
Failure observed29 / 50 (58%)
No manual failure observed21 / 50 (42%)
Not applicable0 / 50 (0%)
Review needed0 / 50 (0%)
Result unknown0 / 50 (0%)
Criteria in equivalent relationships50 / 50 (100%)
Criteria in related relationships0 / 50 (0%)
Criteria without a crosswalk relationship0 / 50 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Understandability · Completed evidence

Dimension · Understandability · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 150

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations150 / 150 (100%)
Failure observed60 / 150 (40%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations150 / 150 (100%)
Failure observed60 / 150 (40%)
No manual failure observed66 / 150 (44%)
Not applicable24 / 150 (16%)
Review needed0 / 150 (0%)
Result unknown0 / 150 (0%)
Criteria in equivalent relationships150 / 150 (100%)
Criteria in related relationships0 / 150 (0%)
Criteria without a crosswalk relationship0 / 150 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Display flexibility · Completed evidence

Dimension · Display flexibility · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 200

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations200 / 200 (100%)
Failure observed42 / 200 (21%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations200 / 200 (100%)
Failure observed42 / 200 (21%)
No manual failure observed123 / 200 (61.5%)
Not applicable35 / 200 (17.5%)
Review needed0 / 200 (0%)
Result unknown0 / 200 (0%)
Criteria in equivalent relationships200 / 200 (100%)
Criteria in related relationships0 / 200 (0%)
Criteria without a crosswalk relationship0 / 200 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Contrast and sensory characteristics · Completed evidence

Dimension · Contrast and sensory characteristics · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 100

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations100 / 100 (100%)
Failure observed32 / 100 (32%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations100 / 100 (100%)
Failure observed32 / 100 (32%)
No manual failure observed64 / 100 (64%)
Not applicable4 / 100 (4%)
Review needed0 / 100 (0%)
Result unknown0 / 100 (0%)
Criteria in equivalent relationships100 / 100 (100%)
Criteria in related relationships0 / 100 (0%)
Criteria without a crosswalk relationship0 / 100 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Non-text content (graphics) · Completed evidence

Dimension · Non-text content (graphics) · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 25

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations25 / 25 (100%)
Failure observed24 / 25 (96%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations25 / 25 (100%)
Failure observed24 / 25 (96%)
No manual failure observed1 / 25 (4%)
Not applicable0 / 25 (0%)
Review needed0 / 25 (0%)
Result unknown0 / 25 (0%)
Criteria in equivalent relationships25 / 25 (100%)
Criteria in related relationships0 / 25 (0%)
Criteria without a crosswalk relationship0 / 25 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Multimedia and two-senses principle (audio/video) · Completed evidence

Dimension · Multimedia and two-senses principle (audio/video) · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 125

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations125 / 125 (100%)
Failure observed18 / 125 (14.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations125 / 125 (100%)
Failure observed18 / 125 (14.4%)
No manual failure observed5 / 125 (4%)
Not applicable102 / 125 (81.6%)
Review needed0 / 125 (0%)
Result unknown0 / 125 (0%)
Criteria in equivalent relationships125 / 125 (100%)
Criteria in related relationships0 / 125 (0%)
Criteria without a crosswalk relationship0 / 125 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Motor skills · Completed evidence

Dimension · Motor skills · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 650

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations643 / 650 (98.9%)
Failure observed179 / 650 (27.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations643 / 650 (98.9%)
Failure observed179 / 650 (27.5%)
No manual failure observed259 / 650 (39.8%)
Not applicable205 / 650 (31.5%)
Review needed0 / 650 (0%)
Result unknown7 / 650 (1.1%)
Criteria in equivalent relationships650 / 650 (100%)
Criteria in related relationships0 / 650 (0%)
Criteria without a crosswalk relationship0 / 650 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Vision · Completed evidence

Dimension · Vision · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 1150

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations1143 / 1150 (99.4%)
Failure observed374 / 1150 (32.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations1143 / 1150 (99.4%)
Failure observed374 / 1150 (32.5%)
No manual failure observed536 / 1150 (46.6%)
Not applicable233 / 1150 (20.3%)
Review needed0 / 1150 (0%)
Result unknown7 / 1150 (0.6%)
Criteria in equivalent relationships1150 / 1150 (100%)
Criteria in related relationships0 / 1150 (0%)
Criteria without a crosswalk relationship0 / 1150 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Hearing · Completed evidence

Dimension · Hearing · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 175

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations175 / 175 (100%)
Failure observed6 / 175 (3.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations175 / 175 (100%)
Failure observed6 / 175 (3.4%)
No manual failure observed39 / 175 (22.3%)
Not applicable130 / 175 (74.3%)
Review needed0 / 175 (0%)
Result unknown0 / 175 (0%)
Criteria in equivalent relationships175 / 175 (100%)
Criteria in related relationships0 / 175 (0%)
Criteria without a crosswalk relationship0 / 175 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Dimension · Cognition · Completed evidence

Dimension · Cognition · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 875

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations875 / 875 (100%)
Failure observed288 / 875 (32.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations875 / 875 (100%)
Failure observed288 / 875 (32.9%)
No manual failure observed410 / 875 (46.9%)
Not applicable177 / 875 (20.2%)
Review needed0 / 875 (0%)
Result unknown0 / 875 (0%)
Criteria in equivalent relationships875 / 875 (100%)
Criteria in related relationships0 / 875 (0%)
Criteria without a crosswalk relationship0 / 875 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Manual requirement group · 1 · Completed evidence

Manual requirement group · 1 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 500

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations500 / 500 (100%)
Failure observed144 / 500 (28.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations500 / 500 (100%)
Failure observed144 / 500 (28.8%)
No manual failure observed196 / 500 (39.2%)
Not applicable160 / 500 (32%)
Review needed0 / 500 (0%)
Result unknown0 / 500 (0%)
Criteria in equivalent relationships500 / 500 (100%)
Criteria in related relationships0 / 500 (0%)
Criteria without a crosswalk relationship0 / 500 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Manual requirement group · 2 · Completed evidence

Manual requirement group · 2 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 500

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations500 / 500 (100%)
Failure observed167 / 500 (33.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations500 / 500 (100%)
Failure observed167 / 500 (33.4%)
No manual failure observed220 / 500 (44%)
Not applicable113 / 500 (22.6%)
Review needed0 / 500 (0%)
Result unknown0 / 500 (0%)
Criteria in equivalent relationships500 / 500 (100%)
Criteria in related relationships0 / 500 (0%)
Criteria without a crosswalk relationship0 / 500 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Manual requirement group · 3 · Completed evidence

Manual requirement group · 3 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 325

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations325 / 325 (100%)
Failure observed46 / 325 (14.2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations325 / 325 (100%)
Failure observed46 / 325 (14.2%)
No manual failure observed204 / 325 (62.8%)
Not applicable75 / 325 (23.1%)
Review needed0 / 325 (0%)
Result unknown0 / 325 (0%)
Criteria in equivalent relationships325 / 325 (100%)
Criteria in related relationships0 / 325 (0%)
Criteria without a crosswalk relationship0 / 325 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Manual requirement group · 4 · Completed evidence

Manual requirement group · 4 · Manually tested subset · Own criterion set · Completed evidence

Study subjects: 25; Criterion comparison units: 75

Same recorded scope: 18

Scope correspondence unknown: 4

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations68 / 75 (90.7%)
Failure observed35 / 75 (46.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations68 / 75 (90.7%)
Failure observed35 / 75 (46.7%)
No manual failure observed16 / 75 (21.3%)
Not applicable17 / 75 (22.7%)
Review needed0 / 75 (0%)
Result unknown7 / 75 (9.3%)
Criteria in equivalent relationships75 / 75 (100%)
Criteria in related relationships0 / 75 (0%)
Criteria without a crosswalk relationship0 / 75 (0%)
Subjects with unknown manual criterion scope0 / 25 (0%)
Subjects with unknown automated criterion scope0 / 25 (0%)
Study subject · Participant 123 · Completed evidence

Study subject · Participant 123 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed22 / 56 (39.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed22 / 56 (39.3%)
No manual failure observed24 / 56 (42.9%)
Not applicable10 / 56 (17.9%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 87 · Completed evidence

Study subject · Participant 87 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed19 / 56 (33.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed19 / 56 (33.9%)
No manual failure observed22 / 56 (39.3%)
Not applicable15 / 56 (26.8%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 29 · Completed evidence

Study subject · Participant 29 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed16 / 56 (28.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed16 / 56 (28.6%)
No manual failure observed25 / 56 (44.6%)
Not applicable15 / 56 (26.8%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 73 · Completed evidence

Study subject · Participant 73 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed23 / 56 (41.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed23 / 56 (41.1%)
No manual failure observed17 / 56 (30.4%)
Not applicable16 / 56 (28.6%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 195 · Completed evidence

Study subject · Participant 195 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed13 / 56 (23.2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed13 / 56 (23.2%)
No manual failure observed23 / 56 (41.1%)
Not applicable19 / 56 (33.9%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 127 · Completed evidence

Study subject · Participant 127 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed22 / 56 (39.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed22 / 56 (39.3%)
No manual failure observed17 / 56 (30.4%)
Not applicable16 / 56 (28.6%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 95 · Completed evidence

Study subject · Participant 95 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed17 / 56 (30.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed17 / 56 (30.4%)
No manual failure observed25 / 56 (44.6%)
Not applicable14 / 56 (25%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 109 · Completed evidence

Study subject · Participant 109 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed17 / 56 (30.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed17 / 56 (30.4%)
No manual failure observed26 / 56 (46.4%)
Not applicable13 / 56 (23.2%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 169 · Completed evidence

Study subject · Participant 169 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed11 / 56 (19.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed11 / 56 (19.6%)
No manual failure observed29 / 56 (51.8%)
Not applicable15 / 56 (26.8%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 163 · Completed evidence

Study subject · Participant 163 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed6 / 56 (10.7%)
No manual failure observed34 / 56 (60.7%)
Not applicable15 / 56 (26.8%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 121 · Completed evidence

Study subject · Participant 121 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed6 / 56 (10.7%)
No manual failure observed34 / 56 (60.7%)
Not applicable16 / 56 (28.6%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 30 · Completed evidence

Study subject · Participant 30 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed21 / 56 (37.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed21 / 56 (37.5%)
No manual failure observed23 / 56 (41.1%)
Not applicable12 / 56 (21.4%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 51 · Completed evidence

Study subject · Participant 51 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed23 / 56 (41.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed23 / 56 (41.1%)
No manual failure observed20 / 56 (35.7%)
Not applicable13 / 56 (23.2%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 05 · Completed evidence

Study subject · Participant 05 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed13 / 56 (23.2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed13 / 56 (23.2%)
No manual failure observed25 / 56 (44.6%)
Not applicable17 / 56 (30.4%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 42 · Completed evidence

Study subject · Participant 42 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed16 / 56 (28.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed16 / 56 (28.6%)
No manual failure observed24 / 56 (42.9%)
Not applicable16 / 56 (28.6%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 178 · Completed evidence

Study subject · Participant 178 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed13 / 56 (23.2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed13 / 56 (23.2%)
No manual failure observed26 / 56 (46.4%)
Not applicable17 / 56 (30.4%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 149 · Completed evidence

Study subject · Participant 149 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed16 / 56 (28.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed16 / 56 (28.6%)
No manual failure observed26 / 56 (46.4%)
Not applicable14 / 56 (25%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 76 · Completed evidence

Study subject · Participant 76 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed12 / 56 (21.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed12 / 56 (21.4%)
No manual failure observed27 / 56 (48.2%)
Not applicable17 / 56 (30.4%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 172 · Completed evidence

Study subject · Participant 172 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed14 / 56 (25%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed14 / 56 (25%)
No manual failure observed31 / 56 (55.4%)
Not applicable11 / 56 (19.6%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 102 · Completed evidence

Study subject · Participant 102 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed11 / 56 (19.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations55 / 56 (98.2%)
Failure observed11 / 56 (19.6%)
No manual failure observed31 / 56 (55.4%)
Not applicable13 / 56 (23.2%)
Review needed0 / 56 (0%)
Result unknown1 / 56 (1.8%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 122 · Completed evidence

Study subject · Participant 122 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed20 / 56 (35.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations56 / 56 (100%)
Failure observed20 / 56 (35.7%)
No manual failure observed24 / 56 (42.9%)
Not applicable12 / 56 (21.4%)
Review needed0 / 56 (0%)
Result unknown0 / 56 (0%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Group · Gesamte Studie · Completed evidence

Group · Gesamte Studie · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 1176

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations1170 / 1176 (99.5%)
Failure observed331 / 1176 (28.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations1170 / 1176 (99.5%)
Failure observed331 / 1176 (28.1%)
No manual failure observed533 / 1176 (45.3%)
Not applicable306 / 1176 (26%)
Review needed0 / 1176 (0%)
Result unknown6 / 1176 (0.5%)
Criteria in equivalent relationships1176 / 1176 (100%)
Criteria in related relationships0 / 1176 (0%)
Criteria without a crosswalk relationship0 / 1176 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Group · Medien · Completed evidence

Group · Medien · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 11; Criterion comparison units: 616

Same recorded scope: 11

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations616 / 616 (100%)
Failure observed197 / 616 (32%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations616 / 616 (100%)
Failure observed197 / 616 (32%)
No manual failure observed270 / 616 (43.8%)
Not applicable149 / 616 (24.2%)
Review needed0 / 616 (0%)
Result unknown0 / 616 (0%)
Criteria in equivalent relationships616 / 616 (100%)
Criteria in related relationships0 / 616 (0%)
Criteria without a crosswalk relationship0 / 616 (0%)
Subjects with unknown manual criterion scope0 / 11 (0%)
Subjects with unknown automated criterion scope0 / 11 (0%)
Group · Verwaltung · Completed evidence

Group · Verwaltung · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 9; Criterion comparison units: 504

Same recorded scope: 6

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations499 / 504 (99%)
Failure observed121 / 504 (24%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations499 / 504 (99%)
Failure observed121 / 504 (24%)
No manual failure observed238 / 504 (47.2%)
Not applicable140 / 504 (27.8%)
Review needed0 / 504 (0%)
Result unknown5 / 504 (1%)
Criteria in equivalent relationships504 / 504 (100%)
Criteria in related relationships0 / 504 (0%)
Criteria without a crosswalk relationship0 / 504 (0%)
Subjects with unknown manual criterion scope0 / 9 (0%)
Subjects with unknown automated criterion scope0 / 9 (0%)
Dimension · Mobile operability · Completed evidence

Dimension · Mobile operability · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 105

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations105 / 105 (100%)
Failure observed0 / 105 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations105 / 105 (100%)
Failure observed0 / 105 (0%)
No manual failure observed22 / 105 (21%)
Not applicable83 / 105 (79%)
Review needed0 / 105 (0%)
Result unknown0 / 105 (0%)
Criteria in equivalent relationships105 / 105 (100%)
Criteria in related relationships0 / 105 (0%)
Criteria without a crosswalk relationship0 / 105 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Keyboard operability · Completed evidence

Dimension · Keyboard operability · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 126

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations126 / 126 (100%)
Failure observed68 / 126 (54%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations126 / 126 (100%)
Failure observed68 / 126 (54%)
No manual failure observed57 / 126 (45.2%)
Not applicable1 / 126 (0.8%)
Review needed0 / 126 (0%)
Result unknown0 / 126 (0%)
Criteria in equivalent relationships126 / 126 (100%)
Criteria in related relationships0 / 126 (0%)
Criteria without a crosswalk relationship0 / 126 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Voice control · Completed evidence

Dimension · Voice control · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 42

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations42 / 42 (100%)
Failure observed9 / 42 (21.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations42 / 42 (100%)
Failure observed9 / 42 (21.4%)
No manual failure observed30 / 42 (71.4%)
Not applicable3 / 42 (7.1%)
Review needed0 / 42 (0%)
Result unknown0 / 42 (0%)
Criteria in equivalent relationships42 / 42 (100%)
Criteria in related relationships0 / 42 (0%)
Criteria without a crosswalk relationship0 / 42 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Compatibility with user agents · Completed evidence

Dimension · Compatibility with user agents · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 63

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations57 / 63 (90.5%)
Failure observed31 / 63 (49.2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations57 / 63 (90.5%)
Failure observed31 / 63 (49.2%)
No manual failure observed12 / 63 (19%)
Not applicable14 / 63 (22.2%)
Review needed0 / 63 (0%)
Result unknown6 / 63 (9.5%)
Criteria in equivalent relationships63 / 63 (100%)
Criteria in related relationships0 / 63 (0%)
Criteria without a crosswalk relationship0 / 63 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Interaction assistance · Completed evidence

Dimension · Interaction assistance · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 189

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations189 / 189 (100%)
Failure observed49 / 189 (25.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations189 / 189 (100%)
Failure observed49 / 189 (25.9%)
No manual failure observed78 / 189 (41.3%)
Not applicable62 / 189 (32.8%)
Review needed0 / 189 (0%)
Result unknown0 / 189 (0%)
Criteria in equivalent relationships189 / 189 (100%)
Criteria in related relationships0 / 189 (0%)
Criteria without a crosswalk relationship0 / 189 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Consistency and predictability · Completed evidence

Dimension · Consistency and predictability · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 105

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations105 / 105 (100%)
Failure observed2 / 105 (1.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations105 / 105 (100%)
Failure observed2 / 105 (1.9%)
No manual failure observed100 / 105 (95.2%)
Not applicable3 / 105 (2.9%)
Review needed0 / 105 (0%)
Result unknown0 / 105 (0%)
Criteria in equivalent relationships105 / 105 (100%)
Criteria in related relationships0 / 105 (0%)
Criteria without a crosswalk relationship0 / 105 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Semantic structure · Completed evidence

Dimension · Semantic structure · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 42

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations42 / 42 (100%)
Failure observed25 / 42 (59.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations42 / 42 (100%)
Failure observed25 / 42 (59.5%)
No manual failure observed17 / 42 (40.5%)
Not applicable0 / 42 (0%)
Review needed0 / 42 (0%)
Result unknown0 / 42 (0%)
Criteria in equivalent relationships42 / 42 (100%)
Criteria in related relationships0 / 42 (0%)
Criteria without a crosswalk relationship0 / 42 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Understandability · Completed evidence

Dimension · Understandability · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 126

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations126 / 126 (100%)
Failure observed49 / 126 (38.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations126 / 126 (100%)
Failure observed49 / 126 (38.9%)
No manual failure observed57 / 126 (45.2%)
Not applicable20 / 126 (15.9%)
Review needed0 / 126 (0%)
Result unknown0 / 126 (0%)
Criteria in equivalent relationships126 / 126 (100%)
Criteria in related relationships0 / 126 (0%)
Criteria without a crosswalk relationship0 / 126 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Display flexibility · Completed evidence

Dimension · Display flexibility · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 168

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations168 / 168 (100%)
Failure observed35 / 168 (20.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations168 / 168 (100%)
Failure observed35 / 168 (20.8%)
No manual failure observed103 / 168 (61.3%)
Not applicable30 / 168 (17.9%)
Review needed0 / 168 (0%)
Result unknown0 / 168 (0%)
Criteria in equivalent relationships168 / 168 (100%)
Criteria in related relationships0 / 168 (0%)
Criteria without a crosswalk relationship0 / 168 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Contrast and sensory characteristics · Completed evidence

Dimension · Contrast and sensory characteristics · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 84

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations84 / 84 (100%)
Failure observed28 / 84 (33.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations84 / 84 (100%)
Failure observed28 / 84 (33.3%)
No manual failure observed52 / 84 (61.9%)
Not applicable4 / 84 (4.8%)
Review needed0 / 84 (0%)
Result unknown0 / 84 (0%)
Criteria in equivalent relationships84 / 84 (100%)
Criteria in related relationships0 / 84 (0%)
Criteria without a crosswalk relationship0 / 84 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Non-text content (graphics) · Completed evidence

Dimension · Non-text content (graphics) · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 21

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations21 / 21 (100%)
Failure observed20 / 21 (95.2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations21 / 21 (100%)
Failure observed20 / 21 (95.2%)
No manual failure observed1 / 21 (4.8%)
Not applicable0 / 21 (0%)
Review needed0 / 21 (0%)
Result unknown0 / 21 (0%)
Criteria in equivalent relationships21 / 21 (100%)
Criteria in related relationships0 / 21 (0%)
Criteria without a crosswalk relationship0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Multimedia and two-senses principle (audio/video) · Completed evidence

Dimension · Multimedia and two-senses principle (audio/video) · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 105

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations105 / 105 (100%)
Failure observed15 / 105 (14.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations105 / 105 (100%)
Failure observed15 / 105 (14.3%)
No manual failure observed4 / 105 (3.8%)
Not applicable86 / 105 (81.9%)
Review needed0 / 105 (0%)
Result unknown0 / 105 (0%)
Criteria in equivalent relationships105 / 105 (100%)
Criteria in related relationships0 / 105 (0%)
Criteria without a crosswalk relationship0 / 105 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Motor skills · Completed evidence

Dimension · Motor skills · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 546

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations540 / 546 (98.9%)
Failure observed149 / 546 (27.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations540 / 546 (98.9%)
Failure observed149 / 546 (27.3%)
No manual failure observed220 / 546 (40.3%)
Not applicable171 / 546 (31.3%)
Review needed0 / 546 (0%)
Result unknown6 / 546 (1.1%)
Criteria in equivalent relationships546 / 546 (100%)
Criteria in related relationships0 / 546 (0%)
Criteria without a crosswalk relationship0 / 546 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Vision · Completed evidence

Dimension · Vision · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 966

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations960 / 966 (99.4%)
Failure observed314 / 966 (32.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations960 / 966 (99.4%)
Failure observed314 / 966 (32.5%)
No manual failure observed449 / 966 (46.5%)
Not applicable197 / 966 (20.4%)
Review needed0 / 966 (0%)
Result unknown6 / 966 (0.6%)
Criteria in equivalent relationships966 / 966 (100%)
Criteria in related relationships0 / 966 (0%)
Criteria without a crosswalk relationship0 / 966 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Hearing · Completed evidence

Dimension · Hearing · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 147

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations147 / 147 (100%)
Failure observed5 / 147 (3.4%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations147 / 147 (100%)
Failure observed5 / 147 (3.4%)
No manual failure observed33 / 147 (22.4%)
Not applicable109 / 147 (74.1%)
Review needed0 / 147 (0%)
Result unknown0 / 147 (0%)
Criteria in equivalent relationships147 / 147 (100%)
Criteria in related relationships0 / 147 (0%)
Criteria without a crosswalk relationship0 / 147 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Cognition · Completed evidence

Dimension · Cognition · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 735

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations735 / 735 (100%)
Failure observed246 / 735 (33.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations735 / 735 (100%)
Failure observed246 / 735 (33.5%)
No manual failure observed342 / 735 (46.5%)
Not applicable147 / 735 (20%)
Review needed0 / 735 (0%)
Result unknown0 / 735 (0%)
Criteria in equivalent relationships735 / 735 (100%)
Criteria in related relationships0 / 735 (0%)
Criteria without a crosswalk relationship0 / 735 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Manual requirement group · 1 · Completed evidence

Manual requirement group · 1 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 420

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations420 / 420 (100%)
Failure observed125 / 420 (29.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations420 / 420 (100%)
Failure observed125 / 420 (29.8%)
No manual failure observed160 / 420 (38.1%)
Not applicable135 / 420 (32.1%)
Review needed0 / 420 (0%)
Result unknown0 / 420 (0%)
Criteria in equivalent relationships420 / 420 (100%)
Criteria in related relationships0 / 420 (0%)
Criteria without a crosswalk relationship0 / 420 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Manual requirement group · 2 · Completed evidence

Manual requirement group · 2 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 420

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations420 / 420 (100%)
Failure observed134 / 420 (31.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations420 / 420 (100%)
Failure observed134 / 420 (31.9%)
No manual failure observed190 / 420 (45.2%)
Not applicable96 / 420 (22.9%)
Review needed0 / 420 (0%)
Result unknown0 / 420 (0%)
Criteria in equivalent relationships420 / 420 (100%)
Criteria in related relationships0 / 420 (0%)
Criteria without a crosswalk relationship0 / 420 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Manual requirement group · 3 · Completed evidence

Manual requirement group · 3 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 273

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations273 / 273 (100%)
Failure observed41 / 273 (15%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations273 / 273 (100%)
Failure observed41 / 273 (15%)
No manual failure observed171 / 273 (62.6%)
Not applicable61 / 273 (22.3%)
Review needed0 / 273 (0%)
Result unknown0 / 273 (0%)
Criteria in equivalent relationships273 / 273 (100%)
Criteria in related relationships0 / 273 (0%)
Criteria without a crosswalk relationship0 / 273 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Manual requirement group · 4 · Completed evidence

Manual requirement group · 4 · Common subjects – manual · Own criterion set · Completed evidence

Study subjects: 21; Criterion comparison units: 63

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations57 / 63 (90.5%)
Failure observed31 / 63 (49.2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with manual observations57 / 63 (90.5%)
Failure observed31 / 63 (49.2%)
No manual failure observed12 / 63 (19%)
Not applicable14 / 63 (22.2%)
Review needed0 / 63 (0%)
Result unknown6 / 63 (9.5%)
Criteria in equivalent relationships63 / 63 (100%)
Criteria in related relationships0 / 63 (0%)
Criteria without a crosswalk relationship0 / 63 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Study subject · Participant 123 · Selected runs

Study subject · Participant 123 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed10 / 56 (17.9%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 87 · Selected runs

Study subject · Participant 87 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed8 / 56 (14.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed8 / 56 (14.3%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed10 / 56 (17.9%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 29 · Selected runs

Study subject · Participant 29 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 73 · Selected runs

Study subject · Participant 73 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed13 / 56 (23.2%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 195 · Selected runs

Study subject · Participant 195 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed2 / 56 (3.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed2 / 56 (3.6%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed14 / 56 (25%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 127 · Selected runs

Study subject · Participant 127 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 95 · Selected runs

Study subject · Participant 95 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed9 / 56 (16.1%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 109 · Selected runs

Study subject · Participant 109 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed10 / 56 (17.9%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 169 · Selected runs

Study subject · Participant 169 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed10 / 56 (17.9%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 163 · Selected runs

Study subject · Participant 163 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed0 / 56 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed0 / 56 (0%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed4 / 56 (7.1%)
Partly assessed13 / 56 (23.2%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 121 · Selected runs

Study subject · Participant 121 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed1 / 56 (1.8%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed1 / 56 (1.8%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed15 / 56 (26.8%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 30 · Selected runs

Study subject · Participant 30 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 51 · Selected runs

Study subject · Participant 51 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed7 / 56 (12.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed7 / 56 (12.5%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed9 / 56 (16.1%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 05 · Selected runs

Study subject · Participant 05 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed12 / 56 (21.4%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 42 · Selected runs

Study subject · Participant 42 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed10 / 56 (17.9%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 178 · Selected runs

Study subject · Participant 178 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 149 · Selected runs

Study subject · Participant 149 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed5 / 56 (8.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed5 / 56 (8.9%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed1 / 56 (1.8%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 76 · Selected runs

Study subject · Participant 76 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed0 / 56 (0%)
Partly assessed14 / 56 (25%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 172 · Selected runs

Study subject · Participant 172 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed6 / 56 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed6 / 56 (10.7%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed9 / 56 (16.1%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 102 · Selected runs

Study subject · Participant 102 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed4 / 56 (7.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed4 / 56 (7.1%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed11 / 56 (19.6%)
Result unknown1 / 56 (1.8%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 122 · Selected runs

Study subject · Participant 122 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Failure observed7 / 56 (12.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Execution progress of mapped checks0 / 18 (0%)
Failure observed7 / 56 (12.5%)
Mapped checks passed0 / 56 (0%)
No failure reported by validator0 / 56 (0%)
Not applicable0 / 56 (0%)
Review needed2 / 56 (3.6%)
Partly assessed9 / 56 (16.1%)
Result unknown0 / 56 (0%)
No mapped check38 / 56 (67.9%)
Criteria in equivalent relationships56 / 56 (100%)
Criteria in related relationships0 / 56 (0%)
Criteria without a crosswalk relationship0 / 56 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Group · Gesamte Studie · Selected runs

Group · Gesamte Studie · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 1176

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks378 / 1176 (32.1%)
Comparison units with complete mapped checks0 / 1176 (0%)
Failure observed102 / 1176 (8.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks378 / 1176 (32.1%)
Comparison units with complete mapped checks0 / 1176 (0%)
Execution progress of mapped checks0 / 378 (0%)
Failure observed102 / 1176 (8.7%)
Mapped checks passed0 / 1176 (0%)
No failure reported by validator0 / 1176 (0%)
Not applicable0 / 1176 (0%)
Review needed27 / 1176 (2.3%)
Partly assessed233 / 1176 (19.8%)
Result unknown16 / 1176 (1.4%)
No mapped check798 / 1176 (67.9%)
Criteria in equivalent relationships1176 / 1176 (100%)
Criteria in related relationships0 / 1176 (0%)
Criteria without a crosswalk relationship0 / 1176 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Group · Medien · Selected runs

Group · Medien · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 11; Criterion comparison units: 616

Same recorded scope: 11

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks198 / 616 (32.1%)
Comparison units with complete mapped checks0 / 616 (0%)
Failure observed65 / 616 (10.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks198 / 616 (32.1%)
Comparison units with complete mapped checks0 / 616 (0%)
Execution progress of mapped checks0 / 198 (0%)
Failure observed65 / 616 (10.6%)
Mapped checks passed0 / 616 (0%)
No failure reported by validator0 / 616 (0%)
Not applicable0 / 616 (0%)
Review needed14 / 616 (2.3%)
Partly assessed110 / 616 (17.9%)
Result unknown9 / 616 (1.5%)
No mapped check418 / 616 (67.9%)
Criteria in equivalent relationships616 / 616 (100%)
Criteria in related relationships0 / 616 (0%)
Criteria without a crosswalk relationship0 / 616 (0%)
Subjects with unknown manual criterion scope0 / 11 (0%)
Subjects with unknown automated criterion scope0 / 11 (0%)
Group · Verwaltung · Selected runs

Group · Verwaltung · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 9; Criterion comparison units: 504

Same recorded scope: 6

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks162 / 504 (32.1%)
Comparison units with complete mapped checks0 / 504 (0%)
Failure observed32 / 504 (6.3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks162 / 504 (32.1%)
Comparison units with complete mapped checks0 / 504 (0%)
Execution progress of mapped checks0 / 162 (0%)
Failure observed32 / 504 (6.3%)
Mapped checks passed0 / 504 (0%)
No failure reported by validator0 / 504 (0%)
Not applicable0 / 504 (0%)
Review needed12 / 504 (2.4%)
Partly assessed111 / 504 (22%)
Result unknown7 / 504 (1.4%)
No mapped check342 / 504 (67.9%)
Criteria in equivalent relationships504 / 504 (100%)
Criteria in related relationships0 / 504 (0%)
Criteria without a crosswalk relationship0 / 504 (0%)
Subjects with unknown manual criterion scope0 / 9 (0%)
Subjects with unknown automated criterion scope0 / 9 (0%)
Dimension · Mobile operability · Selected runs

Dimension · Mobile operability · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 105

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks0 / 105 (0%)
Comparison units with complete mapped checks0 / 105 (0%)
Failure observed0 / 105 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks0 / 105 (0%)
Comparison units with complete mapped checks0 / 105 (0%)
Execution progress of mapped checks0 / 0 (Unknown)
Failure observed0 / 105 (0%)
Mapped checks passed0 / 105 (0%)
No failure reported by validator0 / 105 (0%)
Not applicable0 / 105 (0%)
Review needed0 / 105 (0%)
Partly assessed0 / 105 (0%)
Result unknown0 / 105 (0%)
No mapped check105 / 105 (100%)
Criteria in equivalent relationships105 / 105 (100%)
Criteria in related relationships0 / 105 (0%)
Criteria without a crosswalk relationship0 / 105 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Keyboard operability · Selected runs

Dimension · Keyboard operability · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 126

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks42 / 126 (33.3%)
Comparison units with complete mapped checks0 / 126 (0%)
Failure observed2 / 126 (1.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks42 / 126 (33.3%)
Comparison units with complete mapped checks0 / 126 (0%)
Execution progress of mapped checks0 / 42 (0%)
Failure observed2 / 126 (1.6%)
Mapped checks passed0 / 126 (0%)
No failure reported by validator0 / 126 (0%)
Not applicable0 / 126 (0%)
Review needed6 / 126 (4.8%)
Partly assessed34 / 126 (27%)
Result unknown0 / 126 (0%)
No mapped check84 / 126 (66.7%)
Criteria in equivalent relationships126 / 126 (100%)
Criteria in related relationships0 / 126 (0%)
Criteria without a crosswalk relationship0 / 126 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Voice control · Selected runs

Dimension · Voice control · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 42

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks0 / 42 (0%)
Comparison units with complete mapped checks0 / 42 (0%)
Failure observed0 / 42 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks0 / 42 (0%)
Comparison units with complete mapped checks0 / 42 (0%)
Execution progress of mapped checks0 / 0 (Unknown)
Failure observed0 / 42 (0%)
Mapped checks passed0 / 42 (0%)
No failure reported by validator0 / 42 (0%)
Not applicable0 / 42 (0%)
Review needed0 / 42 (0%)
Partly assessed0 / 42 (0%)
Result unknown0 / 42 (0%)
No mapped check42 / 42 (100%)
Criteria in equivalent relationships42 / 42 (100%)
Criteria in related relationships0 / 42 (0%)
Criteria without a crosswalk relationship0 / 42 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Compatibility with user agents · Selected runs

Dimension · Compatibility with user agents · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 63

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks21 / 63 (33.3%)
Comparison units with complete mapped checks0 / 63 (0%)
Failure observed19 / 63 (30.2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks21 / 63 (33.3%)
Comparison units with complete mapped checks0 / 63 (0%)
Execution progress of mapped checks0 / 21 (0%)
Failure observed19 / 63 (30.2%)
Mapped checks passed0 / 63 (0%)
No failure reported by validator0 / 63 (0%)
Not applicable0 / 63 (0%)
Review needed1 / 63 (1.6%)
Partly assessed1 / 63 (1.6%)
Result unknown0 / 63 (0%)
No mapped check42 / 63 (66.7%)
Criteria in equivalent relationships63 / 63 (100%)
Criteria in related relationships0 / 63 (0%)
Criteria without a crosswalk relationship0 / 63 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Interaction assistance · Selected runs

Dimension · Interaction assistance · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 189

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks42 / 189 (22.2%)
Comparison units with complete mapped checks0 / 189 (0%)
Failure observed0 / 189 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks42 / 189 (22.2%)
Comparison units with complete mapped checks0 / 189 (0%)
Execution progress of mapped checks0 / 42 (0%)
Failure observed0 / 189 (0%)
Mapped checks passed0 / 189 (0%)
No failure reported by validator0 / 189 (0%)
Not applicable0 / 189 (0%)
Review needed1 / 189 (0.5%)
Partly assessed41 / 189 (21.7%)
Result unknown0 / 189 (0%)
No mapped check147 / 189 (77.8%)
Criteria in equivalent relationships189 / 189 (100%)
Criteria in related relationships0 / 189 (0%)
Criteria without a crosswalk relationship0 / 189 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Consistency and predictability · Selected runs

Dimension · Consistency and predictability · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 105

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks0 / 105 (0%)
Comparison units with complete mapped checks0 / 105 (0%)
Failure observed0 / 105 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks0 / 105 (0%)
Comparison units with complete mapped checks0 / 105 (0%)
Execution progress of mapped checks0 / 0 (Unknown)
Failure observed0 / 105 (0%)
Mapped checks passed0 / 105 (0%)
No failure reported by validator0 / 105 (0%)
Not applicable0 / 105 (0%)
Review needed0 / 105 (0%)
Partly assessed0 / 105 (0%)
Result unknown0 / 105 (0%)
No mapped check105 / 105 (100%)
Criteria in equivalent relationships105 / 105 (100%)
Criteria in related relationships0 / 105 (0%)
Criteria without a crosswalk relationship0 / 105 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Semantic structure · Selected runs

Dimension · Semantic structure · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 42

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks21 / 42 (50%)
Comparison units with complete mapped checks0 / 42 (0%)
Failure observed4 / 42 (9.5%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks21 / 42 (50%)
Comparison units with complete mapped checks0 / 42 (0%)
Execution progress of mapped checks0 / 21 (0%)
Failure observed4 / 42 (9.5%)
Mapped checks passed0 / 42 (0%)
No failure reported by validator0 / 42 (0%)
Not applicable0 / 42 (0%)
Review needed1 / 42 (2.4%)
Partly assessed0 / 42 (0%)
Result unknown16 / 42 (38.1%)
No mapped check21 / 42 (50%)
Criteria in equivalent relationships42 / 42 (100%)
Criteria in related relationships0 / 42 (0%)
Criteria without a crosswalk relationship0 / 42 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Understandability · Selected runs

Dimension · Understandability · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 126

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks84 / 126 (66.7%)
Comparison units with complete mapped checks0 / 126 (0%)
Failure observed43 / 126 (34.1%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks84 / 126 (66.7%)
Comparison units with complete mapped checks0 / 126 (0%)
Execution progress of mapped checks0 / 84 (0%)
Failure observed43 / 126 (34.1%)
Mapped checks passed0 / 126 (0%)
No failure reported by validator0 / 126 (0%)
Not applicable0 / 126 (0%)
Review needed0 / 126 (0%)
Partly assessed41 / 126 (32.5%)
Result unknown0 / 126 (0%)
No mapped check42 / 126 (33.3%)
Criteria in equivalent relationships126 / 126 (100%)
Criteria in related relationships0 / 126 (0%)
Criteria without a crosswalk relationship0 / 126 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Display flexibility · Selected runs

Dimension · Display flexibility · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 168

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks63 / 168 (37.5%)
Comparison units with complete mapped checks0 / 168 (0%)
Failure observed5 / 168 (3%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks63 / 168 (37.5%)
Comparison units with complete mapped checks0 / 168 (0%)
Execution progress of mapped checks0 / 63 (0%)
Failure observed5 / 168 (3%)
Mapped checks passed0 / 168 (0%)
No failure reported by validator0 / 168 (0%)
Not applicable0 / 168 (0%)
Review needed1 / 168 (0.6%)
Partly assessed57 / 168 (33.9%)
Result unknown0 / 168 (0%)
No mapped check105 / 168 (62.5%)
Criteria in equivalent relationships168 / 168 (100%)
Criteria in related relationships0 / 168 (0%)
Criteria without a crosswalk relationship0 / 168 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Contrast and sensory characteristics · Selected runs

Dimension · Contrast and sensory characteristics · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 84

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks42 / 84 (50%)
Comparison units with complete mapped checks0 / 84 (0%)
Failure observed16 / 84 (19%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks42 / 84 (50%)
Comparison units with complete mapped checks0 / 84 (0%)
Execution progress of mapped checks0 / 42 (0%)
Failure observed16 / 84 (19%)
Mapped checks passed0 / 84 (0%)
No failure reported by validator0 / 84 (0%)
Not applicable0 / 84 (0%)
Review needed12 / 84 (14.3%)
Partly assessed14 / 84 (16.7%)
Result unknown0 / 84 (0%)
No mapped check42 / 84 (50%)
Criteria in equivalent relationships84 / 84 (100%)
Criteria in related relationships0 / 84 (0%)
Criteria without a crosswalk relationship0 / 84 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Non-text content (graphics) · Selected runs

Dimension · Non-text content (graphics) · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 21

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks21 / 21 (100%)
Comparison units with complete mapped checks0 / 21 (0%)
Failure observed13 / 21 (61.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks21 / 21 (100%)
Comparison units with complete mapped checks0 / 21 (0%)
Execution progress of mapped checks0 / 21 (0%)
Failure observed13 / 21 (61.9%)
Mapped checks passed0 / 21 (0%)
No failure reported by validator0 / 21 (0%)
Not applicable0 / 21 (0%)
Review needed0 / 21 (0%)
Partly assessed8 / 21 (38.1%)
Result unknown0 / 21 (0%)
No mapped check0 / 21 (0%)
Criteria in equivalent relationships21 / 21 (100%)
Criteria in related relationships0 / 21 (0%)
Criteria without a crosswalk relationship0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Multimedia and two-senses principle (audio/video) · Selected runs

Dimension · Multimedia and two-senses principle (audio/video) · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 105

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks42 / 105 (40%)
Comparison units with complete mapped checks0 / 105 (0%)
Failure observed0 / 105 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks42 / 105 (40%)
Comparison units with complete mapped checks0 / 105 (0%)
Execution progress of mapped checks0 / 42 (0%)
Failure observed0 / 105 (0%)
Mapped checks passed0 / 105 (0%)
No failure reported by validator0 / 105 (0%)
Not applicable0 / 105 (0%)
Review needed5 / 105 (4.8%)
Partly assessed37 / 105 (35.2%)
Result unknown0 / 105 (0%)
No mapped check63 / 105 (60%)
Criteria in equivalent relationships105 / 105 (100%)
Criteria in related relationships0 / 105 (0%)
Criteria without a crosswalk relationship0 / 105 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Motor skills · Selected runs

Dimension · Motor skills · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 546

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks126 / 546 (23.1%)
Comparison units with complete mapped checks0 / 546 (0%)
Failure observed33 / 546 (6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks126 / 546 (23.1%)
Comparison units with complete mapped checks0 / 546 (0%)
Execution progress of mapped checks0 / 126 (0%)
Failure observed33 / 546 (6%)
Mapped checks passed0 / 546 (0%)
No failure reported by validator0 / 546 (0%)
Not applicable0 / 546 (0%)
Review needed8 / 546 (1.5%)
Partly assessed85 / 546 (15.6%)
Result unknown0 / 546 (0%)
No mapped check420 / 546 (76.9%)
Criteria in equivalent relationships546 / 546 (100%)
Criteria in related relationships0 / 546 (0%)
Criteria without a crosswalk relationship0 / 546 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Vision · Selected runs

Dimension · Vision · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 966

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks357 / 966 (37%)
Comparison units with complete mapped checks0 / 966 (0%)
Failure observed102 / 966 (10.6%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks357 / 966 (37%)
Comparison units with complete mapped checks0 / 966 (0%)
Execution progress of mapped checks0 / 357 (0%)
Failure observed102 / 966 (10.6%)
Mapped checks passed0 / 966 (0%)
No failure reported by validator0 / 966 (0%)
Not applicable0 / 966 (0%)
Review needed23 / 966 (2.4%)
Partly assessed216 / 966 (22.4%)
Result unknown16 / 966 (1.7%)
No mapped check609 / 966 (63%)
Criteria in equivalent relationships966 / 966 (100%)
Criteria in related relationships0 / 966 (0%)
Criteria without a crosswalk relationship0 / 966 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Hearing · Selected runs

Dimension · Hearing · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 147

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks84 / 147 (57.1%)
Comparison units with complete mapped checks0 / 147 (0%)
Failure observed0 / 147 (0%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks84 / 147 (57.1%)
Comparison units with complete mapped checks0 / 147 (0%)
Execution progress of mapped checks0 / 84 (0%)
Failure observed0 / 147 (0%)
Mapped checks passed0 / 147 (0%)
No failure reported by validator0 / 147 (0%)
Not applicable0 / 147 (0%)
Review needed6 / 147 (4.1%)
Partly assessed78 / 147 (53.1%)
Result unknown0 / 147 (0%)
No mapped check63 / 147 (42.9%)
Criteria in equivalent relationships147 / 147 (100%)
Criteria in related relationships0 / 147 (0%)
Criteria without a crosswalk relationship0 / 147 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Cognition · Selected runs

Dimension · Cognition · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 735

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks252 / 735 (34.3%)
Comparison units with complete mapped checks0 / 735 (0%)
Failure observed79 / 735 (10.7%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks252 / 735 (34.3%)
Comparison units with complete mapped checks0 / 735 (0%)
Execution progress of mapped checks0 / 252 (0%)
Failure observed79 / 735 (10.7%)
Mapped checks passed0 / 735 (0%)
No failure reported by validator0 / 735 (0%)
Not applicable0 / 735 (0%)
Review needed10 / 735 (1.4%)
Partly assessed147 / 735 (20%)
Result unknown16 / 735 (2.2%)
No mapped check483 / 735 (65.7%)
Criteria in equivalent relationships735 / 735 (100%)
Criteria in related relationships0 / 735 (0%)
Criteria without a crosswalk relationship0 / 735 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Automated requirement group · 1 · Selected runs

Automated requirement group · 1 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 420

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks168 / 420 (40%)
Comparison units with complete mapped checks0 / 420 (0%)
Failure observed38 / 420 (9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks168 / 420 (40%)
Comparison units with complete mapped checks0 / 420 (0%)
Execution progress of mapped checks0 / 168 (0%)
Failure observed38 / 420 (9%)
Mapped checks passed0 / 420 (0%)
No failure reported by validator0 / 420 (0%)
Not applicable0 / 420 (0%)
Review needed19 / 420 (4.5%)
Partly assessed95 / 420 (22.6%)
Result unknown16 / 420 (3.8%)
No mapped check252 / 420 (60%)
Criteria in equivalent relationships420 / 420 (100%)
Criteria in related relationships0 / 420 (0%)
Criteria without a crosswalk relationship0 / 420 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Automated requirement group · 3 · Selected runs

Automated requirement group · 3 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 273

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks63 / 273 (23.1%)
Comparison units with complete mapped checks0 / 273 (0%)
Failure observed16 / 273 (5.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks63 / 273 (23.1%)
Comparison units with complete mapped checks0 / 273 (0%)
Execution progress of mapped checks0 / 63 (0%)
Failure observed16 / 273 (5.9%)
Mapped checks passed0 / 273 (0%)
No failure reported by validator0 / 273 (0%)
Not applicable0 / 273 (0%)
Review needed1 / 273 (0.4%)
Partly assessed46 / 273 (16.8%)
Result unknown0 / 273 (0%)
No mapped check210 / 273 (76.9%)
Criteria in equivalent relationships273 / 273 (100%)
Criteria in related relationships0 / 273 (0%)
Criteria without a crosswalk relationship0 / 273 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Automated requirement group · 4 · Selected runs

Automated requirement group · 4 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 63

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks21 / 63 (33.3%)
Comparison units with complete mapped checks0 / 63 (0%)
Failure observed19 / 63 (30.2%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks21 / 63 (33.3%)
Comparison units with complete mapped checks0 / 63 (0%)
Execution progress of mapped checks0 / 21 (0%)
Failure observed19 / 63 (30.2%)
Mapped checks passed0 / 63 (0%)
No failure reported by validator0 / 63 (0%)
Not applicable0 / 63 (0%)
Review needed1 / 63 (1.6%)
Partly assessed1 / 63 (1.6%)
Result unknown0 / 63 (0%)
No mapped check42 / 63 (66.7%)
Criteria in equivalent relationships63 / 63 (100%)
Criteria in related relationships0 / 63 (0%)
Criteria without a crosswalk relationship0 / 63 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Automated requirement group · 2 · Selected runs

Automated requirement group · 2 · Common subjects – automated · Own criterion set · Selected runs

Study subjects: 21; Criterion comparison units: 420

Same recorded scope: 18

Different assessed scopes: 3

Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks126 / 420 (30%)
Comparison units with complete mapped checks0 / 420 (0%)
Failure observed29 / 420 (6.9%)
Comparison measures
Comparison measures
MeasureCount / denominator (share)
Comparison units with mapped automated checks126 / 420 (30%)
Comparison units with complete mapped checks0 / 420 (0%)
Execution progress of mapped checks0 / 126 (0%)
Failure observed29 / 420 (6.9%)
Mapped checks passed0 / 420 (0%)
No failure reported by validator0 / 420 (0%)
Not applicable0 / 420 (0%)
Review needed6 / 420 (1.4%)
Partly assessed91 / 420 (21.7%)
Result unknown0 / 420 (0%)
No mapped check294 / 420 (70%)
Criteria in equivalent relationships420 / 420 (100%)
Criteria in related relationships0 / 420 (0%)
Criteria without a crosswalk relationship0 / 420 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Study subject · Participant 123 · Completed evidence

Study subject · Participant 123 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results5 / 5 (100%)
No automated check mapped11 / 22 (50%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation5 / 22 (22.7%)
Manual failure; all mapped automated checks passed0 / 22 (0%)
Manual failure; automated checks inapplicable0 / 22 (0%)
Manual violation; no configured automated rule11 / 22 (50%)
Manual violation; automated review required0 / 22 (0%)
Manual violation; automated evidence unavailable6 / 22 (27.3%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually17 / 23 (73.9%)
Failure recorded by both methods5 / 23 (21.7%)
Violation recorded only automatically1 / 23 (4.3%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures5 / 22 (22.7%)
Agreement among violation or passed-check results5 / 5 (100%)
Manual failure with passed checks (conditional share)0 / 5 (0%)
Failure recorded only manually17 / 23 (73.9%)
Failure recorded by both methods5 / 23 (21.7%)
Violation recorded only automatically1 / 23 (4.3%)
Comparison units with manual failures22 / 56 (39.3%)
Review needed or insufficient evidence6 / 22 (27.3%)
No automated check mapped11 / 22 (50%)
Applicability disagreement0 / 22 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 87 · Completed evidence

Study subject · Participant 87 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results6 / 6 (100%)
No automated check mapped10 / 19 (52.6%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation6 / 19 (31.6%)
Manual failure; all mapped automated checks passed0 / 19 (0%)
Manual failure; automated checks inapplicable0 / 19 (0%)
Manual violation; no configured automated rule10 / 19 (52.6%)
Manual violation; automated review required0 / 19 (0%)
Manual violation; automated evidence unavailable3 / 19 (15.8%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually13 / 21 (61.9%)
Failure recorded by both methods6 / 21 (28.6%)
Violation recorded only automatically2 / 21 (9.5%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures6 / 19 (31.6%)
Agreement among violation or passed-check results6 / 6 (100%)
Manual failure with passed checks (conditional share)0 / 6 (0%)
Failure recorded only manually13 / 21 (61.9%)
Failure recorded by both methods6 / 21 (28.6%)
Violation recorded only automatically2 / 21 (9.5%)
Comparison units with manual failures19 / 56 (33.9%)
Review needed or insufficient evidence3 / 19 (15.8%)
No automated check mapped10 / 19 (52.6%)
Applicability disagreement0 / 19 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 29 · Completed evidence

Study subject · Participant 29 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results4 / 4 (100%)
No automated check mapped6 / 16 (37.5%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation4 / 16 (25%)
Manual failure; all mapped automated checks passed0 / 16 (0%)
Manual failure; automated checks inapplicable0 / 16 (0%)
Manual violation; no configured automated rule6 / 16 (37.5%)
Manual violation; automated review required0 / 16 (0%)
Manual violation; automated evidence unavailable6 / 16 (37.5%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually12 / 17 (70.6%)
Failure recorded by both methods4 / 17 (23.5%)
Violation recorded only automatically1 / 17 (5.9%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures4 / 16 (25%)
Agreement among violation or passed-check results4 / 4 (100%)
Manual failure with passed checks (conditional share)0 / 4 (0%)
Failure recorded only manually12 / 17 (70.6%)
Failure recorded by both methods4 / 17 (23.5%)
Violation recorded only automatically1 / 17 (5.9%)
Comparison units with manual failures16 / 56 (28.6%)
Review needed or insufficient evidence6 / 16 (37.5%)
No automated check mapped6 / 16 (37.5%)
Applicability disagreement0 / 16 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 73 · Completed evidence

Study subject · Participant 73 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results4 / 4 (100%)
No automated check mapped12 / 23 (52.2%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation4 / 23 (17.4%)
Manual failure; all mapped automated checks passed0 / 23 (0%)
Manual failure; automated checks inapplicable0 / 23 (0%)
Manual violation; no configured automated rule12 / 23 (52.2%)
Manual violation; automated review required1 / 23 (4.3%)
Manual violation; automated evidence unavailable6 / 23 (26.1%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually19 / 23 (82.6%)
Failure recorded by both methods4 / 23 (17.4%)
Violation recorded only automatically0 / 23 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures4 / 23 (17.4%)
Agreement among violation or passed-check results4 / 4 (100%)
Manual failure with passed checks (conditional share)0 / 4 (0%)
Failure recorded only manually19 / 23 (82.6%)
Failure recorded by both methods4 / 23 (17.4%)
Violation recorded only automatically0 / 23 (0%)
Comparison units with manual failures23 / 56 (41.1%)
Review needed or insufficient evidence7 / 23 (30.4%)
No automated check mapped12 / 23 (52.2%)
Applicability disagreement0 / 23 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 195 · Completed evidence

Study subject · Participant 195 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results1 / 1 (100%)
No automated check mapped6 / 13 (46.2%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation1 / 13 (7.7%)
Manual failure; all mapped automated checks passed0 / 13 (0%)
Manual failure; automated checks inapplicable0 / 13 (0%)
Manual violation; no configured automated rule6 / 13 (46.2%)
Manual violation; automated review required1 / 13 (7.7%)
Manual violation; automated evidence unavailable5 / 13 (38.5%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually12 / 14 (85.7%)
Failure recorded by both methods1 / 14 (7.1%)
Violation recorded only automatically1 / 14 (7.1%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations55 / 56 (98.2%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations55 / 56 (98.2%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures1 / 13 (7.7%)
Agreement among violation or passed-check results1 / 1 (100%)
Manual failure with passed checks (conditional share)0 / 1 (0%)
Failure recorded only manually12 / 14 (85.7%)
Failure recorded by both methods1 / 14 (7.1%)
Violation recorded only automatically1 / 14 (7.1%)
Comparison units with manual failures13 / 56 (23.2%)
Review needed or insufficient evidence6 / 13 (46.2%)
No automated check mapped6 / 13 (46.2%)
Applicability disagreement0 / 13 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 127 · Completed evidence

Study subject · Participant 127 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results5 / 5 (100%)
No automated check mapped13 / 22 (59.1%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation5 / 22 (22.7%)
Manual failure; all mapped automated checks passed0 / 22 (0%)
Manual failure; automated checks inapplicable0 / 22 (0%)
Manual violation; no configured automated rule13 / 22 (59.1%)
Manual violation; automated review required0 / 22 (0%)
Manual violation; automated evidence unavailable4 / 22 (18.2%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually17 / 23 (73.9%)
Failure recorded by both methods5 / 23 (21.7%)
Violation recorded only automatically1 / 23 (4.3%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations55 / 56 (98.2%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations55 / 56 (98.2%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures5 / 22 (22.7%)
Agreement among violation or passed-check results5 / 5 (100%)
Manual failure with passed checks (conditional share)0 / 5 (0%)
Failure recorded only manually17 / 23 (73.9%)
Failure recorded by both methods5 / 23 (21.7%)
Violation recorded only automatically1 / 23 (4.3%)
Comparison units with manual failures22 / 56 (39.3%)
Review needed or insufficient evidence4 / 22 (18.2%)
No automated check mapped13 / 22 (59.1%)
Applicability disagreement0 / 22 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 95 · Completed evidence

Study subject · Participant 95 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results4 / 4 (100%)
No automated check mapped10 / 17 (58.8%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation4 / 17 (23.5%)
Manual failure; all mapped automated checks passed0 / 17 (0%)
Manual failure; automated checks inapplicable0 / 17 (0%)
Manual violation; no configured automated rule10 / 17 (58.8%)
Manual violation; automated review required1 / 17 (5.9%)
Manual violation; automated evidence unavailable2 / 17 (11.8%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually13 / 19 (68.4%)
Failure recorded by both methods4 / 19 (21.1%)
Violation recorded only automatically2 / 19 (10.5%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures4 / 17 (23.5%)
Agreement among violation or passed-check results4 / 4 (100%)
Manual failure with passed checks (conditional share)0 / 4 (0%)
Failure recorded only manually13 / 19 (68.4%)
Failure recorded by both methods4 / 19 (21.1%)
Violation recorded only automatically2 / 19 (10.5%)
Comparison units with manual failures17 / 56 (30.4%)
Review needed or insufficient evidence3 / 17 (17.6%)
No automated check mapped10 / 17 (58.8%)
Applicability disagreement0 / 17 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 109 · Completed evidence

Study subject · Participant 109 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results6 / 6 (100%)
No automated check mapped7 / 17 (41.2%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation6 / 17 (35.3%)
Manual failure; all mapped automated checks passed0 / 17 (0%)
Manual failure; automated checks inapplicable0 / 17 (0%)
Manual violation; no configured automated rule7 / 17 (41.2%)
Manual violation; automated review required1 / 17 (5.9%)
Manual violation; automated evidence unavailable3 / 17 (17.6%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually11 / 17 (64.7%)
Failure recorded by both methods6 / 17 (35.3%)
Violation recorded only automatically0 / 17 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures6 / 17 (35.3%)
Agreement among violation or passed-check results6 / 6 (100%)
Manual failure with passed checks (conditional share)0 / 6 (0%)
Failure recorded only manually11 / 17 (64.7%)
Failure recorded by both methods6 / 17 (35.3%)
Violation recorded only automatically0 / 17 (0%)
Comparison units with manual failures17 / 56 (30.4%)
Review needed or insufficient evidence4 / 17 (23.5%)
No automated check mapped7 / 17 (41.2%)
Applicability disagreement0 / 17 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 169 · Completed evidence

Study subject · Participant 169 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results3 / 3 (100%)
No automated check mapped7 / 11 (63.6%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation3 / 11 (27.3%)
Manual failure; all mapped automated checks passed0 / 11 (0%)
Manual failure; automated checks inapplicable0 / 11 (0%)
Manual violation; no configured automated rule7 / 11 (63.6%)
Manual violation; automated review required0 / 11 (0%)
Manual violation; automated evidence unavailable1 / 11 (9.1%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually8 / 13 (61.5%)
Failure recorded by both methods3 / 13 (23.1%)
Violation recorded only automatically2 / 13 (15.4%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations55 / 56 (98.2%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations55 / 56 (98.2%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures3 / 11 (27.3%)
Agreement among violation or passed-check results3 / 3 (100%)
Manual failure with passed checks (conditional share)0 / 3 (0%)
Failure recorded only manually8 / 13 (61.5%)
Failure recorded by both methods3 / 13 (23.1%)
Violation recorded only automatically2 / 13 (15.4%)
Comparison units with manual failures11 / 56 (19.6%)
Review needed or insufficient evidence1 / 11 (9.1%)
No automated check mapped7 / 11 (63.6%)
Applicability disagreement0 / 11 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 163 · Completed evidence

Study subject · Participant 163 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results0 / 0 (Unknown)
No automated check mapped2 / 6 (33.3%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation0 / 6 (0%)
Manual failure; all mapped automated checks passed0 / 6 (0%)
Manual failure; automated checks inapplicable0 / 6 (0%)
Manual violation; no configured automated rule2 / 6 (33.3%)
Manual violation; automated review required1 / 6 (16.7%)
Manual violation; automated evidence unavailable3 / 6 (50%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually6 / 6 (100%)
Failure recorded by both methods0 / 6 (0%)
Violation recorded only automatically0 / 6 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations55 / 56 (98.2%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations55 / 56 (98.2%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures0 / 6 (0%)
Agreement among violation or passed-check results0 / 0 (Unknown)
Manual failure with passed checks (conditional share)0 / 0 (Unknown)
Failure recorded only manually6 / 6 (100%)
Failure recorded by both methods0 / 6 (0%)
Violation recorded only automatically0 / 6 (0%)
Comparison units with manual failures6 / 56 (10.7%)
Review needed or insufficient evidence4 / 6 (66.7%)
No automated check mapped2 / 6 (33.3%)
Applicability disagreement0 / 6 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 121 · Completed evidence

Study subject · Participant 121 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Different assessed scopes: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results1 / 1 (100%)
No automated check mapped3 / 6 (50%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation1 / 6 (16.7%)
Manual failure; all mapped automated checks passed0 / 6 (0%)
Manual failure; automated checks inapplicable0 / 6 (0%)
Manual violation; no configured automated rule3 / 6 (50%)
Manual violation; automated review required0 / 6 (0%)
Manual violation; automated evidence unavailable2 / 6 (33.3%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually5 / 6 (83.3%)
Failure recorded by both methods1 / 6 (16.7%)
Violation recorded only automatically0 / 6 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures1 / 6 (16.7%)
Agreement among violation or passed-check results1 / 1 (100%)
Manual failure with passed checks (conditional share)0 / 1 (0%)
Failure recorded only manually5 / 6 (83.3%)
Failure recorded by both methods1 / 6 (16.7%)
Violation recorded only automatically0 / 6 (0%)
Comparison units with manual failures6 / 56 (10.7%)
Review needed or insufficient evidence2 / 6 (33.3%)
No automated check mapped3 / 6 (50%)
Applicability disagreement0 / 6 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 30 · Completed evidence

Study subject · Participant 30 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results4 / 4 (100%)
No automated check mapped11 / 21 (52.4%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation4 / 21 (19%)
Manual failure; all mapped automated checks passed0 / 21 (0%)
Manual failure; automated checks inapplicable0 / 21 (0%)
Manual violation; no configured automated rule11 / 21 (52.4%)
Manual violation; automated review required0 / 21 (0%)
Manual violation; automated evidence unavailable6 / 21 (28.6%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually17 / 23 (73.9%)
Failure recorded by both methods4 / 23 (17.4%)
Violation recorded only automatically2 / 23 (8.7%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures4 / 21 (19%)
Agreement among violation or passed-check results4 / 4 (100%)
Manual failure with passed checks (conditional share)0 / 4 (0%)
Failure recorded only manually17 / 23 (73.9%)
Failure recorded by both methods4 / 23 (17.4%)
Violation recorded only automatically2 / 23 (8.7%)
Comparison units with manual failures21 / 56 (37.5%)
Review needed or insufficient evidence6 / 21 (28.6%)
No automated check mapped11 / 21 (52.4%)
Applicability disagreement0 / 21 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 51 · Completed evidence

Study subject · Participant 51 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results5 / 5 (100%)
No automated check mapped11 / 23 (47.8%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation5 / 23 (21.7%)
Manual failure; all mapped automated checks passed0 / 23 (0%)
Manual failure; automated checks inapplicable0 / 23 (0%)
Manual violation; no configured automated rule11 / 23 (47.8%)
Manual violation; automated review required0 / 23 (0%)
Manual violation; automated evidence unavailable7 / 23 (30.4%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually18 / 25 (72%)
Failure recorded by both methods5 / 25 (20%)
Violation recorded only automatically2 / 25 (8%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures5 / 23 (21.7%)
Agreement among violation or passed-check results5 / 5 (100%)
Manual failure with passed checks (conditional share)0 / 5 (0%)
Failure recorded only manually18 / 25 (72%)
Failure recorded by both methods5 / 25 (20%)
Violation recorded only automatically2 / 25 (8%)
Comparison units with manual failures23 / 56 (41.1%)
Review needed or insufficient evidence7 / 23 (30.4%)
No automated check mapped11 / 23 (47.8%)
Applicability disagreement0 / 23 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 05 · Completed evidence

Study subject · Participant 05 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results4 / 4 (100%)
No automated check mapped5 / 13 (38.5%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation4 / 13 (30.8%)
Manual failure; all mapped automated checks passed0 / 13 (0%)
Manual failure; automated checks inapplicable0 / 13 (0%)
Manual violation; no configured automated rule5 / 13 (38.5%)
Manual violation; automated review required0 / 13 (0%)
Manual violation; automated evidence unavailable4 / 13 (30.8%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually9 / 14 (64.3%)
Failure recorded by both methods4 / 14 (28.6%)
Violation recorded only automatically1 / 14 (7.1%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations55 / 56 (98.2%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations55 / 56 (98.2%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures4 / 13 (30.8%)
Agreement among violation or passed-check results4 / 4 (100%)
Manual failure with passed checks (conditional share)0 / 4 (0%)
Failure recorded only manually9 / 14 (64.3%)
Failure recorded by both methods4 / 14 (28.6%)
Violation recorded only automatically1 / 14 (7.1%)
Comparison units with manual failures13 / 56 (23.2%)
Review needed or insufficient evidence4 / 13 (30.8%)
No automated check mapped5 / 13 (38.5%)
Applicability disagreement0 / 13 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 42 · Completed evidence

Study subject · Participant 42 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results4 / 4 (100%)
No automated check mapped6 / 16 (37.5%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation4 / 16 (25%)
Manual failure; all mapped automated checks passed0 / 16 (0%)
Manual failure; automated checks inapplicable0 / 16 (0%)
Manual violation; no configured automated rule6 / 16 (37.5%)
Manual violation; automated review required0 / 16 (0%)
Manual violation; automated evidence unavailable6 / 16 (37.5%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually12 / 17 (70.6%)
Failure recorded by both methods4 / 17 (23.5%)
Violation recorded only automatically1 / 17 (5.9%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures4 / 16 (25%)
Agreement among violation or passed-check results4 / 4 (100%)
Manual failure with passed checks (conditional share)0 / 4 (0%)
Failure recorded only manually12 / 17 (70.6%)
Failure recorded by both methods4 / 17 (23.5%)
Violation recorded only automatically1 / 17 (5.9%)
Comparison units with manual failures16 / 56 (28.6%)
Review needed or insufficient evidence6 / 16 (37.5%)
No automated check mapped6 / 16 (37.5%)
Applicability disagreement0 / 16 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 178 · Completed evidence

Study subject · Participant 178 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results3 / 3 (100%)
No automated check mapped7 / 13 (53.8%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation3 / 13 (23.1%)
Manual failure; all mapped automated checks passed0 / 13 (0%)
Manual failure; automated checks inapplicable0 / 13 (0%)
Manual violation; no configured automated rule7 / 13 (53.8%)
Manual violation; automated review required0 / 13 (0%)
Manual violation; automated evidence unavailable3 / 13 (23.1%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually10 / 14 (71.4%)
Failure recorded by both methods3 / 14 (21.4%)
Violation recorded only automatically1 / 14 (7.1%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures3 / 13 (23.1%)
Agreement among violation or passed-check results3 / 3 (100%)
Manual failure with passed checks (conditional share)0 / 3 (0%)
Failure recorded only manually10 / 14 (71.4%)
Failure recorded by both methods3 / 14 (21.4%)
Violation recorded only automatically1 / 14 (7.1%)
Comparison units with manual failures13 / 56 (23.2%)
Review needed or insufficient evidence3 / 13 (23.1%)
No automated check mapped7 / 13 (53.8%)
Applicability disagreement0 / 13 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 149 · Completed evidence

Study subject · Participant 149 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results4 / 4 (100%)
No automated check mapped6 / 16 (37.5%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation4 / 16 (25%)
Manual failure; all mapped automated checks passed0 / 16 (0%)
Manual failure; automated checks inapplicable0 / 16 (0%)
Manual violation; no configured automated rule6 / 16 (37.5%)
Manual violation; automated review required0 / 16 (0%)
Manual violation; automated evidence unavailable6 / 16 (37.5%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually12 / 17 (70.6%)
Failure recorded by both methods4 / 17 (23.5%)
Violation recorded only automatically1 / 17 (5.9%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures4 / 16 (25%)
Agreement among violation or passed-check results4 / 4 (100%)
Manual failure with passed checks (conditional share)0 / 4 (0%)
Failure recorded only manually12 / 17 (70.6%)
Failure recorded by both methods4 / 17 (23.5%)
Violation recorded only automatically1 / 17 (5.9%)
Comparison units with manual failures16 / 56 (28.6%)
Review needed or insufficient evidence6 / 16 (37.5%)
No automated check mapped6 / 16 (37.5%)
Applicability disagreement0 / 16 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 76 · Completed evidence

Study subject · Participant 76 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results2 / 2 (100%)
No automated check mapped5 / 12 (41.7%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation2 / 12 (16.7%)
Manual failure; all mapped automated checks passed0 / 12 (0%)
Manual failure; automated checks inapplicable0 / 12 (0%)
Manual violation; no configured automated rule5 / 12 (41.7%)
Manual violation; automated review required0 / 12 (0%)
Manual violation; automated evidence unavailable5 / 12 (41.7%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually10 / 14 (71.4%)
Failure recorded by both methods2 / 14 (14.3%)
Violation recorded only automatically2 / 14 (14.3%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures2 / 12 (16.7%)
Agreement among violation or passed-check results2 / 2 (100%)
Manual failure with passed checks (conditional share)0 / 2 (0%)
Failure recorded only manually10 / 14 (71.4%)
Failure recorded by both methods2 / 14 (14.3%)
Violation recorded only automatically2 / 14 (14.3%)
Comparison units with manual failures12 / 56 (21.4%)
Review needed or insufficient evidence5 / 12 (41.7%)
No automated check mapped5 / 12 (41.7%)
Applicability disagreement0 / 12 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 172 · Completed evidence

Study subject · Participant 172 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results4 / 4 (100%)
No automated check mapped6 / 14 (42.9%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation4 / 14 (28.6%)
Manual failure; all mapped automated checks passed0 / 14 (0%)
Manual failure; automated checks inapplicable0 / 14 (0%)
Manual violation; no configured automated rule6 / 14 (42.9%)
Manual violation; automated review required1 / 14 (7.1%)
Manual violation; automated evidence unavailable3 / 14 (21.4%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually10 / 16 (62.5%)
Failure recorded by both methods4 / 16 (25%)
Violation recorded only automatically2 / 16 (12.5%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures4 / 14 (28.6%)
Agreement among violation or passed-check results4 / 4 (100%)
Manual failure with passed checks (conditional share)0 / 4 (0%)
Failure recorded only manually10 / 16 (62.5%)
Failure recorded by both methods4 / 16 (25%)
Violation recorded only automatically2 / 16 (12.5%)
Comparison units with manual failures14 / 56 (25%)
Review needed or insufficient evidence4 / 14 (28.6%)
No automated check mapped6 / 14 (42.9%)
Applicability disagreement0 / 14 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 102 · Completed evidence

Study subject · Participant 102 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results2 / 2 (100%)
No automated check mapped6 / 11 (54.5%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation2 / 11 (18.2%)
Manual failure; all mapped automated checks passed0 / 11 (0%)
Manual failure; automated checks inapplicable0 / 11 (0%)
Manual violation; no configured automated rule6 / 11 (54.5%)
Manual violation; automated review required0 / 11 (0%)
Manual violation; automated evidence unavailable3 / 11 (27.3%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually9 / 13 (69.2%)
Failure recorded by both methods2 / 13 (15.4%)
Violation recorded only automatically2 / 13 (15.4%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations55 / 56 (98.2%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations55 / 56 (98.2%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures2 / 11 (18.2%)
Agreement among violation or passed-check results2 / 2 (100%)
Manual failure with passed checks (conditional share)0 / 2 (0%)
Failure recorded only manually9 / 13 (69.2%)
Failure recorded by both methods2 / 13 (15.4%)
Violation recorded only automatically2 / 13 (15.4%)
Comparison units with manual failures11 / 56 (19.6%)
Review needed or insufficient evidence3 / 11 (27.3%)
No automated check mapped6 / 11 (54.5%)
Applicability disagreement0 / 11 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Study subject · Participant 122 · Completed evidence

Study subject · Participant 122 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 1; Criterion comparison units: 56

Same recorded scope: 1

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results6 / 6 (100%)
No automated check mapped9 / 20 (45%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation6 / 20 (30%)
Manual failure; all mapped automated checks passed0 / 20 (0%)
Manual failure; automated checks inapplicable0 / 20 (0%)
Manual violation; no configured automated rule9 / 20 (45%)
Manual violation; automated review required1 / 20 (5%)
Manual violation; automated evidence unavailable4 / 20 (20%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually14 / 21 (66.7%)
Failure recorded by both methods6 / 21 (28.6%)
Violation recorded only automatically1 / 21 (4.8%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations56 / 56 (100%)
Shared criteria with automated checks18 / 56 (32.1%)
Shared criteria with complete automated checks0 / 56 (0%)
Comparison units with manual observations56 / 56 (100%)
Comparison units with mapped automated checks18 / 56 (32.1%)
Comparison units with complete mapped checks0 / 56 (0%)
Comparison units observed by both methods18 / 56 (32.1%)
Automated violation among manual failures6 / 20 (30%)
Agreement among violation or passed-check results6 / 6 (100%)
Manual failure with passed checks (conditional share)0 / 6 (0%)
Failure recorded only manually14 / 21 (66.7%)
Failure recorded by both methods6 / 21 (28.6%)
Violation recorded only automatically1 / 21 (4.8%)
Comparison units with manual failures20 / 56 (35.7%)
Review needed or insufficient evidence5 / 20 (25%)
No automated check mapped9 / 20 (45%)
Applicability disagreement0 / 20 (0%)
Execution progress of mapped checks0 / 18 (0%)
Subjects without an automated run0 / 1 (0%)
Subjects with unknown manual criterion scope0 / 1 (0%)
Subjects with unknown automated criterion scope0 / 1 (0%)
Group · Gesamte Studie · Completed evidence

Group · Gesamte Studie · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 1176

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results77 / 77 (100%)
No automated check mapped159 / 331 (48%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation77 / 331 (23.3%)
Manual failure; all mapped automated checks passed0 / 331 (0%)
Manual failure; automated checks inapplicable0 / 331 (0%)
Manual violation; no configured automated rule159 / 331 (48%)
Manual violation; automated review required7 / 331 (2.1%)
Manual violation; automated evidence unavailable88 / 331 (26.6%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually254 / 356 (71.3%)
Failure recorded by both methods77 / 356 (21.6%)
Violation recorded only automatically25 / 356 (7%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations1170 / 1176 (99.5%)
Shared criteria with automated checks378 / 1176 (32.1%)
Shared criteria with complete automated checks0 / 1176 (0%)
Comparison units with manual observations1170 / 1176 (99.5%)
Comparison units with mapped automated checks378 / 1176 (32.1%)
Comparison units with complete mapped checks0 / 1176 (0%)
Comparison units observed by both methods378 / 1176 (32.1%)
Automated violation among manual failures77 / 331 (23.3%)
Agreement among violation or passed-check results77 / 77 (100%)
Manual failure with passed checks (conditional share)0 / 77 (0%)
Failure recorded only manually254 / 356 (71.3%)
Failure recorded by both methods77 / 356 (21.6%)
Violation recorded only automatically25 / 356 (7%)
Comparison units with manual failures331 / 1176 (28.1%)
Review needed or insufficient evidence95 / 331 (28.7%)
No automated check mapped159 / 331 (48%)
Applicability disagreement0 / 331 (0%)
Execution progress of mapped checks0 / 378 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Group · Medien · Completed evidence

Group · Medien · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 11; Criterion comparison units: 616

Same recorded scope: 11

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results49 / 49 (100%)
No automated check mapped93 / 197 (47.2%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation49 / 197 (24.9%)
Manual failure; all mapped automated checks passed0 / 197 (0%)
Manual failure; automated checks inapplicable0 / 197 (0%)
Manual violation; no configured automated rule93 / 197 (47.2%)
Manual violation; automated review required3 / 197 (1.5%)
Manual violation; automated evidence unavailable52 / 197 (26.4%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually148 / 213 (69.5%)
Failure recorded by both methods49 / 213 (23%)
Violation recorded only automatically16 / 213 (7.5%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations616 / 616 (100%)
Shared criteria with automated checks198 / 616 (32.1%)
Shared criteria with complete automated checks0 / 616 (0%)
Comparison units with manual observations616 / 616 (100%)
Comparison units with mapped automated checks198 / 616 (32.1%)
Comparison units with complete mapped checks0 / 616 (0%)
Comparison units observed by both methods198 / 616 (32.1%)
Automated violation among manual failures49 / 197 (24.9%)
Agreement among violation or passed-check results49 / 49 (100%)
Manual failure with passed checks (conditional share)0 / 49 (0%)
Failure recorded only manually148 / 213 (69.5%)
Failure recorded by both methods49 / 213 (23%)
Violation recorded only automatically16 / 213 (7.5%)
Comparison units with manual failures197 / 616 (32%)
Review needed or insufficient evidence55 / 197 (27.9%)
No automated check mapped93 / 197 (47.2%)
Applicability disagreement0 / 197 (0%)
Execution progress of mapped checks0 / 198 (0%)
Subjects without an automated run0 / 11 (0%)
Subjects with unknown manual criterion scope0 / 11 (0%)
Subjects with unknown automated criterion scope0 / 11 (0%)
Group · Verwaltung · Completed evidence

Group · Verwaltung · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 9; Criterion comparison units: 504

Same recorded scope: 6

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results24 / 24 (100%)
No automated check mapped61 / 121 (50.4%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation24 / 121 (19.8%)
Manual failure; all mapped automated checks passed0 / 121 (0%)
Manual failure; automated checks inapplicable0 / 121 (0%)
Manual violation; no configured automated rule61 / 121 (50.4%)
Manual violation; automated review required4 / 121 (3.3%)
Manual violation; automated evidence unavailable32 / 121 (26.4%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually97 / 129 (75.2%)
Failure recorded by both methods24 / 129 (18.6%)
Violation recorded only automatically8 / 129 (6.2%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations499 / 504 (99%)
Shared criteria with automated checks162 / 504 (32.1%)
Shared criteria with complete automated checks0 / 504 (0%)
Comparison units with manual observations499 / 504 (99%)
Comparison units with mapped automated checks162 / 504 (32.1%)
Comparison units with complete mapped checks0 / 504 (0%)
Comparison units observed by both methods162 / 504 (32.1%)
Automated violation among manual failures24 / 121 (19.8%)
Agreement among violation or passed-check results24 / 24 (100%)
Manual failure with passed checks (conditional share)0 / 24 (0%)
Failure recorded only manually97 / 129 (75.2%)
Failure recorded by both methods24 / 129 (18.6%)
Violation recorded only automatically8 / 129 (6.2%)
Comparison units with manual failures121 / 504 (24%)
Review needed or insufficient evidence36 / 121 (29.8%)
No automated check mapped61 / 121 (50.4%)
Applicability disagreement0 / 121 (0%)
Execution progress of mapped checks0 / 162 (0%)
Subjects without an automated run0 / 9 (0%)
Subjects with unknown manual criterion scope0 / 9 (0%)
Subjects with unknown automated criterion scope0 / 9 (0%)
Dimension · Mobile operability · Completed evidence

Dimension · Mobile operability · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 105

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results0 / 0 (Unknown)
No automated check mapped0 / 0 (Unknown)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation0 / 0 (Unknown)
Manual failure; all mapped automated checks passed0 / 0 (Unknown)
Manual failure; automated checks inapplicable0 / 0 (Unknown)
Manual violation; no configured automated rule0 / 0 (Unknown)
Manual violation; automated review required0 / 0 (Unknown)
Manual violation; automated evidence unavailable0 / 0 (Unknown)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually0 / 0 (Unknown)
Failure recorded by both methods0 / 0 (Unknown)
Violation recorded only automatically0 / 0 (Unknown)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations105 / 105 (100%)
Shared criteria with automated checks0 / 105 (0%)
Shared criteria with complete automated checks0 / 105 (0%)
Comparison units with manual observations105 / 105 (100%)
Comparison units with mapped automated checks0 / 105 (0%)
Comparison units with complete mapped checks0 / 105 (0%)
Comparison units observed by both methods0 / 105 (0%)
Automated violation among manual failures0 / 0 (Unknown)
Agreement among violation or passed-check results0 / 0 (Unknown)
Manual failure with passed checks (conditional share)0 / 0 (Unknown)
Failure recorded only manually0 / 0 (Unknown)
Failure recorded by both methods0 / 0 (Unknown)
Violation recorded only automatically0 / 0 (Unknown)
Comparison units with manual failures0 / 105 (0%)
Review needed or insufficient evidence0 / 0 (Unknown)
No automated check mapped0 / 0 (Unknown)
Applicability disagreement0 / 0 (Unknown)
Execution progress of mapped checks0 / 0 (Unknown)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Keyboard operability · Completed evidence

Dimension · Keyboard operability · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 126

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results2 / 2 (100%)
No automated check mapped43 / 68 (63.2%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation2 / 68 (2.9%)
Manual failure; all mapped automated checks passed0 / 68 (0%)
Manual failure; automated checks inapplicable0 / 68 (0%)
Manual violation; no configured automated rule43 / 68 (63.2%)
Manual violation; automated review required1 / 68 (1.5%)
Manual violation; automated evidence unavailable22 / 68 (32.4%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually66 / 68 (97.1%)
Failure recorded by both methods2 / 68 (2.9%)
Violation recorded only automatically0 / 68 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations126 / 126 (100%)
Shared criteria with automated checks42 / 126 (33.3%)
Shared criteria with complete automated checks0 / 126 (0%)
Comparison units with manual observations126 / 126 (100%)
Comparison units with mapped automated checks42 / 126 (33.3%)
Comparison units with complete mapped checks0 / 126 (0%)
Comparison units observed by both methods42 / 126 (33.3%)
Automated violation among manual failures2 / 68 (2.9%)
Agreement among violation or passed-check results2 / 2 (100%)
Manual failure with passed checks (conditional share)0 / 2 (0%)
Failure recorded only manually66 / 68 (97.1%)
Failure recorded by both methods2 / 68 (2.9%)
Violation recorded only automatically0 / 68 (0%)
Comparison units with manual failures68 / 126 (54%)
Review needed or insufficient evidence23 / 68 (33.8%)
No automated check mapped43 / 68 (63.2%)
Applicability disagreement0 / 68 (0%)
Execution progress of mapped checks0 / 42 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Voice control · Completed evidence

Dimension · Voice control · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 42

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results0 / 0 (Unknown)
No automated check mapped9 / 9 (100%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation0 / 9 (0%)
Manual failure; all mapped automated checks passed0 / 9 (0%)
Manual failure; automated checks inapplicable0 / 9 (0%)
Manual violation; no configured automated rule9 / 9 (100%)
Manual violation; automated review required0 / 9 (0%)
Manual violation; automated evidence unavailable0 / 9 (0%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually9 / 9 (100%)
Failure recorded by both methods0 / 9 (0%)
Violation recorded only automatically0 / 9 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations42 / 42 (100%)
Shared criteria with automated checks0 / 42 (0%)
Shared criteria with complete automated checks0 / 42 (0%)
Comparison units with manual observations42 / 42 (100%)
Comparison units with mapped automated checks0 / 42 (0%)
Comparison units with complete mapped checks0 / 42 (0%)
Comparison units observed by both methods0 / 42 (0%)
Automated violation among manual failures0 / 9 (0%)
Agreement among violation or passed-check results0 / 0 (Unknown)
Manual failure with passed checks (conditional share)0 / 0 (Unknown)
Failure recorded only manually9 / 9 (100%)
Failure recorded by both methods0 / 9 (0%)
Violation recorded only automatically0 / 9 (0%)
Comparison units with manual failures9 / 42 (21.4%)
Review needed or insufficient evidence0 / 9 (0%)
No automated check mapped9 / 9 (100%)
Applicability disagreement0 / 9 (0%)
Execution progress of mapped checks0 / 0 (Unknown)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Compatibility with user agents · Completed evidence

Dimension · Compatibility with user agents · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 63

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results19 / 19 (100%)
No automated check mapped10 / 31 (32.3%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation19 / 31 (61.3%)
Manual failure; all mapped automated checks passed0 / 31 (0%)
Manual failure; automated checks inapplicable0 / 31 (0%)
Manual violation; no configured automated rule10 / 31 (32.3%)
Manual violation; automated review required1 / 31 (3.2%)
Manual violation; automated evidence unavailable1 / 31 (3.2%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually12 / 31 (38.7%)
Failure recorded by both methods19 / 31 (61.3%)
Violation recorded only automatically0 / 31 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations57 / 63 (90.5%)
Shared criteria with automated checks21 / 63 (33.3%)
Shared criteria with complete automated checks0 / 63 (0%)
Comparison units with manual observations57 / 63 (90.5%)
Comparison units with mapped automated checks21 / 63 (33.3%)
Comparison units with complete mapped checks0 / 63 (0%)
Comparison units observed by both methods21 / 63 (33.3%)
Automated violation among manual failures19 / 31 (61.3%)
Agreement among violation or passed-check results19 / 19 (100%)
Manual failure with passed checks (conditional share)0 / 19 (0%)
Failure recorded only manually12 / 31 (38.7%)
Failure recorded by both methods19 / 31 (61.3%)
Violation recorded only automatically0 / 31 (0%)
Comparison units with manual failures31 / 63 (49.2%)
Review needed or insufficient evidence2 / 31 (6.5%)
No automated check mapped10 / 31 (32.3%)
Applicability disagreement0 / 31 (0%)
Execution progress of mapped checks0 / 21 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Interaction assistance · Completed evidence

Dimension · Interaction assistance · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 189

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results0 / 0 (Unknown)
No automated check mapped37 / 49 (75.5%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation0 / 49 (0%)
Manual failure; all mapped automated checks passed0 / 49 (0%)
Manual failure; automated checks inapplicable0 / 49 (0%)
Manual violation; no configured automated rule37 / 49 (75.5%)
Manual violation; automated review required1 / 49 (2%)
Manual violation; automated evidence unavailable11 / 49 (22.4%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually49 / 49 (100%)
Failure recorded by both methods0 / 49 (0%)
Violation recorded only automatically0 / 49 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations189 / 189 (100%)
Shared criteria with automated checks42 / 189 (22.2%)
Shared criteria with complete automated checks0 / 189 (0%)
Comparison units with manual observations189 / 189 (100%)
Comparison units with mapped automated checks42 / 189 (22.2%)
Comparison units with complete mapped checks0 / 189 (0%)
Comparison units observed by both methods42 / 189 (22.2%)
Automated violation among manual failures0 / 49 (0%)
Agreement among violation or passed-check results0 / 0 (Unknown)
Manual failure with passed checks (conditional share)0 / 0 (Unknown)
Failure recorded only manually49 / 49 (100%)
Failure recorded by both methods0 / 49 (0%)
Violation recorded only automatically0 / 49 (0%)
Comparison units with manual failures49 / 189 (25.9%)
Review needed or insufficient evidence12 / 49 (24.5%)
No automated check mapped37 / 49 (75.5%)
Applicability disagreement0 / 49 (0%)
Execution progress of mapped checks0 / 42 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Consistency and predictability · Completed evidence

Dimension · Consistency and predictability · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 105

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results0 / 0 (Unknown)
No automated check mapped2 / 2 (100%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation0 / 2 (0%)
Manual failure; all mapped automated checks passed0 / 2 (0%)
Manual failure; automated checks inapplicable0 / 2 (0%)
Manual violation; no configured automated rule2 / 2 (100%)
Manual violation; automated review required0 / 2 (0%)
Manual violation; automated evidence unavailable0 / 2 (0%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually2 / 2 (100%)
Failure recorded by both methods0 / 2 (0%)
Violation recorded only automatically0 / 2 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations105 / 105 (100%)
Shared criteria with automated checks0 / 105 (0%)
Shared criteria with complete automated checks0 / 105 (0%)
Comparison units with manual observations105 / 105 (100%)
Comparison units with mapped automated checks0 / 105 (0%)
Comparison units with complete mapped checks0 / 105 (0%)
Comparison units observed by both methods0 / 105 (0%)
Automated violation among manual failures0 / 2 (0%)
Agreement among violation or passed-check results0 / 0 (Unknown)
Manual failure with passed checks (conditional share)0 / 0 (Unknown)
Failure recorded only manually2 / 2 (100%)
Failure recorded by both methods0 / 2 (0%)
Violation recorded only automatically0 / 2 (0%)
Comparison units with manual failures2 / 105 (1.9%)
Review needed or insufficient evidence0 / 2 (0%)
No automated check mapped2 / 2 (100%)
Applicability disagreement0 / 2 (0%)
Execution progress of mapped checks0 / 0 (Unknown)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Semantic structure · Completed evidence

Dimension · Semantic structure · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 42

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results4 / 4 (100%)
No automated check mapped4 / 25 (16%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation4 / 25 (16%)
Manual failure; all mapped automated checks passed0 / 25 (0%)
Manual failure; automated checks inapplicable0 / 25 (0%)
Manual violation; no configured automated rule4 / 25 (16%)
Manual violation; automated review required1 / 25 (4%)
Manual violation; automated evidence unavailable16 / 25 (64%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually21 / 25 (84%)
Failure recorded by both methods4 / 25 (16%)
Violation recorded only automatically0 / 25 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations42 / 42 (100%)
Shared criteria with automated checks21 / 42 (50%)
Shared criteria with complete automated checks0 / 42 (0%)
Comparison units with manual observations42 / 42 (100%)
Comparison units with mapped automated checks21 / 42 (50%)
Comparison units with complete mapped checks0 / 42 (0%)
Comparison units observed by both methods21 / 42 (50%)
Automated violation among manual failures4 / 25 (16%)
Agreement among violation or passed-check results4 / 4 (100%)
Manual failure with passed checks (conditional share)0 / 4 (0%)
Failure recorded only manually21 / 25 (84%)
Failure recorded by both methods4 / 25 (16%)
Violation recorded only automatically0 / 25 (0%)
Comparison units with manual failures25 / 42 (59.5%)
Review needed or insufficient evidence17 / 25 (68%)
No automated check mapped4 / 25 (16%)
Applicability disagreement0 / 25 (0%)
Execution progress of mapped checks0 / 21 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Understandability · Completed evidence

Dimension · Understandability · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 126

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results22 / 22 (100%)
No automated check mapped18 / 49 (36.7%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation22 / 49 (44.9%)
Manual failure; all mapped automated checks passed0 / 49 (0%)
Manual failure; automated checks inapplicable0 / 49 (0%)
Manual violation; no configured automated rule18 / 49 (36.7%)
Manual violation; automated review required0 / 49 (0%)
Manual violation; automated evidence unavailable9 / 49 (18.4%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually27 / 70 (38.6%)
Failure recorded by both methods22 / 70 (31.4%)
Violation recorded only automatically21 / 70 (30%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations126 / 126 (100%)
Shared criteria with automated checks84 / 126 (66.7%)
Shared criteria with complete automated checks0 / 126 (0%)
Comparison units with manual observations126 / 126 (100%)
Comparison units with mapped automated checks84 / 126 (66.7%)
Comparison units with complete mapped checks0 / 126 (0%)
Comparison units observed by both methods84 / 126 (66.7%)
Automated violation among manual failures22 / 49 (44.9%)
Agreement among violation or passed-check results22 / 22 (100%)
Manual failure with passed checks (conditional share)0 / 22 (0%)
Failure recorded only manually27 / 70 (38.6%)
Failure recorded by both methods22 / 70 (31.4%)
Violation recorded only automatically21 / 70 (30%)
Comparison units with manual failures49 / 126 (38.9%)
Review needed or insufficient evidence9 / 49 (18.4%)
No automated check mapped18 / 49 (36.7%)
Applicability disagreement0 / 49 (0%)
Execution progress of mapped checks0 / 84 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Display flexibility · Completed evidence

Dimension · Display flexibility · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 168

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results1 / 1 (100%)
No automated check mapped17 / 35 (48.6%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation1 / 35 (2.9%)
Manual failure; all mapped automated checks passed0 / 35 (0%)
Manual failure; automated checks inapplicable0 / 35 (0%)
Manual violation; no configured automated rule17 / 35 (48.6%)
Manual violation; automated review required0 / 35 (0%)
Manual violation; automated evidence unavailable17 / 35 (48.6%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually34 / 39 (87.2%)
Failure recorded by both methods1 / 39 (2.6%)
Violation recorded only automatically4 / 39 (10.3%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations168 / 168 (100%)
Shared criteria with automated checks63 / 168 (37.5%)
Shared criteria with complete automated checks0 / 168 (0%)
Comparison units with manual observations168 / 168 (100%)
Comparison units with mapped automated checks63 / 168 (37.5%)
Comparison units with complete mapped checks0 / 168 (0%)
Comparison units observed by both methods63 / 168 (37.5%)
Automated violation among manual failures1 / 35 (2.9%)
Agreement among violation or passed-check results1 / 1 (100%)
Manual failure with passed checks (conditional share)0 / 1 (0%)
Failure recorded only manually34 / 39 (87.2%)
Failure recorded by both methods1 / 39 (2.6%)
Violation recorded only automatically4 / 39 (10.3%)
Comparison units with manual failures35 / 168 (20.8%)
Review needed or insufficient evidence17 / 35 (48.6%)
No automated check mapped17 / 35 (48.6%)
Applicability disagreement0 / 35 (0%)
Execution progress of mapped checks0 / 63 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Contrast and sensory characteristics · Completed evidence

Dimension · Contrast and sensory characteristics · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 84

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results16 / 16 (100%)
No automated check mapped9 / 28 (32.1%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation16 / 28 (57.1%)
Manual failure; all mapped automated checks passed0 / 28 (0%)
Manual failure; automated checks inapplicable0 / 28 (0%)
Manual violation; no configured automated rule9 / 28 (32.1%)
Manual violation; automated review required1 / 28 (3.6%)
Manual violation; automated evidence unavailable2 / 28 (7.1%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually12 / 28 (42.9%)
Failure recorded by both methods16 / 28 (57.1%)
Violation recorded only automatically0 / 28 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations84 / 84 (100%)
Shared criteria with automated checks42 / 84 (50%)
Shared criteria with complete automated checks0 / 84 (0%)
Comparison units with manual observations84 / 84 (100%)
Comparison units with mapped automated checks42 / 84 (50%)
Comparison units with complete mapped checks0 / 84 (0%)
Comparison units observed by both methods42 / 84 (50%)
Automated violation among manual failures16 / 28 (57.1%)
Agreement among violation or passed-check results16 / 16 (100%)
Manual failure with passed checks (conditional share)0 / 16 (0%)
Failure recorded only manually12 / 28 (42.9%)
Failure recorded by both methods16 / 28 (57.1%)
Violation recorded only automatically0 / 28 (0%)
Comparison units with manual failures28 / 84 (33.3%)
Review needed or insufficient evidence3 / 28 (10.7%)
No automated check mapped9 / 28 (32.1%)
Applicability disagreement0 / 28 (0%)
Execution progress of mapped checks0 / 42 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Non-text content (graphics) · Completed evidence

Dimension · Non-text content (graphics) · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 21

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results13 / 13 (100%)
No automated check mapped0 / 20 (0%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation13 / 20 (65%)
Manual failure; all mapped automated checks passed0 / 20 (0%)
Manual failure; automated checks inapplicable0 / 20 (0%)
Manual violation; no configured automated rule0 / 20 (0%)
Manual violation; automated review required0 / 20 (0%)
Manual violation; automated evidence unavailable7 / 20 (35%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually7 / 20 (35%)
Failure recorded by both methods13 / 20 (65%)
Violation recorded only automatically0 / 20 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations21 / 21 (100%)
Shared criteria with automated checks21 / 21 (100%)
Shared criteria with complete automated checks0 / 21 (0%)
Comparison units with manual observations21 / 21 (100%)
Comparison units with mapped automated checks21 / 21 (100%)
Comparison units with complete mapped checks0 / 21 (0%)
Comparison units observed by both methods21 / 21 (100%)
Automated violation among manual failures13 / 20 (65%)
Agreement among violation or passed-check results13 / 13 (100%)
Manual failure with passed checks (conditional share)0 / 13 (0%)
Failure recorded only manually7 / 20 (35%)
Failure recorded by both methods13 / 20 (65%)
Violation recorded only automatically0 / 20 (0%)
Comparison units with manual failures20 / 21 (95.2%)
Review needed or insufficient evidence7 / 20 (35%)
No automated check mapped0 / 20 (0%)
Applicability disagreement0 / 20 (0%)
Execution progress of mapped checks0 / 21 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Multimedia and two-senses principle (audio/video) · Completed evidence

Dimension · Multimedia and two-senses principle (audio/video) · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 105

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results0 / 0 (Unknown)
No automated check mapped10 / 15 (66.7%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation0 / 15 (0%)
Manual failure; all mapped automated checks passed0 / 15 (0%)
Manual failure; automated checks inapplicable0 / 15 (0%)
Manual violation; no configured automated rule10 / 15 (66.7%)
Manual violation; automated review required2 / 15 (13.3%)
Manual violation; automated evidence unavailable3 / 15 (20%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually15 / 15 (100%)
Failure recorded by both methods0 / 15 (0%)
Violation recorded only automatically0 / 15 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations105 / 105 (100%)
Shared criteria with automated checks42 / 105 (40%)
Shared criteria with complete automated checks0 / 105 (0%)
Comparison units with manual observations105 / 105 (100%)
Comparison units with mapped automated checks42 / 105 (40%)
Comparison units with complete mapped checks0 / 105 (0%)
Comparison units observed by both methods42 / 105 (40%)
Automated violation among manual failures0 / 15 (0%)
Agreement among violation or passed-check results0 / 0 (Unknown)
Manual failure with passed checks (conditional share)0 / 0 (Unknown)
Failure recorded only manually15 / 15 (100%)
Failure recorded by both methods0 / 15 (0%)
Violation recorded only automatically0 / 15 (0%)
Comparison units with manual failures15 / 105 (14.3%)
Review needed or insufficient evidence5 / 15 (33.3%)
No automated check mapped10 / 15 (66.7%)
Applicability disagreement0 / 15 (0%)
Execution progress of mapped checks0 / 42 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Motor skills · Completed evidence

Dimension · Motor skills · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 546

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results30 / 30 (100%)
No automated check mapped76 / 149 (51%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation30 / 149 (20.1%)
Manual failure; all mapped automated checks passed0 / 149 (0%)
Manual failure; automated checks inapplicable0 / 149 (0%)
Manual violation; no configured automated rule76 / 149 (51%)
Manual violation; automated review required3 / 149 (2%)
Manual violation; automated evidence unavailable40 / 149 (26.8%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually119 / 152 (78.3%)
Failure recorded by both methods30 / 152 (19.7%)
Violation recorded only automatically3 / 152 (2%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations540 / 546 (98.9%)
Shared criteria with automated checks126 / 546 (23.1%)
Shared criteria with complete automated checks0 / 546 (0%)
Comparison units with manual observations540 / 546 (98.9%)
Comparison units with mapped automated checks126 / 546 (23.1%)
Comparison units with complete mapped checks0 / 546 (0%)
Comparison units observed by both methods126 / 546 (23.1%)
Automated violation among manual failures30 / 149 (20.1%)
Agreement among violation or passed-check results30 / 30 (100%)
Manual failure with passed checks (conditional share)0 / 30 (0%)
Failure recorded only manually119 / 152 (78.3%)
Failure recorded by both methods30 / 152 (19.7%)
Violation recorded only automatically3 / 152 (2%)
Comparison units with manual failures149 / 546 (27.3%)
Review needed or insufficient evidence43 / 149 (28.9%)
No automated check mapped76 / 149 (51%)
Applicability disagreement0 / 149 (0%)
Execution progress of mapped checks0 / 126 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Vision · Completed evidence

Dimension · Vision · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 966

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results77 / 77 (100%)
No automated check mapped146 / 314 (46.5%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation77 / 314 (24.5%)
Manual failure; all mapped automated checks passed0 / 314 (0%)
Manual failure; automated checks inapplicable0 / 314 (0%)
Manual violation; no configured automated rule146 / 314 (46.5%)
Manual violation; automated review required5 / 314 (1.6%)
Manual violation; automated evidence unavailable86 / 314 (27.4%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually237 / 339 (69.9%)
Failure recorded by both methods77 / 339 (22.7%)
Violation recorded only automatically25 / 339 (7.4%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations960 / 966 (99.4%)
Shared criteria with automated checks357 / 966 (37%)
Shared criteria with complete automated checks0 / 966 (0%)
Comparison units with manual observations960 / 966 (99.4%)
Comparison units with mapped automated checks357 / 966 (37%)
Comparison units with complete mapped checks0 / 966 (0%)
Comparison units observed by both methods357 / 966 (37%)
Automated violation among manual failures77 / 314 (24.5%)
Agreement among violation or passed-check results77 / 77 (100%)
Manual failure with passed checks (conditional share)0 / 77 (0%)
Failure recorded only manually237 / 339 (69.9%)
Failure recorded by both methods77 / 339 (22.7%)
Violation recorded only automatically25 / 339 (7.4%)
Comparison units with manual failures314 / 966 (32.5%)
Review needed or insufficient evidence91 / 314 (29%)
No automated check mapped146 / 314 (46.5%)
Applicability disagreement0 / 314 (0%)
Execution progress of mapped checks0 / 357 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Hearing · Completed evidence

Dimension · Hearing · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 147

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results0 / 0 (Unknown)
No automated check mapped0 / 5 (0%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation0 / 5 (0%)
Manual failure; all mapped automated checks passed0 / 5 (0%)
Manual failure; automated checks inapplicable0 / 5 (0%)
Manual violation; no configured automated rule0 / 5 (0%)
Manual violation; automated review required2 / 5 (40%)
Manual violation; automated evidence unavailable3 / 5 (60%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually5 / 5 (100%)
Failure recorded by both methods0 / 5 (0%)
Violation recorded only automatically0 / 5 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations147 / 147 (100%)
Shared criteria with automated checks84 / 147 (57.1%)
Shared criteria with complete automated checks0 / 147 (0%)
Comparison units with manual observations147 / 147 (100%)
Comparison units with mapped automated checks84 / 147 (57.1%)
Comparison units with complete mapped checks0 / 147 (0%)
Comparison units observed by both methods84 / 147 (57.1%)
Automated violation among manual failures0 / 5 (0%)
Agreement among violation or passed-check results0 / 0 (Unknown)
Manual failure with passed checks (conditional share)0 / 0 (Unknown)
Failure recorded only manually5 / 5 (100%)
Failure recorded by both methods0 / 5 (0%)
Violation recorded only automatically0 / 5 (0%)
Comparison units with manual failures5 / 147 (3.4%)
Review needed or insufficient evidence5 / 5 (100%)
No automated check mapped0 / 5 (0%)
Applicability disagreement0 / 5 (0%)
Execution progress of mapped checks0 / 84 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Dimension · Cognition · Completed evidence

Dimension · Cognition · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 735

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results58 / 58 (100%)
No automated check mapped117 / 246 (47.6%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation58 / 246 (23.6%)
Manual failure; all mapped automated checks passed0 / 246 (0%)
Manual failure; automated checks inapplicable0 / 246 (0%)
Manual violation; no configured automated rule117 / 246 (47.6%)
Manual violation; automated review required4 / 246 (1.6%)
Manual violation; automated evidence unavailable67 / 246 (27.2%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually188 / 267 (70.4%)
Failure recorded by both methods58 / 267 (21.7%)
Violation recorded only automatically21 / 267 (7.9%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations735 / 735 (100%)
Shared criteria with automated checks252 / 735 (34.3%)
Shared criteria with complete automated checks0 / 735 (0%)
Comparison units with manual observations735 / 735 (100%)
Comparison units with mapped automated checks252 / 735 (34.3%)
Comparison units with complete mapped checks0 / 735 (0%)
Comparison units observed by both methods252 / 735 (34.3%)
Automated violation among manual failures58 / 246 (23.6%)
Agreement among violation or passed-check results58 / 58 (100%)
Manual failure with passed checks (conditional share)0 / 58 (0%)
Failure recorded only manually188 / 267 (70.4%)
Failure recorded by both methods58 / 267 (21.7%)
Violation recorded only automatically21 / 267 (7.9%)
Comparison units with manual failures246 / 735 (33.5%)
Review needed or insufficient evidence71 / 246 (28.9%)
No automated check mapped117 / 246 (47.6%)
Applicability disagreement0 / 246 (0%)
Execution progress of mapped checks0 / 252 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Manual requirement group · 1 · Completed evidence

Manual requirement group · 1 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 420

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results34 / 34 (100%)
No automated check mapped52 / 125 (41.6%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation34 / 125 (27.2%)
Manual failure; all mapped automated checks passed0 / 125 (0%)
Manual failure; automated checks inapplicable0 / 125 (0%)
Manual violation; no configured automated rule52 / 125 (41.6%)
Manual violation; automated review required4 / 125 (3.2%)
Manual violation; automated evidence unavailable35 / 125 (28%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually91 / 129 (70.5%)
Failure recorded by both methods34 / 129 (26.4%)
Violation recorded only automatically4 / 129 (3.1%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations420 / 420 (100%)
Shared criteria with automated checks168 / 420 (40%)
Shared criteria with complete automated checks0 / 420 (0%)
Comparison units with manual observations420 / 420 (100%)
Comparison units with mapped automated checks168 / 420 (40%)
Comparison units with complete mapped checks0 / 420 (0%)
Comparison units observed by both methods168 / 420 (40%)
Automated violation among manual failures34 / 125 (27.2%)
Agreement among violation or passed-check results34 / 34 (100%)
Manual failure with passed checks (conditional share)0 / 34 (0%)
Failure recorded only manually91 / 129 (70.5%)
Failure recorded by both methods34 / 129 (26.4%)
Violation recorded only automatically4 / 129 (3.1%)
Comparison units with manual failures125 / 420 (29.8%)
Review needed or insufficient evidence39 / 125 (31.2%)
No automated check mapped52 / 125 (41.6%)
Applicability disagreement0 / 125 (0%)
Execution progress of mapped checks0 / 168 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Manual requirement group · 2 · Completed evidence

Manual requirement group · 2 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 420

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results22 / 22 (100%)
No automated check mapped70 / 134 (52.2%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation22 / 134 (16.4%)
Manual failure; all mapped automated checks passed0 / 134 (0%)
Manual failure; automated checks inapplicable0 / 134 (0%)
Manual violation; no configured automated rule70 / 134 (52.2%)
Manual violation; automated review required1 / 134 (0.7%)
Manual violation; automated evidence unavailable41 / 134 (30.6%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually112 / 141 (79.4%)
Failure recorded by both methods22 / 141 (15.6%)
Violation recorded only automatically7 / 141 (5%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations420 / 420 (100%)
Shared criteria with automated checks126 / 420 (30%)
Shared criteria with complete automated checks0 / 420 (0%)
Comparison units with manual observations420 / 420 (100%)
Comparison units with mapped automated checks126 / 420 (30%)
Comparison units with complete mapped checks0 / 420 (0%)
Comparison units observed by both methods126 / 420 (30%)
Automated violation among manual failures22 / 134 (16.4%)
Agreement among violation or passed-check results22 / 22 (100%)
Manual failure with passed checks (conditional share)0 / 22 (0%)
Failure recorded only manually112 / 141 (79.4%)
Failure recorded by both methods22 / 141 (15.6%)
Violation recorded only automatically7 / 141 (5%)
Comparison units with manual failures134 / 420 (31.9%)
Review needed or insufficient evidence42 / 134 (31.3%)
No automated check mapped70 / 134 (52.2%)
Applicability disagreement0 / 134 (0%)
Execution progress of mapped checks0 / 126 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Manual requirement group · 3 · Completed evidence

Manual requirement group · 3 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 273

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results2 / 2 (100%)
No automated check mapped27 / 41 (65.9%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation2 / 41 (4.9%)
Manual failure; all mapped automated checks passed0 / 41 (0%)
Manual failure; automated checks inapplicable0 / 41 (0%)
Manual violation; no configured automated rule27 / 41 (65.9%)
Manual violation; automated review required1 / 41 (2.4%)
Manual violation; automated evidence unavailable11 / 41 (26.8%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually39 / 55 (70.9%)
Failure recorded by both methods2 / 55 (3.6%)
Violation recorded only automatically14 / 55 (25.5%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations273 / 273 (100%)
Shared criteria with automated checks63 / 273 (23.1%)
Shared criteria with complete automated checks0 / 273 (0%)
Comparison units with manual observations273 / 273 (100%)
Comparison units with mapped automated checks63 / 273 (23.1%)
Comparison units with complete mapped checks0 / 273 (0%)
Comparison units observed by both methods63 / 273 (23.1%)
Automated violation among manual failures2 / 41 (4.9%)
Agreement among violation or passed-check results2 / 2 (100%)
Manual failure with passed checks (conditional share)0 / 2 (0%)
Failure recorded only manually39 / 55 (70.9%)
Failure recorded by both methods2 / 55 (3.6%)
Violation recorded only automatically14 / 55 (25.5%)
Comparison units with manual failures41 / 273 (15%)
Review needed or insufficient evidence12 / 41 (29.3%)
No automated check mapped27 / 41 (65.9%)
Applicability disagreement0 / 41 (0%)
Execution progress of mapped checks0 / 63 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Manual requirement group · 4 · Completed evidence

Manual requirement group · 4 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 63

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results19 / 19 (100%)
No automated check mapped10 / 31 (32.3%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation19 / 31 (61.3%)
Manual failure; all mapped automated checks passed0 / 31 (0%)
Manual failure; automated checks inapplicable0 / 31 (0%)
Manual violation; no configured automated rule10 / 31 (32.3%)
Manual violation; automated review required1 / 31 (3.2%)
Manual violation; automated evidence unavailable1 / 31 (3.2%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually12 / 31 (38.7%)
Failure recorded by both methods19 / 31 (61.3%)
Violation recorded only automatically0 / 31 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations57 / 63 (90.5%)
Shared criteria with automated checks21 / 63 (33.3%)
Shared criteria with complete automated checks0 / 63 (0%)
Comparison units with manual observations57 / 63 (90.5%)
Comparison units with mapped automated checks21 / 63 (33.3%)
Comparison units with complete mapped checks0 / 63 (0%)
Comparison units observed by both methods21 / 63 (33.3%)
Automated violation among manual failures19 / 31 (61.3%)
Agreement among violation or passed-check results19 / 19 (100%)
Manual failure with passed checks (conditional share)0 / 19 (0%)
Failure recorded only manually12 / 31 (38.7%)
Failure recorded by both methods19 / 31 (61.3%)
Violation recorded only automatically0 / 31 (0%)
Comparison units with manual failures31 / 63 (49.2%)
Review needed or insufficient evidence2 / 31 (6.5%)
No automated check mapped10 / 31 (32.3%)
Applicability disagreement0 / 31 (0%)
Execution progress of mapped checks0 / 21 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Automated requirement group · 1 · Completed evidence

Automated requirement group · 1 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 420

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results34 / 34 (100%)
No automated check mapped52 / 125 (41.6%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation34 / 125 (27.2%)
Manual failure; all mapped automated checks passed0 / 125 (0%)
Manual failure; automated checks inapplicable0 / 125 (0%)
Manual violation; no configured automated rule52 / 125 (41.6%)
Manual violation; automated review required4 / 125 (3.2%)
Manual violation; automated evidence unavailable35 / 125 (28%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually91 / 129 (70.5%)
Failure recorded by both methods34 / 129 (26.4%)
Violation recorded only automatically4 / 129 (3.1%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations420 / 420 (100%)
Shared criteria with automated checks168 / 420 (40%)
Shared criteria with complete automated checks0 / 420 (0%)
Comparison units with manual observations420 / 420 (100%)
Comparison units with mapped automated checks168 / 420 (40%)
Comparison units with complete mapped checks0 / 420 (0%)
Comparison units observed by both methods168 / 420 (40%)
Automated violation among manual failures34 / 125 (27.2%)
Agreement among violation or passed-check results34 / 34 (100%)
Manual failure with passed checks (conditional share)0 / 34 (0%)
Failure recorded only manually91 / 129 (70.5%)
Failure recorded by both methods34 / 129 (26.4%)
Violation recorded only automatically4 / 129 (3.1%)
Comparison units with manual failures125 / 420 (29.8%)
Review needed or insufficient evidence39 / 125 (31.2%)
No automated check mapped52 / 125 (41.6%)
Applicability disagreement0 / 125 (0%)
Execution progress of mapped checks0 / 168 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Automated requirement group · 3 · Completed evidence

Automated requirement group · 3 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 273

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results2 / 2 (100%)
No automated check mapped27 / 41 (65.9%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation2 / 41 (4.9%)
Manual failure; all mapped automated checks passed0 / 41 (0%)
Manual failure; automated checks inapplicable0 / 41 (0%)
Manual violation; no configured automated rule27 / 41 (65.9%)
Manual violation; automated review required1 / 41 (2.4%)
Manual violation; automated evidence unavailable11 / 41 (26.8%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually39 / 55 (70.9%)
Failure recorded by both methods2 / 55 (3.6%)
Violation recorded only automatically14 / 55 (25.5%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations273 / 273 (100%)
Shared criteria with automated checks63 / 273 (23.1%)
Shared criteria with complete automated checks0 / 273 (0%)
Comparison units with manual observations273 / 273 (100%)
Comparison units with mapped automated checks63 / 273 (23.1%)
Comparison units with complete mapped checks0 / 273 (0%)
Comparison units observed by both methods63 / 273 (23.1%)
Automated violation among manual failures2 / 41 (4.9%)
Agreement among violation or passed-check results2 / 2 (100%)
Manual failure with passed checks (conditional share)0 / 2 (0%)
Failure recorded only manually39 / 55 (70.9%)
Failure recorded by both methods2 / 55 (3.6%)
Violation recorded only automatically14 / 55 (25.5%)
Comparison units with manual failures41 / 273 (15%)
Review needed or insufficient evidence12 / 41 (29.3%)
No automated check mapped27 / 41 (65.9%)
Applicability disagreement0 / 41 (0%)
Execution progress of mapped checks0 / 63 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Automated requirement group · 4 · Completed evidence

Automated requirement group · 4 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 63

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results19 / 19 (100%)
No automated check mapped10 / 31 (32.3%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation19 / 31 (61.3%)
Manual failure; all mapped automated checks passed0 / 31 (0%)
Manual failure; automated checks inapplicable0 / 31 (0%)
Manual violation; no configured automated rule10 / 31 (32.3%)
Manual violation; automated review required1 / 31 (3.2%)
Manual violation; automated evidence unavailable1 / 31 (3.2%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually12 / 31 (38.7%)
Failure recorded by both methods19 / 31 (61.3%)
Violation recorded only automatically0 / 31 (0%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations57 / 63 (90.5%)
Shared criteria with automated checks21 / 63 (33.3%)
Shared criteria with complete automated checks0 / 63 (0%)
Comparison units with manual observations57 / 63 (90.5%)
Comparison units with mapped automated checks21 / 63 (33.3%)
Comparison units with complete mapped checks0 / 63 (0%)
Comparison units observed by both methods21 / 63 (33.3%)
Automated violation among manual failures19 / 31 (61.3%)
Agreement among violation or passed-check results19 / 19 (100%)
Manual failure with passed checks (conditional share)0 / 19 (0%)
Failure recorded only manually12 / 31 (38.7%)
Failure recorded by both methods19 / 31 (61.3%)
Violation recorded only automatically0 / 31 (0%)
Comparison units with manual failures31 / 63 (49.2%)
Review needed or insufficient evidence2 / 31 (6.5%)
No automated check mapped10 / 31 (32.3%)
Applicability disagreement0 / 31 (0%)
Execution progress of mapped checks0 / 21 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Automated requirement group · 2 · Completed evidence

Automated requirement group · 2 · Subjects tested by both methods · Equivalent criteria · Completed evidence

Study subjects: 21; Criterion comparison units: 420

Same recorded scope: 18

Different assessed scopes: 3

What does automation detect among manual failures?
MeasureCount / denominator (share)
Agreement among violation or passed-check results22 / 22 (100%)
No automated check mapped70 / 134 (52.2%)
What does automation detect among manual failures?
What does automation detect among manual failures?
MeasureCount / denominator (share)
Manual violation; automated violation22 / 134 (16.4%)
Manual failure; all mapped automated checks passed0 / 134 (0%)
Manual failure; automated checks inapplicable0 / 134 (0%)
Manual violation; no configured automated rule70 / 134 (52.2%)
Manual violation; automated review required1 / 134 (0.7%)
Manual violation; automated evidence unavailable41 / 134 (30.6%)
What does each method contribute?
MeasureCount / denominator (share)
Failure recorded only manually112 / 141 (79.4%)
Failure recorded by both methods22 / 141 (15.6%)
Violation recorded only automatically7 / 141 (5%)
Comparison measures
Which criteria are covered?
MeasureCount / denominator (share)
Shared criteria with manual observations420 / 420 (100%)
Shared criteria with automated checks126 / 420 (30%)
Shared criteria with complete automated checks0 / 420 (0%)
Comparison units with manual observations420 / 420 (100%)
Comparison units with mapped automated checks126 / 420 (30%)
Comparison units with complete mapped checks0 / 420 (0%)
Comparison units observed by both methods126 / 420 (30%)
Automated violation among manual failures22 / 134 (16.4%)
Agreement among violation or passed-check results22 / 22 (100%)
Manual failure with passed checks (conditional share)0 / 22 (0%)
Failure recorded only manually112 / 141 (79.4%)
Failure recorded by both methods22 / 141 (15.6%)
Violation recorded only automatically7 / 141 (5%)
Comparison units with manual failures134 / 420 (31.9%)
Review needed or insufficient evidence42 / 134 (31.3%)
No automated check mapped70 / 134 (52.2%)
Applicability disagreement0 / 134 (0%)
Execution progress of mapped checks0 / 126 (0%)
Subjects without an automated run0 / 21 (0%)
Subjects with unknown manual criterion scope0 / 21 (0%)
Subjects with unknown automated criterion scope0 / 21 (0%)
Source qualifications
AvailabilityRuns
Recorded method version is outside this comparison1
Method coverage and observations
Method coverage and observations
MethodCases with results / configuredCriteria with observations / mappedCriteria in scopeRequirements: observed / mapped / in scopeAvailability
Manual eCH Web assessment · 2.1.00 / 00 / 043120 / 0 / 308No matching run
Automated WCAG checks (axe) · 1.2.05580 / 58591674 / 16745208372 / 372 / 372Available
Manual eCH Web assessment · 2.1.02298 / 23001118 / 1120112080 / 80 / 80Available
Automated WCAG checks (axe) · 1.2.00 / 00 / 05040 / 0 / 36No matching run
Manual eCH Web assessment · 2.0.0570 / 575275 / 28028020 / 20 / 20Available
Show data table
Method coverage and observations
MethodRunsCases with results / configuredCriteria with observations / mappedCriteria in scopeCases with failuresPositive case observationsNot applicableReview neededUnknownCases without criterion mappingExecution: complete / partial / unverifiedRequirements: observed / mapped / in scopeAvailability
Manual eCH Web assessment · 2.1.000 / 00 / 043120000000 / 0 / 770 / 0 / 308No matching run
Automated WCAG checks (axe) · 1.2.0935580 / 58591674 / 167452084382188279615827900 / 0 / 93372 / 372 / 372Available
Manual eCH Web assessment · 2.1.0202298 / 23001118 / 112011206498927570200 / 0 / 2080 / 80 / 80Available
Automated WCAG checks (axe) · 1.2.000 / 00 / 05040000000 / 0 / 90 / 0 / 36No matching run
Manual eCH Web assessment · 2.0.05570 / 575275 / 2802801282621800500 / 0 / 520 / 20 / 20Available

PDF documents: manual assessment

The document Quick Test comprises 25 assessments of 20 distinct documents. Several websites use the same document; identical content counts once in the document-level analysis. Ratings of the same document agree.

The Quick Test is a sample assessment at the tester’s discretion. The stored rating is the mean of numerical observation ratings on a 1–10 scale. Under the specification used, 6 points or more, including the boundary, receives the label “conforming”: 4 of 20 documents meet it. This classification does not certify full conformance. The manual Web assessment’s G classes do not apply to PDFs.

PDF documents: automated testing

98 selected test runs cover 93 distinct documents. All 98 validations completed; no selected execution failed or remained unvalidated. Of the 102 websites, 4 have no selected automated PDF test run; they do not count as passes.

91 of 93 documents have at least one automatically detected rule violation. 2 have no detected violation; this does not certify full PDF/UA conformance. The median is 7 failed rules per document, ranging from 0 to 17.

Testing used PDF/UA-1, with veraPDF 1.30.2 (96 runs) and 1.30.3 (2 runs). The results therefore come from two software versions.

Manual PDF testing: rating distribution

20 distinct documents, 25 assessments. Manual observations belong to one general Quick Test case without individual criterion assignments. They cannot support a manual top-five list by criterion. The stored rating distribution is therefore shown alongside the most frequent automated rule violations.

Rating (1–10) Documents Quick Test classification
1 11 non-conforming (below 6)
4 5 non-conforming (below 6)
7 3 conforming (6 or more)
10 1 conforming (6 or more)

Automated PDF testing: most frequent rule violations

93 distinct documents. Top five, extended for ties. Each document counts once per rule. The two tables show different measures and populations of different sizes.

PDF/UA-1 rule and meaning Documents with violation
5-1 — PDF/UA identifier missing from metadata 76 / 93
7.1-10 — Document title not displayed as the window title 61 / 93
7.1-3 — Content neither tagged nor marked as a decorative artifact 61 / 93
7.18.1-2 — Annotations without an alternative description 43 / 93
6.2-1 — Tagged-document flag missing (MarkInfo/Marked) 42 / 93
7.18.5-2 — Links without an alternative description 42 / 93

Automated PDF testing by sector

Each website with a selected run counts once (98 websites). The same PDF may occur on several sites. “Distinct documents” counts documents within each sector; violation counts and the median refer to websites. In the media sector, 15 websites represent 10 distinct documents.

Sector Websites Distinct documents With violation Without detected violation Median failed rules per site
Federal government 4 4 4 0 5
Federal-related organisations 5 5 5 0 10
Cantons 26 26 24 2 7
Canton-related organisations 6 6 6 0 5.5
Towns and municipalities 15 15 15 0 8
Higher education 19 19 19 0 7
Media 15 10 15 0 8
Online shops 8 8 8 0 6.5

Manual and automated testing of the same PDF

All 20 manually assessed documents were also tested automatically, using the same document version in each pair (25 linked assessments). All have at least one automatically detected rule violation, including the 4 classified as “conforming” manually. Those documents failed 1, 4, 5 and 6 rules respectively. The document rated 10 manually has one automated rule violation.

A high manual sample rating and an automated rule violation can therefore coexist: the methods examine different aspects. The number of failed rules is not converted into a manual rating.

Easy-to-read language

The pilot study includes easy-to-read language in a Swiss accessibility study for the first time.

Entry point on the home page. Only 6 of 101 websites provide a recognisable entry point to easy-to-read content on the home page. On another 7, an indication exists but cannot clearly be recognised as an entry point. No entry point was found on 88 websites.

Sector Entry point present Unclear Not found
Public administration 5 5 48
Higher education 1 0 18
Media 0 0 15
Online shops 0 2 7

Detailed assessment. A specialist assessed the standard's criteria for 33 websites. Easy-to-read content was found on only 6. Where no content can be found, findability is considered unfulfilled; language level and the icon are not assessed there.

Criterion Fulfilled
Prominent, consistent findability (eCH-0059 13.6) 2 of 33
Language level A2 (13.2) 5 of 6 with easy-to-read content
Easy-to-read icon (13.3) 2 of 6 with easy-to-read content

No website fulfils all three criteria. Where easy-to-read language is offered, texts are usually understandable, but often difficult to find and not marked with the icon. People who depend on it therefore frequently cannot reach the available information.

Accessibility statements

Manual assessment: the verdict

The recorded manual accessibility-statement verdict is non-conformant for 23 of 28 websites and conformant for 5. The remaining 74 websites in the study have no selected manual accessibility-statement test.

These classifications retain the existing verdicts of the completed manual tests. Their 46 rated observations concern accessibility statements only. Other supplementary requirements are marked not applicable in these tests. The classification follows this test’s rules; it is not the overall Web accessibility score G.

Scope of the manual assessment

Recorded observations cover criteria 16.1, 16.3, 16.4 and 16.8. A completed test does not mean that all eight criteria have a recorded rating. “Without a rating” counts as neither fulfilled nor unfulfilled.

Criterion Rated (of 28) No rating (of 28)
16.1 Compliance status and scope 6 22
16.2 Documented exemptions 0 28
16.3 Feedback mechanism and escalation contact 6 22
16.4 German, French and Italian 6 22
16.5 Romansh 0 28
16.6 English 0 28
16.7 Machine-readable version 0 28
16.8 Reachable from every page 28 0

Supplementary automated detection

The automated check records whether a statement and particular information can be detected. It covers 101 websites and does not replace the manual verdict. The populations differ: 28 manually tested and 101 automatically checked websites.

Result Websites
Statement detected 8
Accessibility page, not clearly recognisable as a statement 25
No statement found 53
Technically untestable 15

Statements have so far been found almost exclusively on public-sector and higher education websites: the eight detected statements come from one federal website, four cantons and three higher education institutions. No statement was found on any of the 15 media websites.

How often individual items were detected:

Criterion Detected on
16.1 Compliance status and scope 8
16.2 Documented exemptions 7
16.3 Feedback mechanism and escalation contact 1
16.4 German, French and Italian 2
16.5 Romansh 0
16.6 English 4
16.7 Machine-readable version 0
16.8 Reachable from every page 6

Existing statements usually give compliance status and known limitations. A feedback mechanism with an escalation contact for people whose feedback remains unanswered was detected in only one statement. No machine-readable version, newly required by eCH-0059, was found. «Detected» means that the information is present; whether its content fulfils the requirement is assessed through the Additional web requirements tests.

Study groups

Results for media and public administration are shown separately by test method. Small populations remain visible with their counts. These group views are subsets of the whole study; their counts are not added to the overall total.

Media

Websites in this group: 15

Manual assessment
MeasureValue
Websites with selected completed manual runs14
Websites with a calculable assessment14
Median overall score G66.34
Observed score range52.71–72.93
Overall G assessment: classes and distribution
Overall class from GOffers / assessable offers
Good accessibilityScore interval (points): 90 ≤ G ≤ 1000 / 14 (0.0 %)
Conditional accessibilityScore interval (points): 80 ≤ G < 900 / 14 (0.0 %)
Insufficient accessibilityScore interval (points): 60 ≤ G < 8010 / 14 (71.4 %)
Poor accessibilityScore interval (points): 0 ≤ G < 604 / 14 (28.6 %)
Automated results
MeasureValue
Websites with automated results12
Websites without automated results3
Websites with observed criterion evidence12
Websites with a detected violation12
Mean number of affected criteria per website with criterion evidence5.92

Execution completeness was not captured in this dataset.

Manual testing

Manual eCH Web assessment · 2.1.0

Criterion scope: WCAG A/AA — eCH Web

Completed evidence — Included websites: 14

Bar length: share of the 14 websites in this list.

Most frequent findings, top 5
  • 1.1.1 — Non-text Content — 14 / 14
  • 1.3.1 — Info and Relationships — 14 / 14
  • 4.1.2 — Name, Role, Value — 14 / 14
  • 1.4.3 — Contrast (Minimum) — 13 / 14
  • 2.2.2 — Pause, Stop, Hide — 13 / 14
  • 2.4.6 — Headings and Labels — 13 / 14
All criteria and evidence states
All criteria and evidence states
CriterionWebsites with an observed deficiencyWebsites with criterion evidenceResult statesAdditional notes (may overlap)
1.1.1 — Non-text Content1414Recorded violation: 14
1.3.1 — Info and Relationships1414Recorded violation: 14
4.1.2 — Name, Role, Value1414Recorded violation: 14
1.4.3 — Contrast (Minimum)1314Assessed without a violation: 1; Recorded violation: 13
2.2.2 — Pause, Stop, Hide1314Assessed without a violation: 1; Recorded violation: 13
2.4.6 — Headings and Labels1314Assessed without a violation: 1; Recorded violation: 13
2.4.11 — Focus Not Obscured (Minimum)1214Assessed without a violation: 2; Recorded violation: 12
3.3.2 — Labels or Instructions1214Assessed without a violation: 2; Recorded violation: 12
2.4.2 — Page Titled1114Assessed without a violation: 3; Recorded violation: 11
2.4.3 — Focus Order1114Assessed without a violation: 3; Recorded violation: 11
2.4.4 — Link Purpose (In Context)1114Assessed without a violation: 3; Recorded violation: 11
2.1.1 — Keyboard1014Assessed without a violation: 4; Recorded violation: 10
2.5.3 — Label in Name1014Assessed without a violation: 4; Recorded violation: 10
3.3.1 — Error Identification914Not applicable: 1; Assessed without a violation: 4; Recorded violation: 9
2.4.1 — Bypass Blocks814Assessed without a violation: 6; Recorded violation: 8
2.4.7 — Focus Visible814Assessed without a violation: 6; Recorded violation: 8
3.3.3 — Error Suggestion814Not applicable: 1; Assessed without a violation: 5; Recorded violation: 8
1.4.4 — Resize text714Assessed without a violation: 7; Recorded violation: 7
1.4.11 — Non-Text Contrast614Assessed without a violation: 8; Recorded violation: 6
4.1.3 — Status Messages614Assessed without a violation: 8; Recorded violation: 6
1.2.3 — Audio Description or Media Alternative (Prerecorded)514Not applicable: 9; Recorded violation: 5
1.2.5 — Audio Description (Prerecorded)514Not applicable: 9; Recorded violation: 5
1.3.5 — Identify Input Purpose514Not applicable: 1; Assessed without a violation: 8; Recorded violation: 5
1.4.12 — Text Spacing414Assessed without a violation: 10; Recorded violation: 4
1.2.2 — Captions (Prerecorded)314Not applicable: 7; Assessed without a violation: 4; Recorded violation: 3
1.3.2 — Meaningful Sequence314Assessed without a violation: 11; Recorded violation: 3
1.4.10 — Reflow214Assessed without a violation: 12; Recorded violation: 2
1.2.1 — Audio-only and Video-only (Prerecorded)114Not applicable: 13; Recorded violation: 1
1.4.1 — Use of Color114Assessed without a violation: 13; Recorded violation: 1
1.4.5 — Images of Text114Assessed without a violation: 13; Recorded violation: 1
2.4.5 — Multiple Ways114Assessed without a violation: 13; Recorded violation: 1
2.5.2 — Pointer Cancellation114Assessed without a violation: 13; Recorded violation: 1
3.1.1 — Language of Page114Assessed without a violation: 13; Recorded violation: 1
1.2.4 — Captions (Live)014Not applicable: 14
1.3.3 — Sensory Characteristics014Not applicable: 1; Assessed without a violation: 13
1.3.4 — Orientation014Not applicable: 14
1.4.13 — Content on Hover or Focus014Not applicable: 4; Assessed without a violation: 10
1.4.2 — Audio Control014Not applicable: 6; Assessed without a violation: 8
2.1.2 — No Keyboard Trap014Not applicable: 1; Assessed without a violation: 13
2.1.4 — Character Key Shortcuts014Not applicable: 2; Assessed without a violation: 12
2.2.1 — Timing Adjustable014Not applicable: 14
2.3.1 — Three Flashes or Below Threshold014Assessed without a violation: 14
2.5.1 — Pointer Gestures014Not applicable: 14
2.5.4 — Motion Actuation014Not applicable: 14
2.5.7 — Dragging Movements014Not applicable: 14
2.5.8 — Target Size (Minimum)014Assessed without a violation: 14
3.1.2 — Language of Parts014Not applicable: 14
3.2.1 — On Focus014Not applicable: 1; Assessed without a violation: 13
3.2.2 — On Input014Not applicable: 1; Assessed without a violation: 13
3.2.3 — Consistent Navigation014Assessed without a violation: 14
3.2.4 — Consistent Identification014Assessed without a violation: 14
3.2.6 — Consistent Help014Assessed without a violation: 14
3.3.4 — Error Prevention (Legal, Financial, Data)014Not applicable: 14
3.3.7 — Redundant Entry014Not applicable: 6; Assessed without a violation: 8
3.3.8 — Accessible Authentication (Minimum)014Not applicable: 1; Assessed without a violation: 13
4.1.1 — Parsing (obsolete)014Not applicable: 13; Assessed without a violation: 1
Data basis and sources

checklist-ech-0059-web · 2.1.0

checklist-ech-0059-web · 2.0.0 ·

eCH-0059: ech-0059

WCAG 2.2: wcag2.2

manual-automated-v4 · 7d4e21a1256b2375f0c336a43c2c090424b67a2350ffc7bfd6b383d5b1e01255

adis-web-wcag-aa-manual · 2026-11-07.1 · afbaceb79c5525117679fe7e510557d1e95ae200e375d770539e16594120d115

Automated testing

Automated WCAG checks (axe) · 1.2.0

Criterion scope: WCAG A/AA — axe

Selected runs — Included websites: 12

Bar length: share of the 12 websites in this list.

Most frequent findings, top 5
  • 4.1.2 — Name, Role, Value — 12 / 12
  • 1.4.3 — Contrast (Minimum) — 11 / 12
  • 2.4.2 — Page Titled — 11 / 12
  • 3.1.1 — Language of Page — 11 / 12
  • 1.1.1 — Non-text Content — 10 / 12
All criteria and evidence states
All criteria and evidence states
CriterionWebsites with an observed deficiencyWebsites with criterion evidenceResult statesAdditional notes (may overlap)
4.1.2 — Name, Role, Value1212Recorded violation: 12Completeness not confirmed: 12
1.4.3 — Contrast (Minimum)1112Review required: 1; Recorded violation: 11Completeness not confirmed: 12
2.4.2 — Page Titled1112Incomplete results: 1; Recorded violation: 11Completeness not confirmed: 12
3.1.1 — Language of Page1112Incomplete results: 1; Recorded violation: 11Completeness not confirmed: 12
1.1.1 — Non-text Content1012Incomplete results: 2; Recorded violation: 10Completeness not confirmed: 12
2.4.4 — Link Purpose (In Context)812Incomplete results: 4; Recorded violation: 8Completeness not confirmed: 12
1.3.1 — Info and Relationships312Unassessed or unavailable: 9; Recorded violation: 3Completeness not confirmed: 12; Evidence or mapping not assured: 12
1.4.4 — Resize text312Incomplete results: 9; Recorded violation: 3Completeness not confirmed: 12
1.4.1 — Use of Color112Incomplete results: 8; Review required: 3; Recorded violation: 1Completeness not confirmed: 12
2.1.1 — Keyboard112Incomplete results: 11; Recorded violation: 1Completeness not confirmed: 12
1.2.1 — Audio-only and Video-only (Prerecorded)Unavailable12Incomplete results: 11; Review required: 1Completeness not confirmed: 12
1.2.2 — Captions (Prerecorded)Unavailable12Incomplete results: 8; Review required: 4Completeness not confirmed: 12
1.2.3 — Audio Description or Media Alternative (Prerecorded)Unavailable12No mapped rule: 12
1.2.4 — Captions (Live)Unavailable12No mapped rule: 12
1.2.5 — Audio Description (Prerecorded)Unavailable12No mapped rule: 12
1.3.2 — Meaningful SequenceUnavailable12No mapped rule: 12
1.3.3 — Sensory CharacteristicsUnavailable12No mapped rule: 12
1.3.4 — OrientationUnavailable12No mapped rule: 12
1.3.5 — Identify Input PurposeUnavailable12No mapped rule: 12
1.4.10 — ReflowUnavailable12No mapped rule: 12
1.4.11 — Non-Text ContrastUnavailable12No mapped rule: 12
1.4.12 — Text SpacingUnavailable12No mapped rule: 12
1.4.13 — Content on Hover or FocusUnavailable12No mapped rule: 12
1.4.2 — Audio ControlUnavailable12Incomplete results: 10; Review required: 2Completeness not confirmed: 12
1.4.5 — Images of TextUnavailable12No mapped rule: 12
2.1.2 — No Keyboard TrapUnavailable12No mapped rule: 12
2.1.4 — Character Key ShortcutsUnavailable12No mapped rule: 12
2.2.1 — Timing AdjustableUnavailable12Incomplete results: 12Completeness not confirmed: 12
2.2.2 — Pause, Stop, HideUnavailable12Incomplete results: 12Completeness not confirmed: 12
2.3.1 — Three Flashes or Below ThresholdUnavailable12No mapped rule: 12
2.4.1 — Bypass BlocksUnavailable12Incomplete results: 8; Review required: 4Completeness not confirmed: 12
2.4.11 — Focus Not Obscured (Minimum)Unavailable12No mapped rule: 12
2.4.3 — Focus OrderUnavailable12No mapped rule: 12
2.4.5 — Multiple WaysUnavailable12No mapped rule: 12
2.4.6 — Headings and LabelsUnavailable12No mapped rule: 12
2.4.7 — Focus VisibleUnavailable12No mapped rule: 12
2.5.1 — Pointer GesturesUnavailable12No mapped rule: 12
2.5.2 — Pointer CancellationUnavailable12No mapped rule: 12
2.5.3 — Label in NameUnavailable12No mapped rule: 12
2.5.4 — Motion ActuationUnavailable12No mapped rule: 12
2.5.7 — Dragging MovementsUnavailable12No mapped rule: 12
2.5.8 — Target Size (Minimum)Unavailable12No mapped rule: 12
3.1.2 — Language of PartsUnavailable12Incomplete results: 12Completeness not confirmed: 12
3.2.1 — On FocusUnavailable12No mapped rule: 12
3.2.2 — On InputUnavailable12No mapped rule: 12
3.2.3 — Consistent NavigationUnavailable12No mapped rule: 12
3.2.4 — Consistent IdentificationUnavailable12No mapped rule: 12
3.2.6 — Consistent HelpUnavailable12No mapped rule: 12
3.3.1 — Error IdentificationUnavailable12No mapped rule: 12
3.3.2 — Labels or InstructionsUnavailable12Incomplete results: 10; Review required: 2Completeness not confirmed: 12
3.3.3 — Error SuggestionUnavailable12No mapped rule: 12
3.3.4 — Error Prevention (Legal, Financial, Data)Unavailable12No mapped rule: 12
3.3.7 — Redundant EntryUnavailable12No mapped rule: 12
3.3.8 — Accessible Authentication (Minimum)Unavailable12No mapped rule: 12
4.1.1 — Parsing (obsolete)Unavailable12No mapped rule: 12
4.1.3 — Status MessagesUnavailable12No mapped rule: 12
Data basis and sources

wcag22-automated-axe · 1.2.0

eCH-0059: ech-0059

WCAG 2.2: wcag2.2

manual-automated-v4 · 7d4e21a1256b2375f0c336a43c2c090424b67a2350ffc7bfd6b383d5b1e01255

adis-web-wcag-aa-automated · 2026-11-07.1 · 99167cf7de6eb9ecc95f8757c0c610a88ce3f5195eb5fcb93dd5d3d778cd09d9

Accessibility profile

Each bar shows the arithmetic mean of the fulfilment shares for individual websites. Each website has equal weight. The value describes the share of criteria met, not the share of accessible websites. Inapplicable criteria are excluded; missing results do not count as zero. n is the number of websites with a numerical result in the group shown.

Manual Web testing

Method and source

derived:adis-manual-criterion-result/2026-11-07.1/projection:afbaceb79c5525117679fe7e510557d1e95ae200e375d770539e16594120d115/policy:06df74ff43db17a4b908861d5f049c414bef2188a715cd25376dc59cfadb22e2

Mobile operability · adis-wcag-derived-2026-11-07.1 · Approved

Keyboard operability · adis-wcag-derived-2026-11-07.1 · Approved

Voice control · adis-wcag-derived-2026-11-07.1 · Approved

Compatibility with user agents · adis-wcag-derived-2026-11-07.1 · Approved

Interaction assistance · adis-wcag-derived-2026-11-07.1 · Approved

Consistency and predictability · adis-wcag-derived-2026-11-07.1 · Approved

Semantic structure · adis-wcag-derived-2026-11-07.1 · Approved

Understandability · adis-wcag-derived-2026-11-07.1 · Approved

Display flexibility · adis-wcag-derived-2026-11-07.1 · Approved

Contrast and sensory characteristics · adis-wcag-derived-2026-11-07.1 · Approved

Non-text content (graphics) · adis-wcag-derived-2026-11-07.1 · Approved

Multimedia and two-senses principle (audio/video) · adis-wcag-derived-2026-11-07.1 · Approved

Motor skills · adis-wcag-derived-2026-11-07.1 · Approved

Vision · adis-wcag-derived-2026-11-07.1 · Approved

Hearing · adis-wcag-derived-2026-11-07.1 · Approved

Cognition · adis-wcag-derived-2026-11-07.1 · Approved

Keyboard operability: 40.71 % 14 of 15 Domains

Voice control: 64.29 % 14 of 15 Domains

Compatibility with user agents: 30.95 % 14 of 15 Domains

Interaction assistance: 62.24 % 14 of 15 Domains

Consistency and predictability: 100 % 14 of 15 Domains

Semantic structure: 39.29 % 14 of 15 Domains

Understandability: 47.14 % 14 of 15 Domains

Display flexibility: 73.38 % 14 of 15 Domains

Contrast and sensory characteristics: 63.1 % 14 of 15 Domains

Non-text content (graphics): 0 % 14 of 15 Domains

Multimedia and two-senses principle (audio/video): 21.43 % 7 of 15 Domains

Show data table
Manual Web testing — WCAG profile: derived manual results — NAMoS Pilotstudie 2026 / Media — %
Study / cohortMeasureMean %Minimum %Maximum %n assessedTotal DomainsExcludedNotes
NAMoS Pilotstudie 2026 / MediaKeyboard operability40.7116.6783.3314151
14 of 15 Domains with a numeric result

Evidence coverage: Numeric 83; Applicable 89; Not applicable 1; Not numerically mapped 0; Not assessed 6; Conflicting 0

NAMoS Pilotstudie 2026 / MediaVoice control64.295010014151
14 of 15 Domains with a numeric result

Evidence coverage: Numeric 26; Applicable 28; Not applicable 2; Not numerically mapped 0; Not assessed 2; Conflicting 0

NAMoS Pilotstudie 2026 / MediaCompatibility with user agents30.9505014151
14 of 15 Domains with a numeric result

Evidence coverage: Numeric 29; Applicable 32; Not applicable 13; Not numerically mapped 0; Not assessed 3; Conflicting 0

NAMoS Pilotstudie 2026 / MediaInteraction assistance62.2442.8610014151
14 of 15 Domains with a numeric result

Evidence coverage: Numeric 88; Applicable 97; Not applicable 38; Not numerically mapped 0; Not assessed 9; Conflicting 0

NAMoS Pilotstudie 2026 / MediaConsistency and predictability10010010014151
14 of 15 Domains with a numeric result

Evidence coverage: Numeric 68; Applicable 73; Not applicable 2; Not numerically mapped 0; Not assessed 5; Conflicting 0

NAMoS Pilotstudie 2026 / MediaSemantic structure39.2905014151
14 of 15 Domains with a numeric result

Evidence coverage: Numeric 28; Applicable 30; Not applicable 0; Not numerically mapped 0; Not assessed 2; Conflicting 0

NAMoS Pilotstudie 2026 / MediaUnderstandability47.14206014151
14 of 15 Domains with a numeric result

Evidence coverage: Numeric 70; Applicable 76; Not applicable 14; Not numerically mapped 0; Not assessed 6; Conflicting 0

NAMoS Pilotstudie 2026 / MediaDisplay flexibility73.3857.1487.514151
14 of 15 Domains with a numeric result

Evidence coverage: Numeric 102; Applicable 110; Not applicable 10; Not numerically mapped 0; Not assessed 8; Conflicting 0

NAMoS Pilotstudie 2026 / MediaContrast and sensory characteristics63.12510014151
14 of 15 Domains with a numeric result

Evidence coverage: Numeric 55; Applicable 59; Not applicable 1; Not numerically mapped 0; Not assessed 4; Conflicting 0

NAMoS Pilotstudie 2026 / MediaNon-text content (graphics)00014151
14 of 15 Domains with a numeric result

Evidence coverage: Numeric 14; Applicable 15; Not applicable 0; Not numerically mapped 0; Not assessed 1; Conflicting 0

NAMoS Pilotstudie 2026 / MediaMultimedia and two-senses principle (audio/video)21.430507158
7 of 15 Domains with a numeric result

Evidence coverage: Numeric 18; Applicable 23; Not applicable 52; Not numerically mapped 0; Not assessed 5; Conflicting 0

Evidence availability

Automated assessment — Web · Measures · wcag22-automated-axe · 1.2.0 · 2 — NAMoS Pilotstudie 2026 / Media — No numeric profile available; Subjects with a numeric result: 0 / 15; Provisional: live ratings

Manual assessment — Web · Measures · quickcheck-ech-0059-statement · 2 — NAMoS Pilotstudie 2026 / Media — No numeric profile available; Subjects with a numeric result: 0 / 15

Automated assessment — Document · Measures · wcag22-automated-verapdf-pdf · 2 — NAMoS Pilotstudie 2026 / Media — No numeric profile available; Subjects with a numeric result: 0 / 15; Provisional: live ratings

Manual assessment — Web · Measures · checklist-ech-0059-web · 2.1.0 · 2 — NAMoS Pilotstudie 2026 / Media — No numeric profile available; Subjects with a numeric result: 0 / 15

Manual assessment — Document · Measures · quicktest-ech-0059-documents · 2 — NAMoS Pilotstudie 2026 / Media — No numeric profile available; Subjects with a numeric result: 0 / 15

Manual assessment — Web · Measures · checklist-ech-0059-web-zusatz · 2 — NAMoS Pilotstudie 2026 / Media — No numeric profile available; Subjects with a numeric result: 0 / 15

Manual assessment — Web · Measures · checklist-ech-0059-easy-sign · 2 — NAMoS Pilotstudie 2026 / Media — No numeric profile available; Subjects with a numeric result: 0 / 15

Manual assessment — Web · Measures · checklist-ech-0059-web · 2.0.0 · 2 — NAMoS Pilotstudie 2026 / Media — No numeric profile available; Subjects with a numeric result: 0 / 15

Automated assessment — Web · Measures · wcag22-automated-axe · 1.1.0 · 2 — NAMoS Pilotstudie 2026 / Media — No numeric profile available; Subjects with a numeric result: 0 / 15

Public administration

Websites in this group: 59

Manual assessment
MeasureValue
Websites with selected completed manual runs9
Websites with a calculable assessment9
Median overall score G72.58
Observed score range48.4–86.2
Overall G assessment: classes and distribution
Overall class from GOffers / assessable offers
Good accessibilityScore interval (points): 90 ≤ G ≤ 1000 / 9 (0.0 %)
Conditional accessibilityScore interval (points): 80 ≤ G < 902 / 9 (22.2 %)
Insufficient accessibilityScore interval (points): 60 ≤ G < 805 / 9 (55.6 %)
Poor accessibilityScore interval (points): 0 ≤ G < 602 / 9 (22.2 %)
Automated results
MeasureValue
Websites with automated results57
Websites without automated results2
Websites with observed criterion evidence57
Websites with a detected violation52
Mean number of affected criteria per website with criterion evidence3.44

Execution completeness was not captured in this dataset.

Manual testing

Manual eCH Web assessment · 2.1.0

Criterion scope: WCAG A/AA — eCH Web

Completed evidence — Included websites: 9

Bar length: share of the 9 websites in this list.

Most frequent findings, top 5
  • 1.3.1 — Info and Relationships — 9 / 9
  • 4.1.2 — Name, Role, Value — 9 / 9
  • 1.1.1 — Non-text Content — 8 / 9
  • 1.3.5 — Identify Input Purpose — 7 / 9
  • 2.4.3 — Focus Order — 7 / 9
All criteria and evidence states
All criteria and evidence states
CriterionWebsites with an observed deficiencyWebsites with criterion evidenceResult statesAdditional notes (may overlap)
1.3.1 — Info and Relationships99Recorded violation: 9
4.1.2 — Name, Role, Value99Recorded violation: 9
1.1.1 — Non-text Content89Assessed without a violation: 1; Recorded violation: 8
1.3.5 — Identify Input Purpose79Not applicable: 2; Recorded violation: 7
2.4.3 — Focus Order79Assessed without a violation: 2; Recorded violation: 7
2.4.6 — Headings and Labels69Assessed without a violation: 3; Recorded violation: 6
1.4.10 — Reflow59Assessed without a violation: 4; Recorded violation: 5
1.4.3 — Contrast (Minimum)59Assessed without a violation: 4; Recorded violation: 5
2.4.2 — Page Titled59Assessed without a violation: 4; Recorded violation: 5
2.4.4 — Link Purpose (In Context)59Assessed without a violation: 4; Recorded violation: 5
2.4.7 — Focus Visible59Assessed without a violation: 4; Recorded violation: 5
3.3.1 — Error Identification59Not applicable: 1; Assessed without a violation: 3; Recorded violation: 5
1.4.12 — Text Spacing49Assessed without a violation: 5; Recorded violation: 4
1.4.4 — Resize text49Assessed without a violation: 5; Recorded violation: 4
2.1.1 — Keyboard49Assessed without a violation: 5; Recorded violation: 4
2.4.1 — Bypass Blocks49Assessed without a violation: 5; Recorded violation: 4
2.4.11 — Focus Not Obscured (Minimum)49Assessed without a violation: 5; Recorded violation: 4
1.4.1 — Use of Color39Assessed without a violation: 6; Recorded violation: 3
1.4.11 — Non-Text Contrast39Assessed without a violation: 6; Recorded violation: 3
3.3.3 — Error Suggestion39Not applicable: 2; Assessed without a violation: 4; Recorded violation: 3
4.1.3 — Status Messages39Assessed without a violation: 6; Recorded violation: 3
2.5.3 — Label in Name29Assessed without a violation: 7; Recorded violation: 2
3.3.2 — Labels or Instructions29Not applicable: 1; Assessed without a violation: 6; Recorded violation: 2
1.2.2 — Captions (Prerecorded)19Not applicable: 7; Assessed without a violation: 1; Recorded violation: 1
1.2.3 — Audio Description or Media Alternative (Prerecorded)19Not applicable: 8; Recorded violation: 1
1.2.5 — Audio Description (Prerecorded)19Not applicable: 8; Recorded violation: 1
1.3.2 — Meaningful Sequence19Assessed without a violation: 8; Recorded violation: 1
1.4.5 — Images of Text19Assessed without a violation: 8; Recorded violation: 1
2.1.2 — No Keyboard Trap19Assessed without a violation: 8; Recorded violation: 1
3.1.1 — Language of Page19Assessed without a violation: 8; Recorded violation: 1
3.2.1 — On Focus19Not applicable: 1; Assessed without a violation: 7; Recorded violation: 1
3.2.6 — Consistent Help19Assessed without a violation: 8; Recorded violation: 1
1.2.1 — Audio-only and Video-only (Prerecorded)09Not applicable: 9
1.2.4 — Captions (Live)09Not applicable: 9
1.3.3 — Sensory Characteristics09Not applicable: 2; Assessed without a violation: 7
1.3.4 — Orientation09Not applicable: 9
1.4.13 — Content on Hover or Focus09Not applicable: 4; Assessed without a violation: 5
1.4.2 — Audio Control09Not applicable: 7; Assessed without a violation: 2
2.1.4 — Character Key Shortcuts09Not applicable: 1; Assessed without a violation: 8
2.2.1 — Timing Adjustable09Not applicable: 8; Assessed without a violation: 1
2.2.2 — Pause, Stop, Hide09Not applicable: 9
2.3.1 — Three Flashes or Below Threshold09Assessed without a violation: 9
2.4.5 — Multiple Ways09Assessed without a violation: 9
2.5.1 — Pointer Gestures09Not applicable: 8; Assessed without a violation: 1
2.5.2 — Pointer Cancellation09Assessed without a violation: 9
2.5.4 — Motion Actuation09Not applicable: 9
2.5.7 — Dragging Movements09Not applicable: 9
2.5.8 — Target Size (Minimum)09Assessed without a violation: 9
3.1.2 — Language of Parts09Not applicable: 8; Assessed without a violation: 1
3.2.2 — On Input09Assessed without a violation: 9
3.2.3 — Consistent Navigation09Assessed without a violation: 9
3.2.4 — Consistent Identification09Assessed without a violation: 9
3.3.4 — Error Prevention (Legal, Financial, Data)09Not applicable: 9
3.3.7 — Redundant Entry09Not applicable: 1; Assessed without a violation: 8
3.3.8 — Accessible Authentication (Minimum)09Not applicable: 4; Assessed without a violation: 5
4.1.1 — Parsing (obsolete)09Not applicable: 4; Unassessed or unavailable: 5Evidence or mapping not assured: 5
Data basis and sources

checklist-ech-0059-web · 2.1.0

checklist-ech-0059-web · 2.0.0 ·

eCH-0059: ech-0059

WCAG 2.2: wcag2.2

manual-automated-v4 · 7d4e21a1256b2375f0c336a43c2c090424b67a2350ffc7bfd6b383d5b1e01255

adis-web-wcag-aa-manual · 2026-11-07.1 · afbaceb79c5525117679fe7e510557d1e95ae200e375d770539e16594120d115

Automated testing

Automated WCAG checks (axe) · 1.2.0

Criterion scope: WCAG A/AA — axe

Selected runs — Included websites: 57

Bar length: share of the 57 websites in this list.

Most frequent findings, top 5
  • 4.1.2 — Name, Role, Value — 43 / 57
  • 1.4.3 — Contrast (Minimum) — 33 / 57
  • 2.4.4 — Link Purpose (In Context) — 27 / 57
  • 3.1.1 — Language of Page — 25 / 57
  • 2.4.2 — Page Titled — 21 / 57
All criteria and evidence states
All criteria and evidence states
CriterionWebsites with an observed deficiencyWebsites with criterion evidenceResult statesAdditional notes (may overlap)
4.1.2 — Name, Role, Value4357Incomplete results: 7; Review required: 7; Recorded violation: 43Completeness not confirmed: 57
1.4.3 — Contrast (Minimum)3357Incomplete results: 1; Review required: 23; Recorded violation: 33Completeness not confirmed: 57
2.4.4 — Link Purpose (In Context)2757Incomplete results: 30; Recorded violation: 27Completeness not confirmed: 57
3.1.1 — Language of Page2557Incomplete results: 32; Recorded violation: 25Completeness not confirmed: 57
2.4.2 — Page Titled2157Incomplete results: 36; Recorded violation: 21Completeness not confirmed: 57
1.1.1 — Non-text Content1857Incomplete results: 39; Recorded violation: 18Completeness not confirmed: 57
1.3.1 — Info and Relationships1557Review required: 3; Unassessed or unavailable: 39; Recorded violation: 15Completeness not confirmed: 57; Evidence or mapping not assured: 57
1.4.1 — Use of Color757Incomplete results: 45; Review required: 5; Recorded violation: 7Completeness not confirmed: 57
1.4.4 — Resize text757Incomplete results: 50; Recorded violation: 7Completeness not confirmed: 57
1.2.1 — Audio-only and Video-only (Prerecorded)Unavailable57Incomplete results: 57Completeness not confirmed: 57
1.2.2 — Captions (Prerecorded)Unavailable57Incomplete results: 54; Review required: 3Completeness not confirmed: 57
1.2.3 — Audio Description or Media Alternative (Prerecorded)Unavailable57No mapped rule: 57
1.2.4 — Captions (Live)Unavailable57No mapped rule: 57
1.2.5 — Audio Description (Prerecorded)Unavailable57No mapped rule: 57
1.3.2 — Meaningful SequenceUnavailable57No mapped rule: 57
1.3.3 — Sensory CharacteristicsUnavailable57No mapped rule: 57
1.3.4 — OrientationUnavailable57No mapped rule: 57
1.3.5 — Identify Input PurposeUnavailable57No mapped rule: 57
1.4.10 — ReflowUnavailable57No mapped rule: 57
1.4.11 — Non-Text ContrastUnavailable57No mapped rule: 57
1.4.12 — Text SpacingUnavailable57No mapped rule: 57
1.4.13 — Content on Hover or FocusUnavailable57No mapped rule: 57
1.4.2 — Audio ControlUnavailable57Incomplete results: 57Completeness not confirmed: 57
1.4.5 — Images of TextUnavailable57No mapped rule: 57
2.1.1 — KeyboardUnavailable57Incomplete results: 57Completeness not confirmed: 57
2.1.2 — No Keyboard TrapUnavailable57No mapped rule: 57
2.1.4 — Character Key ShortcutsUnavailable57No mapped rule: 57
2.2.1 — Timing AdjustableUnavailable57Incomplete results: 57Completeness not confirmed: 57
2.2.2 — Pause, Stop, HideUnavailable57Incomplete results: 57Completeness not confirmed: 57
2.3.1 — Three Flashes or Below ThresholdUnavailable57No mapped rule: 57
2.4.1 — Bypass BlocksUnavailable57Incomplete results: 50; Review required: 7Completeness not confirmed: 57
2.4.11 — Focus Not Obscured (Minimum)Unavailable57No mapped rule: 57
2.4.3 — Focus OrderUnavailable57No mapped rule: 57
2.4.5 — Multiple WaysUnavailable57No mapped rule: 57
2.4.6 — Headings and LabelsUnavailable57No mapped rule: 57
2.4.7 — Focus VisibleUnavailable57No mapped rule: 57
2.5.1 — Pointer GesturesUnavailable57No mapped rule: 57
2.5.2 — Pointer CancellationUnavailable57No mapped rule: 57
2.5.3 — Label in NameUnavailable57No mapped rule: 57
2.5.4 — Motion ActuationUnavailable57No mapped rule: 57
2.5.7 — Dragging MovementsUnavailable57No mapped rule: 57
2.5.8 — Target Size (Minimum)Unavailable57No mapped rule: 57
3.1.2 — Language of PartsUnavailable57Incomplete results: 57Completeness not confirmed: 57
3.2.1 — On FocusUnavailable57No mapped rule: 57
3.2.2 — On InputUnavailable57No mapped rule: 57
3.2.3 — Consistent NavigationUnavailable57No mapped rule: 57
3.2.4 — Consistent IdentificationUnavailable57No mapped rule: 57
3.2.6 — Consistent HelpUnavailable57No mapped rule: 57
3.3.1 — Error IdentificationUnavailable57No mapped rule: 57
3.3.2 — Labels or InstructionsUnavailable57Incomplete results: 53; Review required: 4Completeness not confirmed: 57
3.3.3 — Error SuggestionUnavailable57No mapped rule: 57
3.3.4 — Error Prevention (Legal, Financial, Data)Unavailable57No mapped rule: 57
3.3.7 — Redundant EntryUnavailable57No mapped rule: 57
3.3.8 — Accessible Authentication (Minimum)Unavailable57No mapped rule: 57
4.1.1 — Parsing (obsolete)Unavailable57No mapped rule: 57
4.1.3 — Status MessagesUnavailable57No mapped rule: 57
Data basis and sources

wcag22-automated-axe · 1.2.0

eCH-0059: ech-0059

WCAG 2.2: wcag2.2

manual-automated-v4 · 7d4e21a1256b2375f0c336a43c2c090424b67a2350ffc7bfd6b383d5b1e01255

adis-web-wcag-aa-automated · 2026-11-07.1 · 99167cf7de6eb9ecc95f8757c0c610a88ce3f5195eb5fcb93dd5d3d778cd09d9

Accessibility profile

Each bar shows the arithmetic mean of the fulfilment shares for individual websites. Each website has equal weight. The value describes the share of criteria met, not the share of accessible websites. Inapplicable criteria are excluded; missing results do not count as zero. n is the number of websites with a numerical result in the group shown.

Manual Web testing

Method and source

derived:adis-manual-criterion-result/2026-11-07.1/projection:afbaceb79c5525117679fe7e510557d1e95ae200e375d770539e16594120d115/policy:06df74ff43db17a4b908861d5f049c414bef2188a715cd25376dc59cfadb22e2

Mobile operability · adis-wcag-derived-2026-11-07.1 · Approved

Keyboard operability · adis-wcag-derived-2026-11-07.1 · Approved

Voice control · adis-wcag-derived-2026-11-07.1 · Approved

Compatibility with user agents · adis-wcag-derived-2026-11-07.1 · Approved

Interaction assistance · adis-wcag-derived-2026-11-07.1 · Approved

Consistency and predictability · adis-wcag-derived-2026-11-07.1 · Approved

Semantic structure · adis-wcag-derived-2026-11-07.1 · Approved

Understandability · adis-wcag-derived-2026-11-07.1 · Approved

Display flexibility · adis-wcag-derived-2026-11-07.1 · Approved

Contrast and sensory characteristics · adis-wcag-derived-2026-11-07.1 · Approved

Non-text content (graphics) · adis-wcag-derived-2026-11-07.1 · Approved

Multimedia and two-senses principle (audio/video) · adis-wcag-derived-2026-11-07.1 · Approved

Motor skills · adis-wcag-derived-2026-11-07.1 · Approved

Vision · adis-wcag-derived-2026-11-07.1 · Approved

Hearing · adis-wcag-derived-2026-11-07.1 · Approved

Cognition · adis-wcag-derived-2026-11-07.1 · Approved

Keyboard operability: 53.7 % 9 of 59 Domains

Voice control: 88.89 % 9 of 59 Domains

Compatibility with user agents: 33.33 % 9 of 59 Domains

Interaction assistance: 71.16 % 9 of 59 Domains

Consistency and predictability: 95 % 9 of 59 Domains

Semantic structure: 44.44 % 9 of 59 Domains

Understandability: 63.33 % 9 of 59 Domains

Display flexibility: 71.75 % 9 of 59 Domains

Contrast and sensory characteristics: 66.67 % 9 of 59 Domains

Non-text content (graphics): 11.11 % 9 of 59 Domains

Multimedia and two-senses principle (audio/video): 50 % 2 of 59 Domains

Show data table
Manual Web testing — WCAG profile: derived manual results — NAMoS Pilotstudie 2026 / Public administration — %
Study / cohortMeasureMean %Minimum %Maximum %n assessedTotal DomainsExcludedNotes
NAMoS Pilotstudie 2026 / Public administrationKeyboard operability53.7010095950
9 of 59 Domains with a numeric result

Evidence coverage: Numeric 54; Applicable 354; Not applicable 0; Not numerically mapped 0; Not assessed 300; Conflicting 0

NAMoS Pilotstudie 2026 / Public administrationVoice control88.895010095950
9 of 59 Domains with a numeric result

Evidence coverage: Numeric 17; Applicable 117; Not applicable 1; Not numerically mapped 0; Not assessed 100; Conflicting 0

NAMoS Pilotstudie 2026 / Public administrationCompatibility with user agents33.3305095950
9 of 59 Domains with a numeric result

Evidence coverage: Numeric 18; Applicable 173; Not applicable 4; Not numerically mapped 0; Not assessed 155; Conflicting 0

NAMoS Pilotstudie 2026 / Public administrationInteraction assistance71.1633.3310095950
9 of 59 Domains with a numeric result

Evidence coverage: Numeric 53; Applicable 503; Not applicable 28; Not numerically mapped 0; Not assessed 450; Conflicting 0

NAMoS Pilotstudie 2026 / Public administrationConsistency and predictability957510095950
9 of 59 Domains with a numeric result

Evidence coverage: Numeric 44; Applicable 294; Not applicable 1; Not numerically mapped 0; Not assessed 250; Conflicting 0

NAMoS Pilotstudie 2026 / Public administrationSemantic structure44.4405095950
9 of 59 Domains with a numeric result

Evidence coverage: Numeric 18; Applicable 118; Not applicable 0; Not numerically mapped 0; Not assessed 100; Conflicting 0

NAMoS Pilotstudie 2026 / Public administrationUnderstandability63.332010095950
9 of 59 Domains with a numeric result

Evidence coverage: Numeric 46; Applicable 346; Not applicable 8; Not numerically mapped 0; Not assessed 300; Conflicting 0

NAMoS Pilotstudie 2026 / Public administrationDisplay flexibility71.754010095950
9 of 59 Domains with a numeric result

Evidence coverage: Numeric 52; Applicable 452; Not applicable 20; Not numerically mapped 0; Not assessed 400; Conflicting 0

NAMoS Pilotstudie 2026 / Public administrationContrast and sensory characteristics66.67010095950
9 of 59 Domains with a numeric result

Evidence coverage: Numeric 34; Applicable 234; Not applicable 2; Not numerically mapped 0; Not assessed 200; Conflicting 0

NAMoS Pilotstudie 2026 / Public administrationNon-text content (graphics)11.11010095950
9 of 59 Domains with a numeric result

Evidence coverage: Numeric 9; Applicable 59; Not applicable 0; Not numerically mapped 0; Not assessed 50; Conflicting 0

NAMoS Pilotstudie 2026 / Public administrationMultimedia and two-senses principle (audio/video)50010025957
2 of 59 Domains with a numeric result

Evidence coverage: Numeric 4; Applicable 254; Not applicable 41; Not numerically mapped 0; Not assessed 250; Conflicting 0

Evidence availability

Automated assessment — Web · Measures · wcag22-automated-axe · 1.2.0 · 2 — NAMoS Pilotstudie 2026 / Public administration — No numeric profile available; Subjects with a numeric result: 0 / 59; Provisional: live ratings

Manual assessment — Web · Measures · quickcheck-ech-0059-statement · 2 — NAMoS Pilotstudie 2026 / Public administration — No numeric profile available; Subjects with a numeric result: 0 / 59

Automated assessment — Document · Measures · wcag22-automated-verapdf-pdf · 2 — NAMoS Pilotstudie 2026 / Public administration — No numeric profile available; Subjects with a numeric result: 0 / 59; Provisional: live ratings

Manual assessment — Web · Measures · checklist-ech-0059-web · 2.1.0 · 2 — NAMoS Pilotstudie 2026 / Public administration — No numeric profile available; Subjects with a numeric result: 0 / 59

Manual assessment — Document · Measures · quicktest-ech-0059-documents · 2 — NAMoS Pilotstudie 2026 / Public administration — No numeric profile available; Subjects with a numeric result: 0 / 59

Manual assessment — Web · Measures · checklist-ech-0059-web-zusatz · 2 — NAMoS Pilotstudie 2026 / Public administration — No numeric profile available; Subjects with a numeric result: 0 / 59

Manual assessment — Web · Measures · checklist-ech-0059-easy-sign · 2 — NAMoS Pilotstudie 2026 / Public administration — No numeric profile available; Subjects with a numeric result: 0 / 59

Manual assessment — Web · Measures · checklist-ech-0059-web · 2.0.0 · 2 — NAMoS Pilotstudie 2026 / Public administration — No numeric profile available; Subjects with a numeric result: 0 / 59; Provisional: live ratings

Automated assessment — Web · Measures · wcag22-automated-axe · 1.1.0 · 2 — NAMoS Pilotstudie 2026 / Public administration — No numeric profile available; Subjects with a numeric result: 0 / 59