Going Beyond Compliance: Survey report
Appendix 4: Task speed by user impairment
The time taken by testers to complete tasks on the 30 top compliant sites was analysed to see if there were sites that were overall faster than others, and to break down any variance by impairment types.
For each tester impairment type, the fastest ten sites and slowest ten sites were selected. The average task time for each site was used to determine the fastest (those with lowest average task time) and the slowest (those with highest average task time).
With only a couple of exceptions, sites that were in the top ten fastest for some impairments also appeared in the slowest top ten for other impairments. This was a surprising result. It was expected that there would be some variation and that sites that were fast for some impairments would be average for others. However, it appears that there is a marked variance, and one could almost conclude that if a site is going to be fast for an impairment type then it will be slow for another.
The key conclusion is that designers need to take a much broader range of issues into account and use a wider range of testing to minimise barriers to using websites.
Table 4 lists the ten fastest sites by tester impairment type.
Table 5 lists the ten slowest sites by tester impairment type
Table 6 list the ten fastest and slowest sites by tester impairment type.
The key point in the tables is that almost all sites that are fast to complete tasks by one or more impairment types are also one of the slowest to complete tasks by one or more of the other impairment types.
No site appeared in the list of ten fastest sites for every impairment type (three impairment types were the maximum recorded for any site).
Table 4: Top ten fastest sites by tester impairment type
| Tester impairment types | |||||
|---|---|---|---|---|---|
| Deaf | Blind | Low vision | Mobility | Reading | |
| Fastest | 4 million careful owners | 4 million careful owners | 4 million careful owners | Beehive | Community Net |
| Beehive | Bioethics Council | Beehive | Community Net | Department of Labour | |
| Companies Office | Community Net | Department of Labour | Companies Office | Ministry for the Environment | |
| Employment Relations Service | Employment Relations Service | New Zealand Embassies | Good Practice Funding | Ministry for Culture and Heritage | |
| Inland Revenue Department | Ministry for the Environment | Employment Relations Service | Government Jobs | Ministry of Defence | |
| Office for Disability Issues | GCSB | Ministry for the Environment | Governor General | Protect NZ | |
| OSH | Inland Revenue Department | GCSB | Medicines & Medical Devices Safety Auth. | Reduce Rubbish | |
| Protect NZ | Ministry for Culture and Heritage | Reduce Rubbish | Office for Disability Issues | Sustainable Management Fund | |
| Sustainable Management Fund | The Social Report | Te Ara - Encyclopaedia | The Social Report | The Social Report | |
| Tertiary Education Portal | The Treasury | Tertiary Education Portal | Work site | Timeframes | |
Table 5: Top ten slowest sites by tester impairment type
| Tester impairment types | |||||
|---|---|---|---|---|---|
| Deaf | Blind | Low vision | Mobility | Reading | |
| Slowest | Department of Labour | Beehive | Community Net | 4 million careful owners | Beehive |
| Embassies | Companies Office | Good Practice Funding | Bioethics Council | Embassies | |
| GCSB | New Zealand Embassies | Government Jobs | Department of Labour | Governor General | |
| Ministry for Culture and Heritage | Ministry of Defence | Governor-General | Ministry for the Environment | Inland Revenue Department | |
| Reduce Rubbish | Protect NZ | Inland Revenue Department | GCSB | Land Information New Zealand | |
| The Treasury | Sustainable Management Fund | Ministry of Defence | Land Information New Zealand | OSH | |
| Timeframes | Te Ara - Encyclopaedia | Office for Disability Issues | Reduce Rubbish | The Treasury | |
| Te Kete Ipurangi | Tertiary Education Portal | The Social Report | Timeframes | Te Kete Ipurangi | |
| Treaty of Waitangi | Treaty of Waitangi | The Treasury | Te Kete Ipurangi | Treaty of Waitangi | |
| Work site | Work site | Work site | Treaty of Waitangi | Work site | |
Table 6: Ten fastest and slowest sites by tester impairment type
| Fastest | Slowest | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Deaf | Blind | Low vision | Mobility | Reading | Deaf | Blind | Low vision | Mobility | Reading | |
| 4 million careful owners | Yes | Yes | Yes | Yes | ||||||
| Beehive | Yes | Yes | Yes | Yes | Yes | |||||
| Bioethics Council | Yes | Yes | ||||||||
| Community Net | Yes | Yes | Yes | Yes | ||||||
| Companies Office | Yes | Yes | Yes | |||||||
| Department of Labour | Yes | Yes | Yes | Yes | ||||||
| Embassies | Yes | Yes | Yes | Yes | ||||||
| Employment Relations Service | Yes | Yes | Yes | |||||||
| Ministry for the Environment | Yes | Yes | Yes | Yes | ||||||
| GCSB | Yes | Yes | Yes | Yes | ||||||
| Good Practice Funding | Yes | Yes | ||||||||
| Government Jobs | Yes | Yes | ||||||||
| Governor General | Yes | Yes | Yes | |||||||
| Inland Revenue Department | Yes | Yes | Yes | Yes | ||||||
| Land Information New Zealand | Yes | Yes | ||||||||
| Medicines & Medical Devices Safety Auth. | Yes | |||||||||
| Ministry for Culture and Heritage | Yes | Yes | Yes | |||||||
| Ministry of Defence | Yes | Yes | ||||||||
| Office for Disability Issues | Yes | Yes | Yes | |||||||
| OSH | Yes | Yes | ||||||||
| Protect NZ | Yes | Yes | Yes | |||||||
| Reduce Rubbish | Yes | Yes | Yes | Yes | ||||||
| Sustainable Management Fund | Yes | Yes | Yes | |||||||
| Te Ara - Encyclopaedia | Yes | Yes | ||||||||
| Tertiary Education Portal | Yes | Yes | Yes | |||||||
| The Social Report | Yes | Yes | Yes | Yes | ||||||
| The Treasury | Yes | Yes | Yes | Yes | ||||||
| Timeframes | Yes | Yes | Yes | |||||||
| Te Kete Ipurangi | Yes | Yes | Yes | |||||||
| Treaty of Waitangi | Yes | Yes | Yes | Yes | ||||||
| Work site | Yes | Yes | Yes | Yes | Yes | |||||
