New Zealand Disability Strategy Implementation Review 2001-2007
Proposed indicators and data sources
Development of indicators
The outcomes framework developed for this review has been used to propose potential indicators for the 10-year review. A wide range of indicators have been selected, which need to be prioritised before finalising the review plan. Focus has been placed at two levels:
- Implementation outcomes for the Office for Disability Issues, agencies, disabled people’s organisations, disabled people, family and whānau and wider society
- Changes in life outcomes for disabled people across 10 life outcome areas.
The tables below detail available data sources that will demonstrate the emergence of outcomes. They also detail data sources not available, which if developed may be used to show the emergence or otherwise of outcomes.
| Office for Disability Issues | |||
|---|---|---|---|
| Intended outcomes | Indicators | Data sources available | Data sources not available |
| Connect with appropriate agencies who make a significant difference to disabled people’s lives | Existence of prioritisation criteria and systems to connect with targeted agencies Number and type of agencies contacted by (or in touch with) the Office for Disability Issues Number and type of targeted agencies defined as significant for achieving priority outcomes who the Office for Disability Issues have not connected with |
Internal administrative data from Office for Disability Issues | Prioritisation criteria for disabled people’s outcomes based on results from the post-census Disability Survey |
| Successful promotion of the Disability Strategy and disability responsiveness to agencies | Number and type of promotional activities led by the Office for Disability Issues and wider Reach of promotional activities to targeted agencies Level of effect of promotional activities on targeted agencies in relation to disability responsibilities |
Internal administrative data from Office for Disability Issues | Unknown whether assessment form exists |
| Agencies educated about taking a disability perspective to become more responsive to disabled people’s needs | Level of distribution of the Office for Disability Issues’ policy toolkit (reach) Number and type of training seminars or other education forums conducted on disability responsiveness by the Office for Disability Issues or others Number of targeted agencies attending seminars Assessment of educational activities on targeted agencies response to disabled people’s needs |
Internal administrative data from Office for Disability Issues | Unknown whether assessment form exists |
| Agencies’ level of change in disability responsiveness monitored and reported | Number of central government agencies submitting work plans Number of other agencies volunteering information on disability responsiveness |
Internal administrative data from Office for Disability Issues | No data source on non-central government agencies activities |
| Identification and targeting of key agencies to embed disability responsiveness as business-as-usual | Agencies identified to be targeted based on annual assessment of outcomes Number of identified targeted agencies approached |
Internal administrative data from Office for Disability Issues | Collation of internal administrative data from Office for Disability Issues to address indicators |
| Agencies (including central government agencies, local government, other entities, disability support providers, and private sector – focus on targeted agencies to 2011) |
|||
|---|---|---|---|
| Intended outcomes | Indicators | Data sources available | Data sources not available |
| Aware of role in implementing the Disability Strategy | Percentage of targeted agencies aware of the Disability Strategy or need to adopt a disability perspective | Central government agencies’ work plans and progress reports submitted to the Office for Disability Issues | No standardised measure of intended outcomes across agencies |
| Understand context of disability issues | Percentage of targeted agencies who understand the context of disabilities issues as they relate to their Statement of Intent, core business, and/or areas of responsibilities in relation to: 1) awareness of rights of disabled people; 2) number of disabled people effected by their activities, and 3) scope of unmet needs Percentage of targeted agencies who understand the context of disability issues as they relate to the needs of diverse groups of disabled people Extent of research undertaken on disability issues Extent to which research undertaken about disability issues is used to inform targeted agencies Extent to which research findings are disseminated |
Central government agencies’ annual progress reports submitted to the Office for Disability Issues Health Research Council and other research funding pools (e.g. cross-departmental funding pool) |
|
| Partnership with disabled people in leading, developing and delivering policy and services | Level of capability building for disabled people to take leadership roles led by targeted agencies Percentage of targeted agencies who consult, engage or partner with disabled people in leading, developing, and delivering policies and services Partnership approach aligns with agreed practice (to be defined) |
Central government agencies’ annual progress reports submitted to the Office for Disability Issues State Service Commission: Mainstream Supported Employment Programme and Career Progression Survey |
|
| Barriers to participation and independence for disabled clients and employees reduced | Percentage of targeted agencies who identify barriers to participation Percentage of targeted agencies addressing barriers to participation Extent to which accessibility targets of State Services Commission are being met |
Central government agencies’ annual progress reports submitted to the Office for Disability Issues State Service Commission Accessibility Survey State Service Commission Career Progression Survey |
|
| Opportunities for disabled people maximised | See life outcomes indicators | Central government agencies’ annual progress reports submitted to the Office for Disability Issues | |
| Disability responsiveness maintained and a disability perspective embedded in agencies’ policies and processes | Percentage of targeted agencies who have embedded a disability perspective, vs those where addressing disability issues are more ad-hoc or add on | Central government agencies’ annual progress reports submitted to the Office for Disability Issues | |
| Disabled people | |||
|---|---|---|---|
| Intended outcomes | Indicators | Data sources available | Data sources not available |
| Aware of rights, opportunities and choices | Level of education available for disabled people about their rights Level of advocacy by disabled people for disabled people Availability of information about rights of disabled people Percentage of disabled people aware of their rights, recognise discrimination and can self advocate |
Human Rights Commission and Health and Disability Commission’s complaints from disabled people Documentation about activities of disabled persons’ organisations Information available about disabled people’s rights through sources commonly used by disabled people |
Disabled people’s voice through case studies |
| Aspirations and needs communicated, heard and understood | Percentage of disabled people able to communicate their needs, and aspirations Percentage of disabled people able to access support to assist with communications Percentage of disabled people who report their communications needs are met |
Post-census Disability Survey – on equipment and services to support disabled people’s communication New Zealand Relay Service’s data State Services Commission data on accessible government |
|
| Contribution, value and interdependence acknowledged and affirmed | Number of positive media representations of disabled people and their value in society Percentage of disabled people who feel their contribution to society is valued |
New Zealand based media analysis | |
| Leadership and partnership in agencies’ decision making | Level of access to capability building seminars Number of disabled people contributing to agencies decision making Number of initiatives seeking to build disabled people’s leadership capacity Number of disabled people in governance or management roles in agencies |
Central government agencies’ annual progress reports submitted to the Office for Disability Issues Other agencies documentation (e.g. Long Term Council Community Plans) Placement data from Nominations Services State Services Commission’s career progression and development survey |
|
| Support to reach optimum level of participation within their communities | Reflected in changes to life outcomes of disabled people | ||
| Families, whānau, friends and other people who provide support (note: generically referred to as families below) | |||
|---|---|---|---|
| Intended outcomes | Indicators | Data sources available | Data sources not available |
| Aware of their rights, opportunities and choices | Percentage of families aware of their unique rights Level of appropriate family input into decisions affecting their disabled family member Level of education / information for families around responsibility for caring and payment for caring Percentage of families who report it is easy to access accurate information around responsibility for caring and payment for caring |
No data available on families’ perceptions | Survey of families measuring intended outcomes. It may be possible to obtain via research or evaluation on the Carers Strategy. Inclusion in proposed case study |
| Unique needs of families heard and understood | Number of initiatives to identify the unique needs of families Percentage of families able to communicate their needs, and aspirations as distinct from the disabled person they provide support Percentage of families whose unique needs are heard as distinct from the disabled person for whom they provide support |
No data available on families’ perceptions | |
| Contribution and value of families acknowledged and affirmed | Percentage of families who feel their contribution to society is valued | No data available | |
| Meaningful engagement in agencies | Number of families contributing to the agencies decision-making | No data available | |
| Access to appropriate supports to meet unique needs | Percentage of families who access supports to meet their unique needs Percentage of families accessing respite care or carer support Percentage of families satisfied with the level of respite care/care support and other support received to live full lives Percentage of families leading full lives |
Post-census Disability Survey – respite care / carer support | |
| Wider society | |||
|---|---|---|---|
| Intended outcomes | Indicators | Data sources available | Data sources not available |
| Aware of disability issues | Availability of information about rights of disabled people Percentage of general public aware of disability issues Number of media articles or coverage about disability issues |
New Zealand media analysis to assess presentation of disabled people and disability issues | General public survey on perceptions, attitudes, and behaviour towards disabled people |
| Understand need for disability responsiveness | Percentage of general public who understand rights of disabled people | New Zealand media analysis to assess the level of change in discussion about disability issues over the next five years | |
| Positive attitude towards value and contribution of disabled people | Number of positive media representations of disabled people and their value in society Percentage of general public that acknowledge positive contribution of disabled people |
Like Minds, Like Mine attitudinal and behavioural monitoring | |
| Support disability responsiveness initiatives | Percentage of general public support for agencies to be disability responsive | New Zealand media analysis of the support for disability responsiveness | |
Long-term life outcomes for disabled people
| Long-term life outcomes for disabled people: ideally indicators below require analysis at total population level and by impairment type, ethnicity, gender, age, and location (i.e. urban vs rural) | |||
|---|---|---|---|
| Intended outcomes | Indicators | Data sources available | Data sources not available |
| Citizenship: “I participate in my community” Disabled people have equality of choices, rights, responsibilities as non-disabled people |
Number of national and locally-based anti-discrimination programmes Extent to which achievements of disabled people are celebrated Extent to which perspectives of disabled people are included on ethical and bioethical debates Legislative or strategy development aimed at promoting equality Level of participation in democratic processes |
Review of legislation Review of media Documentation on ethical and bioethical debates |
Disabled people’s heard voice through case studies Electoral Commission has published research looking at Māori participation rates. Explore whether possible to do same for disabled people |
| Health: “I feel healthy and well” Disabled people have access to appropriate health and wellbeing services |
Level of awareness of, access to and use of disability support, health and wellbeing services Level of awareness and use of needs assessment Percentage of disabled people who perceive accessing disability supports, health and wellbeing services to be simple Percentage of disabled people who perceive disability supports as fair and flexible Percentage of disabled people who perceive their health and wellbeing needs are timely met Percentage of disabled people who feel they are at the centre of service and support provision |
Statistics New Zealand’s post-census Disability Survey – support, equipment and services Ministry of Health administrative data including the Client Claims Processing System (CCPS) database |
Perception based indicators assessed via case studies with disabled people |
| Education: “I am learning new things” Disabled people have equal opportunities to learn and develop in local educational centres |
Level of access to local early childhood, primary, and secondary schools for disabled children Percentage of disabled children participating in formal education Percentage of disabled children participating in some aspects of mainstream education Level of access to New Zealand Sign Language, communication technologies and human aids to develop effective communications Equitable access to resources for education needs Percentage of disabled people with a school qualification Level of access for disabled people to tertiary education Percentage of adult disabled people attending tertiary institutions Percentage of disabled people with a post-school qualification |
Statistics New Zealand’s post-census Disability Survey – education Ministry of Education’s Special Education administrative data including distribution of resources for education needs Coverage of disability issues and learning needs for disabled people in teacher training and professional development courses Administrative data of tertiary institutions about their disability responsiveness |
Perception based indicators assessed via case studies with disabled people |
| Employment: “I have meaningful employment” Disabled people have meaningful employment of their choice |
Number of and access to programmes to facilitate transition from school to work for disabled people Number of and access to vocation services by working-age disabled people Number of and access to career services by working-age disabled people Percentage of working age disabled people in employment Level of support available for working-age disabled people to access employment Percentage of working-age disabled people receiving appropriate support to enable work Percentage of working-age disabled people who are satisfied with their employment and vocational choices Percentage of employers who are aware of abilities, value and contribution of disabled people Level of availability of communication services, resources and flexible workplace options |
Statistics New Zealand’s post-census Disability Survey – employment State Services Commission’s data on disabled people employed in the public sector Ministry of Social Development’s administrative data Review of performance reporting of providers contracted to provide transition and career service, placement assistance and vocational service |
Survey to measure employers’ perceptions of disabled people (Workbridge has undertaken survey in this area in the past) Perception based indicators assessed via case studies with disabled people |
| Income: “I pay for things” Disabled people’s income supports their independence and their choices |
Level of income support provisions Level of flexibility in income support benefits making transition to work and training easier Level of income of working age disabled people Percentage of disabled people who manage their finances Number of disabled people active in unions and other staff and service organisations Percentage of disabled people who perceive their income is adequate to support their independence |
Statistics New Zealand’s post-census Disability Survey – income Ministry of Social Development’s Work and Income administrative data ACC’s administrative data Union and other staff and service organisations membership and governance data |
Type and availability of data from Ministry of Social Development’s ACC’s, union’s etc requires further scoping Perception based indicators assessed via case studies with disabled people |
| Housing: “I have my own home” Disabled people have a secure, accessible, affordable, quality home in the community |
Percentage of disabled people who own their home Percentage of disabled people living in long-term residential care (adults and children) Percentage of public housing stock accessible to disabled people Level of use of needs-based-customised modifications to enable accessibility within and from the home Percentage of disabled people who say it is easy to access suitable state and private housing through ‘best match”, cross-agency case management, and support and advocacy Level and effective use supply of modified housing stock Level of use of universal design and accessibility principles in new public and private housing stock |
Statistics New Zealand’s Disability Survey – house and home Statistics New Zealand’s Disability Survey – living in residential facilities Reporting mechanisms of Housing New Zealand and supporting agencies (i.e. information available from the Rental database) |
Type and availability of local authorities data about use of universal design requires further scoping Disabled people’s voice heard through case studies |
| Transport and environment: “I can move around” Disabled people have available, accessible and affordable transport and access to built environment |
Proportion of public buildings, facilities, and environments that are accessible to disabled people Percentage of disabled people who undertake independent journeys Percentage of disabled people who can access and use public transport Percentage of public transport personnel trained in disability responsiveness Percentage of training requirements included in driver licensing and contract service delivery Percentage of disabled students able to use School Transport Assistance in a non-discriminatory and equitable basis Level of implementation and monitoring of national accessibility performance standards, as enforced by the Ministry of Transport |
Statistics New Zealand’s post-census Disability Survey – travel and transport Data from Ministry of Transport, Land Transport Barrier Free Trust State Services Commission’s accessibility survey |
Access to data from Ministry of Transport may need to be negotiated |
| Recreation: “I have fun” Disabled people enjoy cultural and recreation activities of their choice |
Proportion of disabled people involved in sports and recreation Proportion of disabled people involved in cultural activities Level of training offered to staff and volunteers working in recreation who are trained in disability responsiveness Proportion of staff and volunteers working in recreation of disability responsiveness Proportion of disability support providers who are trained in sport and recreation and cultural activities Level of availability of and access to inclusive and exclusive sporting and recreation options for disabled people Proportion of disabled people who feel it is easy to access sport, recreation and cultural activities |
SPARC Department of Conservation |
Type and availability of data from central government agencies requires further scoping |
| Relationships: “I have friends and lovers” Disabled people make and keep relationships |
Percentage of disabled people making their own choices about their relationships, sexuality, and reproductive potential Percentage of disabled people supported by families and whānau Percentage of disabled people who are supported to develop independent communication Percentage of disabled people who have opportunities to meet new friends Percentage of disabled people in long-term relationships Percentage of disabled people who perceive they have opportunities to meet new friends Percentage of disabled people who have access to supports to maintain friendships |
None known | Disabled people’s voice through case studies |
| Value: “I feel valued” Disabled people are highly valued by society |
Percentage of disabled people who feel their contribution to society is valued | New Zealand based media analysis | Disabled people's voice through case studies |
| Needs of diverse groups including Māori, Pacific people, children, women and the families/whānau and other providers of support to disabled people | Assessment of the needs of each of these diverse groups across the life indicators above, more specific indicators are detailed below:
|
Statistics New Zealand’s post-census Disability Survey – Māori and disability Statistics New Zealand’s post-census Disability Survey – Pacific people and disability |
Unknown the extent to which existing data about disabled people can be robustly analysed at these subgroup levels |