National Core Indicators for Intellectual and Developmental Disabilities Home- and Community-Based Services Measures ("NCI for ID/DD HCBS Measures" hereafter) originate from NCI(R) In-Person Survey (IPS), an annual multi-state cross-sectional survey of adult recipients of state developmental disabilities systems’ supports and services. First developed in 1997 by the National Association of State Directors of Developmental Disabilities Services (NASDDDS) in collaboration with Human Services Research Institute (HSRI), the main aims of NCI for ID/DD HCBS Measures were to evaluate person-reported outcomes and assess state developmental disabilities service systems performance in various domains and sub-domains accordingly. The unit of analysis is "the state", and the accountable entity is the state-level entity responsible for providing and managing developmental disabilities services. Currently, 48 states and the District of Columbia are members of the NCI program. To align with member states’ fiscal schedules, the annual survey cycle typically starts on July 1 and ends on Jun 30 of the following year.
Gathering subjective information and data from people with ID/DD poses unique challenges due to potential intellectual and developmental limitations experienced by the population. As such, extensive work went into the processes of developing NCI IPS administration methods, survey methodology and measure design and revisions. The original development built on direct consultation with members of the target population and their advocates, as well as extensive literature review and testing.
Measure Specs
General Information
National Core Indicators® - Intellectual and Developmental Disabilities (NCI®-IDD) is a national effort to measure and improve the performance of public developmental disabilities agencies. The measures in this submission are all derived from the NCI-IDD In-person Survey (IPS), which collects experience of care data from adults who receive case management and at least one other paid service from their state developmental disability program. These paid services, collectively known as home and community-based services (HCBS), are intended to support people with disabilities to live and engage in their communities. They include assistance with activities of daily living/instrumental activities of daily living (ADLs/IADLs), employment supports, transportation, support to participate in community life, occupational, physical and other therapies, residential services, behavioral health services, and family and caregiver supports, among others. More than one million people in the U.S. receive services from state developmental disability agencies (Administration for Community Living, n.d.). Medicaid is the predominant payer for HCBS for people with intellectual and developmental disabilities (U.S. Government Accountability Office, 2023). Medicaid-funded HCBS is required to follow person-centered service planning practices where service plans are built around the expressed, individual goals and preferences of the person receiving services.
A 2015 expert panel, which included individuals with disabilities, developed a framework for assessing HCBS quality that comprises 11 domains (National Quality Forum, 2016). The NCI IPS encompasses many of the domains from this national HCBS quality framework, including Person-Centered Planning and Coordination, Choice and Control, Community Inclusion, and Holistic Health and Functioning. Because many HCBS outcomes are individual to the service recipient, they are often best assessed from the person’s perspective. NCI measures provide representative data on whether services are person-centered and meet HCBS users’ needs, priorities, and goals. These data are rolled up to the system-level in state-specific reports. These system-level results, along with more granular data, can be and have been used for quality improvement activities to improve system performance.
Since NCI-IDD was first launched, 48 states have participated. State programs have used NCI-IDD measure results to monitor and improve program participants’ experience with services, including efforts to increase employment. For example, in Missouri, NCI-IDD data demonstrated low rates of people who express they want a job who have a related goal in their service plan. This led to improvement initiatives called Employment First Collaborative and Empowering Through Employment. As a result of these initiatives, significant increases in the number of service plans with employment authorizations occurred between 2016 and 2020. Several NCI-IDD measures are also included in the Centers for Medicare & Medicaid’s (CMS) HCBS Quality Measure Set (QMS). States using the NCI-IDD IPS for compliance with the QMS requirements are required to report on the measures included as QMS mandatory measures using either the 2024-25 or 2025-26 data.
References
Administration for Community Living (n.d.) 30 Years of Community Living for Individuals with Intellectual and/or Developmental Disabilities (1987-2017) Retrieved from https://acl.gov/sites/default/files/Aging%20and%20Disability%20in%20America/30%20Years%207-13-21.pdf
CMCS (2024) Informational Bulletin. Retrieved from https://www.medicaid.gov/federal-policy-guidance/downloads/cib041124.pdf
CMCS (2024) MFP Grant Note: Note to Money Follows the Person (MFP) Demonstration Grant Recipients: Updates to the Home and Community-Based Services (HCBS) Quality Measure Set (QMS) Reporting Requirements for the MFP Demonstration. Retrieved from MFP Supplemental Services Notice
Missouri Department of Public Health (N.d.) Employment Initiatives. Retrieved from Employment Initiatives | dmh.mo.gov
Missouri Department of Public Health (2021) MOQO and You: Daily Life & Employment . Retrieved from MOQO & You: Daily Living & Employment Report | dmh.mo.gov
Missouri Department of Public Health (N.d.) Empowering Through Employment. Retrieved from Empowering Through Employment | dmh.mo.gov
National Quality Forum. (2016). Quality in Home and Services to Support Community Living: Addressing Gaps in Performance Measurement. Washington, DC. Retrieved from https://clpc.ucsf.edu/sites/clpc.ucsf.edu/files/HCBS_Final_Report.pdf
United States Government Accountability Office (GAO, 2023). Medicaid: Characteristics of and Expenditures for Adults with Intellectual or Developmental Disabilities. Retrieved from https://www.gao.gov/products/gao-23-105457
Measures 3622-1-m (NCI for ID/DD HCBS: Community Job Goal) and 3622-2-m (NCI for ID/DD HCBS: Activities of Daily Living (ADL) Goal) are both calculated by examining data collected in the Background Information Section of the survey on goals included in the persons Individualized Service Plan (ISP), and then contrasting that with whether the person has an expressed desire for that goal (Data collected during the survey).
The Background Information Section data are collected separately from the survey itself and come from existing administrative records. The Background Information data used for the above measures comes directly from the respondent’s ISP. In some states, the Background Information data collectors do not have access to the respondent’s ISP. In those cases, surveyors can contact the respondent’s case manager to access this information, and the case manager should review the ISP.
To mitigate challenges related to differing languages used across states to refer to ADL and Community Job Goals, the survey questions are deliberately broad to encompass varying wordings or phrasing of goals in ISPs.
Measure Calculation
Please see attached 3622-1.18-Calculation-of-Measure-Score-Spring2026.docx
Staff
The NCI-IDD® In-Person survey (IPS) was designed to collect information directly from individuals receiving developmental disability system services. The IPS offers valid, reliable, person-centered measures that states use to demonstrate how publicly funded supports are impacting people’s lives and to determine where state systems can improve the quality of those supports.
However, gathering subjective information and data from people with IDD poses unique challenges due to potential intellectual and developmental limitations experienced by the population. NCI IPS administration methods, survey methodology and measure creation and revision were designed with the survey population in mind and are uniquely designed to collect data from this population.
Instructions for Data Collection:
IPS Patient-Reported Data and/or Survey Data are collected via a direct conversation with a person receiving support and services from the state’s lead agency or accountable entity at the state level that administers services to people with intellectual and developmental disabilities (IDD).
The measured entity for all measures included in this submission is the state. In each member state, the lead agency or accountable entity at the state level that administers services to people with IDD is responsible for the state’s IPS administration, in accordance with NCI’s methodological standards.
NCI provides training and technical assistance at all stages of the effort from sampling design through standardized surveyor training and data collection and performs validity checks on the collected data. NCI allows, and has developed training and guidance for, survey administration via face-to-face survey or remote surveying via video conference. NCI offers the IPS survey tool translated into Spanish and written Chinese for trained surveyors who are bilingual. If a trained bilingual surveyor is not available, and/or the respondent requests a language for which there is not a translated survey tool available, NCI allows for the use of interpreters and provides surveyors with training and guidance on how to administer the survey with an interpreter.
Though eligibility for services varies by state, the population surveyed by the IPS includes individuals with IDD.
The IPS consists of two main sections, denoted by Roman numerals I and II.
Section I of the survey contains questions which pertain to personal experiences and require subjective responses; this section may only be answered by the individual receiving services.
Section II of the survey—which consists of objective questions on the individual’s involvement in the community, their choices, rights, and their access to services—allows for responses from a “proxy,” that is, a person who knows the individual well (such as a family member or friend). Surveyor training ensures that surveyors are able to identify acquiescence (e.g. all yes responses), and indicators of inability to understand and respond to questions.
At the end of Section I, the surveyor indicates whether the respondent appeared to understand the questions and answered them in a consistent manner. If the surveyor’s response to this question is negative, Section I data are excluded from analysis. If Section I data are excluded from analysis based on the surveyor’s assessment of inconsistent responses and potential lack of understanding, Section II data are also excluded for this case unless a proxy respondent was used.
A third part of IPS data, known as “Background information” or BI, comes from administrative records and is used to characterize the demographics of respondents. These data are not Patient-Reported Data and/or Survey Data. In some cases, BI data is used to determine whether a question is relevant for the respondent to answer.
Response rates:
The data analyzed for the most recent testing came from 39 states. Each state is instructed to construct a sample frame of adults (18 and over) who are receiving at least one publicly funded service in addition to case management from their state developmental disability service system. Based on this sample frame and the assumption of a middle response distribution (50%), each state is recommended to have a sample size that will support both (1) a 95% confidence level, and (2) a ±5% margin of error. States whose final sample of completed surveys does not include a number of completed surveys that reach this threshold will not be included in NCI reporting. Most states sample more than this minimum recommended size to account for refusals and surveys that may be deemed incomplete or invalid. Some states stratify their samples by factors such as region, program, or funding source.
Incomplete surveys are those that have no valid responses in Section I or Section II.
Surveys are deemed invalid based on the standard data validation and cleaning procedure. A standard data validation and cleaning procedure is applied to returned surveys to identify inconsistent responses and responses noted by the surveyor to be inconsistent or the result of the respondent’s lack of understanding (see above paragraph for details). It should be noted that not all member states collect all of the data elements required to construct all of the proposed measures.
Ultimately, for each measure, the response rate is the number of valid responses to the underlying question. For composite measures, data are treated as missing following the protocols described in each measure-specific submission.
The NCI team offers many potential strategies for states to increase response rates, including designing the initial scheduling approach to ensure surveyors are emphasizing the importance of the survey and how states will use the data, producing resources to let people and families know in advance that they may be selected to participate, sharing the previous years’ data in accessible and user-friendly formats, ensuring case managers and staff are aware and on-board with the survey, and can help prepare the participant, and more. Surveyors are flexible in the time and place where the survey is conducted.
For each measure in the instrument, if the sample size of valid responses from the accountable entity is 20 or below, the data are not analyzed or reported at the accountable entity level for confidentiality protection.
Measure Record
Point of Contact
NCI® and National Core Indicators® are registered trademarks of the NASDDDS and HSRI. The NCI measures and specifications were developed by and are owned by the National Association of State Directors of Developmental Disabilities Services (NASDDDS) and Human Services Research Institute (HSRI). NASDDDS and HSRI hold a copyright on all materials associated with the NCI measures and specifications and may rescind or alter these measures and specifications at any time. Users of the NCI measures and specifications shall not have the right to alter, enhance, or otherwise modify the NCI measures and specifications or associated materials. Anyone desiring to use or reproduce the contents of reports, inclusive of data results, without modification for a non-commercial purpose, may do so without obtaining approval from NCI. The use or reproduction of NCI survey instruments and questions requires prior approval by the NASDDDS and HSRI. All commercial uses or requests for alteration of the measures and specifications must be approved by NASDDDS/HSRI and are subject to a license at the discretion of NASDDDS/HSRI. NCI measures and specifications are not clinical or disability services guidelines, do not establish a standard of medical care, nor a standard for disability services and are not intended or tested for all potential applications.
The measures and specifications are provided “as is” without warranty of any kind. NASDDDS and HSRI make no representations, warranties, or endorsements about the suitability or utility of any product, test, or protocol identified as deriving from or based on an NCI measure or specification. NCI also makes no representations, warranties, or endorsements about the quality of any agency of a state, contractor of a state agency, or other organization who uses, applies, or reports NCI performance measures. NASDDDS/HSRI has no liability to anyone who relies on NCI measures and specifications or data reflective of performance under such measures and specifications.
Henan Li
Cambridge, MA
United States
Henan Li
Human Services Research Institute
Cambridge, MA
United States
Importance
Evidence
The NCI-IDD® IPS collects data from people receiving HCBS from state developmental disability programs about their services, including whether they are person-centered and reflect individual goals and needs. Person-centered service planning is an evidence-based practice (Chong and Caldwell, 2023; Isvan, Bonardi and Hiersteiner, 2023) required in Medicaid HCBS programs. Feedback on the extent to which public developmental disability programs are meeting individual goals and needs across a range of valued outcomes such as employment, functioning, and social connectedness enables states to monitor and address program efficacy and quality, though targeted quality improvement initiatives. It also supports assessing the value these systems are realizing from their investments.
The high level of NCI-IDD adoption and robust response rates are evidence of the value placed by service users and program officials on the measures and their importance. Further, NCI-IDD measures, including those in this submission, align with the 2016 HCBS Quality Framework (National Quality Forum, 2016) and selected NCI-IDD measures have been included in Centers for Medicare & Medicaid national reporting requirements for HCBS programs.
References
Chong, N. and Caldwell, J. (2023) The associations between person-centered planning and person-reported outcomes in home- and community-based services Innovation in Aging https://doi.org/10.1093/geroni/igad104.0808
CMCS (2024) MFP Grant Note: Note to Money Follows the Person (MFP) Demonstration Grant Recipients: Updates to the Home and Community-Based Services (HCBS) Quality Measure Set (QMS) Reporting Requirements for the MFP Demonstration. Retrieved from MFP Supplemental Services Notice
Isvan, N., Bonardi, A., & Hiersteiner, D. (2023). Effects of person-centered planning and practices on the health and well-being of adults with intellectual and developmental disabilities: a multilevel analysis of linked administrative and survey data. Journal of Intellectual Disability Research, doi: 10.1111/jir. 13015. https://onlinelibrary.wiley.com/doi/10.1111/jir.13015
National Quality Forum. (2016). Quality in Home and Services to Support Community Living: Addressing Gaps in Performance Measurement. Washington, DC. Retrieved from https://clpc.ucsf.edu/sites/clpc.ucsf.edu/files/HCBS_Final_Report.pdf
Measure Impact
Various groups of interested parties have been involved in efforts to identify quality measures for HCBS services, and the resulting measures have included reference to NCI measures, NCI concepts or specific NCI measures themselves. The inclusion of NCI measures in frameworks and measure development that relied heavily on stakeholder input demonstrates the importance of NCI measures to the target population.
For example, priorities defined by the target population and other stakeholders were brought forward through expert panelists who came together to establish the NQF framework for HCBS quality described earlier in this submission. A 2015 committee of 18 people including individuals with disabilities and caregivers, and seven Federal Advisors, developed this framework for assessing HCBS quality that comprises 11 domains (National Quality Forum, 2016).
Beyond inclusion in the NQF framework itself, evaluation and psychometric testing of the framework further demonstrated that concepts measured in NCI are valued by the target population. Researchers at University of Minnesota’s Rehabilitation Research and Training Center on Outcome Measures conducted a study to establish the content and social validity of the NQF HCBS Quality Framework with stakeholders. As described in their research center’s brief: “Involving Stakeholders to address challenges in HCBS Measure Development,” this was accomplished through a Participatory Planning and Decision-Making (PPDM) process. The PPDM process included meeting with all stakeholder groups and providing them with an opportunity to evaluate the NQF framework, add to it, and stipulate which personal outcomes and service characteristics were most important to measure. To obtain a nationally representative sample, PPDM groups were conducted across the country with each stakeholder group which included people with intellectual and developmental disabilities, mental health conditions, traumatic brain injury, physical disabilities, and a variety of age-related conditions.
Additional focus groups were organized for family members, HCBS support providers, and groups of public managers. The research center’s brief: “Involving Stakeholders to address challenges in HCBS Measure Development” does not specify the number of people included in the stakeholder groups.
Overall, results from PPDM groups conducted by the University of Minnesota indicated a high degree of stakeholder support for the content of the NQF HCBS Quality Framework, further validating the framework to support quality improvement work. Stakeholders prioritized measures of Person-Centered Planning and Coordination, Choice and Control, and Human and Legal Rights.
Stakeholders in the study did provide input resulting in recommendations for number of revisions or additions to the NQF Quality Framework. These included: (1) adding within the broad community inclusion domain a subdomain focused on access to and quality of transportation; (2) the addition of a stand-alone domain for employment; and (3) a greater focus on the self-determination of people with disabilities rather than the degree of choice and control they experience.
The NCI-IDD measures being submitted are entirely responsive to priorities identified by the stakeholders through this study. Measures of choice and control which are submitted can be viewed as core elements that are supportive of self-determination, as detailed in the logic model section above.
Some measures from this instrument are also part of the Centers for Medicare & Medicaid Services (CMS) HCBS Quality Measure Set QMS). To create the HCBS QMS, CMS published an RFI to solicit public comment from stakeholders on a draft set of quality measures. A goal of this stakeholder engagement was to ensure that the resulting measure set included measures that were important to and important for people receiving services. “Since releasing the RFI, CMS has also engaged with a broad range of stakeholders, including states, managed care plans, consumer advocates, quality measurement experts, researchers, and other federal agencies, to receive additional feedback on the draft measure set and on opportunities to support states with using the measure set, including to meet quality measurement and reporting requirements under various Medicaid HCBS authorities (Page 4).” The number of stakeholders consulted for this work is not specified. The following NCI-IDD measures submitted in this package are included as part of the HCBS QMS:
- Social Connectedness (3622-4-m)
- Satisfaction with Community Inclusion (3622-3-m)
Several states, including California and Kentucky, review NCI-IDD results with statewide groups of service users and families. For example, the Kentucky DD Services Quality Improvement Committee, made up of people receiving services, tracks performance of NCI-IDD measures across 3-year cycles. There were 11 members of the 2024 Quality Improvement Committee including people with disabilities, caregivers and other experts. They identify areas of priority for service users and produce a report. The 2024 Committee Recommendations Report includes priorities based on several measures being submitted in this maintenance package, such as community inclusion, relationships, and employment. The 2024 Committee Recommendations include specific interventions needed to accomplish improvement goals including enhanced information dissemination and service coordinator training.
References:
National Core Indicators. (2024). 2023-24 National Report: Relationships Retrieved from 2023-24 NCI-IDD Relationships National Report
Kentucky National Core Indicators. (2024). Recommendations Report Retrieved from Kentucky National Core Indicators Recommendation Report 2024
National Quality Forum. (2016). Quality in Home and Services to Support Community Living: Addressing Gaps in Performance Measurement. Washington, DC. Retrieved from https://clpc.ucsf.edu/sites/clpc.ucsf.edu/files/HCBS_Final_Report.pdf
Rehabilitation Research and Training Center on HCBS Outcome Measurement (RTC/OM). (2020). Brief 1: Involving stakeholders to address challenges in HCBS measure development: Toward person-centered measurement [Research Brief]. Institute on Community Integration, University of Minnesota-Twin Cities. https://publications.ici.umn.edu/rtcom/briefs/brief-one-involving-stakeholders-to-address-challenges-in-hcbs-mesure-development
Care Gaps
Feasibility
Feasibility
The Online Data Entry Survey Application (ODESA) is a web-based platform that all participating National Core Indicators (NCI) states use to enter survey data for the NCI Intellectual and Developmental Disabilities (NCI-IDD) (including data for the measures included in this package).
Every year, ODESA is updated to reflect the current year’s survey tools. The ODESA application resides on a secure server and requires unique login information for each user. ODESA contains built-in logic checks and skip patterns to standardize data entry across states and across data enterers. In addition to its data entry functions, the system includes administrative features to allow states to manage users and groups, track progress, and download the state’s survey data.
Data are collected yearly, and structured state data exports are available to participating states throughout the data cycle. Cleaned state datasets in Excel, .csv and/or SPSS format are available upon request after the cycle’s standard reports are released publicly. National datasets, with the state names deidentified, are available to researchers upon approval of a proposal and payment of a fee.
Datasets may include missing data due to skip patterns (which may render a question not-applicable to a particular respondent based on their answer to a previous question), unavailable data (in the case of data that are collected in the Background Information section) or the respondent’s inability to, or desire not to respond to a specific question. Information on missing data on specific measures included in this package is included in each measure template.
NCI collects data on subjective experiences and the data reflect the individual’s feelings and experiences, therefore these data cannot be “inaccurate”. Data inaccuracies can potentially result for questions in Section II if a proxy respondent’s responses do not reflect the individual’s true feelings, or, for questions in both sections, if the individual (or proxy) do not correctly interpret the question. Data inaccuracies can also result if the data from the Background Information section are not gathered reliably.
The NCI In Person Survey is implemented in many states and has been in use for many years. As a result, inaccuracies at the state level can often be identified comparing data to previous years and comparing to other states’ data.
There have not been any changes to the instrument or measure specifications since initial submission.
NCI-IDD data collection at the state level occurs in the context of an agreement between states that participate in the National Core Indicators, the National Association of State Directors of Developmental Disability Services (NASDDDS) and Human Services Research Institute (HSRI). An annual NCI participation fee is required to participate in the NCI-IDD data collection. For the 2025-26 data cycle, this fee was $19,300.
Along with the participation fee, states sign an agreement. As part of the agreement, NASDDDS and HSRI commit to being responsible for various NCI activities such as
- Program Direction and Management: Provide general oversight of NCI-IDD activities. Prepare, maintain, and ensure industry standard security protocols for the Online Data Entry Survey Application system (ODESA 2.0).
- Technical Assistance: Furnish a wide range of technical assistance to support states to administer NCI and use NCI data for performance measurement and systems improvement.
- Data Analysis, Management and Reporting: Prepare and distribute reports from the national data sets annually.
As part of the agreement, states commit to being responsible for various NCI activities and the costs incurred therein, such as general operational tasks necessary to gather and enter NCI-IDD data into the NCI data collection portal, staying current with NCI-IDD protocols and undertaking the procedures necessary to meet the national program requirements.
States may choose to hire a vendor to administer the NCI-IDD IPS survey or to use their own staff to collect data. NCI is not involved in payment discussions between states and vendors, and we have no information about the costs of these arrangements.
The NCI-IDD IPS dataset, which includes the measures in this submission, does not include any PHI (Protected Health Information) or PII (Personally Identifiable Information). Data are maintained in a secure data collection platform. Data are de-identified and minimum threshold reporting requirements are in place. Participation in an NCI-IDD interview is voluntary.
The measure specifications have not changed. This was done to maintain consistency with the original specifications and ensure results remain comparable. There has also been no feedback or evidence suggesting a need for changes, such as concerns about burden or requests for revisions. As a result, the existing measure specifications were retained without change.
Proprietary Information
As noted in 4.1b above, an annual NCI participation fee is required to participate in the NCI-IDD data collection. For the 2025-26 data cycle, this fee was $19,300. Participating state agencies own their state’s data.
If a researcher would like to use NCI data for research, there is a fee required for access to the National datasets. Here is the basic fee framework:
Basic fee framework:
Undergraduate/Graduate students (unfunded single study, single survey type) Each additional survey type will cost $600 Support for IRB applications may increase fees. | $600 |
Undergraduate/Graduate students (funded research study, single study, single survey type) Each additional survey type will cost $600 Support for IRB applications may increase fees. | $1,500 |
Academic Institutions (participation in funding application, IRB as necessary, ongoing communication, single study, single survey type) Support for IRB applications may increase fees. This level of access will require additional discussion with the NCI team around terms, conditions and fees for additional surveys and any add-on analyses. Additional data proposal forms may be required if additional research is conducted beyond the aims expressed in this proposal, or if additional team members access the survey tools. | $12,500 and up |
Other External Organizations Terms, conditions and fees are established based on review of proposed study and extent of support required | Case-by-case |
Scientific Acceptability
Testing Data
NCI-IDD In-Person Survey 2024-25 dataset with 39 participating states and 30,888 survey respondents in total.
July 2024 to June 2025.
None.
| Measured Entities | Number of NCI-IDD IPS Respondents | Type |
| Alabama | 601 | State |
| Arizona | 404 | State |
| Arkansas | 409 | State |
| California | 8614 | State |
| Colorado | 1025 | State |
| Connecticut | 611 | State |
| Delaware | 405 | State |
| District of Columbia | 374 | State |
| Georgia | 411 | State |
| Hawaii | 356 | State |
| Illinois | 417 | State |
| Indiana | 844 | State |
| Kansas | 1196 | State |
| Kentucky | 423 | State |
| Louisiana | 458 | State |
| Maryland | 408 | State |
| Michigan | 653 | State |
| Minnesota | 385 | State |
| Missouri | 403 | State |
| Montana | 468 | State |
| Nebraska | 420 | State |
| Nevada | 496 | State |
| New Hampshire | 360 | State |
| New Jersey | 505 | State |
| New York | 1750 | State |
| North Carolina | 451 | State |
| North Dakota | 426 | State |
| Ohio | 571 | State |
| Oklahoma | 396 | State |
| Oregon | 415 | State |
| Pennsylvania | 882 | State |
| South Carolina | 821 | State |
| South Dakota | 349 | State |
| Texas | 1246 | State |
| Utah | 366 | State |
| Virginia | 813 | State |
| Washington | 410 | State |
| Wisconsin | 944 | State |
| Wyoming | 402 | State |
The unit of analysis is the individual respondent. Eligible units are adults with intellectual or developmental disabilities who receive Home- and Community-Based Services and who are able to participate in the NCI In-Person Survey, either independently or with needed communication supports. Individuals may have a range of disabilities, functional abilities, service types, and living arrangements, reflecting the diversity of the HCBS population served by participating state systems.
Reliability
These measures have not been modified since original endorsement.
Validity
These measures have not been modified since original endorsement.
Use & Usability
Use
The Centers for Medicare & Medicaid Services’ Home‑ and Community‑Based Services (HCBS) Quality Measure Set (QMS) is a national framework for standardized quality reporting in Medicaid‑funded HCBS programs. CMS sponsors the HCBS QMS to promote consistent measurement, transparency, and accountability across state HCBS delivery systems, with a particular emphasis on person‑centered outcomes, access, health and safety, and equity for individuals receiving services in home‑ and community‑based settings.
The HCBS Quality Measure Set is national in scope and applies to all state Medicaid agencies administering HCBS through waivers or state plan authorities. Participation is mandatory under the Ensuring Access to Medicaid Services final rule, with phased‑in reporting requirements. The percentage of accountable entities and individuals included is expected to increase as states implement required reporting, beginning with Medicaid HCBS populations specified in CMS guidance.
Measures are applied at the state system level and are used to assess performance of Medicaid HCBS programs overall rather than individual providers. The applicable care setting is home‑ and community‑based services delivered through Medicaid HCBS waivers and state plan options.
NCI is used by the State of California as part of its statewide Quality Assessment Program for developmental disabilities services, administered by the California Department of Developmental Services in partnership with the State Council on Developmental Disabilities and Human Services Research Institute. The program uses National Core Indicators measures as a standardized tool for assessing outcomes experienced by individuals receiving services through California’s developmental disabilities system. The purpose of the program is to support oversight, policy development, and continuous quality improvement across the state’s developmental disabilities service system. NCI measures are used to evaluate person‑reported outcomes related to community inclusion, choice, rights, health, safety, and service coordination, and to identify areas for system improvement at both the statewide and regional levels.
The program is statewide in scope and includes all regional centers responsible for coordinating developmental disabilities services in California. Data collection covers a representative sample of adults receiving publicly funded developmental disabilities services, with the goal of reflecting experiences across the entire service system.
Measures are analyzed and reported at the statewide and regional center levels. The applicable care setting includes home‑ and community‑based services provided through California’s developmental disabilities system.
The purpose of the Adult Core Set is to provide CMS and states with a consistent set of indicators that reflect priority areas in Medicaid quality, including access, experience of care, and outcomes for adult beneficiaries. Measures derived from National Core Indicators are used to address experience‑of‑care and person‑centered outcome domains for adults receiving long‑term services and supports through Medicaid, complementing clinical and administrative measures within the set.
The Adult Core Set is national in scope and applies to state Medicaid programs. While reporting has historically been voluntary, CMS has expanded required reporting for Adult Core Set measures over time, increasing participation across states. The population represented includes adult Medicaid beneficiaries, including adults receiving HCBS, as defined by CMS reporting specifications.
Measures are reported at the state Medicaid program level and used for system‑level assessment rather than provider‑level accountability. The relevant care setting for this measure within the Adult Core Set context is Medicaid‑funded home‑ and community‑based services.
The purpose of Pennsylvania’s use of NCI measures is to support statewide quality management, program oversight, and continuous quality improvement. NCI data are used to assess system performance in areas such as community inclusion, employment, choice and self‑determination, health, safety, and service coordination, and to inform programmatic decisions, policy development, and targeted improvement initiatives within ODP‑administered services.
The program operates statewide and includes individuals receiving services through Pennsylvania’s intellectual disability and autism service system. Data collection reflects a representative sample of adults served by the system, allowing for analysis of outcomes across the Commonwealth and over time as part of ongoing system monitoring.
Measures are used and reported at the state program level and, where applicable, at sub‑state or provider network levels to support internal analysis and quality improvement. The applicable care setting is home‑ and community‑based services delivered through Pennsylvania’s developmental disabilities service system.
The Employment First Collaborative was developed in response to findings from National Core Indicators for Intellectual and Developmental Disabilities (NCI-IDD) data showing low rates of individuals who wanted employment but did not have employment goals included in their service plans. The initiative aimed to increase competitive integrated employment opportunities for individuals with intellectual and developmental disabilities receiving HCBS services in Missouri.
The initiative was implemented statewide in Missouri through the developmental disabilities service system. It targeted HCBS providers, care coordinators, and individuals receiving developmental disability services.
Level of analysis: State developmental disabilities system
Care setting:
- Home- and community-based services (HCBS)
- Community employment and vocational support settings
Empowering Through Employment was created to expand employment supports and improve employment outcomes for individuals with intellectual and developmental disabilities. The initiative built on NCI-IDD findings and Missouri’s Employment First efforts by promoting employment authorizations and employment-focused service planning. Missouri reported significant increases in service plans containing employment authorizations between 2016 and 2020.
The initiative operated statewide across Missouri’s developmental disabilities HCBS system. It involved individuals receiving HCBS services and provider organizations participating in employment-related supports.
Level of analysis: State developmental disabilities system
Care setting:
- Home- and community-based services (HCBS)
- Community employment and vocational support settings
The primary target population includes adults (18+) who receive publicly funded long-term services and supports from their state ID/DD service systems.
The accountable entities are state ID/ DD service systems.
The care settings relevant to the measures are primarily home- and community-based settings. The measures may also capture services delivered in residential settings, such as group homes, supported living arrangements, intermediate care facilities for individuals with intellectual disabilities (ICFs/IID), and nursing facilities. The measures are not intended to assess episodic inpatient care.
Across the measures derived from this instrument, social risk factors are addressed primarily at the measure level through stratification. All IDMs are stratified to facilitate fair and meaningful comparisons across specific residential setting categories. For a small subset of measures, an additional case mix adjustment is applied using a defined risk model to level the playing field where outcomes are especially sensitive to underlying differences in individual support needs. For the remaining measures, adjustment is intentionally not applied, reflecting a person‑centered measurement philosophy in which service systems are expected to align supports with individuals’ needs.
These measures are best suited for use in a state-level quality accountability and improvement program for publicly funded long-term services and supports (LTSS) for individuals with intellectual and developmental disabilities (ID/DD). The measures align with system-level accountability frameworks that monitor and compare performance across states or within-state systems over time. Accordingly, the measures are most appropriate for public reporting, federal and state oversight (e.g., HCBS quality assurance). These measures are not appropriate for provider-level accountability because 1) the outcomes are shaped by system-level policies, care coordination, and individuals’ long-term service environments, which cannot be validly or fairly attributed to a single provider, and 2) these measures are based on sampling strategies designed for state-level estimates rather than provider-level analyses, particularly given that individuals typically receive services from multiple provider types.
Usability
As a system performance measurement tool, the NCI-IDD In Person Survey (IPS) was designed to support state development disabilities (DD) service systems (“states”) to benchmark, set goals, and compare to the NCI-IDD average and other systems’ performance. Federal partners such as the Centers for Medicare & Medicaid Services (CMS) and The Administration on Community Living (ACL) explicitly recognize NCI as a core dataset for managing, funding, and improving DD systems. To achieve those goals, states can take the following steps:
- Systematically analyze IPS results across multiple years to identify trends and priorities for improvement.
- This can be done through meetings of a quality improvement committee and should include the input of service users and other interested parties. Their input can drive decisions about what an ideal system looks like and where targeted improvement efforts might be focused.
- This can include comparing state results to those of other states, and the NCI-IDD average.
- Once priority areas have been identified, states should work to translate findings into specific goals tied to policy or program design such as waiver strategy, provider expectations, training requirements, or other areas.
- Plans should be made to set benchmarks to track improvement year to year, and review plans if benchmarks aren’t met.
- NCI results and the review of the results can be built into agency strategic plans, quality strategies, or legislative/budget justifications.
There are potential challenges related to using NCI data for system performance improvement.
- States may have limited resources and capacity to examine the breadth of NCI data and/or convene groups to review the data.
- For some NCI measures, there are not straightforward, easily accessible “levers to pull” to make improvements. It can take some time and thought to understand the drivers of some outcomes.
- Outcomes of policy/programmatic changes can take years to appear in the data.
- Necessary improvements may include actions from other agencies/areas of government and coordination can be challenging.
- Challenges around “owning” poor performance metrics.
However, these challenges can be mitigated by:
- Ensuring state staff working on NCI and the resulting performance improvement are dedicated, and work cross-agency with program, waiver and fiscal staff. This can ensure multiple perspectives and diverse ideas drive change.
- Examining NCI data in tandem with administrative and claims data to bolster findings and potentially target root causes.
- Setting smaller goals within larger goals to demonstrate improvement over time, as opposed to rapid results of policy changes.
- Making sure NCI is not framed or used as a “scorecard” but instead as a planning tool, or a “road sign” indicating areas for examination and improvement. This can encourage the use of NCI data to improve services, and not as referendum on the operations of the system.
One example of this process comes from Ohio.
Ohio noted in their NCI-IDD data that respondents were often not receiving routine dental care at the recommended intervals. The state examined Medicaid claims data to validate this finding and found that about two-thirds of NCI respondents did not have dental claim with Medicaid within the recommended timeframe. Further work led to the finding that there is a lack of Medicaid dental providers and some providers had waitlists approaching two years.
After convening a quality council and using data to bolster advocacy efforts, IDD considerations were included in the State of Ohio’s Oral Health Plan. This led to cross agency efforts such as:
- Funding for Ohio State’s Developmental and Intellectual Disabilities Dental Certificate Program for Community Providers for postgraduates.
- Enhanced Medicaid reimbursement rates, including a behavior management code for dentists.
- Working towards permitting Ohio’s primary care providers to use silver diamine fluoride for cavity management.
Each year, NCI has several methods to receive feedback on the survey.
- The NCI Annual Meeting brings together state representatives, people administering the survey, contractors and others to discuss survey implementation, troubleshoot challenges, examine how data are used and more.
- The NCI Annual Meeting allows states to discuss how they’ve used data and any achievements they’ve made related to NCI.
- Yearly training processes allow for direct feedback from surveyors on challenges or potential improvements,
- NCI holds office hours to allow those administering surveys at the state level to hear about innovations, changes or other areas of interest. States ask questions and provide feedback.
- Some states solicit feedback directly from people who respond to the survey. Survey administrators then raise any ideas and/or concerns to the NCI team.
Every 6 years, NCI rolls out a survey that has undergone a “revisions cycle.” This work, that spans several years, includes the gathering of extensive feedback from interested parties in the form of online surveys, focus groups, an Advisory group and user groups. The goals of these revisions cycles are to:
- Ensure the survey gathers information that is most relevant and timely for state systems
- Ensure the survey gathers data that will help state systems support people to achieve their goals
- Ensure the survey reflects the latest research and innovations
- Ensure the survey reflects the feedback received through the above channels
Updated guidance allowing remote surveying was added after a pilot study/implementation. This change helped address implementation challenges, particularly during COVID-19, by providing a flexible alternative to in-person surveying. No additional updates have been made since then, and there has been no feedback indicating further changes are needed.
There have been no adverse or unexpected findings from the administration and reporting of the NCI-IDD® In-Person Survey.
Public Comments