Report 2023-115 All Recommendation Responses

Report 2023-115: Department of Health Care Services and Department of Managed Health Care: Children Enrolled in Medi-Cal Face Challenges in Accessing Behavioral Health Care (Release Date: November 2023)

Recommendation #1 To: Health Care Services, Department of

To better ensure appropriate and effective monitoring of timely access to behavioral health care for children, by November 2024 DHCS should make changes to its survey methodologies to do the following, and then implement those changes for the subsequent reporting period: Use its timely access surveys to monitor compliance with the 48 hour urgent appointment standard established in state law where applicable.

6-Month Agency Response

The Department of Health Care Services (DHCS) updated the External Quality Review Organization (EQRO) Timely Access scope of work in November 2023 for the 2024 reporting year to reflect the addition of the two-day urgent appointment. The change will be reflected in the 2024 EQRO Technical Report, which will be published by April 30, 2025.

California State Auditor's Assessment of 6-Month Status: Partially Implemented

DHCS has updated the scope of work with its EQRO for the 2023-24 timely access study to include the 48-hour standard for certain urgent appointments. We will review its reporting of compliance with the standard when it publishes its 2024 report in 2025.

60-Day Agency Response

The Department of Health Care Services (DHCS) updated the External Quality Review Organization (EQRO) Timely Access scope of work for the 2024 reporting year to reflect the addition of the two-day urgent appointment. The change will be reflected in the 2024 EQRO Technical Report, which will be published by April 30, 2025.

As part of the methodology adjustment, DHCS will explore implementing monitoring for both new and existing patients. The adjustment will significantly impact the EQRO's scope of work pertaining to the timely access survey. DHCS will need to secure additional funding for the EQRO to change the survey approach, updating all call scripts and methodology, and work to test the updated methodology. Assuming funding is secured, and scope can be expanded DHCS will implement the change no later than the 2025 EQRO Technical Report, which is published by April 30, 2026.

DHCS also updated the EQRO scope of work for the 2024 reporting year to disclose the proportion of providers excluded from the survey, the reasons for exclusion, and impact on the survey results. The results will be part of the 2024 EQRO Technical Report, which will be published by April 30, 2025.

California State Auditor's Assessment of 60-Day Status: Partially Implemented

DHCS has updated the scope of work with its EQRO for the 2023-24 timely access study to include the 48-hour standard for certain urgent appointments. We will review its reporting of compliance with the standard when it publishes its 2024 report in 2025.

Recommendation #2 To: Health Care Services, Department of

To better ensure appropriate and effective monitoring of timely access to behavioral health care for children, by November 2024 DHCS should make changes to its survey methodologies to do the following, and then implement those changes for the subsequent reporting period: Disclose the proportion of providers excluded from its survey results for each plan, the reasons for excluding those providers, and how such exclusions may affect the survey's conclusions about access to care.

6-Month Agency Response

After further discussion with the EQRO contractor, it was determined it is not necessary to update their Statement of Work to effectuate the change of disclosing the proportion of providers excluded from the survey, the reasons for exclusion, and the impact on the survey results. The change will be reflected in the 2024 Medi-Cal Managed Care (MCMC) External Quality Review Technical Report, which will be published by April 30, 2025.

California State Auditor's Assessment of 6-Month Status: Pending

60-Day Agency Response

The Department of Health Care Services (DHCS) updated the External Quality Review Organization (EQRO) Timely Access scope of work for the 2024 reporting year to reflect the addition of the two-day urgent appointment. The change will be reflected in the 2024 EQRO Technical Report, which will be published by April 30, 2025.

As part of the methodology adjustment, DHCS will explore implementing monitoring for both new and existing patients. The adjustment will significantly impact the EQRO's scope of work pertaining to the timely access survey. DHCS will need to secure additional funding for the EQRO to change the survey approach, updating all call scripts and methodology, and work to test the updated methodology. Assuming funding is secured, and scope can be expanded DHCS will implement the change no later than the 2025 EQRO Technical Report, which is published by April 30, 2026.

DHCS also updated the EQRO scope of work for the 2024 reporting year to disclose the proportion of providers excluded from the survey, the reasons for exclusion, and impact on the survey results. The results will be part of the 2024 EQRO Technical Report, which will be published by April 30, 2025.

California State Auditor's Assessment of 60-Day Status: Pending

Recommendation #3 To: Health Care Services, Department of

To better ensure appropriate and effective monitoring of timely access to behavioral health care for children, by November 2024 DHCS should make changes to its survey methodologies to do the following, and then implement those changes for the subsequent reporting period: Use its timely access surveys to monitor compliance with the timely appointment standards for both new and existing patients.

6-Month Agency Response

DHCS engaged its EQRO contractor to obtain a cost and feasibility analysis to assess the incorporation of monitoring compliance for both new and existing patients.

DHCS has received and is currently reviewing the report to develop recommended next steps.

If updates to the survey methodology are recommended, DHCS will need to secure additional funding for the EQRO to change the survey approach, which will include updating the methodology, updating all call scripts, and testing the updated methodology. Assuming funding is secured and the scope can be expanded, DHCS will implement the change no later than the 2025 EQRO Technical Report, which will be published by April 30, 2026.

California State Auditor's Assessment of 6-Month Status: Pending

60-Day Agency Response

The Department of Health Care Services (DHCS) updated the External Quality Review Organization (EQRO) Timely Access scope of work for the 2024 reporting year to reflect the addition of the two-day urgent appointment. The change will be reflected in the 2024 EQRO Technical Report, which will be published by April 30, 2025.

As part of the methodology adjustment, DHCS will explore implementing monitoring for both new and existing patients. The adjustment will significantly impact the EQRO's scope of work pertaining to the timely access survey. DHCS will need to secure additional funding for the EQRO to change the survey approach, updating all call scripts and methodology, and work to test the updated methodology. Assuming funding is secured, and scope can be expanded DHCS will implement the change no later than the 2025 EQRO Technical Report, which is published by April 30, 2026.

DHCS also updated the EQRO scope of work for the 2024 reporting year to disclose the proportion of providers excluded from the survey, the reasons for exclusion, and impact on the survey results. The results will be part of the 2024 EQRO Technical Report, which will be published by April 30, 2025.

California State Auditor's Assessment of 60-Day Status: Pending

Recommendation #4 To: Managed Health Care, Department of

To better ensure appropriate and effective monitoring of timely access to behavioral health care for children, by November 2024 Managed Health Care should make changes to its survey methodologies to do the following, and then implement those changes for the subsequent reporting period: Use its timely access surveys to monitor compliance with the 48 hour urgent appointment standard established in state law where applicable.

6-Month Agency Response

In March of 2024, the Department of Managed Health Care (DMHC) published the Measurement Year (MY) 2022 Timely Access Report, which included charts and appendices setting forth the mean and median average appointment wait time for each required product, in accordance with Section 1367.03, sub. (f)(3) and included the 48 hour and 96 hour urgent appointment standards.

The DMHC intends to integrate the 48 hour standard into the rate of compliance survey data in the survey methodology by requiring health plans to identify whether prior authorization is required for each applicable provider type included in the survey. The DMHC will seek stakeholder feedback on the proposed APA exempt regulatory changes in its MY 2025 survey methodology. If the approach is adopted, the change would be included in the updated methodology by May 1, 2025. Health plans will report data under the updated methodology in 2026.

California State Auditor's Assessment of 6-Month Status: Pending

60-Day Agency Response

The Department of Managed Health Care's (DMHC) Measurement Year (MY) 2022 Timely Access Report will include new charts and appendices setting forth the mean and median average appointment wait time for each required product, in accordance with Section 1367.03, sub. (f)(3). To implement this recommendation, both the new charts and appendices will include the 48 hour and 96 hour urgent appointment standards to allow the DMHC and members of the public to easily evaluate compliance with both urgent appointment wait time standards across the industry, by product, and by health plan.

The DMHC believes this recommendation will be fully implemented upon publication of the MY 2022 Timely Access Report in early 2024; however, the DMHC will continue to assess ways to incorporate this standard into rate of compliance calculations for specialist physicians and non-physician mental health providers. If the CSA does not agree that this recommendation is fully implemented, the DMHC will need additional staffing and statistical funding, as well as an extension to the APA exemption set forth in Section 1367.03, sub. (f)(3) to implement and refine changes to the survey methodology.

California State Auditor's Assessment of 60-Day Status: Partially Implemented

Although Managed Health Care's upcoming report states that the standards for urgent appointments can be 48 or 96 hours, depending on whether prior authorization is required, it still combines the data on available urgent appointments. This makes it unclear whether the data is for the next available appointment that falls under the 48-hour standard or not. Full implementation of the recommendation will require more clarity that the surveys are asking about and recording appointments specifically for appointment types that fall under the 48-hour standard.

Recommendation #5 To: Managed Health Care, Department of

To better ensure appropriate and effective monitoring of timely access to behavioral health care for children, by November 2024 Managed Health Care should make changes to its survey methodologies to do the following, and then implement those changes for the subsequent reporting period: Disclose the proportion of providers excluded from its survey results for each plan, the reasons for excluding those providers, and how such exclusions may affect the survey's conclusions about access to care.

6-Month Agency Response

In March of 2024, the DMHC published the MY 2022 Timely Access Report with industry level ineligible and non-responsive provider data and set forth how the exclusion of these providers from the survey results may affect the rates of compliance. The DMHC also published the MY 2022 Timely Access Data that includes the health plan-reported number and percentage of ineligible and non-responsive providers in the survey results data for each county for each health plan network. As indicated in the 60 day response, the DMHC will need additional funding and resources to create a health plan-level summary analysis of the data published on the DMHC's public web site.

California State Auditor's Assessment of 6-Month Status: Will Not Implement

The MY 2022 Timely Access report includes a summary table of all health plans' survey response rates and a breakdown on the different reasons a provider was marked as ineligible. DMHC also included reasons why the survey data may not represent the enrollee's experience in obtaining a timely appointment. Nonetheless, DMHC notes that it will need additional finding to create a health plan-level summary analysis of the data, and will not implement the recommendation.

60-Day Agency Response

The DMHC will need additional resources to fully implement the CSA's recommendations. This includes producing dashboards or data tables that will enhance the DMHC's ability to present health plan-level ineligible and non-response data in the future. Therefore, the DMHC will not fully implement CSA's recommendation.

However, to be responsive to the CSA's recommendations within DMHC's current resources, the DMHC's MY 2022 Timely Access Report will include both industry level ineligible and non-responsive provider data and set forth how the exclusion of these providers from the survey results may affect the rates of compliance. While the health plan-reported number and percentage of ineligible and non-responsive providers is included in the survey results data, annually published on DMHC's public website, the MY 2022 Timely Access Report does not include health plan-level analysis due to resource limitations, the large volume of data (over 1.7 million records of data) and limited time to publish the report.

California State Auditor's Assessment of 60-Day Status: Will Not Implement

The department has indicated that it will not implement this recommendation.

Recommendation #6 To: Managed Health Care, Department of

To better ensure appropriate and effective monitoring of timely access to behavioral health care for children, by November 2024 Managed Health Care should make changes to its survey methodologies to do the following, and then implement those changes for the subsequent reporting period: Use its timely access surveys to monitor compliance with the timely appointment standards for both new and existing patients.

6-Month Agency Response

As previously indicated in the 60 day response, to implement this recommendation the DMHC would need additional staffing and statistical funding to develop and test changes to the methodology, and annually evaluate and report the results in the Timely Access Report. In addition, the DMHC would need an extension of the APA exemption to implement and refine these changes in future regulatory amendments to the survey methodology. Thus, the DMHC is unable to implement this change at this time.

California State Auditor's Assessment of 6-Month Status: Will Not Implement

Managed Health Care's response indicates that it will not implement this recommendation because it would need an extension of its APA exemption. However, as we state in our comments to DMHC's response in our report on page 69, it is unclear how this relates to our recommendation that Managed Health Care simply make changes to its survey methodology by November 2024 and then implement those changes for the subsequent reporting period. Managed Health Care's current exemption from the APA does not expire until December 2025. To the extent that Managed Health Care is unable to ensure the feasibility of the changes and to confirm the changes result in reliable, valid, and comparable data over the next year, then it may choose to request that the Legislature extend the exemption.

60-Day Agency Response

The DMHC will need additional staffing and statistical funding to develop and test changes to the methodology, and annually evaluate and report the results in the Timely Access Report. The DMHC's methodology is codified into regulation. Any change to the methodology requires regulatory amendment. The DMHC's current exemption from the Administrative Procedures Act (APA) only allows the DMHC to make changes until December 31, 2025. Typically, development and testing of significant changes to the statistical methodology require several years to complete. After the initial implementation, the DMHC and its statistical vendor evaluate the data reported under the updated methodology and make additional refinements to ensure that the resulting data is valid and reliable. Where significant changes are made, such as those recommended by the CSA, refinements may be required over several reporting cycles. As of this date, any changes would be included in the next methodology for measurement year 2025, and the resulting data would be reported to the DMHC on May 1, 2026. Given the expiration of the APA exemption in H&S section 1367.03, sub. (f)(3) on December 31, 2025, the DMHC will need an extension of the APA exemption to implement and refine these changes in future regulatory amendments to the survey methodology.

California State Auditor's Assessment of 60-Day Status: Will Not Implement

Managed Health Care's response indicates that it will not implement this recommendation.

Recommendation #7 To: Health Care Services, Department of

To assess opportunities to help ensure unbiased timely access survey data, by November 2024, DHCS should determine the feasibility, costs, and likely benefits of adopting a "secret shopper" approach to its timely access surveys. If the department determines that adopting such an approach is reasonably feasible and beneficial, it should implement this methodology by the next reporting year.

6-Month Agency Response

DHCS is continuing to evaluate the feasibility and costs of adopting a "secret shopper" approach to the timely access surveys for the Medi-Cal managed care plans (MCPs) with the EQRO. DHCS engaged its EQRO contractor to conduct an analysis of the secret shopper approach.

DHCS received the report and is reviewing it to develop recommended next steps. If the approach is determined feasible, DHCS will implement the adjusted methodology by the reporting year 2026 for the MCMC delivery system.

DHCS still plans to pilot the secret shopper process in the reporting year 2025 for Drug Medi-Cal Organized Delivery System and Specialty Mental Health Services providers and is working to incorporate this work into the EQRO contract.

DHCS will begin kick-off meetings regarding project development with DHCS' EQRO in approximately July 2024.

California State Auditor's Assessment of 6-Month Status: Pending

60-Day Agency Response

DHCS is continuing to evaluate the feasibility of adopting a "secret shopper" approach to the timely access surveys for the Medi-Cal managed care plans (MCPs).

As part of the feasibility analysis, DHCS will need to consider the operational steps needed when adjusting the methodology, which includes securing additional funding for the EQRO to change the survey approach, working with the EQRO to test the new methodology, and providing guidance to implement the new process with MCPs.

If the approach is determined feasible, DHCS will implement the adjusted methodology by the reporting year 2026 for the Medi-Cal Managed Care delivery system.

DHCS intends to pilot the secret shopper process in the reporting year 2025 for Drug Medi-Cal Organized Delivery System (DMC-ODS) and Specialty Mental Health Services (SMHS) providers.

California State Auditor's Assessment of 60-Day Status: Pending

Recommendation #8 To: Managed Health Care, Department of

To assess opportunities to help ensure unbiased timely access survey data, by November 2024, Managed Health Care should determine the feasibility, costs, and likely benefits of adopting a "secret shopper" approach to its timely access surveys. If the department determines that adopting such an approach is reasonably feasible and beneficial, it should implement this methodology by the next reporting year.

6-Month Agency Response

On February 8, 2024, the DMHC submitted a memo to CSA setting forth its concerns with the feasibility and limitations of a secret shopper methodology. Based on the considerations set forth in the memo, the DMHC has determined that adopting a secret shopper approach is not reasonably feasible or more beneficial than the current survey approach. Thus, the DMHC will not implement a secret shopper survey methodology at this time.

As previously indicated in the 60 day response, the DMHC may explore other options to address the potential bias concerns if an extension of the APA exemption and additional funding for staffing and statistical services is provided to DMHC to implement and refine these changes in future regulatory amendments to the survey methodology.

California State Auditor's Assessment of 6-Month Status: Fully Implemented

DMHC provided documentation demonstrating that it considered the feasibility, costs, and likely benefits of adopting a "secret shopper" approach to its timely access surveys. The memo indicates that DMHC did not find that adopting such an approach is reasonably feasible. Thus, it has appropriately implemented our recommendation.

60-Day Agency Response

The DMHC has significant concerns regarding the feasibility and utility of a secret shopper survey. In addition, the DMHC would need consulting funding to conduct an independent evaluation of the feasibility, costs, and benefits of adopting a "secret shopper" survey. A secret shopper survey would not allow for collection of mental health follow-up appointment wait times, because it can only assess appointment wait times for new patients and cannot measure access for existing patients. (Nor would it allow the DMHC to implement Recommendation 3.) Further, it would not allow for meaningful measurement of specialist physicians and ancillary provider appointment wait times, because these providers often require a referral from a physician and/or prior authorization prior to scheduling an appointment. While a secret shopper survey is unlikely to adequately capture these appointment types, all three classes of appointment wait times are required to be measured by H&S section 1367.03, sub. (f)(3). Given these and other concerns, the DMHC may explore other options to address the potential bias concerns.

Based on the DMHC's five years of experience in developing a survey methodology and the complexities involved with a secret shopper survey, it is estimated to take four to five years to successfully develop and implement this recommendation. Thus, the DMHC cannot implement a secret shopper survey prior to the expiration of the APA exemption on December 31, 2025. (H&S section 1367.03, sub. (f)(3).) In addition to an extension of this APA exemption, the DMHC would also need additional staffing and statistical funding to implement this change.

California State Auditor's Assessment of 60-Day Status: Will Not Implement

Managed Health Care indicates that it will not implement this recommendation.

Recommendation #9 To: Health Care Services, Department of

To improve its ability to use timely access surveys as a tool to improve access to behavioral health services, by November 2024, DHCS should develop a compliance threshold for the percentage of appointments in each Medi-Cal managed care plan meeting timely access standards. For example, DHCS might consider how many calls a member should have to make before obtaining a timely appointment and calculate a threshold accordingly.

6-Month Agency Response

No change from the previous update: DHCS has initiated conversations with the Department of Managed Health Care to develop consistent compliance thresholds. Once established, DHCS will set compliance thresholds and inform the MCPs of the policy by November 2024.

California State Auditor's Assessment of 6-Month Status: Pending

60-Day Agency Response

DHCS has initiated conversations with the Department of Managed Health Care to develop consistent compliance thresholds. Once established, DHCS will set compliance thresholds and inform the MCPs of the policy by November 2024.

California State Auditor's Assessment of 60-Day Status: Pending

Recommendation #10 To: Health Care Services, Department of

To help determine whether timely access to mental health services for children is improving, by November 2024, DHCS should report in each year's timely access survey results on the extent to which those results are comparable to previous years' results and, where data is comparable, discuss the extent to which timely access to care is improving or declining.

6-Month Agency Response

For non-specialty mental health, DHCS updated the 2024 EQRO scope of work to include the year-over-year trending methodology. DHCS is continually working with the EQRO to trend Timely Access Survey data starting with the 2023 and 2024 survey results. They will be published as part of the 2024 EQRO Technical Report, which will be published by April 30, 2025.

California State Auditor's Assessment of 6-Month Status: Pending

60-Day Agency Response

For non-specialty mental health, DHCS updated the 2024 EQRO scope of work to include the year-over-year trending methodology. DHCS will work with the EQRO to trend Timely Access Survey data starting with the 2023 and 2024 survey results. The findings will be published as part of the 2024 EQRO Technical Report, which will be published by April 30, 2025.

California State Auditor's Assessment of 60-Day Status: Pending

Recommendation #11 To: Health Care Services, Department of

To improve Medi-Cal members' access to behavioral health services from county mental health plans and Drug Medi-Cal programs, by November 2024, DHCS should demonstrate that it has followed up with county mental health plans and Drug Medi-Cal programs on CAPs that continue to be deficient in timely access or other network adequacy standards. In doing so, it should assess whether the plans took the actions described in their CAPs and, if so, why those actions did not result in sufficient improvement.

6-Month Agency Response

For 2023 and subsequent submission cycles, DHCS is on track to conduct ongoing follow-up with all Behavioral Health Plans (BHPs) that continue to be out of compliance after submitting a Corrective Action Plan (CAP) for timely access and/or network adequacy standards, in addition to issuing financial sanctions when BHPs do not come into compliance with CAPs.

DHCS is in the process of releasing initial assessment of findings packages for FY2023-24 Annual Network Adequacy Certification. Where relevant (i.e., for deficiencies appearing to be linked to incorrect or incomplete data submissions) BHPs will be given an opportunity to resubmit corrected data to address deficient findings with a Reassessment Submission. DHCS anticipates final finding results to be released to the BHPs in June 2024.

BHPs found to be out-of-compliance with network adequacy standards during initial assessment and having uncorrected/unresolved deficiencies remaining after reassessment submissions will be required to submit a CAP after the reassessment submission period along with applicable supporting documentation. The BHPs will be contacted and required to attend a technical assistance call(s) to address the reasons why the BHP remains non-compliant. CAP completion timelines for BHPs vary depending on the nature and severity of the identified non-compliance. DHCS requires regular periodic check-ins with the plan to ensure the plan is on track to accomplish the stated goals and milestones detailed within the CAP.

DHCS is finalizing internal sanctions protocol and will begin to impose sanctions for network deficiencies beginning FY 2024-25. At this time, DHCS will assess FY 2023-24 annual network certification results along with prior fiscal years' annual network certification results. If BHP network deficiencies identified in prior fiscal years remain unresolved, demonstrating a pattern of non-compliance, DHCS may impose sanctions.

California State Auditor's Assessment of 6-Month Status: Partially Implemented

60-Day Agency Response

Prior to the audit, DHCS had identified steps to improve the Corrective Action Plan (CAP) process for county Mental Health Plans (MHPs) and DMC-ODS plans, collectively referred to as Behavioral Health Plans (BHPs). For the FY 2023-24 network adequacy certification period, BHPs began submitting Annual Network Adequacy Certification documentation on November 1, 2023. DHCS is currently processing the information. BHPs found out-of-compliance with network adequacy standards will be required to submit a CAP along with applicable supporting documentation. BHPs that remain out-of-compliance will be contacted and required to attend a technical assistance call(s) required to address the reasons why the BHP remains non-compliant. Additionally, for data-driven network adequacy standards, the BHP will be required to submit the applicable data to DHCS monthly to show compliance. DHCS will conduct the appropriate analysis and provide results to the BHP. For non-data-related deficiencies that remain non-compliant, DHCS will establish a monitoring timeline to provide periodic check-ins with the BHP to ensure the applicable required documentation needed to bring the BHP into compliance is submitted and reviewed. If BHPs fail to demonstrate sufficient progress or improvement via this process, DHCS will issue financial sanctions when deemed appropriate. Additionally, Drug Medi-Cal (DMC) counties submitted timely access data on November 1, 2023, in response to the implementation of the Mental Health Parity and Addiction Equity Act of 2008. DHCS published BHIN 22-070 on December 30, 2022, which requires DMC counties to meet timely access requirements as specified in 28 CCR 1300.67.2.2 (c)(5). FY 2023-24 is the inaugural year; thus, results will be advisory. Beginning FY 2024-25, DMC counties will be held to compliance, and any DMC county found out of compliance will follow the CAP process as described above.

California State Auditor's Assessment of 60-Day Status: Partially Implemented

DHCS provided the Information Notice it created outlining its expectations of BHPs on CAPs, and indicating it will follow up with BHPs on CAPs that continue to be deficient in timely access or other network adequacy standards. We will assess whether DHCS fully implements this recommendation by conducting that follow-up and making determinations of causes for continued deficiencies after it fully processes the information BHPs submitted in November 2023, and after it begins conducting the same analysis for DMCs beginning in fiscal year 2024-25.

Recommendation #12 To: Health Care Services, Department of

To ensure that children in Medi-Cal have timely access to behavioral health services from county mental health plans and Drug Medi-Cal programs, by November 2024, DHCS should analyze county mental health plans' and Drug Medi-Cal programs' appointment data according to age group to determine if each county meets the compliance threshold for timely access for both adults and children. To the extent a plan does not meet timely access standards for either group, DHCS should require corrective action.

6-Month Agency Response

DHCS is currently working to issue initial assessment findings for FY 2023-24 and the timely access compliance results will be reported out by age group and service/modality type. DHCS anticipates final finding results to be released to the BHPs in June 2024.

DHCS will continue to monitor all future timeliness reporting by age group and service/modality type.

California State Auditor's Assessment of 6-Month Status: Pending

60-Day Agency Response

For the county MHPs and DMC-ODS programs, DHCS revised the Timely Access Data Tool (TADT) for FY 2023-24 Annual Network Adequacy Certification submission to collect Client Identification Numbers (CIN) for all new members requesting behavioral health services. The CINs provide access to a multitude of demographic information which will allow for more robust reporting. On August 31, 2023, DHCS published BHIN 23-041, and on November 1, 2023, BHPs began submitting FY 2023-24 Annual Network Adequacy Certification Submission documentation, which includes the TADT. Due to reporting requirements outlined in BHIN 22-070, DMC counties also submitted timely access data on the FY 2022-23 TADT template. Beginning FY 2024-25, DMC counties will submit timely access data on the current version of the TADT. DHCS will analyze BHPs' appointment data according to age group. For SMHS timely access reporting, the age groups are Children/Youth (0-20) and Adults (21+). For DMC-ODS and State Plan DMC counties, the age groups are Youth (0-17) and Adults (18+). In March 2024, BHPs will receive reports detailing the results of the timely access analysis. The reports will inform each BHP of its compliance with the 80 percent timely access requirement by age group. For BHPs out of compliance with timely access standards, DHCS will require a CAP from the BHP to demonstrate how the BHP will come into compliance with timely access standards.

California State Auditor's Assessment of 60-Day Status: Partially Implemented

DHCS provided the template for its reports that indicate it will analyze county mental health plans' and Drug Medi-Cal programs' appointment data according to age group to determine if each county meets the compliance threshold for timely access for both adults and children. We will review full implementation of this recommendation when DHCS publishes those reports and demonstrates that it will require corrective action for plans not meeting timely access standards for either children or adults.

Recommendation #13 To: Health Care Services, Department of

To ensure that Medi-Cal managed care plans have a sufficient number of providers to offer timely access and meet children's behavioral health care needs, by May 2024, DHCS should develop a new methodology for calculating non-specialty outpatient behavioral health provider-to-member ratios. At minimum, the methodology should consider the following factors:
-The expected demand for behavioral health services by children in Medi-Cal, based on factors including but not limited to past services.
-The estimated number of children likely to need those services.
-The number of full-time providers needed to provide that volume of services.
-The amount of time individual providers spend treating Medi-Cal members.
The methodology should also accommodate potential growth in the need for behavioral health services.

6-Month Agency Response

DHCS conducted an analysis to consider the above-recommended factors and updated the provider-to-member ratio methodology accordingly. The analysis was focused on addressing the items feasible for implementation by May 2024. It was determined feasible to include the number of full-time equivalent providers needed and the amount of time providers spend serving Medi-Cal patients in the methodology. DHCS will continue to perform research on the other recommended factors based on available data and will target inclusion with the 2024 annual network certification (ANC).

California State Auditor's Assessment of 6-Month Status: Partially Implemented

DHCS provided a revised methodology that includes some of the elements of our recommendation. When DHCS finalizes its methodology and provides documentation of its consideration of all factors included in the recommendation, we will assess whether DHCS has fully implemented the recommendation.

60-Day Agency Response

By May 2024, DHCS will conduct an analysis to consider the above-recommended factors and update the provider-to-member ratio methodology accordingly. DHCS is planning the analysis and has begun research into studies to address mental health provider-to-member ratios. In developing an updated methodology, DHCS will consider the feasibility of each of the recommended factors based on available data.

California State Auditor's Assessment of 60-Day Status: Pending

Recommendation #14 To: Health Care Services, Department of

When determining the number of mental health providers a managed care plan has available to serve children in Medi-Cal, DHCS should consider whether providers serve multiple plans or multiple regions within a single plan. When providers do so, DHCS should account for that overlap, such as by reducing the expected contribution of a provider to a given plan when that provider serves multiple plans or regions within a plan.

6-Month Agency Response

DHCS has updated the non-specialty outpatient behavioral health provider-to-member ratios methodology as part of improvements to the ANC process. The updated methodology added a full-time equivalent (FTE) analysis within each MCPs network. DHCS will initiate a work effort in 2024 to assess the feasibility of adjusting the FTE analysis to account for providers who are contracted with more than one MCP. If feasible, DHCS intends to roll out as part of ANC 2026.

California State Auditor's Assessment of 6-Month Status: Partially Implemented

60-Day Agency Response

DHCS has initiated a work effort to update the non-specialty outpatient behavioral health provider-to-member ratios methodology as part of improvements to the annual network certification (ANC) process. The updated methodology will add a full-time equivalent (FTE) analysis within each MCPs network and will be included in the 2024 ANC. DHCS will initiate a work effort in 2024 to assess the feasibility of adjusting the FTE analysis to account for providers who are contracted with more than one MCP. If feasible, DHCS intends to roll out as part of ANC 2026.

California State Auditor's Assessment of 60-Day Status: Pending

Recommendation #15 To: Health Care Services, Department of

To ensure that Medi-Cal managed care plan members do not have to travel unreasonable times or distances to receive care, DHCS should develop a definition of what times and distances are reasonable for members to travel. In doing so, DHCS should consider both the total time or distance a member needs to travel, as well as how those times and distances compare to other plans' times and distances for the same provider type and ZIP code. Thereafter, when DHCS determines that plans' requests for alternative time and distance standards are not reasonable, it should not approve those alternative access standards, thereby requiring those plans to offer members out-of-network access until such time as the plans can provide reasonable travel times and distances to care.

6-Month Agency Response

No change from the previous update: DHCS has begun analysis and is working on a project plan and approach to determine reasonability. To the extent possible, the policy will be aligned across managed care delivery systems and can be adopted for specialty behavioral health as well.

California State Auditor's Assessment of 6-Month Status: Pending

60-Day Agency Response

DHCS has begun analysis and is working on a project plan and approach to determine reasonability. To the extent possible, the policy will be aligned across managed care delivery systems and can be adopted for specialty behavioral health as well.

California State Auditor's Assessment of 60-Day Status: Pending

Recommendation #16 To: Health Care Services, Department of

To ensure that Medi-Cal managed care plans make efforts to obtain additional providers to meet network adequacy standards, by May 2024, DHCS should revise its agreements with plans that do not meet time and distance standards to require them to demonstrate efforts to recruit new providers to underserved areas.

6-Month Agency Response

DHCS acknowledges an increase in the behavioral health care workforce, including physicians who practice in California and are enrolled in Medi-Cal would be beneficial. DHCS contractually requires MCPs to ensure and monitor an appropriate provider network within service areas in compliance with network adequacy standards, and if necessary, attempt to contract with providers in adjoining counties outside the service area. To strengthen further, no sooner than the contract year 2025, DHCS will contractually require MCPs who do not comply with specified network adequacy requirements to demonstrate efforts in recruiting new providers in underserved areas. DHCS has begun MCP contract language development efforts to effectuate the provider recruitment requirements.

California State Auditor's Assessment of 6-Month Status: Pending

60-Day Agency Response

DHCS acknowledges an increase in the behavioral health care workforce, including physicians who practice in California and are enrolled in Medi-Cal would be beneficial. DHCS contractually requires MCPs to ensure and monitor an appropriate provider network within service areas in compliance with network adequacy standards, and if necessary, attempt to contract with providers in adjoining counties outside the service area. To strengthen further, no sooner than the contract year 2025, DHCS will contractually require MCPs that do not comply with specified network adequacy requirements to demonstrate efforts in recruiting new providers in underserved areas. The same contract requirements and considerations apply to specialty behavioral health plans. DHCS has begun MCP contract language development efforts to effectuate the provider recruitment requirements.

California State Auditor's Assessment of 60-Day Status: Pending

Recommendation #17 To: Health Care Services, Department of

To more effectively encourage plans to comply with network adequacy standards, by May 2024, DHCS should develop and implement a policy outlining when noncompliance with network adequacy standards by a Medi-Cal managed care plan, county mental health plan, or county Drug Medi-Cal program justifies financial penalties.

6-Month Agency Response

DHCS is finalizing the enforcement action policy for MCP performance regarding network adequacy standards and is working on alignment across delivery systems to the extent possible. DHCS will implement the policy for Managed Care Plans by May 2024.

California State Auditor's Assessment of 6-Month Status: Pending

DHCS did not provide a copy of its policy upon our request and instead clarified that it is considering an all-plan letter that will operationalize the policy recommended in the report. It is targeting Fall 2024 to disseminate the all-plan letter for public comment.

60-Day Agency Response

DHCS collaborates internally regarding MCP performance concerns and builds a consensus on the appropriate enforcement actions across program areas. DHCS discussed the policy in November 2023 and began the development of the policy. DHCS will implement the policy by May 2024.

California State Auditor's Assessment of 60-Day Status: Pending

Recommendation #18 To: Managed Health Care, Department of

To identify and address timely access issues that affect children, by November 2024, Managed Health Care should update its survey methodology to assess compliance with timely access standards specifically for behavioral health care providers serving children.

6-Month Agency Response

As previously indicated in the 60 day response, to implement this recommendation the DMHC would need additional staffing and statistical funding to develop and test changes to the methodology, and annually evaluate and report the results in the Timely Access Report. In addition, the DMHC would need an extension of the APA exemption to implement and refine these changes in future regulatory amendments to the survey methodology.

California State Auditor's Assessment of 6-Month Status: Will Not Implement

Managed Health Care's response continues to indicate that it will not implement this recommendation because it would need an extension of its APA exemption. However, as we state in our comments to DMHC's response in our report on page 69, it is unclear how this relates to our recommendation that Managed Health Care simply make changes to its survey methodology by November 2024 and then implement those changes for the subsequent reporting period. Managed Health Care's current exemption from the APA does not expire until December 2025. To the extent that Managed Health Care is unable to ensure the feasibility of the changes and to confirm the changes result in reliable, valid, and comparable data over the next year, then it may choose to request that the Legislature extend the exemption.

60-Day Agency Response

To be responsive to the CSA's recommendations, the DMHC will need additional staffing and statistical funding to develop and test changes to the methodology, and annually evaluate and report the results in the Timely Access Report. As indicated in response to recommendation 3, the DMHC's methodology is codified into regulation. Any change to the methodology requires regulatory amendment. The DMHC's current exemption from the Administrative Procedures Act (APA) only allows the DMHC to make changes until December 31, 2025. Typically, development and testing of significant changes to the statistical methodology require several years to complete. After the initial implementation, the DMHC and its statistical vendor evaluate the data reported under the updated methodology and make additional refinements to ensure that the resulting data is valid and reliable. Where significant changes are made, such as those recommended by the CSA, refinements may be required over several reporting cycles. As of this date, any changes would be included in the next methodology for measurement year 2025, and the resulting data would be reported to the DMHC on May 1, 2026. Given, given the expiration of the APA exemption in H&S section 1367.03, sub. (f)(3) on December 31, 2025, the DMHC will need an extension of the APA exemption to implement and refine these changes in future regulatory amendments to the survey methodology.

California State Auditor's Assessment of 60-Day Status: Will Not Implement

Managed Health Care's response indicates it will not implement this recommendation.

All Recommendations in 2023-115

Agency responses received are posted verbatim.