General Information
REAL WORLD TESTING PLAN
GENERAL INFORMATION
Plan Report ID Number: [For ONC-Authorized Certification Body use only]
Developer Name: Diameter Health
Product Name(s): Fusion
Version Number(s): 3.17, 3.124
Certified Health IT: 2015
Product List (CHPL) ID(s): 15.99.04.3023.Diam.31.00.0.180918, 15.04.04.3023.Diam.31.01.0.221107
Developer Real World Testing Page URL: https://www.availityclinicalsolutions.com/certifications/
JUSTIFICATION FOR REAL WORLD TESTING APPROACH
Diameter Health’s goal is to support healthcare interoperability by bringing together data from various siloed care settings and summarizing them into a single patient longitudinal record that can then be adjudicated for accurate and timely measure compliance.
Real-world testing is introduced to “verify that deployed Certified Health IT continues to perform as intended by conducting and measuring observations of interoperability and data exchange”. To that end, our test plan intends to measure the frequency of our certified modules being used in a 90-day time frame, and to understand the success rate of using them. We will also conduct a closely monitored 8-hour window to observe varied ways in which data is produced and enhance our ability to identify detailed issues in real time. Evidence of an unexpected low utilization rate or low success rate could indicate potential problems, which we would then work with our customers to better understand and identify ways to address.
Note: Diameter Health markets to HIEs to import clinical data in the form of C-CDA documents to be used in evaluating measure qualification in the output of QRDA I and QRDA III; therefore, individual types of care settings will not be applicable to our Real-World Testing approach.
STANDARDS UPDATES (INCLUDING STANDARDS VERSION ADVANCEMENT PROCESS (SVAP) AND UNITED STATES CORE DATA FOR INTEROPERABILITY (USCDI))
| Standard (and version) | N/A |
| Updated certification criteria and associated product | N/A |
| Health IT Module CHPL ID | N/A |
| Method used for standard update | N/A |
| Date of ONC-ACB notification | N/A |
| Date of customer notification (SVAP only) | N/A |
| Conformance measure | N/A |
| USCDI-updated certification criteria (and USCDI version) | N/A |
MEASURES USED IN OVERALL APPROACH
| Measurement/Metric | Description | Expected Outcomes |
| Volume of eCQMs produced within 90-day time frame | Number of eCQMs recorded during 90-day time frame Number of QRDA I reports created during 90-day time frame Number of QRDA III reports created during 90-day time frame | We expect that the Fusion Product can record, report, export and import QRDA reports accurately and effectively, regardless of the volume or frequency of use. We expect a moderate to high frequency of QRDA III file utilization with high success rate, a low to moderate frequency of QRDA I creation with high success rate, and low frequency for QRDA I import with high success rate. |
| Volume of eCQMs produced within closely monitored 8-hour time frame | Number of QRDA I reports created during monitored time frame Number of QRDA III reports created during monitored time frame | We expect a moderate to high frequency of QRDA III file utilization with high success rate, ad hoc QRDA I creation with high success rate, and low frequency for QRDA I import with high success rate. |
ASSOCIATED CERTIFICATION CRITERIA
| Measurement/Metric | Associated Certification Criteria |
| Volume of eCQMs produced within 90-day time frame Volume of eCQMs produced within closely monitored 8-hour time frame | 170.315 (c)(1): Clinical Quality Measures – Record and Export View details: https://www.hhs.gov/guidance/sites/default/files/hhs-guidance-documents/2006094409-pm-c1ccg.pdf 170.315 (c)(2): Clinical Quality Measures – Import and Calculate View details: https://www.hhs.gov/guidance/sites/default/files/hhs-guidance-documents/2006093871-kq-c2tp.pdf View details: 170.315 (c)(3): Clinical Quality Measures – Report https://www.hhs.gov/guidance/sites/default/files/hhs-guidance-documents/2006094409-pm-c3ccg.pdf |
JUSTIFICATION FOR SELECTED MEASUREMENT/METRIC
| Measurement/Metric | Justification |
| Volume of eCQMs produced within 90-day time frame Volume of eCQMs produced within closely monitored 8-hour time frame | 170.315 (c)(1), 170.315 (c)(2) and 170.315 (c)(3) will be tested together. C1 requires a certified Health IT module to record data, calculate eCQMs, and export the data in QRDA I format. C2 requires a certified Health IT module to import data from a QRDA I file and calculate the CQMs based on that data. C3 requires a certified Health IT module must be able to create a conformant QRDA I formatted file and a QRDA III aggregate report to be used for transmitting eCQM data to CMS. By checking the frequency of these activities done in real-world, it helps validate that our product has all necessary capabilities to support our customers with their reporting needs. |
CARE SETTING(S)
| Care Setting | Justification |
| N/A (HIEs) | Diameter Health markets to HIEs with a goal of collecting data across care settings to inform a single longitudinal patient record. This approach enhances the accuracy of measure calculation by pulling together all data related to the patient so that it can be considered when calculating measures. |
EXPECTED OUTCOMES
| Measurement/Metric | Expected Outcomes |
| Volume of eCQMs produced within 90-day time frame | We expect that the Fusion product can record, report, export and import QRDA reports accurately and effectively, regardless of the volume or frequency of use. We expect a moderate to high frequency of QRDA III file utilization with high success rate, a low to moderate frequency of QRDA I creation as well as ad hoc QRDA I creation with high success rate, and low frequency for QRDA I import with high success rate. |
| Volume of eCQMs produced within closely monitored 8-hour time frame | We expect a moderate to high frequency of QRDA III file utilization with high success rate, ad hoc QRDA I creation with high success rate, and low frequency for QRDA I import with high success rate. |
SCHEDULE OF KEY MILESTONES
| Key Milestone | Care Setting | Date/Time frame |
| Planning/kickoff: Identify clients actively using eCQMs Engage with clients to promote participation Discuss/align on RWT approach with clients | n/a (HIEs) | Q1 2023 |
| Data Collection: Select 90-day time frame and run usage reports from client systems that capture eCQMs included, type of file created (QRDA I vs. QRDA III), number of patients processed, final status of report, and number of errors Coordinate day in which each participating client will have concentrated QRDA report creation to monitor success of QRDA III report creation, ad-hoc QRDA I runs, and collect detailed error messages | n/a (HIEs) | Q2 2023 |
| Analyze metrics: Review Real-World test data vs expected outcomes If unexpected results are identified, create a plan to investigate, and resolve, if applicable | n/a (HIEs) | Q3 2023 |
| Produce findings report: Summarize RWT Key milestones/findings | n/a (HIEs) | Q4 2023 |