Downstream clinical consequences of stress cardiovascular magnetic resonance based on appropriate use criteria
Journal of Cardiovascular Magnetic Resonance volume 17, Article number: 35 (2015)
Appropriate use criteria (AUC) have been developed by professional organizations as a response to the rising costs of imaging, with the goal of optimizing test-patient selection. Consequently, the AUC are now increasingly used by third-party-payers to assess reimbursement. However, these criteria were created by expert consensus and have not been systematically assessed for CMR. The aim of this study was to determine the rates of abnormal stress-CMR and subsequent downstream utilization of angiography and revascularization procedures based on the most recent AUC.
300 consecutive patients referred for CMR-stress testing were prospectively enrolled. Two cardiologists reviewed all clinical information before the CMR-stress test and classified the test as “appropriate’, “maybe appropriate” or “rarely appropriate” according to the 2013 AUC. Patients were followed for 2 months for the primary outcomes of coronary angiography and/or revascularization.
49.7% of stress CMRs were appropriate, 36.7% maybe appropriate, and 13.6% rarely appropriate. Ischemia was significantly more likely to be seen in the appropriate (18.8%) or maybe appropriate groups (21.8%) than the rarely appropriate group (4.8%) (p = 0.030 and p = 0.014 respectively). Referral for cardiac catheterization was not significantly different in the appropriate (10.1%) and maybe appropriate groups (10.0%) compared to the rarely appropriate group (2.4%) (p = 0.119 and p = 0.127 respectively). No patients undergoing catheterization in the rarely appropriate group went on to require revascularization, in contrast to 53.3% of the appropriate vs 36.4% of the maybe appropriate patients (p = 0.391). Presence of ischemia led to referral for cardiac catheterization in 50.0% of the appropriate group vs 33.3% of the maybe appropriate group (p = 0.225); in contrast to none of the rarely appropriate group.
The great majority of tests were classified as appropriate or maybe appropriate. Downstream cardiac catheterization rates were similar in all 3 groups. However, rarely appropriate studies never required revascularization, suggesting suboptimal resource utilization. Studies classified as maybe appropriate had similar rates of abnormal findings and led to similar rates of downstream catheterization and revascularization as those that were deemed appropriate. This suggests that consideration could be given to upgrading some of the common maybe appropriate indications to the appropriate category.
As a response to fiscal pressures and with the goal of optimizing test-patient selection, appropriate use criteria (AUC) have been developed by several professional organizations - including the American College of Cardiology, the Society for Cardiovascular Magnetic Resonance, the American Society of Nuclear Cardiology and the American Society of Echocardiography [1–5]. Consequently, the AUC are now increasingly used by payers to assess the suitability of reimbursement for imaging procedures. Moreover, recent approval of the “Protecting Access to Medicare Act” (PAMA) by the United States Congress has very significant implications for the application of AUC to CMR reimbursement [6,7]. It states that starting in 2017 - in order to be paid by Medicare for advanced imaging - certification must be provided that the ordering physicians consulted the AUC. The claim to Medicare must specify whether the requested imaging adheres to the AUC. The act also states that criteria must be developed by national medical societies or provider-led entities and should be evidence based, to the extent possible. By November 2015, the Centers for Medicare and Medicaid Services (CMS) must select the specific AUC to be used. Finally, in 2020 CMS must identify up to 5% of physicians as outliers in adherence to AUC, who may then be subject to prior authorization.
Stress CMR is increasing used in the management of patients with known or suspected coronary artery disease . The initial AUC for stress CMR was recently replaced by the AUC for stable ischemic heart disease, as part of a new multimodality approach [1,5]. The AUC were developed by a panel who were asked to rate 80 clinical indications as being “appropriate”, “maybe appropriate”, or “rarely appropriate”. However, these criteria were created by expert consensus and have never been systematically assessed or validated for CMR. In particular, there is no data regarding the impact of the AUC on downstream cardiac procedures.
The aims of this study were to determine the rates of abnormal stress CMR results and subsequent downstream utilization of angiography and revascularization procedures based on the most recent AUC.
Three hundred consecutive patients referred for CMR stress testing were prospectively enrolled in a single academic medical center. Patients were excluded if they had metallic implants incompatible with CMR, glomerular filtration rate < 30 ml/min, high degree atrio-ventricular block, severe active wheezing from asthma or severe claustrophobia. Subjects were asked to abstain from caffeine-containing products for at least 12 h prior to the test.
Demographic and clinical characteristics were recorded prospectively at the time of CMR stress testing from patient interviews and the electronic medical record. Patients gave informed written consent for the protocol, which was approved by the local institutional review board.
Images were acquired on a 3 T scanner (Philips Achieva, Philips Medical Systems, Best, the Netherlands) using a six-element phased-array receiver coil as previously described . Steady-state free-precession cine images were acquired in multiple short-axis and three long-axis views (repetition time, 3.0 ms; echo time, 1.5 ms; flip angle, 40°; slice thickness 6 mm).
The patient table was then partially pulled outside the scanner bore to allow direct observation of the patient and full access. A 0.4 mg bolus of regadenoson (Lexiscan, Astellas Pharma Inc) was infused under continuous electrocardiography and blood pressure monitoring. Approximately 1 min after regadenoson administration, the perfusion sequence was applied and Gadolinium contrast (0.075 mmol/kg gadoteridol, Bracco Diagnostics) followed by a saline flush (30 ml) was infused (4.5 ml/s) via an antecubital vein. On the console, the perfusion images were observed as they were acquired, with breath-holding starting from the appearance of contrast in the right ventricular cavity. Imaging was completed 10 to 15 s after the gadolinium bolus had transited the left ventricular myocardium. Perfusion images consisted of three to four short-axis slices obtained every heartbeat with a saturation-recovery, gradient-echo sequence (repetition time 2.8 ms; echo time 1.1 ms; flip angle 20°; voxel size, 2.5 × 2.5 × 8 mm). Aminophylline (100 mg IV) was administered immediately after stress perfusion imaging . Rest perfusion images were acquired 15 min after stress imaging with an additional contrast bolus (0.075 mmol/kg gadoteridol) using identical sequence parameters. Five minutes after rest perfusion, late gadolinium enhancement (LGE) imaging was performed with a 2D segmented gradient echo phase-sensitive inversion-recovery sequence in the identical views as cine-CMR. Inversion delay times were typically 280 to 360 ms. Perfusion and LGE images were visually interpreted by standard methods . The pattern of LGE was classified as either infarct or non-CAD type on the basis of subendocardial enhancement [11,12].
Patient classification for AUC
Two independent general cardiologists reviewed all clinical information dated before the CMR stress test. These reviewers were blinded to the results of the CMR and to the clinical course subsequent to the test. The CMR stress tests were classified as “appropriate’, “maybe appropriate” or “rarely appropriate” as defined by the 2013 AUC . A third blinded independent physician adjudicated any discrepancy between the interpreters.
After CMR, patients were prospectively followed for 2 months for the primary outcomes of coronary angiography and/or revascularization. Clinical follow-up was based on review of the electronic medical records or from telephone interviews with patients or their physicians.
Normally distributed data were expressed as mean ± SD. Continuous variables were compared by the Student’s t-test or Wilcoxon rank-sum (depending on data normality). Comparisons of discrete variables were made using the chi-square test; Fisher’s exact test was used when the assumptions of the chi-square test were not met. A p value of <0.05 was considered statistically significant.
Table 1 summarizes the baseline patient characteristics. The mean age of the study population was 59 years. 54% of patients were female and 36% had diabetes mellitus. 32% had known coronary artery disease, including prior PCI (17%) and CABG (4%). The mean ejection fraction was 61%. Of the 300 CMRs reviewed, arbitration for AUC assignment by a third cardiologist was required for just 1 patient.
At 2 months of follow-up, the endpoint of coronary angiography occurred in 27 patients and the endpoint of revascularization occurred in 12 patients (PCI = 11, CABG = 1).
Based on the 2013 AUC, 49.7% of stress CMRs were classified as appropriate, 36.7% as maybe appropriate, and 13.6% as rarely appropriate. A comparison of the baseline characteristics across AUC is given in Table 1. There were significant differences in age, prevalence of diabetes, hyperlipidemia, smoking, hypertension, and known CAD across the three groups.
The six most frequent AUC categories accounted for 179 patients (Table 2). Of patients with these common six indications approximately 69% were classified as appropriate and 31% as maybe appropriate.
Relationship of appropriateness to CMR results
Abnormal CMR stress results (defined as presence of ischemia or scar) were more common in the appropriate (29.5%) and maybe appropriate (28.2%) groups compared with the rarely appropriate (14.6%) group although the differences did not reach statistical significance (p = 0.055 and p = 0.085 respectively) (Fig. 1). Ischemia was significantly more likely to be seen in patients in the appropriate (18.8%) or maybe appropriate groups (21.8%) than the rarely appropriate group (4.8%) (p = 0.030 and p = 0.014 respectively) (Fig. 2).
Relationship of appropriateness to downstream angiography and revascularization
There was a trend towards more referral for cardiac catheterization in the appropriate (10.1%) and maybe appropriate groups (10.0%) compared to the rarely appropriate group (2.4%), but the differences were not statistically significant (p = 0.119 and p = 0.127 respectively). However, none of the patients undergoing catheterization in the rarely appropriate group went on to require revascularization, in contrast to 53.3% of the appropriate vs 36.4% of the maybe appropriate patients (p = 0.391) (Fig. 3).
Relationship of abnormal CMR results with referral to downstream angiography
The finding of ischemia on CMR led to referral for cardiac catheterization in 50.0% of the appropriate group vs 33.3% of the maybe appropriate group (p = 0.225). In contrast none of the rarely appropriate patients with ischemia were referred for cardiac catheterization. Based on an angiographic cut-off of ≤50% major epicardial stenosis, stress-CMR had a sensitivity = 94%, specificity = 44%, positive predictive value = 77%, and negative predictive value = 80%, in this biased referral population.
Due to rising healthcare costs, appropriate use of cardiovascular imaging is increasingly emphasized by professional societies, third party payers and accreditation agencies [6,7,13,14]. To the best of our knowledge this is the first study to systematically and prospectively assess the downstream utilization of angiography and revascularization procedures based on the AUC for stress-CMR. We have shown that tests categorized by the AUC as rarely appropriate, infrequently demonstrate ischemia, but the rates of downstream cardiac catheterization were not significantly different to those categorized as appropriate or maybe appropriate. Importantly when patients underwent cardiac catheterization none of the rarely appropriate group went on to require subsequent revascularization. These findings appear to support the current AUC classification of rarely appropriate stress-CMR studies, since this group appears to result in suboptimal resource utilization.
In our study population, the great majority of tests ordered were deemed as appropriate or maybe appropriate. Only, approximately 14% of the stress-CMRs were categorized as rarely appropriate. This is similar to the inappropriate proportions reported for stress echocardiography (9–33%) [15,16], Single Photon Emission Computed Tomography (SPECT) (7–46%) [17–19], and Positron Emission Tomography (PET) (10.2%) . It is interesting to speculate whether growing pre-certification demands by third-party payers may have affected physicians test orderings patterns, but this cannot be assessed from this study.
We found that studies that were classified as maybe appropriate had similar rates of ischemia and led to similar rates of downstream catheterization and revascularization as those that were deemed appropriate. This suggests that consideration could be given to upgrading some of the common maybe appropriate indications to the appropriate category (Table 2).
It is interesting to note that even when ischemia was reported, patients were more likely to be referred for cardiac catheterization in the appropriate and maybe appropriate groups. In fact none of the patients with ischemia in the rarely appropriate group were referred for cardiac catheterization. The reasons for this are unclear but may relate to physician’s assessment that invasive testing and revascularization would not significantly change outcomes or symptoms in this patient group.
In this study we have looked at the rates of abnormal stress tests and the endpoints of downstream angiography and revascularization to help assess optimal test-patient selection and imaging utilization. However, there are a number of important caveats to bear in mind. Higher rates of abnormal findings and greater use of angiography or revascularization doesn’t necessarily imply better outcomes. Such validation would require performance of prospective randomized outcome trials. Ideally these studies should be part of larger initiatives to compare the effectiveness of different imaging modalities. Although, such studies will be challenging to perform and fund, they are of critical importance in clarifying optimal imaging strategies. Another important point to emphasize is that stress testing can be very useful in patient management even when it does not lead to angiography or revascularization . For example a normal study may lead to exclusion of coronary artery disease as a cause of symptoms, as well as to clinic/hospital discharge; or it may lead to ‘surgical clearance’ in patients referred prior to elective non-cardiac surgery. Further studies are required to more comprehensively assess these types of clinical impact and management change [22,23].
Future steps in assessing and validating AUC for stress-CMR should aim to compare the prognostic ability of the test across the various AUC categories. Such an approach was recently undertaken by Doukky et al. in a large nuclear study . They demonstrated that inappropriate use of SPECT was associated with reduced prognostic value. In those patients whose scans were appropriate or uncertain, abnormal scans were of significant value in predicting major adverse cardiac events (hazard ratio 3.1–3.7) compared with normal scans. However, in those with inappropriate scans, abnormal studies did not achieve significance in predicting adverse cardiac events. Moreover, all abnormal SPECT findings were associated with increasing rates of revascularization, irrespective of the level of appropriateness.
Our study was limited by a small sample size (n = 300) drawn from a single academic institution and may not be representative of the wider population. However, this may have the advantage of providing uniform scanning, interpretation and follow-up protocols. Larger studies with greater statistical power and more events (particularly revascularization) will allow a more comprehensive analysis of subgroups. The results of this study should therefore be regarded as preliminary, until larger multicenter studies are completed. As mentioned above, cardiac catheterization and revascularization are only part of the downstream clinical consequences of CMR-stress. Cost-effectiveness was not assessed in this study and clearly needs to be the subject of future studies aiming to establish the validity of the AUC.
The great majority of tests ordered in our population were classified as appropriate or maybe appropriate. Downstream referral for cardiac catheterization was not significantly different in the 3 groups. However, rarely appropriate studies never required revascularization, suggesting suboptimal resource utilization. Studies classified as maybe appropriate had similar rates of abnormal findings and led to similar rates of downstream catheterization and revascularization as those that were deemed appropriate. This suggests that consideration could be given to upgrading some of the common maybe appropriate indications to the appropriate category.
Hendel RC, Patel MR, Kramer CM, Poon M, Hendel RC, Carr JC, et al. ACCF/ACR/SCCT/SCMR/ASNC/NASCI/SCAI/SIR 2006 appropriateness criteria for cardiac computed tomography and cardiac magnetic resonance imaging: a report of the american college of cardiology foundation quality strategic directions committee appropriateness criteria working group, american college of radiology, society of cardiovascular computed tomography, society for cardiovascular magnetic resonance, american society of nuclear cardiology, north american society for cardiac imaging, society for cardiovascular angiography and interventions, and society of interventional radiology. J Am Coll Cardiol. 2006;48(7):1475–97.
Hendel RC, Berman DS, Di Carli MF, Heidenreich PA, Henkin RE, Pellikka PA, et al. ACCF/ASNC/ACR/AHA/ASE/SCCT/SCMR/SNM 2009 appropriate Use criteria for cardiac radionuclide imaging: a report of the american college of cardiology foundation appropriate Use criteria task force, the american society of nuclear cardiology, the american college of radiology, the american heart association, the american society of echocardiography, the society of cardiovascular computed tomography, the society for cardiovascular magnetic resonance, and the society of nuclear medicine. J Am Coll Cardiol. 2009;53(23):2201–29.
American College of Cardiology Foundation Appropriate Use Criteria Task F, American Society of E, American Heart A, American Society of Nuclear C, Heart Failure Society of A, Heart Rhythm S, Society for Cardiovascular A, Interventions, Society of Critical Care M, Society of Cardiovascular Computed T et al. ACCF/ASE/AHA/ASNC/HFSA/HRS/SCAI/SCCM/SCCT/SCMR 2011 appropriate Use criteria for echocardiography. A report of the american college of cardiology foundation appropriate Use criteria task force, american society of echocardiography, american heart association, american society of nuclear cardiology, heart failure society of america, heart rhythm society, society for cardiovascular angiography and interventions, society of critical care medicine, society of cardiovascular computed tomography, and society for cardiovascular magnetic resonance endorsed by the american college of chest physicians. J Am Coll Cardiol. 2011;57(9):1126–66.
Taylor AJ, Cerqueira M, Hodgson JM, Mark D, Min J, O’Gara P, et al. ACCF/SCCT/ACR/AHA/ASE/ASNC/NASCI/SCAI/SCMR 2010 appropriate use criteria for cardiac computed tomography. A report of the american college of cardiology foundation appropriate Use criteria task force, the society of cardiovascular computed tomography, the american college of radiology, the american heart association, the american society of echocardiography, the american society of nuclear cardiology, the north american society for cardiovascular imaging, the society for cardiovascular angiography and interventions, and the society for cardiovascular magnetic resonance. J Am Coll Cardiol. 2010;56(22):1864–94.
Wolk MJ, Bailey SR, Doherty JU, Douglas PS, Hendel RC, Kramer CM, et al. ACCF/AHA/ASE/ASNC/HFSA/HRS/SCAI/SCCT/SCMR/STS 2013 multimodality appropriate use criteria for the detection and risk assessment of stable ischemic heart disease: a report of the American college of cardiology foundation appropriate use criteria task force, american heart association, american society of echocardiography, american society of nuclear cardiology, heart failure society of america, heart rhythm society, society for cardiovascular angiography and interventions, society of cardiovascular computed tomography, society for cardiovascular magnetic resonance, and society of thoracic surgeons. J Am Coll Cardiol. 2014;63(4):380–406.
Ferrari VA, Whitman B, Blankenship JC, Budoff MJ, Costa M, Weissman NJ, et al. Cardiovascular imaging payment and reimbursement systems: understanding the past and present in order to guide the future. J Am Coll Cardiol Img. 2014;7(3):324–32.
Soman P, Kelly R. Imaging at the 2014 ACC legislative conference: a debrief. J Am Coll Cardiol Img. 2015;8(1):118–20.
Greenwood JP, Maredia N, Younger JF, Brown JM, Nixon J, Everett CC, et al. Cardiovascular magnetic resonance and single-photon emission computed tomography for diagnosis of coronary heart disease (CE-MARC): a prospective trial. Lancet. 2012;379(9814):453–60.
Dandekar VK, Bauml MA, Ertel AW, Dickens C, Gonzalez RC, Farzaneh-Far A. Assessment of global myocardial perfusion reserve using cardiovascular magnetic resonance of coronary sinus flow at 3 Tesla. J Cardiovascular Magnetic Resonance Off J Soc Cardiovascular Magnetic Resonance. 2014;16(1):24.
Klem I, Heitner JF, Shah DJ, Sketch Jr MH, Behar V, Weinsaft J, et al. Improved detection of coronary artery disease by stress perfusion cardiovascular magnetic resonance with the use of delayed enhancement infarction imaging. J Am Coll Cardiol. 2006;47(8):1630–8.
Reimer KA, Jennings RB. The “wavefront phenomenon” of myocardial ischemic cell death. II. Transmural progression of necrosis within the framework of ischemic bed size (myocardium at risk) and collateral flow. Laboratory Investigation J Technical Methods Pathol. 1979;40(6):633–44.
McCrohon JA, Moon JC, Prasad SK, McKenna WJ, Lorenz CH, Coats AJ, et al. Differentiation of heart failure related to dilated cardiomyopathy and coronary artery disease using gadolinium-enhanced cardiovascular magnetic resonance. Circulation. 2003;108(1):54–9.
Hendel RC. Utilization management of cardiovascular imaging pre-certification and appropriateness. J Am Coll Cardiol Img. 2008;1(2):241–8.
Iglehart JK. Health insurers and medical-imaging policy–a work in progress. N Engl J Med. 2009;360(10):1030–7.
Bhattacharyya S, Kamperidis V, Chahal N, Shah BN, Roussin I, Li W, et al. Clinical and prognostic value of stress echocardiography appropriateness criteria for evaluation of coronary artery disease in a tertiary referral centre. Heart. 2014;100(5):370–4.
Willens HJ, Nelson K, Hendel RC. Appropriate use criteria for stress echocardiography: impact of updated criteria on appropriateness ratings, correlation with pre-authorization guidelines, and effect of temporal trends and an educational initiative on utilization. J Am Coll Cardiol Img. 2013;6(3):297–309.
Medolago G, Marcassa C, Alkraisheh A, Campini R, Ghilardi A, Giubbini R, et al. Applicability of the appropriate use criteria for SPECT myocardial perfusion imaging in Italy: preliminary results. Eur J Nucl Med Mol Imaging. 2014;41(9):1695–700.
Hendel RC, Cerqueira M, Douglas PS, Caruth KC, Allen JM, Jensen NC, et al. A multicenter assessment of the use of single-photon emission computed tomography myocardial perfusion imaging with appropriateness criteria. J Am Coll Cardiol. 2010;55(2):156–62.
Doukky R, Hayes K, Frogge N, Balakrishnan G, Dontaraju VS, Rangel MO, et al. Impact of appropriate use on the prognostic value of single-photon emission computed tomography myocardial perfusion imaging. Circulation. 2013;128(15):1634–43.
Winchester DE, Chauffe RJ, Meral R, Nguyen D, Ryals S, Dusaj R, Shaw L, Beyth RJ: Clinical utility of inappropriate positron emission tomography myocardial perfusion imaging: Test results and cardiovascular events. J Nuclear Cardiol Off Publication Am Soc Nuclear Cardiol 2014.
Armstrong W, Eagle KA. Appropriate use criteria in echocardiography: is no change the same as no benefit? JAMA Internal Med. 2013;173(17):1609–10.
Matulevicius SA, Rohatgi A, Das SR, Price AL, DeLuna A, Reimold SC. Appropriate use and clinical impact of transthoracic echocardiography. JAMA Internal Med. 2013;173(17):1600–7.
Abbasi SA, Ertel A, Shah RV, Dandekar V, Chung J, Bhat G, et al. Impact of cardiovascular magnetic resonance on management and clinical decision-making in heart failure patients. J Cardiovascular Magnetic Resonance Off J Soc Cardiovascular Magnetic Resonance. 2013;15:89.
The authors declare that they have no competing interests.
AF conceived the study, participated in its design and coordination, supervised imaging and drafted the manuscript. SM and OM participated in the study design and conduct, and helped to draft the manuscript. MAB and VR participated in the study coordination and supervised the performance of the studies. All authors read and approved the final manuscript.
About this article
Cite this article
McGraw, S., Mirza, O., Bauml, M.A. et al. Downstream clinical consequences of stress cardiovascular magnetic resonance based on appropriate use criteria. J Cardiovasc Magn Reson 17, 35 (2015). https://doi.org/10.1186/s12968-015-0137-x