- Open Access
Downstream clinical consequences of stress cardiovascular magnetic resonance based on appropriate use criteria
© McGraw et al.; licensee BioMed Central. 2015
- Received: 28 November 2014
- Accepted: 30 April 2015
- Published: 15 May 2015
Appropriate use criteria (AUC) have been developed by professional organizations as a response to the rising costs of imaging, with the goal of optimizing test-patient selection. Consequently, the AUC are now increasingly used by third-party-payers to assess reimbursement. However, these criteria were created by expert consensus and have not been systematically assessed for CMR. The aim of this study was to determine the rates of abnormal stress-CMR and subsequent downstream utilization of angiography and revascularization procedures based on the most recent AUC.
300 consecutive patients referred for CMR-stress testing were prospectively enrolled. Two cardiologists reviewed all clinical information before the CMR-stress test and classified the test as “appropriate’, “maybe appropriate” or “rarely appropriate” according to the 2013 AUC. Patients were followed for 2 months for the primary outcomes of coronary angiography and/or revascularization.
49.7% of stress CMRs were appropriate, 36.7% maybe appropriate, and 13.6% rarely appropriate. Ischemia was significantly more likely to be seen in the appropriate (18.8%) or maybe appropriate groups (21.8%) than the rarely appropriate group (4.8%) (p = 0.030 and p = 0.014 respectively). Referral for cardiac catheterization was not significantly different in the appropriate (10.1%) and maybe appropriate groups (10.0%) compared to the rarely appropriate group (2.4%) (p = 0.119 and p = 0.127 respectively). No patients undergoing catheterization in the rarely appropriate group went on to require revascularization, in contrast to 53.3% of the appropriate vs 36.4% of the maybe appropriate patients (p = 0.391). Presence of ischemia led to referral for cardiac catheterization in 50.0% of the appropriate group vs 33.3% of the maybe appropriate group (p = 0.225); in contrast to none of the rarely appropriate group.
The great majority of tests were classified as appropriate or maybe appropriate. Downstream cardiac catheterization rates were similar in all 3 groups. However, rarely appropriate studies never required revascularization, suggesting suboptimal resource utilization. Studies classified as maybe appropriate had similar rates of abnormal findings and led to similar rates of downstream catheterization and revascularization as those that were deemed appropriate. This suggests that consideration could be given to upgrading some of the common maybe appropriate indications to the appropriate category.
- Single Photon Emission Compute Tomography
- Cardiovascular Magnetic Resonance
- Late Gadolinium Enhancement
- Cardiac Catheterization
As a response to fiscal pressures and with the goal of optimizing test-patient selection, appropriate use criteria (AUC) have been developed by several professional organizations - including the American College of Cardiology, the Society for Cardiovascular Magnetic Resonance, the American Society of Nuclear Cardiology and the American Society of Echocardiography [1–5]. Consequently, the AUC are now increasingly used by payers to assess the suitability of reimbursement for imaging procedures. Moreover, recent approval of the “Protecting Access to Medicare Act” (PAMA) by the United States Congress has very significant implications for the application of AUC to CMR reimbursement [6,7]. It states that starting in 2017 - in order to be paid by Medicare for advanced imaging - certification must be provided that the ordering physicians consulted the AUC. The claim to Medicare must specify whether the requested imaging adheres to the AUC. The act also states that criteria must be developed by national medical societies or provider-led entities and should be evidence based, to the extent possible. By November 2015, the Centers for Medicare and Medicaid Services (CMS) must select the specific AUC to be used. Finally, in 2020 CMS must identify up to 5% of physicians as outliers in adherence to AUC, who may then be subject to prior authorization.
Stress CMR is increasing used in the management of patients with known or suspected coronary artery disease . The initial AUC for stress CMR was recently replaced by the AUC for stable ischemic heart disease, as part of a new multimodality approach [1,5]. The AUC were developed by a panel who were asked to rate 80 clinical indications as being “appropriate”, “maybe appropriate”, or “rarely appropriate”. However, these criteria were created by expert consensus and have never been systematically assessed or validated for CMR. In particular, there is no data regarding the impact of the AUC on downstream cardiac procedures.
The aims of this study were to determine the rates of abnormal stress CMR results and subsequent downstream utilization of angiography and revascularization procedures based on the most recent AUC.
Three hundred consecutive patients referred for CMR stress testing were prospectively enrolled in a single academic medical center. Patients were excluded if they had metallic implants incompatible with CMR, glomerular filtration rate < 30 ml/min, high degree atrio-ventricular block, severe active wheezing from asthma or severe claustrophobia. Subjects were asked to abstain from caffeine-containing products for at least 12 h prior to the test.
Demographic and clinical characteristics were recorded prospectively at the time of CMR stress testing from patient interviews and the electronic medical record. Patients gave informed written consent for the protocol, which was approved by the local institutional review board.
Images were acquired on a 3 T scanner (Philips Achieva, Philips Medical Systems, Best, the Netherlands) using a six-element phased-array receiver coil as previously described . Steady-state free-precession cine images were acquired in multiple short-axis and three long-axis views (repetition time, 3.0 ms; echo time, 1.5 ms; flip angle, 40°; slice thickness 6 mm).
The patient table was then partially pulled outside the scanner bore to allow direct observation of the patient and full access. A 0.4 mg bolus of regadenoson (Lexiscan, Astellas Pharma Inc) was infused under continuous electrocardiography and blood pressure monitoring. Approximately 1 min after regadenoson administration, the perfusion sequence was applied and Gadolinium contrast (0.075 mmol/kg gadoteridol, Bracco Diagnostics) followed by a saline flush (30 ml) was infused (4.5 ml/s) via an antecubital vein. On the console, the perfusion images were observed as they were acquired, with breath-holding starting from the appearance of contrast in the right ventricular cavity. Imaging was completed 10 to 15 s after the gadolinium bolus had transited the left ventricular myocardium. Perfusion images consisted of three to four short-axis slices obtained every heartbeat with a saturation-recovery, gradient-echo sequence (repetition time 2.8 ms; echo time 1.1 ms; flip angle 20°; voxel size, 2.5 × 2.5 × 8 mm). Aminophylline (100 mg IV) was administered immediately after stress perfusion imaging . Rest perfusion images were acquired 15 min after stress imaging with an additional contrast bolus (0.075 mmol/kg gadoteridol) using identical sequence parameters. Five minutes after rest perfusion, late gadolinium enhancement (LGE) imaging was performed with a 2D segmented gradient echo phase-sensitive inversion-recovery sequence in the identical views as cine-CMR. Inversion delay times were typically 280 to 360 ms. Perfusion and LGE images were visually interpreted by standard methods . The pattern of LGE was classified as either infarct or non-CAD type on the basis of subendocardial enhancement [11,12].
Patient classification for AUC
Two independent general cardiologists reviewed all clinical information dated before the CMR stress test. These reviewers were blinded to the results of the CMR and to the clinical course subsequent to the test. The CMR stress tests were classified as “appropriate’, “maybe appropriate” or “rarely appropriate” as defined by the 2013 AUC . A third blinded independent physician adjudicated any discrepancy between the interpreters.
After CMR, patients were prospectively followed for 2 months for the primary outcomes of coronary angiography and/or revascularization. Clinical follow-up was based on review of the electronic medical records or from telephone interviews with patients or their physicians.
Normally distributed data were expressed as mean ± SD. Continuous variables were compared by the Student’s t-test or Wilcoxon rank-sum (depending on data normality). Comparisons of discrete variables were made using the chi-square test; Fisher’s exact test was used when the assumptions of the chi-square test were not met. A p value of <0.05 was considered statistically significant.
Baseline Characteristics Stratified by Appropriate Use Criteria
Total N = 300
Appropriate N = 149
Maybe Appropriate N = 110
Rarely Appropriate N = 41
Current Smoking %
Known CAD %
Prior MI %
Prior PCI %
Prior CABG %
At 2 months of follow-up, the endpoint of coronary angiography occurred in 27 patients and the endpoint of revascularization occurred in 12 patients (PCI = 11, CABG = 1).
Based on the 2013 AUC, 49.7% of stress CMRs were classified as appropriate, 36.7% as maybe appropriate, and 13.6% as rarely appropriate. A comparison of the baseline characteristics across AUC is given in Table 1. There were significant differences in age, prevalence of diabetes, hyperlipidemia, smoking, hypertension, and known CAD across the three groups.
AUC categories in our study population
Follow-up testing (>90 days) for new or worsening symptoms with non-obstructive CAD on coronary angiography (invasive or noninvasive) OR normal prior stress imaging study
Symptomatic in intermediate pre-test probability of CAD with interpretable ECG AND able to exercise
Symptomatic in intermediate pre-test probability of CAD with uninterpretable ECG OR unable to exercise
Newly diagnosed systolic heart failure (resting LV function previously assessed but no prior CAD evaluation)
Evaluation for symptomatic (ischemic equivalent) post-revascularization (PCI or CABG)
Sequential or follow up testing (≤90 days) with uncertain results on prior stress imaging study (not stress CMR) where obstructive CAD remains a concern
Symptomatic in low pre-test probability of CAD with interpretable ECG AND able to exercise
Pre-operative clearance in poor or unknown functional capacity (<4 METS); intermediate risk surgery with ≥1 clinical risk factor
High pre-test probability of CAD with an interpretable ECG and able to exercise
High pre-test probability of CAD with an uninterpretable ECG and unable to exercise
Follow up testing for new or worsening symptoms with an abnormal prior stress imaging study
Follow up testing (>90 Days) in an asymptomatic or symptomatically stable patient whose last study was ≥ 2 years ago
Follow up testing (>90 Days) in an asymptomatic patient without ischemic equivalent, who has a normal prior stress imaging study or non-obstructive CAD on angiogram who is intermediate to high global CAD risk with a study ≥ 2 years ago
Follow up testing (>90 Days) in an a patient with stable symptoms, who has a normal prior stress imaging study or non-obstructive CAD on angiogram who is intermediate to high global CAD risk with a study ≥ 2 years ago
Symptomatic patients who are low pre-test probability of CAD with an uninterpretable ECG or unable to exercise
Newly diagnosed diastolic heart failure
Evaluation of arrhythmias without ischemic equivalent with frequent PVCs
Syncope without ischemic equivalent in a patient with low global CAD risk
Follow up testing (>90 Days) in an asymptomatic or symptomatically stable patient with a history of abnormal prior stress imaging study < 2 years ago
Follow up testing (>90 Days) in an asymptomatic patient with a normal prior stress imaging study OR non-obstructive CAD on angiogram
Follow up testing for new or worsening symptoms in a patient with prior obstructive CAD on invasive coronary angiography
Pre-op risk stratification in a patient with poor or unknown functional capacity (<4 METs) in a patient who is undergoing vascular surgery with ≥ 1 clinical risk factor
Relationship of appropriateness to CMR results
Relationship of appropriateness to downstream angiography and revascularization
Relationship of abnormal CMR results with referral to downstream angiography
The finding of ischemia on CMR led to referral for cardiac catheterization in 50.0% of the appropriate group vs 33.3% of the maybe appropriate group (p = 0.225). In contrast none of the rarely appropriate patients with ischemia were referred for cardiac catheterization. Based on an angiographic cut-off of ≤50% major epicardial stenosis, stress-CMR had a sensitivity = 94%, specificity = 44%, positive predictive value = 77%, and negative predictive value = 80%, in this biased referral population.
Due to rising healthcare costs, appropriate use of cardiovascular imaging is increasingly emphasized by professional societies, third party payers and accreditation agencies [6,7,13,14]. To the best of our knowledge this is the first study to systematically and prospectively assess the downstream utilization of angiography and revascularization procedures based on the AUC for stress-CMR. We have shown that tests categorized by the AUC as rarely appropriate, infrequently demonstrate ischemia, but the rates of downstream cardiac catheterization were not significantly different to those categorized as appropriate or maybe appropriate. Importantly when patients underwent cardiac catheterization none of the rarely appropriate group went on to require subsequent revascularization. These findings appear to support the current AUC classification of rarely appropriate stress-CMR studies, since this group appears to result in suboptimal resource utilization.
In our study population, the great majority of tests ordered were deemed as appropriate or maybe appropriate. Only, approximately 14% of the stress-CMRs were categorized as rarely appropriate. This is similar to the inappropriate proportions reported for stress echocardiography (9–33%) [15,16], Single Photon Emission Computed Tomography (SPECT) (7–46%) [17–19], and Positron Emission Tomography (PET) (10.2%) . It is interesting to speculate whether growing pre-certification demands by third-party payers may have affected physicians test orderings patterns, but this cannot be assessed from this study.
We found that studies that were classified as maybe appropriate had similar rates of ischemia and led to similar rates of downstream catheterization and revascularization as those that were deemed appropriate. This suggests that consideration could be given to upgrading some of the common maybe appropriate indications to the appropriate category (Table 2).
It is interesting to note that even when ischemia was reported, patients were more likely to be referred for cardiac catheterization in the appropriate and maybe appropriate groups. In fact none of the patients with ischemia in the rarely appropriate group were referred for cardiac catheterization. The reasons for this are unclear but may relate to physician’s assessment that invasive testing and revascularization would not significantly change outcomes or symptoms in this patient group.
In this study we have looked at the rates of abnormal stress tests and the endpoints of downstream angiography and revascularization to help assess optimal test-patient selection and imaging utilization. However, there are a number of important caveats to bear in mind. Higher rates of abnormal findings and greater use of angiography or revascularization doesn’t necessarily imply better outcomes. Such validation would require performance of prospective randomized outcome trials. Ideally these studies should be part of larger initiatives to compare the effectiveness of different imaging modalities. Although, such studies will be challenging to perform and fund, they are of critical importance in clarifying optimal imaging strategies. Another important point to emphasize is that stress testing can be very useful in patient management even when it does not lead to angiography or revascularization . For example a normal study may lead to exclusion of coronary artery disease as a cause of symptoms, as well as to clinic/hospital discharge; or it may lead to ‘surgical clearance’ in patients referred prior to elective non-cardiac surgery. Further studies are required to more comprehensively assess these types of clinical impact and management change [22,23].
Future steps in assessing and validating AUC for stress-CMR should aim to compare the prognostic ability of the test across the various AUC categories. Such an approach was recently undertaken by Doukky et al. in a large nuclear study . They demonstrated that inappropriate use of SPECT was associated with reduced prognostic value. In those patients whose scans were appropriate or uncertain, abnormal scans were of significant value in predicting major adverse cardiac events (hazard ratio 3.1–3.7) compared with normal scans. However, in those with inappropriate scans, abnormal studies did not achieve significance in predicting adverse cardiac events. Moreover, all abnormal SPECT findings were associated with increasing rates of revascularization, irrespective of the level of appropriateness.
Our study was limited by a small sample size (n = 300) drawn from a single academic institution and may not be representative of the wider population. However, this may have the advantage of providing uniform scanning, interpretation and follow-up protocols. Larger studies with greater statistical power and more events (particularly revascularization) will allow a more comprehensive analysis of subgroups. The results of this study should therefore be regarded as preliminary, until larger multicenter studies are completed. As mentioned above, cardiac catheterization and revascularization are only part of the downstream clinical consequences of CMR-stress. Cost-effectiveness was not assessed in this study and clearly needs to be the subject of future studies aiming to establish the validity of the AUC.
The great majority of tests ordered in our population were classified as appropriate or maybe appropriate. Downstream referral for cardiac catheterization was not significantly different in the 3 groups. However, rarely appropriate studies never required revascularization, suggesting suboptimal resource utilization. Studies classified as maybe appropriate had similar rates of abnormal findings and led to similar rates of downstream catheterization and revascularization as those that were deemed appropriate. This suggests that consideration could be given to upgrading some of the common maybe appropriate indications to the appropriate category.
- Hendel RC, Patel MR, Kramer CM, Poon M, Hendel RC, Carr JC, et al. ACCF/ACR/SCCT/SCMR/ASNC/NASCI/SCAI/SIR 2006 appropriateness criteria for cardiac computed tomography and cardiac magnetic resonance imaging: a report of the american college of cardiology foundation quality strategic directions committee appropriateness criteria working group, american college of radiology, society of cardiovascular computed tomography, society for cardiovascular magnetic resonance, american society of nuclear cardiology, north american society for cardiac imaging, society for cardiovascular angiography and interventions, and society of interventional radiology. J Am Coll Cardiol. 2006;48(7):1475–97.View ArticlePubMedGoogle Scholar
- Hendel RC, Berman DS, Di Carli MF, Heidenreich PA, Henkin RE, Pellikka PA, et al. ACCF/ASNC/ACR/AHA/ASE/SCCT/SCMR/SNM 2009 appropriate Use criteria for cardiac radionuclide imaging: a report of the american college of cardiology foundation appropriate Use criteria task force, the american society of nuclear cardiology, the american college of radiology, the american heart association, the american society of echocardiography, the society of cardiovascular computed tomography, the society for cardiovascular magnetic resonance, and the society of nuclear medicine. J Am Coll Cardiol. 2009;53(23):2201–29.View ArticlePubMedGoogle Scholar
- American College of Cardiology Foundation Appropriate Use Criteria Task F, American Society of E, American Heart A, American Society of Nuclear C, Heart Failure Society of A, Heart Rhythm S, Society for Cardiovascular A, Interventions, Society of Critical Care M, Society of Cardiovascular Computed T et al. ACCF/ASE/AHA/ASNC/HFSA/HRS/SCAI/SCCM/SCCT/SCMR 2011 appropriate Use criteria for echocardiography. A report of the american college of cardiology foundation appropriate Use criteria task force, american society of echocardiography, american heart association, american society of nuclear cardiology, heart failure society of america, heart rhythm society, society for cardiovascular angiography and interventions, society of critical care medicine, society of cardiovascular computed tomography, and society for cardiovascular magnetic resonance endorsed by the american college of chest physicians. J Am Coll Cardiol. 2011;57(9):1126–66.View ArticleGoogle Scholar
- Taylor AJ, Cerqueira M, Hodgson JM, Mark D, Min J, O’Gara P, et al. ACCF/SCCT/ACR/AHA/ASE/ASNC/NASCI/SCAI/SCMR 2010 appropriate use criteria for cardiac computed tomography. A report of the american college of cardiology foundation appropriate Use criteria task force, the society of cardiovascular computed tomography, the american college of radiology, the american heart association, the american society of echocardiography, the american society of nuclear cardiology, the north american society for cardiovascular imaging, the society for cardiovascular angiography and interventions, and the society for cardiovascular magnetic resonance. J Am Coll Cardiol. 2010;56(22):1864–94.View ArticlePubMedGoogle Scholar
- Wolk MJ, Bailey SR, Doherty JU, Douglas PS, Hendel RC, Kramer CM, et al. ACCF/AHA/ASE/ASNC/HFSA/HRS/SCAI/SCCT/SCMR/STS 2013 multimodality appropriate use criteria for the detection and risk assessment of stable ischemic heart disease: a report of the American college of cardiology foundation appropriate use criteria task force, american heart association, american society of echocardiography, american society of nuclear cardiology, heart failure society of america, heart rhythm society, society for cardiovascular angiography and interventions, society of cardiovascular computed tomography, society for cardiovascular magnetic resonance, and society of thoracic surgeons. J Am Coll Cardiol. 2014;63(4):380–406.View ArticlePubMedGoogle Scholar
- Ferrari VA, Whitman B, Blankenship JC, Budoff MJ, Costa M, Weissman NJ, et al. Cardiovascular imaging payment and reimbursement systems: understanding the past and present in order to guide the future. J Am Coll Cardiol Img. 2014;7(3):324–32.View ArticleGoogle Scholar
- Soman P, Kelly R. Imaging at the 2014 ACC legislative conference: a debrief. J Am Coll Cardiol Img. 2015;8(1):118–20.View ArticleGoogle Scholar
- Greenwood JP, Maredia N, Younger JF, Brown JM, Nixon J, Everett CC, et al. Cardiovascular magnetic resonance and single-photon emission computed tomography for diagnosis of coronary heart disease (CE-MARC): a prospective trial. Lancet. 2012;379(9814):453–60.View ArticlePubMed CentralPubMedGoogle Scholar
- Dandekar VK, Bauml MA, Ertel AW, Dickens C, Gonzalez RC, Farzaneh-Far A. Assessment of global myocardial perfusion reserve using cardiovascular magnetic resonance of coronary sinus flow at 3 Tesla. J Cardiovascular Magnetic Resonance Off J Soc Cardiovascular Magnetic Resonance. 2014;16(1):24.View ArticleGoogle Scholar
- Klem I, Heitner JF, Shah DJ, Sketch Jr MH, Behar V, Weinsaft J, et al. Improved detection of coronary artery disease by stress perfusion cardiovascular magnetic resonance with the use of delayed enhancement infarction imaging. J Am Coll Cardiol. 2006;47(8):1630–8.View ArticlePubMedGoogle Scholar
- Reimer KA, Jennings RB. The “wavefront phenomenon” of myocardial ischemic cell death. II. Transmural progression of necrosis within the framework of ischemic bed size (myocardium at risk) and collateral flow. Laboratory Investigation J Technical Methods Pathol. 1979;40(6):633–44.Google Scholar
- McCrohon JA, Moon JC, Prasad SK, McKenna WJ, Lorenz CH, Coats AJ, et al. Differentiation of heart failure related to dilated cardiomyopathy and coronary artery disease using gadolinium-enhanced cardiovascular magnetic resonance. Circulation. 2003;108(1):54–9.View ArticlePubMedGoogle Scholar
- Hendel RC. Utilization management of cardiovascular imaging pre-certification and appropriateness. J Am Coll Cardiol Img. 2008;1(2):241–8.View ArticleGoogle Scholar
- Iglehart JK. Health insurers and medical-imaging policy–a work in progress. N Engl J Med. 2009;360(10):1030–7.View ArticlePubMedGoogle Scholar
- Bhattacharyya S, Kamperidis V, Chahal N, Shah BN, Roussin I, Li W, et al. Clinical and prognostic value of stress echocardiography appropriateness criteria for evaluation of coronary artery disease in a tertiary referral centre. Heart. 2014;100(5):370–4.View ArticlePubMedGoogle Scholar
- Willens HJ, Nelson K, Hendel RC. Appropriate use criteria for stress echocardiography: impact of updated criteria on appropriateness ratings, correlation with pre-authorization guidelines, and effect of temporal trends and an educational initiative on utilization. J Am Coll Cardiol Img. 2013;6(3):297–309.View ArticleGoogle Scholar
- Medolago G, Marcassa C, Alkraisheh A, Campini R, Ghilardi A, Giubbini R, et al. Applicability of the appropriate use criteria for SPECT myocardial perfusion imaging in Italy: preliminary results. Eur J Nucl Med Mol Imaging. 2014;41(9):1695–700.View ArticlePubMedGoogle Scholar
- Hendel RC, Cerqueira M, Douglas PS, Caruth KC, Allen JM, Jensen NC, et al. A multicenter assessment of the use of single-photon emission computed tomography myocardial perfusion imaging with appropriateness criteria. J Am Coll Cardiol. 2010;55(2):156–62.View ArticlePubMedGoogle Scholar
- Doukky R, Hayes K, Frogge N, Balakrishnan G, Dontaraju VS, Rangel MO, et al. Impact of appropriate use on the prognostic value of single-photon emission computed tomography myocardial perfusion imaging. Circulation. 2013;128(15):1634–43.View ArticlePubMedGoogle Scholar
- Winchester DE, Chauffe RJ, Meral R, Nguyen D, Ryals S, Dusaj R, Shaw L, Beyth RJ: Clinical utility of inappropriate positron emission tomography myocardial perfusion imaging: Test results and cardiovascular events. J Nuclear Cardiol Off Publication Am Soc Nuclear Cardiol 2014.Google Scholar
- Armstrong W, Eagle KA. Appropriate use criteria in echocardiography: is no change the same as no benefit? JAMA Internal Med. 2013;173(17):1609–10.View ArticleGoogle Scholar
- Matulevicius SA, Rohatgi A, Das SR, Price AL, DeLuna A, Reimold SC. Appropriate use and clinical impact of transthoracic echocardiography. JAMA Internal Med. 2013;173(17):1600–7.View ArticleGoogle Scholar
- Abbasi SA, Ertel A, Shah RV, Dandekar V, Chung J, Bhat G, et al. Impact of cardiovascular magnetic resonance on management and clinical decision-making in heart failure patients. J Cardiovascular Magnetic Resonance Off J Soc Cardiovascular Magnetic Resonance. 2013;15:89.View ArticleGoogle Scholar
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.