Skip to main content

Quantification in cardiovascular magnetic resonance: agreement of software from three different vendors on assessment of left ventricular function, 2D flow and parametric mapping

Abstract

Background

Quantitative results of cardiovascular magnetic resonance (CMR) image analysis influence clinical decision making. Image analysis is performed based on dedicated software. The manufacturers provide different analysis tools whose algorithms are often unknown. The aim of this study was to evaluate the impact of software on quantification of left ventricular (LV) assessment, 2D flow measurement and T1- and T2-parametric mapping.

Methods

Thirty-one data sets of patients who underwent a CMR Scan on 1.5 T were analyzed using three different software (Circle CVI: cvi42, Siemens Healthineers: Argus, Medis: Qmass/Qflow) by one reader blinded to former results. Cine steady state free precession short axis images were analyzed regarding LV ejection fraction (EF), end-systolic and end-diastolic volume (ESV, EDV) and LV mass. Phase-contrast magnetic resonance images were evaluated for forward stroke volume (SV) and peak velocity (Vmax). Pixel-wise generated native T1- and T2-maps were used to assess T1- and T2-time. Forty-five data sets were evaluated twice (15 per software) for intraobserver analysis. Equivalence was considered if the confidence interval of a paired assessment of two sofware was within a tolerance interval defined by ±1.96 highest standard deviation obtained by intraobserver analysis.

Results

For each parameter, thirty data sets could be analyzed with all three software. All three software (A/B, A/C, B/C) were considered equivalent for LV EF, EDV, ESV, mass, 2D flow SV and T2-time. Differences between software were detected in flow measurement for Vmax and in parametric mapping for T1-time. For Vmax, equivalence was given between software A and C and for T1-time equivalence was given between software B and C.

Conclusion

Software had no impact on quantitative results of LV assessment, T2-time and SV based on 2D flow. In contrast to that, Vmax and T1-time may be influenced by software. CMR reports should contain the name and version of the software applied for image analysis to avoid misinterpretation upon follow-up and research examinations.

Trial registration

ISRCTN12210850. Registered 14 July 2017, retrospectively registered.

Background

In the past years, cardiovascular magnetic resonance Imaging (CMR) has emerged as a broadly applied imaging modality in cardiac diagnostics [1]. Due to its high accuracy and reproducibility, CMR is considered as gold standard for evaluation of left ventricular (LV) function [2]. CMR is the recommended method to assess cardiac function and hemodynamics especially when transthoracic echocardiography is limited [3]. In addition to mere functional assessment, non-invasive tissue differentiation represents CMR’s unique feature [4]. Clinical decision-making is often based on quantification, i.e. the placement of an implantable cardiac defibrillator depends on quantified LV function or valve replacement on quantitative flow assessment [5,6,7]. Therefore, accurate and reliable quantification is essential for correct diagnosis and adequate treatment. Technical aspects such as field strength, vendor platforms and imaging protocol influence CMR results [8,9,10,11,12]. The Society for Cardiovascular Magnetic Resonance (SCMR) published not only standardized protocols for image acquisition and interpretation, but also guidelines for reporting which propose to report scanner type, sequences used and study quality [13,14,15]. Interestingly, it is not suggested to report the software used [15]. CMR image analysis is performed on dedicated commercial and non-commercial software solutions. They often differ within and between sites. Quantitative analysis is mostly based on manually contouring or manually correction of semi-automatic segmented regions of interest (ROI) in CMR images. For LV volumetry and flow quantification, the contour relies on the definition of a whole pixel or subpixel depending on the software. In case of parametric mapping, not all software providers do have a specific tool. A recent study reported that software used for myocardial perfusion analysis is not interchangeable and reliable results were only achieved within the same software [16]. In contrast to this, statistically significant differences were found in analysis of T2* mapping between two software which were considered to be without any effect on clinical decision making [17]. Other groups found a strong correlation and no significant differences between software for LV assessment [18, 19]. Software comparison for flow measurement was only done in a small number of patients [20]. The impact of the software-dependent approaches of contour modification on results is unknown and mathematical calculation and extrapolation remain reserved to the vendors.

The aim of the present study was to investigate the equivalence of three commercially available software used at our site for assessment of LV, 2D flow and T1- and T2-parametric mapping. We hypothesized that mean differences between software are smaller than intraobserver variability and hence, software can be considered as equivalent.

Methods

Patient data sets

For logistical reasons, we chose at the beginning of this study the first available data sets of patients with histologically confirmed soft tissue sarcoma planned for anthracycline-based chemotherapy from an on-going study of our working group (ISRCTN12210850) [21]. Exclusion criteria were chronic renal failure (estimated glomerular filtration rate < 30 mL/m2), cardiac metastases, known incompatibility for gadolinium contrast media and contraindication for CMR. We had to exclude short axis images (SAX) in one patient as they were not recorded continuously, T1-map in one patient due to an artifact and flow in one patient due to aliasing in flow measurement. In order to still match the required number of analyzed data, we included a 31st patient for analysis of SAX, T1-time and flow. A total of 31 data sets of patients (16 male, details see Table 1) were analyzed. The population suffered from different co-morbidities. In detail, 15 patients (48%) had arterial hypertension, 1 patient (3%) had coronary artery disease and 6 patients had diabetes mellitus type II (19%). Eleven patients (36%) received anthracycline-based chemotherapy (> 300 mg/m2 doxorubicin-equivalent cumulative dose) prior to the study. Ethical approval was given for the mentioned study by the local ethics committee of Charité Medical University Berlin (approval number EA1/262/14). All patients gave their written informed consent before participating in the study.

Table 1 Patient characteristics

CMR imaging protocol

All CMR examinations were performed using a 1.5 Tesla scanner (Magnetom Avanto Fit, Siemens Healthineers, Erlangen, Germany). Protocol and slice planning were identical in all cases according to institutional standards. In short, retrospective electrocardiographic (ECG) gated balanced steady state free precession (bSSFP) cine images covering the whole LV from basis to apex were obtained without gap in a breath-hold technique (repetition time 46.34 ms, echo time 1.44 ms, voxel size 2.0 × 2.0 × 7.0 mm3, flip angle 80 degrees). Segmented gradient-echo phase contrast CMR (PC-CMR) was performed at the sinotubular junction of the ascending aorta. The velocity encoding range was set at 150 cm/s in a through-plane direction [9]. Native T1- and T2-mapping data were obtained in one midventricular short axis as previously described [4].

Post-processing software packages

Three software packages were used for image analysis and quantitative assessment according to current institutional standards between June and December 2016 [13]. All data sets were analyzed by one reader (L.Z.) blinded to former quantitative results using Circle Cardiovascular Imaging: cvi42 version 5.3.2 (Calgary, Canada), (software A); Siemens Healthineers: Classic Argus (Argus viewer, Argus LV function and Argus flow) on SyngoMMWP version VE53A acquisition work place, (software B); and Medis medical imaging systems: Medis Suite 2.1 with the applications Qmass and Qflow version 8.1 (Leiden, Netherlands), (software C). We analyzed software using the default settings. The software surfaces are presented in Fig. 1. Forty-five data sets randomly selected were analyzed twice (15 per software) for intraobserver analysis.

Fig. 1
figure 1

Presentation of software surfaces. Screenshots of cvi42, Argus and Medis Suite used for image analysis for left ventricular assessment, 2D flow measurement and T1- and T2-parametric mapping

Left ventricular assessment

For LV assessment we used cvi42 heart function [22], Argus LV function [23] and Qmass ventricular function [24]. Endo- and epicardial borders were contoured manually in short axis cine images (SAX) at end-diastole and end-systole. The basal slice was included in the analysis if at least 50% of blood volume was surrounded by myocardium. Papillary muscles were excluded and considered part of the blood pool. If available, contour smoothing was applied. Quality control of the contours was performed in the movie mode. Ejection fraction (EF in %) and myocardial mass (Mass in g), end-systolic and end-diastolic volume (ESV and EDV, respectively, in ml) were recorded [25].

Flow measurement

For 2D flow assessment, we used cvi42 Flow [26], Argus Flow [27] and Qflow PC Flow [28]. The ascending aorta was contoured in the magnitude image with the sharpest blood/tissue contrast. Contours were propagated to phase contrast images in all temporal phases, corrected manually and controlled carefully. Peak velocity (Vmax in cm/s) was measured in all software and forward stroke volume (SV in ml) was calculated automatically in function of the vessel area in all phases [29].

Parametric mapping

For T1 and T2 mapping the procedure was identical in cvi42 (using T1- and T2-tool) [30, 31] and Qmass (using time signal intensity mode) [32]. Endo- and epicardial limits were delineated and corrected in all 8 raw images for T1-mapping or 3 raw images for T2-mapping, copied into the scanner generated pixel maps and corrected again if necessary. In Argus viewer [33], a ROI was drawn around the myocardium in all colored pixel-wise maps with the same procedure for all studies. Segment-based global T1- and T2-times (in ms) and area (if available) were recorded [34, 35].

Statistical analysis

The sample size calculation for the equivalence test was based on reference values obtained with cvi42 in our working group and from literature assuming that the distribution of the available data is comparable to other software types [9, 36, 37]. The equivalence margin was set to the 95% tolerance interval of the intraobserver difference with 95% coverage, such that two software systems would be considered equivalent if their deviations would be within the limits of 95% of the deviances generated by one observer performing repeated measures with the same software. It was assumed that the standard deviation (SD) of each software would be equal to the intraobserver variability. Based on a power of 0.9 and a Bonferroni-corrected α-level of 0.017 correcting for three tests, 30 patients were found to be sufficient even for the conservative assumption of a correlation of 0.2 between measurements of two different software. PASS, version 11, was used for sample size calculation [38].

Normality was checked based on visual inspection of the data using Quantile-Quantile-plots (QQ-plots). No strong deviations from normal distribution were noted thus parametric methods were used. The Pearson’s correlation coefficient (r) was calculated for correlation analysis and Bland-Altman plots were generated to assess the bias (mean difference) and the 95% limits of agreement between each pair of software for each parameter. Equivalence limits were determined as ±1.96 maximum intraobserver SD variability across the three software, which corresponds to the largest observed 95% tolerance interval with 95% coverage of repeated measurements with the same software. Following the approach outlined by Walker and Nowacki [39], Bonferroni corrected confidence intervals were constructed using α = 0.05/3 = 0.017, thus leading to (1–2α)*100% = 96.7% confidence intervals. These were obtained for the paired assessments of two software and equivalence was concluded when the confidence interval was completely within the limits of equivalence. Testing the null hypothesis of no difference between software was based on a test with shifted null hypothesis where the shift equaled the respective limits of equivalence. As the results of an equivalence test by CI is only binary (yes/no), no p-values were given. Area of T1- and T2-mapping was recorded if applicable and compared for differences by paired t-test with α = 0.05. Statistical analysis was performed by Graph Pad Prism 6, version 6.0.7 for windows [40].

Results

For each parameter 30 data sets were available and could be analyzed with each software (Fig. 2 and Table 2).

Fig. 2
figure 2

Single values obtained for each patient with each software for left ventricular assessment (a-d), 2D flow (e, f) and parametric mapping (g, h). EF: ejection fraction, EDV end-systolic volume, ESV end-diastolic volume, Vmax: peak velocity, SV: stroke volume. Blue dot: Software A; black square: Software B; red triangle: Software C

Table 2 Results of left ventricular assessment, 2D Flow and parametric mapping per software (A, B, C)

Left ventricular assessment

All software showed a strong positive correlation for EF (r software A/B: 0.940, software A/C: 0.965, software B/C: 0.951), mass (r software A/B: 0.975, software A/C: 0.975, software B/C: 0.974), EDV (r software A/B: 0.994, software A/C: 0.996, software B/C: 0.995) and ESV (r software A/B: 0.994, software A/C: 0.997, software B/C: 0.996). For EF, Bland-Altman analysis revealed narrowest limits of agreement between software A/C (Fig. 3b). Smallest bias but widest limits of agreement were found between software A/B (Fig. 3a). Comparing software B/C, a rising difference with increasing mean is shown (Fig. 3c). For mass, bias of software A/B was more than twice and B/C more than three times higher compared to software A/C (Fig. 3d-f). For EDV and ESV, narrowest limits of agreement were found between software A/C, but smallest bias was detected between software B/C (Fig. 4a-f).

Fig. 3
figure 3

Bland-Altman plots of LV function (EF) and LV mass for agreement between software A and B (a, d), software A and C (b, e) and software B and C (c, f). Dashed lines indicate mean difference, dotted lines indicate limits of agreement

Fig. 4
figure 4

Bland-Altman plots of LV end-diastolic (EDV) and end-systolic volume (ESV) for agreement between software A and B (a, d), software A and C (b, e) and software B and C (c, f). Dashed lines indicate mean difference, dotted lines indicate limits of agreement

Flow measurement

All software showed a very strong positive correlation for Vmax (r: software A/B: 0.996, software A/C: 1.0, software B/C 0.996) and SV (r: S software A/B: 0.989, software A/C: 0.992, software B/C 0.986). For Vmax, bias of software A/C was close to zero and presented narrowest limits of agreement (Fig. 5b). Software B showed lower Vmax compared to software A and software C (Fig. 5a, c). For SV, smallest bias was found between software A/B (Fig. 5d). Software C showed lower SV compared to software A and software B (Fig. 5e, f).

Fig. 5
figure 5

Bland-Altman plots of peak velocity (Vmax) and stroke volume (SV) for agreement between software A and B (a, d), software A and C (b, e) and software B and C (c, f). Dashed lines indicate mean difference, dotted lines indicate limits of agreement

Parametric mapping

Software B/C showed highest correlation for T1-time (r: S software W A/B: 0.903, software A/C: 0.891, software B/C 0.961) and for T2-time (r: software A/B: 0.897, software A/C 0.912, software B/C 0.931). Software A had longer T1- and T2-time and best agreement was detected between software B/C (Fig. 6a-f). The measured area was significantly smaller in software A compared to software B for both, T1- and T2-time (p < 0.001, respectively). Within one software, the measured area did not differ between first and second measurement of T1- and T2-time (p > 0.05, respectively).

Fig. 6
figure 6

Bland-Altman plots of T1-time and T2-time for agreement between software A and B (a, d), software A and C (b, e) and software B and C (c, f). Dashed lines indicate mean difference, dotted lines indicate limits of agreement

Equivalence testing

Equivalence limits for the differences between software for each parameter were based on the highest SD obtained by intraobserver analysis and were derived as ±1.96 SD (Table 3, Additional files 1 and 2). Software B showed the highest SD for all parameters except for mass and ESV (software A). For EF, mass, EDV, ESV, SV and T2-time, the Bonferroni-corrected confidence intervals (indicated as black lines in Fig. 7) of all software comparisons were completely contained within the equivalence limits (indicated as grey shaded area in Fig. 7), indicating that software A, B and C could be considered to be equivalent for these parameters (Fig. 7a, b, d, f). For Vmax, software A/C (CI -0.1 to 0.0) were equivalent, (Fig. 7c). In contrast to that, the confidence intervals of the comparisons of software A/B (CI 3.8 to 6.5) and B/C (CI -6.6 to − 3.8) were completely outside of equivalence limits (− 0.2 to 0.2), indicating no equivalence between software A and B as well as between software B and C. For T1-time, equivalence was given between software B and C (CI 1.9 to 13.2) as illustrated in Fig. 7e. The lower confidence intervals of comparisons of software A/B (CI -32.0 to − 13.3) and A/C (CI -25.0 to − 5.3) were marginally outside of the equivalence limits (CI-24.5 to 24.5) signifying that there was not sufficient evidence to claim equivalence.

Table 3 Intraobserver variability for software A, B and C
Fig. 7
figure 7

Equivalence testing for LV assessment (a-d), flow measurement (e, f), parametric mapping (g, h). Equivalence of measurements of two software is shown if the confidence interval for software comparison (indicated as black lines, squares marked upper and lower limits) are contained within the equivalence limits (tolerance interval marked grey)

Discussion

Quantification is a basic requirement for cardiovascular decision making and several parameters in CMR depend on reliable and robust values. To the best of our knowledge, this is the first study comparing three CMR analysis software for quantification of LV 2D flow and T1 and T2 parametric mapping. Main findings were: (i) all three software were equivalent for LV assessment (EF, EDV, ESV and mass), (ii) all three software were equivalent for SV, but only two software for Vmax, (iii) equivalence was given for all software in quantification of T2-time, but only two software for T1-time.

It is well known that different post-processing SW are used world-wide in clinical routine and research. They differ e.g. regarding pixel definition settings, contour detection and other algorithms. Each pixel of a cardiac image displayed by the post-processing software provides information about its size and specific value, such as maximum velocity in case of flow measurement or T1-time in case of T1-mapping. For quantitative image analysis contours intersect pixels. Depending on the software type, different pixel inclusion methods for calculations can be used, e.g. to involve the pixel partly or entirely. In a clinical setting it is crucial to know if these potential differences could impact the results. Previous studies compared the relation between software using correlations, intra-class-coefficient and significant differences. We applied an equivalence testing approach using the intraobserver variability to define equivalence margins to identify deviations between software. In the present study there is no impact of scan procedure related technical influences [21] as we analyzed the same data sets with all three software. The discussion of the results is based on the findings of the particular software versions, we have used. All vendors were open-minded for discussion and adaption.

For LV assessment, all three software showed a high correlation and equivalence for LV EF, EDV, ESV and mass. Our results are supported by previous studies using different software. Messali et al. revealed a high correlation of LV function and volume without significant differences between ViewForum (Philips) and Argus in 46 patients [19]. Kara et al. demonstrated a high correlation between LV tutorials (Cardiovascular Imaging Solutions) and Argus in 40 patients with known or suspected coronary artery disease. Additionally, they compared CMR software with other modalities like CT and 2D echocardiography, but only for EDV they could show a stronger correlation between CMR tools and CT rather than the two CMR software. Another group compared image analysis of 15 healthy subjects between one scanner providing MASS and one scanner providing Argus and did not find significant differences within one observer [41]. Nevertheless, CMR image segmentation is reader dependent and LV quantification differs even between expert readers which emphasizes the need for standardization [42]. In our study, we assumed that a range within software could be declared as equivalent, however, this range would depend on the reader’s precision. Still, our intraobserver bias was comparable to former results even though we excluded papillary muscles from LV mass [36, 43]. In the present study, each software calculated volumes in function of area and slice thickness. As there was no gap between the SAX slices, interpolation was not necessary. EF and mass were derived from cardiac volumes. We conclude that different pixel definitions of the present software did not substantially influence results of LV volumetry. The applied software are interchangeable for LV assessment in this cohort of patients.

Hemodynamics can be assessed by PC-CMR to evaluate shunt fraction, valve regurgitation or stenosis [3]. We used automatic contour propagation with manual correction in all three software for comparison of flow data sets of 30 patients. Boye et al. applied a software flow analysis procedure in 6 patients with aortic insufficiency and showed similar results for aortic regurgitant fraction based on backward/forward SV in four software, three out of those four were the same as in our study [20]. Consistently, the present study showed equivalence for SV between all three software. However, even in phantom measurements without manual contour correction they revealed differences in contour propagation algorithms as they found different velocities among software. In our study, intraobserver analysis of Vmax showed a high reliability within each software. But, despite accurate corrected anatomical borders, we identified software B measuring nonequivalent Vmax values compared to other software even when the peak velocity measuring square was in the same phase and visually at a similar location within the vessel. This finding is attributed to different voxel averaging methods, depending on the software. In software B the default of flow measurement was an averaging including 4 adjacent voxels in contrast to the other software which preset a single voxel. Voxel averaging techniques reduce spatial resolution of the measurement and significantly underestimate peak velocity compared to the single voxel technique with a difference of 7% mean percentage, but do not influence the flow volume [44]. We found nearly congruent Vmax values between software A and C, whereas these software showed the highest bias in SV. This could be explained by the fact that Vmax is measured by only one or a few voxel while SV is calculated as sum of velocities of the voxel within the ROI multiplied by the area at each temporal phase [45]. We cannot exclude small differences in ROI sizes despite manual border correction among software. However, ROI size should then substantially affect the SV which was not the case in this study. Interestingly, the velocity measuring pixel among two software vendors partly exceeded the anatomical and delineated border of the aorta, in turn possibly inducing an incorrect velocity value for this phase. Therefore, attentive care must be taken to control outliers and to avoid misalignment. Other authors analyzed also the impact of different modalities to assess different anatomical structures [46,47,48,49]. In our opinion, the validation of different software is warranted at least within an imaging modality and needs further attention.

CMR enables tissue characterization using parametric mapping techniques. Myocardial T2-mapping can detect edema in acute myocardial infarction or inflammation [37]. Native T1-mapping reflects pathological changes in both myocardium and interstitium [35, 50]. It allows further differentiation of cardiac diseases in LV hypertrophy and in systemic diseases such as amyloidosis [51, 52]. For T2* analysis, statistically significant but clinically negligible differences were found between the software Functool protocol (GE) and the T2* module of Qmass [17]. In line with this finding, our results indicated that the present software are not equivalent in quantifying T1-times. Differences could occur due to different contour drawing procedures and pixel inclusion approaches that potentially influence precision. This may lead to the significant smaller area of the ROI in software A than in software B for both, T1- and T2-quantification. Qmass and cvi42 provided a tool for endo- and epicardial border delineation. Argus has no such specific tool yet. However, within one software, the delineated area was consistent between two measurements. Another explanation for discrepancies might be the different ranges of the values for T1- and T2-time. This is supported by the fact that the relation of our maximum intraobserver SD to the recently published segment based normal values of our group was much smaller for T1- than for T2-time accounting for narrower equivalence limits for T1-time (the maximum intraobserver SD of ±24.4 ms correlates to ±2.5% of the published normal value of 980.7 ms for T1-time, whereas the maximum intraobserver SD ±3.2 ms correlates to ±6.1% of the published normal value of 52.3 ms for T2-time) [4]. Within one software, SD of intraobserver analysis for T2-time was comparable to other studies using Qmass and Osirix [37, 53]. The intraobserver SD of T1-time is in good agreement with other publications in the literature investigating ViewForum and cvi42 [4, 10, 11, 54]. However, the range of published intraobserver values is considerably high. Depending on the CMR sequence a correction factor can be introduced if T1-times have to be calculated using the software [55]. Therefore, the impact of software on T1-time quantification should be evaluated in further studies including other diseases like amyloid and hypertrophic cardiomyopathy and at different sites with an approach to correct for some variations as described for LV assessment [42].

Limitations

Currently there is a lack of an internationally accepted gold standard for software, like phantoms for the different cardiac structure and function. Therefore, we used intraobserver variability of an experienced reader as gold standard to assess equivalence testing. We investigated only a certain number of SW, being aware that there are many others on the market. Further, our findings were specific for the particular software version, knowing that software packages evolve continuously. We did not analyze different cardiovascular diseases but among the selected patients 52% suffered from cardiac alterations. The potential influence of multiple observers and other pathologies on the comparability of results from different software systems was not considered in this study but should be subject to continuative analyses.

Conclusion

We could demonstrate exchangeability of cvi42 version 5.6, Classic Argus and Medis Suite 2.1 for LV evaluation, forward stroke volume in 2D flow measurement and T2-time in T2 parametric mapping. We conclude that different pixel inclusion methods of the software do not substantially affect calculation of the mentioned parameters but might influence results of T1-time. Vessel contours and the peak velocity measuring square in each phase of flow measurement should be checked carefully, particularly when contour propagation is used. Software users should be aware of the current setting of voxel averaging techniques during flow analysis. Our results underline the need of standardization and indicate that the individual analysis software (including version) and specific settings should be mentioned in clinical reports to avoid misinterpretation upon follow-up examinations and to assure comparability of CMR studies.

Abbreviations

bSSFP:

Balanced steadystate free precession

CMR:

Cardiovascular magnetic resonance

ECG:

Electrocardiogram

EDV:

End-diastolic volume

EF:

Ejection fraction

ESV:

End-systolic volume

LV:

Left ventricle/left ventricular

PC:

Phase contrast

ROI:

Region of interest

SAX:

Short axis

SD:

Standard deviation

SV:

Stroke volume

Vmax:

Maximum velocity, peak velocity

References

  1. Hendel RC, Patel MR, Kramer CM, Poon M, Hendel RC, Carr JC, et al. ACCF/ACR/SCCT/SCMR/ASNC/NASCI/SCAI/SIR 2006 Appropriateness Criteria for Cardiac Computed Tomography and Cardiac Magnetic Resonance Imaging: A Report of the American College of Cardiology Foundation Quality Strategic Directions Committee Appropriateness Criteria Working Group, American College of Radiology, Society of Cardiovascular Computed Tomography, Society for Cardiovascular Magnetic Resonance, American Society of Nuclear Cardiology, North American Society for Cardiac Imaging, Society for Cardiovascular Angiography and Interventions, and Society of Interventional Radiology. J Am Coll Cardiol. 2006;48(7):1475–97.

    Article  PubMed  Google Scholar 

  2. Ponikowski P, Voors AA, Anker SD, Bueno H, Cleland JGF, Coats AJS, et al. 2016 ESC guidelines for the diagnosis and treatment of acute and chronic heart failureThe task force for the diagnosis and treatment of acute and chronic heart failure of the European Society of Cardiology (ESC)developed with the special contribution of the heart failure association (HFA) of the ESC. Eur Heart J. 2016;37(27):2129–200.

    Article  PubMed  Google Scholar 

  3. Myerson SG. Heart valve disease: investigation by cardiovascular magnetic resonance. J Cardiovasc Magn Reson. 2012;14:7.

    Article  PubMed  PubMed Central  Google Scholar 

  4. von Knobelsdorff-Brenkenhoff F, Schuler J, Doganguzel S, Dieringer MA, Rudolph A, Greiser A, et al. Detection and monitoring of acute myocarditis applying quantitative cardiovascular magnetic resonance. Circulation Cardiovasc Imaging. 2017;10(2):e005242.

    Article  Google Scholar 

  5. Rajwani A, Stewart MJ, Richardson JD, Child NM, Maredia N. The incremental impact of cardiac MRI on clinical decision-making. Br J Radiol. 2016;89(1057):20150662.

    Article  PubMed  Google Scholar 

  6. von Knobelsdorff-Brenkenhoff F, Schulz-Menger J. Role of cardiovascular magnetic resonance in the guidelines of the European Society of Cardiology. J Cardiovasc Magn Reson. 2016;18:6.

    Article  Google Scholar 

  7. Vahanian A, Alfieri O, Andreotti F, Antunes MJ, Baron-Esquivias G, Baumgartner H, et al. Guidelines on the management of valvular heart disease (version 2012). Eur Heart J. 2012;33(19):2451–96.

    Article  PubMed  Google Scholar 

  8. Kellman P, Hansen MS. T1-mapping in the heart: accuracy and precision. J Cardiovasc Magn Reson. 2014;16:2.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Traber J, Wurche L, Dieringer MA, Utz W, von Knobelsdorff-Brenkenhoff F, Greiser A, et al. Real-time phase contrast magnetic resonance imaging for assessment of haemodynamics: from phantom to patients. Eur J Radiol. 2016;26(4):986–96.

    Article  Google Scholar 

  10. Dabir D, Child N, Kalra A, Rogers T, Gebker R, Jabbour A, et al. Reference values for healthy human myocardium using a T1 mapping methodology: results from the International T1 Multicenter cardiovascular magnetic resonance study. J Cardiovasc Magn Reson. 2014;16:69.

    Article  PubMed  PubMed Central  Google Scholar 

  11. von Knobelsdorff-Brenkenhoff F, Prothmann M, Dieringer MA, Wassmuth R, Greiser A, Schwenke C, et al. Myocardial T1 and T2 mapping at 3 T: reference values, influencing factors and implications. J Cardiovasc Magn Reson. 2013;15:1–11.

    Article  Google Scholar 

  12. Raman FS, Kawel-Boehm N, Gai N, Freed M, Han J, Liu C-Y, et al. Modified look-locker inversion recovery T1 mapping indices: assessment of accuracy and reproducibility between magnetic resonance scanners. J Cardiovasc Magn Reson. 2013;15:64.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Schulz-Menger J, Bluemke DA, Bremerich J, Flamm SD, Fogel MA, Friedrich MG, et al. Standardized image interpretation and post processing in cardiovascular magnetic resonance: Society for Cardiovascular Magnetic Resonance (SCMR) Board of Trustees Task Force on standardized post processing. J Cardiovasc Magn Reson. 2013;15:35.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Kramer CM, Barkhausen J, Flamm SD, Kim RJ, Nagel E. Standardized cardiovascular magnetic resonance (CMR) protocols 2013 update. J Cardiovasc Magn Reson. 2013;15:91.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Hundley WG, Bluemke D, Bogaert JG, Friedrich MG, Higgins CB, Lawson MA, et al. Society for Cardiovascular Magnetic Resonance guidelines for reporting cardiovascular magnetic resonance examinations. J Cardiovasc Magn Reson. 2009;11:5.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Handayani A, Sijens PE, Lubbers DD, Triadyaksa P, Oudkerk M. Ooijen PMAv: influence of the choice of Software package on the outcome of Semiquantitative MR myocardial perfusion analysis. Radiology. 2013;266(3):759–65.

    Article  PubMed  Google Scholar 

  17. Mavrogeni S, Bratis K, van Wijk K, Kyrou L, Kattamis A, Reiber JHC. The reproducibility of cardiac and liver T2* measurement in thalassemia major using two different software packages. Int J Cardiovasc Imaging. 2013;29(7):1511–16.

  18. Kara B, Nayman A, Guler I, Gul EE, Koplay M, Paksoy Y. Quantitative assessment of left ventricular Function and myocardial mass: a comparison of coronary CT angiography with cardiac MRI and echocardiography. Pol J Radiol. 2016;81:95–102.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Messalli G, Palumbo A, Maffei E, Martini C, Seitun S, Aldrovandi A, et al. Assessment of left ventricular volumes with cardiac MRI: comparison between two semiautomated quantitative software packages. Radiol Med. 2009;114(5):718–27.

    Article  CAS  PubMed  Google Scholar 

  20. Boye D, Springer O, Wassmer F, Scheidegger S, Remonda L, Berberat J. Effects of contour propagation and background corrections in different MRI flow software packages. Acta Radiol Open. 2015;4(6):1–6.

    Google Scholar 

  21. Muehlberg F, Funk S, Zange L, Knobelsdorff-Brenkenhoff F, Blaszczyk E, Schulz A, et al. Native myocardial T1 time can predict development of subsequent anthracycline-induced cardiomyopathy. ESC Heart Failure. 2018;5(4):620–9.

    Article  PubMed  PubMed Central  Google Scholar 

  22. cvi42 Heart function. Available at [https://www.circlecvi.com/features/heart-function.php] (Accessed 02 April 2018).

  23. Siemens Healthineers Argus Function. Available at [https://www.healthcare.siemens.com/magnetic-resonance-imaging/options-and-upgrades/clinical-applications/argus-function] (Accessed 02 April 2018).

  24. Medis QMass LV & RV Function. Available at [https://www.medis.nl/Apps/LVRVFunction] (Accessed 02 April 2018).

  25. Patel MR, White RD, Abbara S, Bluemke DA, Herfkens RJ, Picard M, et al. 2013 ACCF/ACR/ASE/ASNC/SCCT/SCMR appropriate utilization of cardiovascular imaging in heart failure: a joint report of the American College of Radiology Appropriateness Criteria Committee and the American College of Cardiology Foundation appropriate use criteria task force. J Am Coll Cardiol. 2013;61(21):2207–31.

    Article  PubMed  Google Scholar 

  26. cvi42 Flow. Available at [https://www.circlecvi.com/features/flow.php] (Accessed 02 April 2018).

  27. Siemens Healthineers Argus Flow. Available at [https://www.healthcare.siemens.com/magnetic-resonance-imaging/options-and-upgrades/clinical-applications/argus-flow] (Accessed 02 April 2018).

  28. Medis QFlow PC Flow. Available at [https://www.medis.nl/Apps/PCFlow] (Accessed 02 April 2018).

  29. Nayak KS, Nielsen J-F, Bernstein MA, Markl M, D. Gatehouse P, M. Botnar R, et al: Cardiovascular magnetic resonance phase contrast imaging. J Cardiovasc Magn Reson 2015, 17:71.

  30. cvi42 T1 Mapping. Available at [https://www.circlecvi.com/features/T1-map.php] (Accessed 02 April 2018).

  31. cvi42 T2 Mapping. Available at [https://www.circlecvi.com/features/T2-map.php] (Accessed 02 April 2018).

  32. Medis QMass Time Signal Intensity (TSI). Available at [https://www.medis.nl/Apps/TSI] (Accessed 02 April 2018).

  33. Siemens Healthineers Argus Viewer. Available at [https://www.healthcare.siemens.com/magnetic-resonance-imaging/options-and-upgrades/clinical-applications/argus-viewer] (Accessed 02 April 2018).

  34. Messroghli DR, Moon JC, Ferreira VM, Grosse-Wortmann L, He T, Kellman P, et al. Clinical recommendations for cardiovascular magnetic resonance mapping of T1, T2, T2* and extracellular volume: a consensus statement by the Society for Cardiovascular Magnetic Resonance (SCMR) endorsed by the European Association for Cardiovascular Imaging (EACVI). J Cardiovasc Magn Reson. 2017;19:75.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Moon JC, Messroghli DR, Kellman P, Piechnik SK, Robson MD, Ugander M, et al. Myocardial T1 mapping and extracellular volume quantification: a Society for Cardiovascular Magnetic Resonance (SCMR) and CMR working Group of the European Society of cardiology consensus statement. J Cardiovasc Magn Reson. 2013;15:92.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Hudsmith LE, Petersen SE, Francis JM, Robson MD, Neubauer S. Normal human left and right ventricular and left atrial dimensions using steady state free precession magnetic resonance imaging. J Cardiovasc Magn Reson. 2005;7(5):775–82.

    Article  PubMed  Google Scholar 

  37. Wassmuth R, Prothmann M, Utz W, Dieringer M, von Knobelsdorff-Brenkenhoff F, Greiser A, et al. Variability and homogeneity of cardiovascular magnetic resonance myocardial T2-mapping in volunteers compared to patients with edema. J Cardiovasc Magn Reson. 2013;15:27.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Hintze J. PASS 11, NCSS, LLC. Utah, USA: Kaysville; 2011. www.ncss.com

    Google Scholar 

  39. Walker E, Nowacki AS. Understanding equivalence and noninferiority testing. J Gen Intern Med. 2011;26(2):192–6.

    Article  PubMed  Google Scholar 

  40. GraphPad Software. La Jolla, California, USA www.graphpad.com.

  41. Gandy SJ, Waugh SA, Nicholas RS, Simpson HJ, Milne W, Houston JG. Comparison of the reproducibility of quantitative cardiac left ventricular assessments in healthy volunteers using different MRI scanners: a multicenter simulation. J Magn Reson Imaging. 2008;28(2):359–65.

    Article  PubMed  Google Scholar 

  42. Suinesiaputra A, Bluemke DA, Cowan BR, Friedrich MG, Kramer CM, Kwong R, et al. Quantification of LV function and mass by cardiovascular magnetic resonance: multi-center variability and consensus contours. J Cardiovasc Magn Reson. 2015;17:63.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Alfakih K, Plein S, Thiele H, Jones T, Ridgway JP, Sivananthan MU. Normal human left and right ventricular dimensions for MRI as assessed by turbo gradient echo and steady-state free precession imaging sequences. J Magn Reson Imaging. 2003;17(3):323–9.

    Article  PubMed  Google Scholar 

  44. Rodrigues J, Minhas K, Pieles G, McAlindon E, Occleshaw C, Manghat N, et al. The effect of reducing spatial resolution by in-plane partial volume averaging on peak velocity measurements in phase contrast magnetic resonance angiography. Quant Imaging Med Surg. 2016;6(5):564–72.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Gatehouse PD, Keegan J, Crowe LA, Masood S, Mohiaddin RH, Kreitner K-F, et al. Applications of phase-contrast flow and velocity imaging in cardiovascular MRI. Eur J Radiol. 2005;15(10):2172–84.

    Article  Google Scholar 

  46. Caruthers SD, Lin SJ, Brown P, Watkins MP, Williams TA, Lehr KA, et al. Practical value of cardiac magnetic resonance imaging for clinical quantification of aortic valve stenosis: comparison with echocardiography. Circulation. 2003;108(18):2236–43.

    Article  PubMed  Google Scholar 

  47. Garcia J, Capoulade R, Le Ven F, Gaillard E, Kadem L, Pibarot P, et al: Discrepancies between cardiovascular magnetic resonance and Doppler echocardiography in the measurement of transvalvular gradient in aortic stenosis: the effect of flow vorticity. J Cardiovasc Magn Reson. 2013;15:84.

  48. Garcia J, Kadem L, Larose E, Clavel MA, Pibarot P. Comparison between cardiovascular magnetic resonance and transthoracic Doppler echocardiography for the estimation of effective orifice area in aortic stenosis. J Cardiovasc Magn Reson. 2011;13:25.

  49. Cawley PJ, Maki JH, Otto CM. Cardiovascular magnetic resonance imaging for valvular heart disease: technique and validation. Circulation. 2009;119(3):468–78.

    Article  PubMed  Google Scholar 

  50. Schelbert EB, Messroghli DR. State of the art: clinical applications of cardiac T1 mapping. Radiology. 2016;278(3):658–76.

    Article  PubMed  Google Scholar 

  51. Dass S, Suttie JJ, Piechnik SK, Ferreira VM, Holloway CJ, Banerjee R, et al. Myocardial tissue characterization using magnetic resonance noncontrast T1 mapping in hypertrophic and dilated cardiomyopathy. Circulation Cardiovasc Imaging. 2012;5(6):726–33.

    Article  Google Scholar 

  52. Karamitsos TD, Piechnik SK, Banypersad SM, Fontana M, Ntusi NB, Ferreira VM, et al. Noncontrast T1 mapping for the diagnosis of cardiac amyloidosis. JACC Cardiovasc Imaging. 2013;6(4):488–97.

    Article  PubMed  Google Scholar 

  53. Zhang Y, Corona-Villalobos CP, Kiani AN, Eng J, Kamel IR, Zimmerman SL, et al. Myocardial T2 mapping by cardiovascular magnetic resonance reveals subclinical myocardial inflammation in patients with systemic lupus erythematosus. Int J Cardiovasc Imaging. 2015;31(2):389–97.

    Article  PubMed  CAS  Google Scholar 

  54. Graham-Brown MPM, Rutherford E, Levelt E, March DS, Churchward DR, Stensel DJ, et al. Native T1 mapping: inter-study, inter-observer and inter-center reproducibility in hemodialysis patients. J Cardiovasc Magn Reson. 2017;19:21.

    Article  PubMed  PubMed Central  Google Scholar 

  55. cvi42 User Manual 5.6. Chapter 241 T1 Calculation (Native and Post Contrast). Available at [https://www.circlecvi.com/docs/product-support/manuals/cvi42_user_manual_v5.6.pdf] (Accessed 04 May 2018).

Download references

Acknowledgements

We gratefully thank Kerstin Kretschel, Denise Kleindienst and Evelyn Polzin for technical assistance. We thank Luisa Schmacht for support and Serkan Doganguezel for providing data for power calculation (Doctoral thesis: Doganguzel S: Parametric T1-mapping in cardiac magnetic resonance - Influence of contrast medium and field strength. Berlin: Charité - Medical University Berlin; 2017. URL: https://refubium.fu-berlin.de/handle/fub188/3617). The software vendors - Siemens Healthineers, Circle Cardiovascular Imaging and Medis medical imaging systems - are gratefully acknowledged for their support.

Funding

The main work of Dr. Muehlberg was supported by a grant of the Helios Research Center Berlin (HCR ID 058429). Dr. Schulz-Menger hold institutional grants of the Charité Medical University.

Availability of data and materials

The datasets analyzed during the current study are not publicly available due to German laws but are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

Authors

Contributions

LZ participated on study design, read the images, performed statistical analysis and drafted the manuscript with input from FM, EB, SS, JT, FB. FM provided the data sets and headed the coordination and image acquisition of the underlying study. SS assisted in study design, statistical analysis and data interpretation. JSM conceived and designed the study, supported statistical analysis and drafting the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Jeanette Schulz-Menger.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was given for the original study by the local ethical committee of Charité Medical University Berlin (approval number EA1/262/14). All patients gave their written informed consent before participating in the study.

Consent for publication

Written informed consent for study participation included the consent for publication.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

Intraobserver analysis. Bland-Altman plots of LV function (EF), mass, end-diastolic (EDV) and end-systolic volume (ESV) (PDF 369 kb)

Additional file 2:

Intraobserver analysis. Bland-Altman plots of peak velocity (Vmax), stroke volume (SV), T1-time and T2-time (PDF 368 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zange, L., Muehlberg, F., Blaszczyk, E. et al. Quantification in cardiovascular magnetic resonance: agreement of software from three different vendors on assessment of left ventricular function, 2D flow and parametric mapping. J Cardiovasc Magn Reson 21, 12 (2019). https://doi.org/10.1186/s12968-019-0522-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12968-019-0522-y

Keywords