Skip to main content
Download PDF
Download ePub

The use of dedicated long-axis views focused on the left atrium improves the accuracy of left atrial volumes and emptying fraction measured by cardiovascular magnetic resonance

Journal of Cardiovascular Magnetic Resonance volume 25, Article number: 10 (2023) Cite this article

Abstract

Background

The use of apical views focused on the left atrium (LA) has improved the accuracy of LA volume evaluation by two-dimensional (2D) echocardiography. However, routine cardiovascular magnetic resonance (CMR) evaluation of LA volumes still uses standard 2- and 4-chamber cine images focused on the left ventricle (LV). To investigate the potential of LA-focused CMR cine images, we compared LA maximuml (LAVmax) and minimum (LAVmin) volumes, and emptying fraction (LAEF), calculated on both standard and LA-focused long-axis cine images, with LA volumes and LAEF obtained by short-axis cine stacks covering the LA. LA strain was also calculated and compared between standard and LA-focused images.

Methods

LA volumes and LAEF were obtained from 108 consecutive patients by applying the biplane area-length algorithm to both standard and LA-focused 2- and 4-chamber cine images. Manual segmentation of a short-axis cine stack covering the LA was used as the reference method. In addition, LA strain reservoir (εs), conduit (εe) and booster pump (εa) were calculated using CMR feature-tracking.

Results

Compared to the reference method, the standard approach significantly underestimated LA volumes (LAVmax: bias − 13 ml; LOA =  + 11, − 37 ml; LAVmax i: bias − 7 ml/m2; LOA =  + 7, − 21 ml/m2; LAVmin; bias − 10 ml, LOA: + 9, − 28 ml; LAVmin i: bias − 5 ml/m2, LOA: + 5, − 16 ml/m2), and overestimated LA-EF (bias 5%, LOA: + 23, − 14%). Conversely, LA volumes (LAVmax: bias 0 ml; LOA: + 10, − 10 ml; LAVmax i: bias 0 ml/m2; LOA: + 5, − 6 ml/m2; LAVmin: bias − 2 ml; LOA: + 7, − 10 ml; LAVmin i: bias − 1 ml/m2; LOA: + 3, − 5 ml/m2) and LAEF (bias 2%, LOA: + 11, − 7%) by LA-focused cine images were similar to those measured using the reference method. LA volumes by LA-focused images were obtained faster than using the reference method (1.2 vs 4.5 min, p < 0.001). LA strain (εs: bias 7%, LOA = 25, − 11%; εe: bias 4%, LOA = 15, − 8%; εa: bias 3%, LOA = 14, − 8%) was significantly higher in standard vs. LA-focused images (p < 0.001).

Conclusion

LA volumes and LAEF measured using dedicated LA-focused long-axis cine images are more accurate than using standard LV-focused cine images. Moreover, LA strain is significantly lower in LA-focused vs. standard images.

Background

Left atrial (LA) size and function are robust prognostic markers of adverse cardiovascular outcomes in a variety of cardiac conditions [1,2,3,4,5,6].

Cardiovascular magnetic resonance (CMR) is considered the reference imaging modality to assess the size and function of cardiac chambers [7], and recently LA size and function measured by CMR have been reported to be associated with cardiovascular outcome, independent of left ventricular (LV) measures [5]. However, current CMR guidelines do not provide specific recommendations on how to measure LA volumes [8]. LA cavity contouring from a short-axis cine stack has been reported to provide larger LA volumes than the conventional biplane area-length algorithm applied to standard (i.e. images focused on the LV) long-axis 2- and 4-chamber cine images [9]. Short axis contouring  has been used as a reference method to validate LA volumes and emptying fraction (LAEF) measured by three-dimensional (3D) echocardiography [10], and to assess the prognostic value of LA function in survivors of a ST elevation myocardial infarction [11]. However, the short axis contouring method has never been implemented in routine CMR practice, due to its significant scan acquisition and post-processing time. As a result, LA volumes and strain by CMR are usually evaluated by applying the biplane area-length algorithm and the feature tracking method to standard long-axis 2- and 4-chamber cine images [1, 2, 7, 12,13,14]. However, the latter are oriented according to the major axis of the LV, which lies in a plane with a different spatial orientation compared to the LA [10]. Thus, the standard long-axis views optimized according to the maximal LV length commonly foreshorten the LA, with the consequent underestimation its size and overestimation of the extent of myocardial wall deformation by strain. [10, 15,16,17]

A previous transthoracic echocardiographic study showed that apical 2- and 4-chamber views focused on the LA provided more accurate estimation of LA maximum volume (LAVmax) than standard long-axis views [16]. However, it remains to be clarified whether the acquisition of dedicated LA-focused long-axis cine views improves the accuracy of LA volumes estimation, and the impact of these additional acquisitions on the current workflow in CMR daily practice. To address these issues, we designed a prospective, observational, multicenter study to: (i) assess whether the use of LA-focused long-axis images improves the accuracy in quantifying LA volumes and LAEF, compared to standard long-axis images; (ii) quantify both the acquisition time required to obtain LA focused long-axis images and the computational time to obtain LA volumes and LAEF (iii) and compare LA strain values obtained by standard vs. LA-focused long-axis images.

Methods

Study design

The present investigation is a prospective, multicenter and observational study. Consecutive patients undergoing clinically referred CMR at Istituto Auxologico Italiano, IRCSS (Milan, Italy), and Policlinico San Donato, IRCSS (San Donato Milanese, Italy), were screened for study inclusion from May 2021 to June 2021. Exclusion criteria were: (i) age < 18 years; (ii) significant cardiac arrhythmia (i.e. atrial fibrillation); (iii) unwillingness to take part in the study; (iv) congenital heart disease; (v) pregnancy and/or any other contraindication to CMR study; (vi) heart transplantation; (vii) non-diagnostic image quality. Demographics and clinical data were recorded on the same day of CMR scan.

The study was performed according to the principles of the declaration of Helsinki and was approved by the Ethics Committee of the Istituto Auxologico Italiano, IRCCS, Milan, Italy (reference # CE 2021_05_18_09, approved on May 18th, 2021). All patients gave written consent to have their anonymized clinical data used for scientific purposes. The data that support the findings of this study are available on reasonable request to the corresponding author.

CMR study protocol

CMR were performed on 1.5 T system (MAGNETOM Aera at Policlinico San Donato, and AVANTOFit at Istituto Auxologico Italiano; Siemens Healthineers, Erlangen, Germany). LV volumes, mass (LVM) and ejection fraction (LVEF), and right ventricular (RV) volumes and ejection fraction (RVEF) were obtained from manual tracing of cine balanced steady-state free precession (bSSFP) images acquired at the end of expiration, using the following parameters: slice thickness 6.0 mm, no gap, flip angle 60°–80°, repetition time and echo time were tailored for each patient to achieve 25 to 30 cardiac phases per cardiac cycle; typical readout field of view = 350 mm; phase resolution matrix = 75%; voxel size = 1.4 × 1.4 mm.

CMR acquisition of the LA

Cine bSSFP images of the LA were obtained using 3 protocols:

  • 1. The standard (i.e. LV-focused) 2-chamber long-axis views were obtained from the vertical long-axis scout already acquired with modification to pass through the anterior and inferior LV myocardial walls [8]. The standard 4-chamber long-axis cine images were obtained from the 2-chamber long-axis views, through the LV apex and the center of the mitral annulus.

  • 2. The LA-focused 4- and 2-chamber long-axis cine images were planned from the standard long-axis cine images. The method used to produce LA-focused cine images is explained in Fig. 1. By starting from the end-systolic standard 4-chamber cine image (Fig. 1, panel A1), the LA-focused 2-chamber image (Fig. 1, panel B) was obtained, oriented parallel to the interatrial septum, by selecting a perpendicular plane passing through the roof of the LA and the center of the mitral annulus. From the cine image in panel B, a perpendicular plane was selected, again intercepting the roof of the LA and the center of the mitral annulus, to obtain the LA-focused 4-chamber cine image (Fig. 1, panel C). Before the acquisition, the plane orientation to obtain LA- focused cine images was cross-checked in the standard 3-chamber cine image (Fig. 1, Panel A2), to avoid the inclusion of the adjacent aortic root in the final images.

  • 3. The reference used for LA volumes and LAEF was a short-axis stack of cine images covering the entire LA, from the atrio-ventricular ring to the LA base. Orientation of the short-axis stack was perpendicular to the interatrial septum. Slice thickness was 6 mm with no gap and with temporal resolution < 45 ms [8, 18].

Fig. 1
figure 1

Method used to obtain the left-atrial focused long-axis cine images. Left atrial (LA)-focused 4- and 2-chamber long-axis cine images were planned from the standard long-axis cine images. Starting from the end-systolic standard 4-chamber cine image (A1), the LA-focused 2-chamber image (B) was obtained, oriented parallel to the interatrial septum, by selecting a perpendicular plane passing through the roof of the LA and the center of the mitral annulus. From the cine image in panel B, a perpendicular plane was selected, again intercepting the roof of the LA and the center of the mitral annulus, to obtain the LA-focused 4-chamber cine image (C). Before acquisition, the plane orientation to obtain LA-focused cine images was cross-checked in the standard 3-chamber cine image (A2), to avoid the inclusion of the adjacent aortic root in the final images

Full size image

An example of reference, standard and LA-focused cine images is illustrated in Fig. 2.

Fig. 2
figure 2

LA volumes and left atrial emptying fraction (LAEF) quantification on standard (A), left-atrial focused (B) and reference short-axis images (C). The biplane area-length method was applied to A and B while C was analyzed using the Simpson’s disc summation algorithm. All images represent end-systolic frames. In the standard images (A) the LA is clearly foreshortened compared to the LA focused cine images (B).  LAVmin: Minimum left atrial volume; LAVMax: Maximimum left atrial volume

Full size image

The time delays of the CMR scan due to LA-focused long-axis cine images and LA short-axis cine stack acquisitions were measured.

CMR post-processing of the LA

Analysis of the LA included LAVmax, minimum LA volume (LAVmin), LAEF and LA strain. LA volumes were reported both as absolute values and as indexed to body surface area.

In both standard and LA-focused long-axis cine-images, the LA cavity borders were traced in 4- and 2-chamber long-axis views in the frame before the opening of the mitral valve (LA end-diastole), and in the frame corresponding to the closure of the mitral valve (LA end-systole). Images were analyzed using a commercially available software, cvi42 (version 13.5, Circle Cardiovascular Imaging Inc, Alberta, Calgary, Canada). The biplane area-length method [19] was applied to estimate the LA volumes by standard and LA-focused long-axis using the following formula:

$$LA volume=\frac{0.85\times {4}_{chamber}LA Area\times {2}_{chamber}LA Area }{{L}_{min}}$$

where Lmin was the shorter long axis length of the LA either from the 2- or the 4-chamber view [19]. In the short-axis stack (used as reference) LA endocardial contours were manually traced and Simpson’s method of disks was applied for volumetric analysis. The most distal slice was defined as the slice showing LA cavity with no more than 50% of the circumference surrounded by LV myocardial tissue [10, 20]. The volume of the LA appendage was excluded from the LA cavity tracing, given its wide anatomical variability and its negligible clinical impact.

LAEF was calculated as (LAVmax − LAVmin)/LAVmax

To evaluate the clinical significance of using the three CMR image acquisition protocols, we categorized our patients in 4 groups based on previously published partition values: normal LA size (< 53 ml/m2), mildly dilated (53–62 ml/m2), moderately dilated (63–73 ml/m2), and severely dilated (> 73 ml/m2) [1].

LA strain analysis was performed using CMR feature-tracking (CMR-FT) on a dedicated software (Qstrain, version 2.1.12.2, Medis Medical Imaging Systems, Leiden, the Netherlands). LA endocardial borders were manually traced in 2- and 4-chamber views and the automated tracking algorithm was applied, with manual correction for minor misalignments. The three LA phasic functions (reservoir, conduit and booster pump) were analyzed.

Statistical analysis

The normal distribution of the variables was assessed by Shapiro–Wilk normality test. Categorical variables are summarized as count and percentage. Normally distributed variables were summarized as mean ± standard deviation (SD), and non-normally distributed variables as median and interquartile range (IQR). Agreement between LA volumes and LAEF derived by both the standard long-axis and the LA-focused long-axis views with LA volumes and LAEF derived by short-axis stacks were analyzed using Pearson correlation and Bland–Altman plots, illustrating biases and 95% limits of agreement (LOA). LA volumes and LAEF obtained from the reference, the standard, and the LA-focused methods were compared using Kruskal–Wallis one-way analysis of variance. LA strain values obtained from the standard and the LA-focused methods were compared using Student T test.

Analyses were performed with SPSS (version 23.0, Statistical Package for the Social Sciences, International Business Machines, Inc., Armonk, New York, USA). A p-value < 0.05 was considered statistically significant.

Reproducibility analysis

Intra and inter-observer reproducibility analysis of LAVmax, LAVmin and LAEF measurements, obtained by reference and LA-focused imaging, was performed by two experienced operators (LT and SF, level 3 EACVI CMR certification) on 15 randomly chosen patients, by computing two-way mixed intraclass correlation coefficient (ICC) [21] for absolute agreement and Pearson correlation. An experienced operator reanalyzed the same data set weeks apart and blinded from the first measurements for intra-observer variability. A different experienced operator independently and blindly analyzed the same images for inter-observer variability.

Results

We enrolled 118 patients. Ten patients were excluded: seven because of irregular heart rhythm at the time of the CMR study (either frequent ectopic beats or atrial fibrillation), and three due to the poor breath-hold performance during the study. The final study population consisted of 108 patients: 55 patients from Policlinico San Donato, and 53 patients from Istituto Auxologico Italiano. LA volumes could be evaluated in all patients (feasibility 100%). Out of 108 patients, 8 were excluded from LA strain analysis, due to inadequate semiautomatic tracking in either one or both the 2- and 4ch cine images.

Enrolled patients were predominantly men (71%), age of 55 ± 19 years.

Demographics, clinical indications to CMR, and CMR findings of the study cohort are summarized in Table 1.

Table 1 Clinical and CMR characteristics of the study population (n = 108)
Full size table

LAVmax

The reference volumetric method yielded a LAVmax of 82 ml (IQR 67–105 ml) and a LAVmax i of 42 (IQR 36–54 ml/m2). LAVmax and LAV max-i derived from the standard cine images were 72 ml (IQR 55–93 ml) and 38 ml/m2 (IQR 28–48 ml/m2), respectively. LAVmax and LAVmax-i derived from LA-focused cine images were 83 ml (IQR 66–103 ml) and 43 ml/m2 (IQR 37–55 ml/m2), respectively.

The LAVmax obtained from the standard long-axis sequences were significantly smaller than the LAVmax obtained from both the reference (p = 0.007) and the LA-focused (p = 0.007) cine images. Conversely, the LAVmax obtained from the LA-focused images were similar to those obtained using the reference method (p = 1). Table 2.

Table 2 Comparison of left atrial volumes and emptying fraction from reference, standard, and focused-left-atrial cine images
Full size table

Although a good correlation was noted between the standard and the reference methods (r2 = 0.86), Bland–Altman analysis revealed underestimation of LAVmax by the standard method (LAVmax bias: − 13 ml; 95% LOA: + 11 ml, − 37 ml; LAVmax-i bias: − 7 ml/m2; 95% LOA: + 7 ml/m2, − 21 ml/m2).

Conversely, LA-focused and reference methods showed excellent correlation for LAVmax (r2 = 0.97) with negligible bias at Bland Altman analysis (LAVmax bias: 0 ml; 95% LOA: + 10 ml, − 10 ml; LAVmax i bias: 0 ml/m2; 95% LOA: + 5 ml/m2, − 6 ml/m2) (Figs. 3 and 7).

Fig. 3
figure 3

Left atrial maximum volume (LAVmax): comparison between methods. Comparison of LAVmax obtained using the biplane area-length method applied to both the standard (top panels) and the LA-focused (bottom panels) cine images, with LAVmax derived by the short-axis segmentation used as reference

Full size image

The extent of the underestimation of LAVmax-i obtained with the standard method determined a change of the category of LA dilation severity in 21 patients (19.4%). Among them, 9 patients who were classified as normal or mildly dilated with the standard method of LA volume measurements were found to have moderately dilated LA using the reference method, and 4 patients with moderately dilated LA according to the standard method were found to have severely dilated LA using the reference method. Compared to the standard method, by using the reference method to calculate the LA volumes moves 17 patients in one more severe degree and four patients in 2 more severe degrees of LA dilation. Conversely, only four patients had their LA dilation severity underestimated of only 1 degree using the LA-focused vs the reference method, whereas LA dilation severity was overestimated by 1 degree in four patients (Fig. 4).

Fig. 4
figure 4

Distribution of the patients in LA size categories according to the method used for LAVmax quantification. The method using a short-axis stack of cine images covering the entire LA, from the atrio-ventricular ring to the base, was considered as reference. Arrows with superimposed numbers show the patients who change category by using either the standard or the LA-focused 4- and 2-chamber cine images

Full size image

LAVmin

The reference volumetric method yielded a LAVmin of 38 ml (IQR 30–55 ml) and a LAVmin-i of 20 ml/m2 (IQR 16–30 ml/m2). The LAVmin and LAVmin-i derived from standard long-axis cine images were 29 ml (IQR 21–48 ml) and 16 ml/m2 (IQR 12–24 ml/m2), respectively. The LAVmin and LAVmin i derived from LA-focused long-axis cine images were 37 ml (IQR 27–53 ml) and 19 ml/m2 (IQR 15–28 ml/m2), respectively.

The LAVmin obtained from the standard long-axis sequences were significantly smaller than the LAVmin obtained from both the reference (p < 0.001) and the LA-focused (p = 0.01) cine images. Conversely, the LAVmin obtained from the LA-focused images were similar to those obtained from the reference method (p = 0.46) (Table 2).

Although a good correlation was noted between the LAVmin obtained using the standard and the reference methods (r2 = 0.87), Bland–Altman analysis revealed a large underestimation of LAVmin by the reference method (LAVmin bias: − 10 ml; 95% LOA: + 9 ml, − 28 ml; LAVmin-i bias: − 5 ml/m2; 95% LOA: + 5 ml/m2, − 16 ml/m2).

Conversely, the LA-focused and the reference methods showed excellent correlation for LAVmin (r2 = 0.98) with negligible bias at Bland Altman analysis (LAVmin bias: − 2 ml, 95% LOA: + 7 ml, − 10 ml; LAVmin i bias: − 1 ml/m2, 95% LOA: + 3 ml/m2, − 5 ml/m2) (Figs. 5 and 8).

Fig. 5
figure 5

Left atrial minimum volume (LAVmin): comparison between methods. Comparison of LAVmin obtained using the biplane area-length method applied to both the standard (top panels) and the LA-focused (bottom panels) cine images, with LAVmin derived by the short-axis segmentation used as reference

Full size image

LAEF

The reference volumetric method yielded a LAEF of 52% (IQR 45–58%). LAEF derived from the standard and the LA-focused long-axis cine images were 56% (IQR 48–64%) and 55% (IQR 45–60%), respectively.

The LAEF obtained using the standard long-axis sequences was significantly higher than the LAEF obtained from the reference method (p = 0.006). Conversely, the LAEF obtained from LA-focused images was similar to those obtained using the reference method (p = 0.3) (Table 2).

A moderate correlation was noted between the LAEF obtained using the standard and the reference methods (r2 = 0.58) and Bland–Altman analysis revealed overestimation of LAEF by the reference method (bias: 5%; 95% LOA: + 23%, − 14%).

Conversely, the LA-focused and the reference methods showed good correlation for LAEF (r2 = 0.82) with small bias at Bland Altman analysis (bias: 2%, 95% LOA: + 11, − 7%) (Fig. 6).

Fig. 6
figure 6

Left atrial emptying fraction: comparison between methods. Comparison of left atrial emptying fraction (LAEF) obtained using the biplane area-length method applied to both the standard (top panels) and the LA-focused (bottom panels) cine images, with LAEF derived by the short-axis segmentation that were taken as reference

Full size image
Fig. 7
figure 7

Left atrial maximum volume index (LAVmax-i): comparison between methods. Comparison of LAVmax-i obtained using the biplane area-length method applied to both the standard (top panels) and the LA-focused (bottom panels) cine images, with LAVmax-i derived by the short-axis segmentation used as reference

Full size image
Fig. 8
figure 8

Left atrial minimum volume index (LAVmin-i): comparison between methods. Comparison of LAVmin-I obtained using the biplane area-length method applied to both the standard (top panels) and the LA-focused (bottom panels) cine images, with LAVmin-i derived by the short-axis segmentation used as reference

Full size image

Reproducibility of LA size and function by LA-focused long-axis views

LAVmax, LAVmin and LAEF measured using the LA-focused long-axis views showed excellent intra- and inter-observer reproducibility, with ICC ranging from 0.97 to 0.99 (Table 3).

Table 3 Intra- and inter-observer reproducibility for left atrial volumes and emptying fraction from LA-focused cine images
Full size table

LAVmax, LAVmin and LAEF measured using the reference short-axis stack showed good to excellent intra- and inter-observer reproducibility, with ICC ranging from 0.88 to 0.99 (Additional file 1: Table S1).

LA strain analysis

At CMR-FT analysis, all three LA strain values (reservoir strain (εs): bias 7%, LOA = 25, − 11%; conduit strain (εe): bias 4%, LOA = 15, − 8%; booster pump strain (εa): bias 3%, LOA = 14, − 8%; all p < 0.001) were significantly higher in standard vs. LA-focused images. LA strain values showed moderate correlation between the two methods (Table 4).

Table 4 CMR feature tracking left atrial strain analysis on LA-focused vs. standard cine images
Full size table

CMR scan acquisition delay and post-processing time related to LA volumes quantification

The scan delay due to the acquisition of the LA-focused long-axis cine images was significantly shorter than the scan delay due to short-axis LA acquisition, used as reference method, (72 s, IQR 60–120 s vs. 270 s, IQR 228–300; p < 0.001).

The post-processing time of LA-focused cine images was significantly shorter than that of reference short-axis LA stack (28 s, IQR 25–29 s vs. 103 s, IQR 98–129 s; p = 0.008) and similar to that of standard long-axis cine images (26 s, IQR 24–28 s; p = 0.4).

Discussion

To our knowledge, this is the first study proposing and testing the accuracy and reproducibility of CMR LA dedicated long-axis cine views to measure LA volumes and LAEF, and to assess the impact on LA strain values of using the LA focused images.

Our results can be summarized as follows: (i) LA volumes and LAEF obtained by LA-focused imaging did not significantly differ from the respective values obtained by the reference method in patients undergoing clinically indicated CMR; (ii) LA volumes were significantly larger, and LAEF was significantly lower, when they were obtained from LA-focused long-axis cine images compared to standard long-axis views; (iii) LA strain values obtained by LA-focused imaging are significantly lower than those produced by standard images; (iv) LA volumes and LAEF obtained by LA-focused imaging showed excellent intra- and inter-observer reproducibility and (v) the scan delay and the post-processing time due to LA-focused images acquisition and analysis were significantly lower than those required by the short-axis stack used as a reference.

LA remodeling largely depends on LV diastolic performance over time [3, 4], represents an early feature of several cardiovascular diseases [4, 22] and heralds adverse cardiovascular outcomes [2, 11, 12].

Among the various LA imaging parameters, LAVmax has been the most extensively assessed biomarker [1,2,3,4,5]. More recently, there has been increasing interest for LAVmin, which has shown a greater prognostic value than LAVmax [23,24,25] and may reflect the ‘contractile’ function of the LA more precisely [26, 27]. LAEF is another relevant parameter, since it showed the best correlation with E/Eʹ values in a population of patients with diastolic dysfunction assessed by echocardiography [28]. LA strain is also emerging as a prognosticator of adverse cardiovascular events in multiple disease settings [29, 30] and in the general population [31].

At present, CMR is considered the gold standard for morpho-functional assessment of cardiac chambers [7]. However, current CMR guidelines do not provide specific recommendations on how to measure LA volumes, LAEF and strain.

LA volumes are usually calculated by using the biplane area-length algorithm in standard (i.e. LV focused) long-axis cine images [1, 2, 5, 12,13,14, 32, 33]. However, LV and LA long-axis are not parallel [10]. Thus, if LA volumes are measured in standard long-axis images, which optimize the orientation for the LV, there is a likelihood of foreshortening the LA images, entailing an underestimation of LA volumes [9, 34,35,36] and an overestimation of LA strain [17]. These methodological issues are critical to diagnose LA volumes dilation and/or dysfunction using tomographic imaging techniques [9, 10, 16]. The use of the standard method was associated to the underestimation of the severity of LA dilation in 21% of our patients (the underestimation was of two degrees of severity in 4%), that may be associated to a significant underestimation of both their mortality and morbidity [1, 5].

LA volumetric analysis by CMR has been considered as the reference standard in several investigations, by performing a short-axis stack of cine images covering the LA, and then calculating LA volumes by tracing LA cavity at end-systole and end-diastole [9, 11, 14]. Unfortunately, this approach is time-consuming and is usually limited to research purposes. Accordingly, the best CMR methodological approach for measuring LA volumes and LAEF in daily practice remains to be established.

In the present study, we propose a new method consisting of applying the biplane area-length method to dedicated long-axis cine views, focused on the LA and intercepting its true long-axis. In comparison to the biplane area-length method applied to standard long-axis views, we demonstrated that this approach, which avoids LA foreshortening, provides a more accurate estimation of LA volumes, with values that were significantly larger than those obtained using the standard (i.e. LV-focused) cine images. Moreover, LAEF assessed by standard long-axis sequences showed only a moderate correlation with the values obtained from the reference method, resulting in significant overestimation of LA function. Conversely, LAEF values derived from LA-focused images and the reference method were similar.

Iwataki et al. [16] were the first to demonstrate that conventional apical long-axis views by 2D echocardiography were less accurate than LA dedicated 4- and 2-chamber views to estimate LA volumes measured by 3D echocardiography. Badano et al. [10] confirmed the underestimation of LA volumes measured by 3D echocardiography by the biplane area-length method applied to conventional apical 4- and 2-chamber views obtained by 2D echocardiography. Accordingly, current guidelines for the assessment of cardiac chambers by 2D echocardiography recommend the use of dedicated, LA-focused apical 4- and 2-chamber views to assess LA volumes [15].

The evaluation of LA size and function by CMR has gained increasing attention in the last years. The potential role of area-length biplane algorithm as an alternative and faster method to Simpson’s for the volumetric analysis of the LA has been repeatedly explored, providing controversial results.

Sievers et al. [19] suggested that LA volumes and LAEF calculated through the biplane area-length method from standard long-axis images are accurate in healthy subjects and patients with atrial fibrillation. Consistently, the authors found marginally larger LAVmax (difference of 1 ± 1 ml) obtained by the biplane area-length method than those calculated by the Simpson’s method in short-axis, whereas LAVmin and LAEF were similar between the two methods. These findings were derived from a single-center population including 33 individuals. Atrial volumes were obtained through prospective gating and bSSFP, which do not represent the current CMR standard of practice [8].

Nacif et al. [36] found that, in 88 patients with a history of atrial fibrillation, the LA volumes and LAEF calculated using the biplane area-length method did not significantly differ from those obtained by the Simpson’s method applied to short-axis derived by retrospective gating and bSSFP sequences.

However, Nanni et al. [34] subsequently reported that LAVmin, although not LAVmax, was significantly underestimated by the standard biplane area-length, entailing a significant overestimation of LAEF in comparison to the short axis Simpson’ method.

Wandelt et al. [9] demonstrated a relevant underestimation of both LA volumes and confirmed an overestimation of the LAEF through the biplane area-length-algorithm applied to standard long-axis cine images vs. the Simpson’s method applied to a stack of slices covering the LA in transversal orientation as a reference (80 vs. 99 ml, 37 vs. 53 ml and 55 vs. 48% for LAVmax, LAVmin and LAEF, respectively).

Our findings are in line with the results of the latter two studies, showing an underestimation of LA volumes and an overestimation of LAEF obtained through the biplane-area length algorithm applied on standard cine images in comparison to the reference method.

As regards LA strain, CMR-FT is a feasible and reproducible semi-automated post-processing method using bSSFP to quantitatively assess LA phasic functions (reservoir, conduit and booster pump) [37]. Nabeshima et al. [17] recently reported that the foreshortening of the LA cavity in 2D echo apical views potentially overestimates reservoir strain. CMR-FT-derived LA strain values are usually calculated using standard long-axis cine images [38]. Our study is the first to apply CMR-FT analysis to both standard and LA-focused long-axis views. We showed that all three LA strain components obtained by LA-focused images are significantly lower than those obtained using the standard 2- and 4-chamber cine images. The difference observed may be partly explained by the fact that strain values depend on the geometry of the chamber, which varies according to the acquisition plane. Moreover, LA-focused images better include LA posterior wall, where pulmonary veins convey and atrial deformation is probably blunted.

To try to maintain the convenient workflow and the time-saving approach provided with the biplane area-length algorithm, and take into account the different anatomical orientation of the LA compared to the LV, we propose to adopt for CMR an approach similar to the one recommended for 2D echocardiography. The acquisition of dedicated, LA focused (i.e. optimized for the LA length) 4- and 2 chamber views required a very short extra scan time, was significantly faster than the short-axis method, and provided similar results to the short axis reference method with excellent intra- and inter-observer reproducibility. The latter feature is essential for the potential clinical implementation since imaging speed is a major issue of CMR [39].

Limitations

This is a pilot and methodological investigation. Thus, we do not provide normal reference values for the proposed acquisition protocol of the LA, which will eventually be the subject of a future investigation.

We did not use an independent cardiac imaging modality as reference for the accuracy of LA volumes. In fact, cardiac computed tomography entails radiation exposure and may be unethical without a specific clinical indication. Nevertheless, we validated LA-focused long-axis cine images with LA volumes obtained by a CMR short-axis cine stack, which is considered as a reference standard.

The present study is purely methodological, as it evaluates the accuracy of LA volumes obtained from the LA-focused cine images compared to standard long-axis ones. The clinical impact of this novel approach is beyond the aims of the study. According to our results, and the emerging literature about the prognostic role of LA size and function assessed by CMR, the clinical impact of LA-focused cine sequences warrants further investigation.

Finally, the biplane area-length algorithm is based on the geometric assumption of an ellipsoid chamber. Although we have enrolled a relatively large number of patients with a wide range of LA volumes, future studies are needed to confirm the robustness of our results in the various geometries of the LA.

Conclusions

CMR assessment of the LA using LA-focused long-axis cine imaging is quick, feasible and provides more accurate LA volumes and LAEF than standard long-axis cine imaging. LA strain values obtained by LA-focused imaging are significantly lower than those produced by standard images. Considering the diagnostic and prognostic value of the accurate assessment of LA size in many cardiac conditions, and the limited additional scan time needed to acquire dedicated LA-focused images, this method should enter the clinical routine of CMR studies.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

2D:

Two-dimensional

3D:

Three-dimensional

bSSFP:

Balanced steady state free precession

CMR:

Cardiovascular magnetic resonance

εa:

Booster pump strain

εe:

Conduit strain

εs:

Reservoir strain

FT:

Feature tracking

ICC:

Intraclass correlation coefficient

IQR:

Interquartile range

LA:

Left atrium/left atrial

LAEF:

Left atrial emptying fraction

LAVmax:

Maximum left atrial volume

LAVmax-i:

Maximum left atrial indexed to body surface area

LAVmin:

Minimum left atrial volume

LAVmin-i:

Minimum left atrial volume indexed to body surface area

LOA:

Limits of agreement

LV:

Left ventricle/left ventricular

LVEF:

Left ventricular ejection fraction

LVM:

Left ventricular mass

RV:

Right ventricle/right ventricular

RVEF:

Right ventricular ejection fraction

References

  1. Khan MA, Yang EY, Zhan Y, Judd RM, Chan W, Nabi F, et al. Association of left atrial volume index and all-cause mortality in patients referred for routine cardiovascular magnetic resonance: a multicenter study. J Cardiovasc Magn Reson. 2019;21:4.

    Article  Google Scholar 

  2. Gulati A, Ismail TF, Jabbour A, Ismail NA, Morarji K, Ali A, Raza S, et al. Clinical utility and prognostic value of left atrial volume assessment by cardiovascular magnetic resonance in non-ischaemic dilated cardiomyopathy. Eur J Heart Fail. 2013;15:660–70.

    Article  CAS  Google Scholar 

  3. Thomas L, Marwick TH, Popescu BA, Donal E, Badano LP. Left atrial structure and function, and left ventricular diastolic dysfunction: JACC state-of-the-art review. J Am Coll Cardiol. 2019;73:1961–77.

    Article  Google Scholar 

  4. Thomas L, Muraru D, Popescu BA, Sitges M, Rosca M, Pedrizzetti G, et al. Evaluation of left atrial size and function: relevance for clinical practice. J Am Soc Echocardiogr. 2020;33:934–52.

    Article  Google Scholar 

  5. Raisi-Estabragh Z, McCracken C, Condurache D, Aung N, Vargas JD, Naderi H et al. Left atrial structure and function are associated with cardiovascular outcomes independent of left ventricular measures: a UK Biobank CMR study. Eur Heart J Cardiovasc Imaging. 2021;jeab266.

  6. Garg P, Gosling R, Swoboda P, Jones R, Rothman A, Wild JM, et al. Cardiac magnetic resonance identifies raised left ventricular filling pressure: prognostic implications. Eur Heart J. 2022;43(26):2511–22.

    Article  Google Scholar 

  7. Petersen SE, Khanji MY, Plein S, Lancellotti P, Bucciarelli-Ducci C. European Association of Cardiovascular Imaging expert consensus paper: a comprehensive review of cardiovascular magnetic resonance normal values of cardiac chamber size and aortic root in adults and recommendations for grading severity. Eur Heart J Cardiovasc Imaging. 2019;20:1321–31.

    Article  Google Scholar 

  8. Kramer CM, Barkhausen J, Bucciarelli-Ducci C, Flamm SD, Kim RJ, Nagel E. Standardized cardiovascular magnetic resonance imaging (CMR) protocols: 2020 update. J Cardiovasc Magn Reson. 2020;22:17.

    Article  Google Scholar 

  9. Wandelt LK, Kowallick JT, Schuster A, Wachter R, Stümpfig T, Unterberg-Buchwald C, et al. Quantification of left atrial volume and phasic function using cardiovascular magnetic resonance imaging-comparison of biplane area-length method and Simpson’s method. Int J Cardiovasc Imaging. 2017;33:1761–9.

    Article  Google Scholar 

  10. Badano LP, Miglioranza MH, Mihăilă S, Peluso D, Xhaxho J, Marra MP, et al. Left atrial volumes and function by three-dimensional echocardiography: reference values, accuracy, reproducibility, and comparison with two-dimensional echocardiographic measurements. Circ Cardiovasc Imaging. 2016;9:1–12.

    Article  Google Scholar 

  11. Lønborg JT, Engstrøm T, Møller JE, Ahtarovski KA, Kelbæk H, Holmvang L, et al. Left atrial volume and function in patients following ST elevation myocardial infarction and the association with clinical outcome: a cardiovascular magnetic resonance study. Eur Heart J Cardiovasc Imaging. 2013;14(2):118–27.

    Article  Google Scholar 

  12. Patel RK, Jardine AG, Mark PB, Cunningham AF, Steedman T, Powell JR, et al. Association of left atrial volume with mortality among ESRD patients with left ventricular hypertrophy referred for kidney transplantation. Am J Kidney Dis. 2010;55:1088–96.

    Article  Google Scholar 

  13. Hudsmith LE, Petersen SE, Francis JM, Robson MD, Neubauer S. Normal human left and right ventricular and left atrial dimensions using steady state free precession magnetic resonance imaging. J Cardiovasc Magn Reson. 2005;7:775–82.

    Article  Google Scholar 

  14. Kawel-Boehm N, Maceira A, Valsangiacomo-Buechel ER, Vogel-Claussen J, Turkbey EB, Williams R, et al. Normal values for cardiovascular magnetic resonance in adults and children. J Cardiovasc Magn Reson. 2015;17:29.

    Article  Google Scholar 

  15. Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L, et al. Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. J Am Soc Echocardiogr. 2015;28:1-39.e14.

    Article  Google Scholar 

  16. Iwataki M, Takeuchi M, Otani K, Kuwaki H, Haruki N, Yoshitani H, et al. Measurement of left atrial volume from transthoracic three-dimensional echocardiographic datasets using the biplane Simpson’s technique. J Am Soc Echocardiogr. 2012;25:1319–26.

    Article  Google Scholar 

  17. Nabeshima Y, Kitano T, Takeuchi M. Reliability of left atrial strain reference values: a 3D echocardiographic study. PLoS ONE. 2021;16(4): e0250089. https://doi.org/10.1371/journal.pone.0250089.

    Article  CAS  Google Scholar 

  18. Perez de Isla L, Feltes G, Moreno J, Martinez W, Saltijeral A, de Agustin JA, et al. Quantification of left atrial volumes using three-dimensional wall motion tracking echocardiographic technology: comparison with cardiac magnetic resonance. Eur Heart J Cardiovasc Imaging. 2014;15:793–9.

    Article  Google Scholar 

  19. Sievers B, Kirchberg S, Addo M, Bakan A, Brandts B, Trappe HJ. Assessment of left atrial volumes in sinus rhythm and atrial fibrillation using the biplane area-length method and cardiovascular magnetic resonance imaging with TrueFISP. J Cardiovasc Magn Reson. 2004;6:855–63.

    Article  Google Scholar 

  20. Mor-Avi V, Yodwut C, Jenkins C, Kühl H, Nesser HJ, Marwick TH, et al. Real-time 3D echocardiographic quantification of left atrial volume: multicenter study for validation with CMR. JACC Cardiovasc Imaging. 2012;5:769–77.

    Article  Google Scholar 

  21. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63. doi: https://doi.org/10.1016/j.jcm.2016.02.012. Epub 2016 Mar 31. Erratum in: J Chiropr Med. 2017;16(4):346.

  22. Bernardini A, Camporeale A, Pieroni M, Pieruzzi F, Figliozzi S, Lusardi P, et al. Atrial dysfunction assessed by cardiac magnetic resonance as an early marker of fabry cardiomyopathy. JACC Cardiovasc Imaging. 2020;13:2262–4.

    Article  Google Scholar 

  23. Russo C, Jin Z, Homma S, Rundek T, Elkind MSV, Sacco RL, Di Tullio MR. LA phasic volumes and reservoir function in the elderly by real-time 3D echocardiography: normal values, prognostic significance, and clinical correlates. JACC Cardiovasc Imaging. 2017;10(9):976–85.

    Article  Google Scholar 

  24. Wu VC, Takeuchi M, Kuwaki H, Iwataki M, Nagata Y, Otani K, et al. Prognostic value of LA volumes assessed by transthoracic 3D echocardiography: comparison with 2D echocardiography. JACC Cardiovasc Imaging. 2013;6(10):1025–35.

    Article  Google Scholar 

  25. Matei LL, Ghilencea LN, Bejan GC, Stoica S, Dragoi-Galrinho R, Siliste C, et al. Minimum left atrial volume evaluated by 3D echocardiography predicts atrial fibrillation recurrences after a first radiofrequency catheter ablation for paroxysmal episodes. Maedica (Bucur). 2021;16(3):345–52.

    Article  Google Scholar 

  26. Abhayaratna WP, Seward JB, Appleton CP, Douglas PS, Oh JK, Tajik AJ, et al. Left atrial size: physiologic determinants and clinical applications. J Am Coll Cardiol United States. 2006;47:2357–63.

    Article  Google Scholar 

  27. Aune E, Baekkevar M, Roislien J, Rodevand O, Otterstad JE. Normal reference ranges for left and right atrial volume indexes and ejection fractions obtained with real-time three-dimensional echocardiography. Eur J Echocardiogr J Work Gr Echocardiogr Eur Soc Cardiol England. 2009;10:738–44.

    Article  Google Scholar 

  28. Murata M, Iwanaga S, Tamura Y, Kondo M, Kouyama K, Murata M, et al. A real-time three-dimensional echocardiographic quantitative analysis of left atrial function in left ventricular diastolic dysfunction. Am J Cardiol. 2008;102(8):1097–102.

    Article  Google Scholar 

  29. Santos AB, Roca GQ, Claggett B, Sweitzer NK, Shah SJ, Anand IS, et al. Prognostic relevance of left atrial dysfunction in heart failure with preserved ejection fraction. Circ Heart Fail. 2016;9: e002763.

    Article  CAS  Google Scholar 

  30. Lelong B, Chabanne C, Fournet M, Galli E, Mabo P, Donal E, et al. Prognostic value of left atrial reservoir function in patients with severe aortic stenosis: a 2D speckle-tracking echocardiographic study. Eur Heart J Cardiovasc Imaging. 2015;17:533–41.

    Google Scholar 

  31. Modin D, Biering-Sørensen SR, Møgelvang R, Alhakak AS, Jensen JS, Biering-Sørensen T. Prognostic value of left atrial strain in predicting cardiovascular morbidity and mortality in the general population. Eur Heart J Cardiovasc Imaging. 2019;20(7):804–15.

    Article  Google Scholar 

  32. Maceira AM, Cosín-Sales J, Roughton M, Prasad SK, Pennell DJ. Reference left atrial dimensions and volumes by steady state free precession cardiovascular magnetic resonance. J Cardiovasc Magn Reson. 2010;12:65.

    Article  Google Scholar 

  33. Kühl JT, Lønborg J, Fuchs A, Andersen MJ, Vejlstrup N, Kelbæk H, et al. Assessment of left atrial volume and function: a comparative study between echocardiography, magnetic resonance imaging and multi slice computed tomography. Int J Cardiovasc Imaging. 2012;28:1061–71.

    Article  Google Scholar 

  34. Nanni S, Westenberg JJ, Bax JJ, Siebelink HM, de Roos A, Kroft LJ. Biplane versus short-axis measures of the left atrium and ventricle in patients with systolic dysfunction assessed by magnetic resonance. Clin Imaging. 2016;40:907–12.

    Article  Google Scholar 

  35. Hudsmith LE, Cheng AS, Tyler DJ, Shirodaria C, Lee J, Petersen SE, et al. Assessment of left atrial volumes at 1.5 Tesla and 3 Tesla using FLASH and SSFP cine imaging. J Cardiovasc Magn Reson. 2007;9:673–9.

    Article  CAS  Google Scholar 

  36. Nacif MS, Barranhas AD, Türkbey E, Marchiori E, Kawel N, Mello RA, et al. Left atrial volume quantification using cardiac MRI in atrial fibrillation: comparison of the Simpson’s method with biplane area-length, ellipse, and three-dimensional methods. Diagn Interv Radiol. 2013;19:213–20.

    Google Scholar 

  37. Kowallick JT, Morton G, Lamata P, Jogiya R, Kutty S, Hasenfuß G, et al. Quantification of atrial dynamics using cardiovascular magnetic resonance: interstudy reproducibility. J Cardiovasc Magn Reson. 2015;17:36.

    Article  Google Scholar 

  38. Truong VT, Palmer C, Wolking S, Sheets B, Young M, Ngo TNM, et al. Normal left atrial strain and strain rate using cardiac magnetic resonance feature tracking in healthy volunteers. Eur Heart J Cardiovasc Imaging. 2020;21(4):446–53.

    Google Scholar 

  39. Axel L, Otazo R. Accelerated MRI for the assessment of cardiac function. Br J Radiol. 2016;89:20150655.

    Article  Google Scholar 

Download references

Acknowledgements

We acknowledge Dr. Elvis Tresova, Dr. Giuseppe Sola, Dr. Denis Tresova, Dr. Karima Tissir, Dr. Daniela Lauricella, Dr. Gianluca Cristiano, Dr. Stefano Di Lorenzo, Dr. Federica Lipomani, and Dr. Andrea Daddario for their essential support in CMR scan acquisition.

Funding

This study was partially supported by Ricerca Corrente funding from Italian Ministry of Health to IRCCS Policlinico San Donato.

Author information

Authors and Affiliations

  1. Multimodality Cardiac Imaging Section, IRCCS Policlinico San Donato, San Donato Milanese, Milan, Italy

    Lara Tondi, Silvia Pica, Antonia Camporeale, Giandomenico Disabato & Massimo Lombardi

  2. Department of Cardiology, Istituto Auxologico Italiano IRCCS, Milan, Italy

    Luigi P. Badano, Camilla Torlasco, Gianfranco Parati & Denisa Muraru

  3. Department of Medicine and Surgery, University Milano-Bicocca, Milan, Italy

    Luigi P. Badano, Diana R. Florescu, Gianfranco Parati & Denisa Muraru

  4. Clinical Echocardiography Diagnostic Service, Cardio Center, Humanitas Research Hospital IRCCS, Rozzano, Milan, Italy

    Stefano Figliozzi

  5. Department of Cardiology, University of Medicine and Pharmacy of Craiova, Craiova, Romania

    Diana R. Florescu

  6. University of Pavia, Pavia, Italy

    Giandomenico Disabato

Authors
  1. Lara Tondi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luigi P. Badano
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Stefano Figliozzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Silvia Pica
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Camilla Torlasco
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Antonia Camporeale
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Diana R. Florescu
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Giandomenico Disabato
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Gianfranco Parati
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Massimo Lombardi
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Denisa Muraru
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

L.T. designed the study, analyzed the data, interpreted the results and drafted the manuscript; L.P.B designed the study, interpreted the results, revised critically the manuscript for important intellectual content and approved the final manuscript; S.F. designed the study, analyzed the data, interpreted the results and revised critically the manuscript for important intellectual content, S.P. analyzed the data from the subset of subjects used for assessing inter-observer variability of our results and revised critically the manuscript for important intellectual content; C.T. revised critically the manuscript for important intellectual content; V.V., A.C., M.L., D.R.F. and G.P revised critically the manuscript for important intellectual content; D.M contributed in the conception of the study and interpretation of the results, and critically revised the manuscript for important intellectual content. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Lara Tondi.

Ethics declarations

Ethics approval and consent to participate

The study was performed according to the principles of the declaration of Helsinki and was approved by the Ethics Committee of the Istituto Auxologico Italiano, IRCCS, Milan, Italy (reference # CE 2021_05_18_09, approved on May 18th, 2021). All patients gave written consent to have their anonymized clinical data used for scientific purposes.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

Table S1. Intra- and inter-observer reproducibility for left atrial volumes and emptying fraction from short axis manual segmentation (reference). Table S2. Bland Altman and correlation analysis between standard and left atrial-focused long axis images for left atrial volumes, emptying fraction and diameters. Table S3. Comparison of left atrial long-axis diameters between standard and LA-focused images.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tondi, L., Badano, L.P., Figliozzi, S. et al. The use of dedicated long-axis views focused on the left atrium improves the accuracy of left atrial volumes and emptying fraction measured by cardiovascular magnetic resonance. J Cardiovasc Magn Reson 25, 10 (2023). https://doi.org/10.1186/s12968-022-00905-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12968-022-00905-w

Keywords

Journal of Cardiovascular Magnetic Resonance

ISSN: 1532-429X

Contact us