Physics in Medicine & Biology

Robust CNN Multi-Nested-LSTM Framework with Compound Loss for Patch-based Multi-Push Ultrasound Shear Wave Imaging and Segmentation

Reconstruct, denoise and segment Young’s modulus maps from sequential multi-push shear wave motion data.

MD Jahin Alam1,3Ahsan Habib Akash1,2Muyinatu A. Lediju Bell3,4,5Md. Kamrul Hasan1,*
1Dept. of EEE, Bangladesh University of Engineering and Technology (BUET) 2Lane Dept. of CSEE, West Virginia University 3Dept. of ECE, Johns Hopkins University 4Dept. of Biomedical Engineering, Johns Hopkins University 5Dept. of Computer Science, Johns Hopkins University
*Corresponding author
Architecture: a ResNet3D encoder feeds multi-nested LSTM blocks with temporal and FFT attention and a modulus decoder, producing primary reconstructions that are merged across ROIs; a post-denoiser with a shared encoder, foreground and background decoders, and a fusion block outputs the denoised modulus map and inclusion mask.
Overview. (i) The reconstruction network maps each region’s 3D motion volume to a 2D modulus map, and per-region outputs are merged into one primary reconstruction Y′. (ii) The post-denoiser cleans foreground and background separately, fuses them into the final map Y, and predicts the inclusion mask M, supervised by a compound loss.
Overview

Why shear wave elastography needs a robust learned pipeline

Tissue stiffness separates pathology from healthy tissue: liver fibrosis sits above 8 kPa against under 6 kPa for normal liver, and malignant breast lesions at 33.3–80 kPa against 5–10 kPa for fatty tissue. Shear wave elastography (SWE) measures stiffness by pushing tissue with an acoustic radiation force (ARF) and tracking the resulting shear wave; Young’s modulus follows from the wave speed. In practice, reconstructions suffer from noise sensitivity, multi-push strategies that scale poorly to larger regions of interest, and too little annotated data, which leads to poor reconstructions and unreliable inclusion segmentation.

Sequential multi-push SWE covers a wider region by firing several ARF pushes one after another, each imaging its own overlapping sub-region. This work learns the full chain from that motion data to a clean stiffness map and a lesion mask.

26.33 dBPSNR in simulation, with 30.73 dB CNR and 0.813 IoU
22.44 dBPSNR on CIRS 049 phantoms, with 36.88 dB CNR and 0.781 IoU
7.82 ± 0.59 kPaex vivo swine liver estimate, consistent with reported values
0.08coefficient of variation on liver, vs. 0.42 for a spatio-temporal CNN

Abstract

Objective: Ultrasound shear wave imaging enables noninvasive, quantitative assessment of tissue pathology with mechanical elasticity measurements. However, shear wave elastography (SWE) reconstructions are challenged by noise sensitivity, inefficient multi-push strategies for scalable ROI coverage, and limited annotated data, leading to suboptimal reconstruction and unreliable inclusion segmentation. Approach: We present a two-stage deep learning framework that addresses these limitations through a CNN-based Multi-Nested-LSTM reconstruction network followed by a compound-loss-driven CNN denoiser. The reconstruction stage begins with a ResNet3D encoder that extracts spatiotemporal features from sequential multi-push acoustic radiation force (ARF) data. These features are temporally windowed with Nested CNN-LSTM, converted from 3D to 2D with a temporal attention module (TAM), and enhanced by FFT-based frequency attention. The resulting 2D maps are decoded into primary 2D elasticity reconstructions. To mitigate data scarcity and improve generalization, a patch-based training regime is also proposed. The second stage introduces a dual-decoder denoising network that separately processes inclusion and background stiffness features, followed by a fusion module that produces a denoised modulus map and a segmentation mask. A multi-objective compound loss is designed to accommodate the denoising, fusing, and mask generation. Results: Tested on simulated and CIRS phantom datasets with four overlapping push regions, the method yields 26.33 dB PSNR, 30.73 dB CNR, and 0.813 IoU in simulation, and 22.44 dB PSNR, 36.88 dB CNR, and 0.781 IoU experimentally. Evaluation on an ex vivo swine liver confirmed elasticity estimates within reported biological stiffness ranges. Compared to DSWE-Net and spatio-temporal CNNs, our approach shows superior reconstruction, segmentation, and noise insensitivity. Significance: This framework provides a robust approach to SWE reconstruction and inclusion segmentation, demonstrating strong potential for clinical translation.

Method

Two stages: reconstruct, then denoise and segment

SWE procedure: ARF push and shear wave generation, shear wave tracking with a transducer, tissue displacement maps stacked over time, and a deep learning method producing the elasticity map and mask.
Data acquisition and reconstruction. Each of R sequential ARF pushes yields a displacement volume ID,k ∈ ℝT×A×L for its sub-region; the task is to map these to a 2D modulus map Y and a binary mask M.

Stage 1 · Reconstruction network

  • ResNet3D encoder extracts spatiotemporal features from each region’s motion volume.
  • Multi-Nested-LSTM blocks (six ConvLSTMs) window the temporal axis.
  • A temporal attention module converts features from 3D to 2D, and FFT-based attention weights their frequency content.
  • An SE-attention decoder outputs the 2D modulus map. Region outputs are merged with spatial windowing.

Stage 2 · Post-denoiser

  • One encoder is shared by two decoders, one for the inclusion and one for the background.
  • A fusion block merges both into the denoised map and predicts the inclusion mask.
  • Compound loss: foreground and background regional terms, a fusion term (MAE + normalized cross-correlation), total variation, and IoU.
Patch-based training. For the scarce phantom data, the network is trained on small spatio-temporal patches that are stitched back with a Tukey window. This gives many more samples from few acquisitions, and the phantom model is trained jointly with simulation data so every epoch sees real noise.
Data

Simulation, phantom and ex vivo data

Simulation pipeline: k-Wave generates the ARF and shear wave motion for the k-th region, Field II produces RF data from scatterers, noise of 25 to 35 dB is added, and the Loupas tracking algorithm yields the tracked shear wave.
Generating SWE data with k-Wave and Field II. Noise is added to the RF data before tracking so the network learns from realistic tracking errors.
Results

Reconstruction quality

Compared against DSWE-Net and the spatio-temporal CNN of Neidhardt et al. Y is the denoised output of the full pipeline.

Inclusion segmentation

Neidhardt et al. do not produce masks, so segmentation is compared with masks derived from DSWE-Net.

DataMethodIoU ↑F1 ↑HD ↓ASSD ↓
SimulationDSWE-Net (masks)0.6290.8617.531.39
Ours (M)0.8130.8926.181.18
CIRS 049DSWE-Net (masks)0.6670.35090.8676.95
Ours (M)0.7810.8736.400.86

Masks M come straight from the denoiser’s sigmoid output. CIRS 049 labels were hand-drawn from B-mode images, where some boundaries are indistinct, which lowers IoU for every method.

Ex vivo

Swine liver

On a fresh swine liver (single push, not seen in training), stiffness was measured inside a 16.4 mm × 8.1 mm box to the right of the push. Reported values for ex vivo swine liver range from 8.23 ± 2.38 to 9.13 ± 2.13 kPa. The denoised output Y gives 7.82 ± 0.59 kPa with the lowest spread; Neidhardt et al. overestimate, driven by noise more than 8 mm from the push, where shear waves attenuate in viscoelastic liver. DSWE-Net did not produce a usable result.

Estimate (inside box)Mean ± SD [kPa]Median [kPa]CV ↓
Neidhardt et al.11.11 ± 4.6311.020.42
Ours, primary (Y′)7.38 ± 0.986.840.13
Ours, denoised (Y)7.82 ± 0.597.660.08
B-mode image of the swine liver beside stiffness maps from Neidhardt et al., the primary reconstruction and the denoised output, with a dotted measurement box; Neidhardt et al. shows high noisy values on the right side.
B-mode (40 dB dynamic range) and stiffness maps. The dotted box marks the measurement region.
Box plot of liver stiffness: Neidhardt et al. has a wide spread with many outliers up to about 31 kPa; the primary and denoised outputs are compact around 7 to 8 kPa.
Distribution of stiffness estimates inside the box.
Qualitative

Reconstructions

Ablation

What each part contributes

On simulation data, six nested ConvLSTMs beat a single one, and adding the temporal attention module and FFT attention gives the best primary reconstruction. In the denoiser, the NCC fusion term (β2) and a moderate total-variation weight (γ = 10) both help; a heavier TV weight blurs the inclusion boundary.

VariantMAE ↓FG · kPaMAE ↓BG · kPaCNR ↑dBPSNR ↑dBSSIM ↑

κ: fusion weight; β2: NCC weight; γ: TV weight. Best value per block is highlighted.

Citation

BibTeX

@article{alam2026robust,
  title   = {Robust CNN Multi-Nested-LSTM Framework with Compound Loss for
             Patch-based Multi-Push Ultrasound Shear Wave Imaging and Segmentation},
  author  = {Alam, MD Jahin and Akash, Ahsan Habib and Bell, Muyinatu A. Lediju and
             Hasan, Md. Kamrul},
  journal = {Physics in Medicine \& Biology},
  year    = {2026}
}