[Medical ML] CNN Architectures for Medical Imaging: From ResNet to EfficientNet

*By Oleh Ivchenko | February 8, 2026* Convolutional Neural Networks (CNNs) have fundamentally transformed medical image analysis, evolving from simple feature extractors to sophisticated architectures capable of matching or exceeding radiologist-level performance. This article provides a comprehensive technical deep-dive into the CNN architectures that power modern medical AI systems, examining their design principles, clinical applications, and performance characteristics. ## The Evolution of Medical Imaging CNNs The journey from basic convolution operations to today’s state-of-the-art architectures represents one of the most significant advances in computational medicine. Understanding this evolution is crucial for implementing effective diagnostic AI systems.

graph LR
    A[LeNet 1998] --> B[AlexNet 2012]
    B --> C[VGG ResNet 2014]
    C --> D[DenseNet 2016]
    D --> E[EfficientNet 2019]
    E --> F[Hybrid 2024]

## Core Architecture Families ### ResNet: The Residual Revolution ResNet (Residual Networks) introduced skip connections that allow gradients to flow directly through the network, enabling training of extremely deep architectures without vanishing gradient problems.

graph TD
    A[Input x] --> B[Conv Layer 1]
    B --> C[BatchNorm]
    C --> D[Conv Layer 2]
    A --> E[Skip Connection]
    E --> F[Add and Output]

**Mathematical Formulation:** For a traditional CNN layer: **H(x) = F(x)** For ResNet: **H(x) = F(x) + x** This simple modification has profound implications. The network learns the *residual* F(x) = H(x) – x, which is easier to optimize when the optimal mapping is close to identity. **Clinical Applications:** – **Pulmonary nodule detection:** ResNet-50 achieves 94.2% sensitivity in lung CT analysis – **Intracranial hemorrhage classification:** Deep ResNets excel at fine-grained CT detail extraction – **Bone fracture detection:** Residual connections preserve subtle skeletal features

ResNet Variant	Layers	Parameters	Top-1 Accuracy (ImageNet)	Medical Imaging Use Case
ResNet-18	18	11.7M	69.8%	Quick screening, mobile deployment
ResNet-34	34	21.8M	73.3%	Balanced performance/efficiency
ResNet-50	50	25.6M	76.1%	Most common medical imaging baseline
ResNet-101	101	44.5M	77.4%	Complex multi-class classification
ResNet-152	152	60.2M	78.3%	Research, maximum feature extraction

### DenseNet: Maximizing Feature Reuse DenseNet (Densely Connected Networks) takes connectivity to the extreme: each layer receives inputs from *all* preceding layers and passes its feature maps to *all* subsequent layers.

graph LR
    A[Layer 0] --> B[Layer 1]
    A --> C[Layer 2]
    A --> D[Layer 3]
    B --> C
    B --> D
    C --> D

**Key Innovation:** Feature concatenation instead of summation – ResNet: **H(x) = F(x) + x** (addition) – DenseNet: **H(x) = [x₀, x₁, …, xₗ₋₁]** (concatenation) This design provides: – **3× parameter reduction** compared to ResNet with equivalent performance – **Improved gradient flow** through direct connections – **Feature reuse** reducing redundancy – **Implicit deep supervision** from multiple paths **CheXNet Breakthrough:** DenseNet-121 trained on 112,120 chest X-rays achieved radiologist-level performance in pneumonia detection, demonstrating the architecture’s effectiveness for medical imaging.

Medical Application	DenseNet Variant	Performance (AUC)	Dataset
Chest X-ray multi-label	DenseNet-121	0.841	ChestX-ray14
Pancreatic cyst classification	DenseNet-169	0.89	Institutional CT
Thymoma staging	DenseNet-201	0.92	Masaoka-Koga
COVID-19 detection	DenseNet-121	0.96	COVIDx CT

### Inception: Multi-Scale Feature Extraction The Inception architecture captures information at multiple scales simultaneously by applying different filter sizes in parallel within each module.

graph TD
    A[Previous Layer] --> B[1x1 Conv]
    A --> C[3x3 Conv]
    A --> D[5x5 Conv]
    A --> E[Ma[REDACTED]ol]
    B --> F[Concatenate]
    C --> F

**Design Principles:** 1. **Multi-scale processing:** Parallel convolutions with 1×1, 3×3, and 5×5 filters 2. **Dimensionality reduction:** 1×1 convolutions before larger filters reduce computation 3. **Sparse connections:** Computationally efficient approximation of optimal sparse structure **Evolution:** – **Inception v1 (GoogLeNet):** Original architecture, 22 layers – **Inception v2/v3:** Batch normalization, factorized convolutions – **Inception v4:** Streamlined design, uniform reduction blocks – **Inception-ResNet:** Combines Inception modules with residual connections **Medical Imaging Applications:** – Lung cancer staging (multi-scale tumor features) – Kidney cancer classification (varied lesion sizes) – Osteomeatal complex inflammation detection ### EfficientNet: Optimal Scaling EfficientNet revolutionizes architecture design by introducing *compound scaling* — simultaneously scaling network depth, width, and resolution using a principled approach.

graph LR
    A[Base Model] --> B[Compound Scaling]
    B --> C[Depth]
    B --> D[Width]
    B --> E[Resolution]
    E --> F[Scaled Model]

**Compound Scaling Formula:** – depth: d = α^φ – width: w = β^φ – resolution: r = γ^φ Where α · β² · γ² ≈ 2 (resource constraint) and φ controls overall scaling.

Model	Input Size	Parameters	FLOPs	Top-1 Acc
EfficientNet-B0	224×224	5.3M	0.39B	77.1%
EfficientNet-B3	300×300	12M	1.8B	81.6%
EfficientNet-B4	380×380	19M	4.2B	82.9%
EfficientNet-B7	600×600	66M	37B	84.3%

**Medical Imaging Advantages:** – **Optimal resource utilization:** Best accuracy-per-FLOP ratio – **Scalable deployment:** B0 for edge devices, B7 for research – **Small lesion detection:** Higher resolution variants excel at subtle findings ### MobileNet: Edge Deployment MobileNet enables deployment of medical AI on resource-constrained devices through depthwise separable convolutions.

graph TD
    A[Input Image] --> B[Depthwise Conv]
    B --> C[Pointwise Conv]
    C --> D[Output Features]
    D --> E[Classification]

**Computational Savings:** Standard convolution cost: **DK² × M × N × DF²** Depthwise separable cost: **DK² × M × DF² + M × N × DF²** Reduction ratio: **1/N + 1/DK²** (typically 8-9× fewer operations) **Mobile Medical AI Applications:** – Point-of-care skin lesion screening – Portable ultrasound analysis – Field-deployable chest X-ray triage ## Attention Mechanisms in Medical CNNs ### Squeeze-and-Excitation Networks (SE-Net) SE-Net introduces channel attention by explicitly modeling interdependencies between channels, allowing the network to emphasize informative features.

graph LR
    A[Feature Map] --> B[Global Pool]
    B --> C[FC Layers]
    C --> D[Sigmoid]
    D --> E[Scale Features]
    E --> F[Output]

**Clinical Impact:** – **Pulmonary nodule detection:** SE-ResNet achieves 12% sensitivity improvement – **Spatial attention focus:** Concentrates on discriminative anatomical regions – **3D extension:** SE-3D networks for volumetric CT/MRI analysis ### Convolutional Block Attention Module (CBAM) CBAM applies both channel and spatial attention sequentially, providing comprehensive feature refinement.

graph LR
    A[Input F] --> B[Channel Attention]
    B --> C[Refined F]
    C --> D[Spatial Attention]
    D --> E[Output F]

## U-Net: The Segmentation Standard While not strictly a classification architecture, U-Net deserves special mention for its dominance in medical image segmentation tasks.

graph TD
    A[Encoder 64] --> B[Encoder 128]
    B --> C[Encoder 256]
    C --> D[Bottom 512]
    D --> E[Decoder 256]
    E --> F[Decoder 128]

**U-Net Variants for Medical Imaging:**

Variant	Key Innovation	Application
3D U-Net	Volumetric convolutions	CT/MRI organ segmentation
Attention U-Net	Attention gates in skip connections	Improved boundary detection
U-Net++	Nested dense skip pathways	Multi-scale feature fusion
nnU-Net	Self-configuring framework	Automatic architecture selection
TransUNet	Transformer encoder + U-Net decoder	Long-range dependency modeling

## Performance Benchmarks on Medical Datasets ### MedMNIST Benchmark Results (2024-2025)

Architecture	DermaMNIST	BloodMNIST	PathMNIST	OrganAMNIST	Avg AUC
ResNet-18	0.912	0.987	0.978	0.996	0.968
ResNet-50	0.917	0.991	0.982	0.997	0.972
DenseNet-121	0.921	0.993	0.985	0.998	0.974
EfficientNet-B0	0.915	0.989	0.980	0.996	0.970
EfficientNet-B4	0.928	0.994	0.988	0.998	0.977
VGG-16	0.909	0.985	0.976	0.995	0.966
MedNet (2025)	0.932	0.995	0.989	0.998	0.979

**Key Finding (2025):** CNNs, particularly DenseNet-121 and VGG-16, consistently outperform Vision Transformers in end-to-end training on medical imaging datasets when sufficient data is available, highlighting the continued relevance of CNN architectures. ## Architecture Selection Guide

graph TD
    A[Select Architecture] --> B{Deploy Target}
    B --> C[Cloud Server]
    B --> D[Mobile Edge]
    C --> E[ResNet DenseNet]
    D --> F[MobileNet EfficientNet]

## Practical Recommendations for Clinical Implementation ### For Routine Clinical Use **Recommended:** Xception, MobileNet, EfficientNet-B0/B1 – Optimal accuracy-efficiency tradeoff – Real-time inference capability – Edge deployment feasible ### For Spatial Discrimination Tasks **Recommended:** SE-Net, Inception-ResNet, CBAM-enhanced models – Lung nodule localization – Hemorrhage detection – Tumor boundary delineation ### For Multi-Structure Classification **Recommended:** DenseNet, ResNet ensembles – Robust feature extraction – Multiple pathology detection – Large-scale screening programs ### For Research and Maximum Performance **Recommended:** EfficientNet-B4+, ResNet-152 – State-of-the-art accuracy – Comprehensive feature l[REDACTED]g – Publication-grade results ## Conclusion The landscape of CNN architectures for medical imaging continues to evolve rapidly. While newer transformer-based approaches show promise, CNNs remain the backbone of clinical AI deployment due to their: – **Proven clinical efficacy** across multiple FDA-approved devices – **Computational efficiency** enabling real-time inference – **Interpretability** through established visualization techniques – **Transfer l[REDACTED]g capability** with extensive pretrained weights For Ukrainian healthcare implementations, the path forward involves: 1. Starting with established architectures (ResNet-50, DenseNet-121) 2. Applying transfer l[REDACTED]g from ImageNet or RadImageNet 3. Fine-tuning with local patient demographics 4. Deploying lightweight variants for point-of-care applications The next article in this series will explore Vision Transformers in Radiology, examining how attention mechanisms are pushing the boundaries of medical image analysis. ## References 1. He K., et al. “Deep residual l[REDACTED]g for image recognition.” CVPR 2016. 2. Huang G., et al. “Densely connected convolutional networks.” CVPR 2017. 3. Tan M., Le Q.V. “EfficientNet: Rethinking model scaling for convolutional neural networks.” ICML 2019. 4. Szegedy C., et al. “Going deeper with convolutions.” CVPR 2015. 5. Hu J., et al. “Squeeze-and-excitation networks.” CVPR 2018. 6. Woo S., et al. “CBAM: Convolutional block attention module.” ECCV 2018. 7. Ronneberger O., et al. “U-Net: Convolutional networks for biomedical image segmentation.” MICCAI 2015. 8. Howard A.G., et al. “MobileNets: Efficient convolutional neural networks for mobile vision applications.” arXiv 2017. 9. “MedNet: A lightweight attention-augmented CNN for medical image classification.” Scientific Reports 2025. 10. “Deep l[REDACTED]g models for CT image classification: A comprehensive literature review.” PMC 2025. 11. “A review of convolutional neural network based methods for medical image classification.” Computers in Biology and Medicine 2024. 12. “MedMNIST v2: A large-scale lightweight benchmark for 2D and 3D biomedical image classification.” Scientific Data 2023.