Published research · ICML 2026
Understanding when—and why—optimization methods fail
- Research question
- Why do scientific ML models fail under different training conditions, and which optimization methods help in each regime?
- Key finding
- Across the SciML models studied, we identify three distinct training regimes. Optimization effectiveness depends on the regime: no single method performs well across all three.
- My contribution
- As a co-first author, I investigated failure modes, implemented second-order optimization pipelines in PyTorch, and built reproducible Slurm workflows for ablation studies and model behavior analysis.
Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization
Y. Wang*, Y. Hu*, X. Zhong* et al.
* Equal contribution