A Proximal Descent Method for Minimizing Weakly Convex Optimization
Feng-Yi Liao, Yang Zheng
- 发表年份
- 2025
- 访问权限
- 开放获取
摘要
We study the problem of minimizing a $m$-weakly convex and possibly nonsmooth function. Weak convexity provides a broad framework that subsumes convex, smooth, and many composite nonconvex functions. In this work, we propose a $\textit{proximal descent method}$, a simple and efficient first-order algorithm that combines the inexact proximal point method with classical convex bundle techniques. Our analysis establishes explicit non-asymptotic convergence rates in terms of $(η,ε)$-inexact stationarity. In particular, the method finds an $(η,ε)$-inexact stationary point using at most $\mathcal{O}\!\left( \Big(\tfrac{1}{η^2} + \tfrac{1}ε\Big) \max\!\left\{\tfrac{1}{η^2}, \tfrac{1}ε\right\} \right)$ function value and subgradient evaluations. Consequently, the algorithm also achieves the best-known complexity of $\mathcal{O}(1/δ^4)$ for finding an approximate Moreau stationary point with $\|\nabla f_{2m}(x)\|\leq δ$. A distinctive feature of our method is its \emph{automatic adaptivity}: with no parameter tuning or algorithmic modification, it accelerates to $\mathcal{O}(1/δ^2)$ complexity under smoothness and further achieves linear convergence under quadratic growth. Overall, this work bridges convex bundle methods and weakly convex optimization, while providing accelerated guarantees under structural assumptions.
关键词
相关论文
Statistical Learning Theory
Yuhai Wu, Vladimir Vapnik
1999
Fractional Differential Equations
Igor Podlubný
2025
Applied Nonlinear Control
Jean-Jacques Slotine, Weiping Li
1991
Genetic Programming: On the Programming of Computers by Means of Natural Selection
John R. Koza
1992