Differentially Private Nonparametric Modal Learning with Applications to Regression and Clustering
Preprint, submitted to Journal of Machine Learning Research, 2026
Abstract
Existing private methods for estimating density modes mainly recover a single mode, while recovering all modes requires searches from multiple starting locations that can themselves reveal information about individual records. We propose DP-GRAMS, a differentially private algorithm that selects starting locations with a density-aware initialization on a public grid, moves each toward higher estimated density, and groups the endpoints into estimated modes, all within a single privacy budget. We prove that DP-GRAMS satisfies differential privacy and recovers every population mode with high probability, with error bounds that separate statistical error from the cost of privacy and a lower bound showing these rates are nearly optimal. We extend the method to modal regression and clustering and show that it preserves tumor-type separation in cancer gene-expression data.
Recommended citation: Bhattacharjee, A., & Auddy, A. (2026). Differentially Private Nonparametric Modal Learning with Applications to Regression and Clustering. arXiv:2607.29675. https://arxiv.org/abs/2607.29675
