Adds fast gradient clipping support for the Embedding layer.#694

Closed

pagarwl wants to merge 4 commits intopytorch:mainfrom pagarwl:main

+547-2

Commits on Dec 9, 2024

Adds fast gradient norm calculation for the embedding layer. The algorithm is described in the 'A Unified Fast Gradient Clipping Framework for DP-SGD' paper: https://proceedings.neurips.cc/paper_fi…
pagarwl
committed

Commits on Jan 12, 2025

Incorporate code review feedback on PR pytorch#694
pagarwl
committed

Commits on Feb 3, 2025

Fix isort issue in PR pytorch#694
pagarwl
committed

Commits on Feb 11, 2025

Merge branch 'pytorch:main' into main
pagarwl
authored