Fine-Tuning on Private Data: Differential Privacy with Opacus and Federated LoRA in PyTorch
September 28, 2026 · IntelliSensei Team
Regulated data blocks most enterprise fine-tuning projects. Here is how DP-SGD with Opacus and federated LoRA actually work in PyTorch: threat models, DP-LoRA configuration, the hyperparameters that invert, FedAvg aggregation, and the accuracy you should expect to pay.
Read more