Closed
Description
🐛 Bug
I am trying to implement augmentation multiplicity (as implemented in Paper 1 and Paper 2 ) using Opacus's new functionality of functorch. I am following the exact steps as pointed out by @alexandresablayrolles in #455 and #575.
However, I am facing a bug in the predictions = fmodel(params, batch)
line where it says that AttributeError: 'Tensor' object has no attribute '_forward_counter'
. My intuition is that the attribute _forward_counter should be added to the model while calling make_functional()
but there has been some code change which might be causing this.
Any help is appreciated. Thanks!
Colab reproducible link
To Reproduce
Steps to reproduce the behavior:
- Open colab link
- Run until the end till the train() function cell
- The bug line has been pointed out in comments
Expected behavior
I would expect the forward function to work with the new functorch functionality.
Metadata
Metadata
Assignees
Labels
No labels