You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
While designing a prototype NVP_7, I observed that our memory footprint goes from ~350MB to ~950MB. This translates into having to divide our operable batch-size by almost 3 and thus nearly tripling training costs in terms of gpu-hours. Hence, rather than comparable parameter count, we may want to aim for a comparable memory footprint when enhancing the decoder.
Add resnet blocks to NVP_5's decoder until it reaches ~5.4mil parameters (same as NVP_4). See #39
The text was updated successfully, but these errors were encountered: