Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NVP_7: NVP_5 w/ increased decoder complexity #42

Open
Micky774 opened this issue Mar 2, 2020 · 1 comment
Open

NVP_7: NVP_5 w/ increased decoder complexity #42

Micky774 opened this issue Mar 2, 2020 · 1 comment
Labels
appearance Appearance module Medium Priority model design Test model idea undergoing design

Comments

@Micky774
Copy link
Collaborator

Micky774 commented Mar 2, 2020

Add resnet blocks to NVP_5's decoder until it reaches ~5.4mil parameters (same as NVP_4). See #39

@Micky774
Copy link
Collaborator Author

Micky774 commented Mar 2, 2020

While designing a prototype NVP_7, I observed that our memory footprint goes from ~350MB to ~950MB. This translates into having to divide our operable batch-size by almost 3 and thus nearly tripling training costs in terms of gpu-hours. Hence, rather than comparable parameter count, we may want to aim for a comparable memory footprint when enhancing the decoder.

@magsol magsol modified the milestone: Hello World Milestone Mar 6, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
appearance Appearance module Medium Priority model design Test model idea undergoing design
Projects
None yet
Development

No branches or pull requests

2 participants