Adding Vae Decoder in Wan #688
Conversation
Signed-off-by: Mohit Soni <[email protected]>
mohiso22
requested review from
ochougul,
quic-amitraj,
quic-hemagnih and
quic-rishinr
as code owners
| ) | ||
|
|
||
| if self.vae_decoder.qpc_session is None: | ||
| self.vae_decoder.qpc_session = QAICInferenceSession( |
There was a problem hiding this comment.
nit: will this be reusing the same set of device_ids post DIT is done?
There was a problem hiding this comment.
Put the qpc loading as well here, refer flux pipeline.
There was a problem hiding this comment.
Not yet, will update it now
| specializations (List[Dict]): Model specialization configurations | ||
| **compiler_options: Additional compiler options | ||
| """ | ||
| self._compile(specializations=specializations, **compiler_options) |
There was a problem hiding this comment.
nit: currently "-aic-hmx-conv3d" flag is part of the assert-sdk, this will soon be in the release sdk and we should enable it by default once it's in.
| ) | ||
|
|
||
| if self.vae_decoder.qpc_session is None: | ||
| self.vae_decoder.qpc_session = QAICInferenceSession( |
There was a problem hiding this comment.
Put the qpc loading as well here, refer flux pipeline.
|
Refer flux pipeline for the changes and removed not needed class. |
| }, | ||
| ] | ||
| ], | ||
| "vae_decoder": [ |
There was a problem hiding this comment.
there was some error without this, so temporary did list by default
|
To handle two different types of
Later inside init of pipeline map with the desired method with |
update flux init as well to reflect this changes. |
Signed-off-by: Mohit Soni <[email protected]>
Signed-off-by: Mohit Soni <[email protected]>
Signed-off-by: Mohit Soni <[email protected]>
3 participants
No description provided.