Skip to content

Error: Server disconnected without sending a response. #2

@fahmifahmi11

Description

@fahmifahmi11

Microsoft Windows [Version 10.0.19045.5854]
(c) Microsoft Corporation. All rights reserved.

C:\pinokio\api\ChatterCraft-Pinokio.git\app>conda_hook && conda deactivate && conda deactivate && conda deactivate && conda activate base && C:\pinokio\api\ChatterCraft-Pinokio.
git\app\env\Scripts\activate C:\pinokio\api\ChatterCraft-Pinokio.git\app\env && python app.py

NLTK 'punkt' data found.
Using device: cuda
Initializing ChatterCraft AI...
[DEBUG: Creating StoryCraftChatterboxApp instance]
TTS Optimal Device: CUDA
All TTS model files found.
Loading Chatterbox TTS model on TTS device: cuda...
loaded PerthNet (Implicit) at step 250,000
Chatterbox TTS model loaded. Performing a test generation...
LlamaModel is using LlamaSdpaAttention, but torch.nn.functional.scaled_dot_product_attention does not support output_attentions=True. Falling back to the manual attention im
plementation, but specifying the manual implementation will be required from Transformers version v5.0.0 onwards. This warning can be removed using the argument attn_implementa tion="eager" when loading the model.
Sampling: 0%| | 0/1000 [00:00<?, ?it/s]W
e detected that you are passing past_key_values as a tuple of tuples. This is deprecated and will be removed in v4.47. Please convert your cache or use an appropriate Cache
class (https://huggingface.co/docs/transformers/kv_cache#legacy-cache-format)
Sampling: 5%|██████▏ | 49/1000 [00:03<01:08, 13.98it/s]
Chatterbox TTS model test generation successful. Audio shape: torch.Size([1, 47040])
[DEBUG: Creating Gradio interface]

Starting interface...
Local URL: http://localhost:7861

[DEBUG: Launching Gradio interface on port 7861]

  • Running on local URL: http://0.0.0.0:7861
    Error: Server disconnected without sending a response.
    [DEBUG: Cleaning up app instance]
    Cleaning up resources...
    TTS model unloaded.
    No LLM model currently loaded to unload.
    Cleared PyTorch CUDA cache during cleanup.
    Cleanup finished.

(env) (base) C:\pinokio\api\ChatterCraft-Pinokio.git\app>

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions