You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I start the cpu version docker as my machine has run low on GPU memory, but dify always reports the timeout error, only the small file like 4k or so can work. I have increased the TEXT_GENERATION_TIMEOUT_MS setting in dify but I still got the error
I switch to Xinference and it works fine. So I guess the problem is either in dify tei plugin or tei itself.
I also wrote a python script to test the my tei server directly, but for a 60k md file, I will always get one or two chunk fails to embedding. So how do I debug the issue.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I start the cpu version docker as my machine has run low on GPU memory, but dify always reports the timeout error, only the small file like 4k or so can work. I have increased the TEXT_GENERATION_TIMEOUT_MS setting in dify but I still got the error
I switch to Xinference and it works fine. So I guess the problem is either in dify tei plugin or tei itself.
I also wrote a python script to test the my tei server directly, but for a 60k md file, I will always get one or two chunk fails to embedding. So how do I debug the issue.
Thanks.
Beta Was this translation helpful? Give feedback.
All reactions