Backend Server

Starting/Stopping LibreChat

1. Connect to ehsdttlp30 using your ssh tool of choice.
2. Navigate to the ToxPipe LibreChat directory: cd /toxpipe/LibreChat
3. Use docker compose up to run the Docker containers needed for ToxPipe. Add the -d flag at the end to run in detached mode. Use docker compose down to stop all Docker containers needed for ToxPipe. You can use docker compose up/down <container name> to start/stop a single container.

• Configuration for the Docker containers is found in /toxpipe/LibreChat/docker-compose.yml and /toxpipe/LibreChat/docker-compose.override.yml.

Models

Adding new models

Regardless of the host of the model to be added, you will need to navigate to the ToxPipe LibreChat folder on the GPU server following these steps:

1. Connect to ehsdttlp30 using your ssh tool of choice.
2. Navigate to the ToxPipe LibreChat directory: cd /toxpipe/LibreChat

From Azure

1. Sign into an AWS account with administrative permissions: https://us-east-1.console.aws.amazon.com/console/home?region=us-east-1.

From AWS

From Google Cloud

From Ollama