-
Notifications
You must be signed in to change notification settings - Fork 1
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
c728658
commit a336a0b
Showing
3 changed files
with
54 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,54 @@ | ||
# workshop-llm | ||
Workshop to create a RAG application to use LLM models. This workshop is developed in Python using Jupyter Notebook connected using the official libraries to IRIS. | ||
|
||
You can find more in-depth information in https://learning.intersystems.com. | ||
|
||
|
||
# What do you need to install? | ||
* [Git](https://git-scm.com/downloads) | ||
* [Docker](https://www.docker.com/products/docker-desktop) (if you are using Windows, make sure you set your Docker installation to use "Linux containers"). | ||
* [Docker Compose](https://docs.docker.com/compose/install/) | ||
* [Visual Studio Code](https://code.visualstudio.com/download) + [InterSystems ObjectScript VSCode Extension](https://marketplace.visualstudio.com/items?itemName=daimor.vscode-objectscript) | ||
|
||
# Setup | ||
Build the image we will use during the workshop: | ||
|
||
```console | ||
$ git clone https://github.com/intersystems-ib/workshop-llm | ||
$ cd workshop-llm | ||
$ docker-compose build | ||
``` | ||
|
||
# Configuration | ||
|
||
The main purpose of this example is to identify the main steps to create a RAG application using MISTRAL as LLM and IRIS as vector database to save and search the specific context. | ||
|
||
## **ATTENTION** Docker configuration | ||
|
||
There is a known issue related to the permission request from Docker Desktop to access to the folders of the project, this permission has to be granted before to launch **docker-compose up -d**. To allow the file sharing in Docker Desktop you have to open settings option, select **Resources** and **File Sharing**, from that screen you have to include the path to the project, you can see here an example: | ||
 | ||
|
||
If you don't share this folder previously PostgreSQL database won't be initialized and the project will fail. | ||
|
||
## Test Production | ||
* Run the containers that we will use in the workshop: | ||
``` | ||
docker-compose build | ||
docker-compose up -d | ||
``` | ||
Automatically an IRIS instance, will be deployed, a Jupyter Notebook is deployed under (http://localhost:8888) too. | ||
|
||
## IRIS database | ||
|
||
* Open the [Management Portal](http://localhost:52774/csp/sys/UtilHome.csp). | ||
* Login using the default `superuser`/ `SYS` account. | ||
* Open System Explorer --> SQL | ||
* Select NAMESPACE USER and Schema `Test` | ||
|
||
# Testing with Jupyter Notebook | ||
|
||
This project is devolped in Python using Jupyter Notebook, you can access to it from [here](http://localhost:8888) and open LLMTests.ipnyb file. | ||
 | ||
|
||
You can test the project step by step or execute it at one time, feel free. |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.