Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] AI/LLM integration #1325

Draft
wants to merge 122 commits into
base: develop
Choose a base branch
from
Draft

[WIP] AI/LLM integration #1325

wants to merge 122 commits into from

Conversation

perfectra1n
Copy link
Member

@perfectra1n perfectra1n commented Mar 3, 2025 •
edited
Loading

Status:
image

Goals:

  • Create vector embeddings and store in the SQLite DB
  • Create an "index" to provide as initial context to LLMs
  • Allow a user to "chat" with their notes
  • Allow the use of Anthropic (Claude), OpenAI (ChatGPT), or Ollama

@perfectra1n perfectra1n mentioned this pull request Mar 3, 2025
Closed
@eliandoran eliandoran marked this pull request as draft March 3, 2025 18:41
@eliandoran eliandoran mentioned this pull request Mar 8, 2025
Open
perfectra1n added 25 commits March 8, 2025 20:51
@perfectra1n
Merge branch 'develop' into ai-llm-integration
9f84a84
@perfectra1n
create embedding services
b248a7a
@perfectra1n
set up DB migrations
b97c8dd
@perfectra1n
set up embedding providers here?
1ff5bc6
@perfectra1n
add additional AI / LLM options and translations
c442943
@perfectra1n
set up embedding API endpoints
1361e4d
@perfectra1n
initialize embeddings if option is enabled
ea6f9c8
@perfectra1n
add additional options for ollama embeddings
d3013c9
@perfectra1n
fix the Ollama embedding model setting option breaking
553f7dd
@perfectra1n
update schema with our new tables
dc439b2
@perfectra1n
nearly able to process embeddings
6ace4d5
@perfectra1n
I can create embeddings now?
0daa9e7
@perfectra1n
Show embedding generation stats to user
0cd1be5
@perfectra1n
update embedding stats every 5s for user
1ca98e2
@perfectra1n
show fancier stats
51c83bb
@perfectra1n
fancier embedding process stats
19bf741
@perfectra1n
Create better relationships between notes, sanitize ridiculous spacin…
7e232d1 
…g to save tokens
@perfectra1n
update relationship weights
733fdcf
@perfectra1n
I'm 100% going to have to destroy this commit later
adaac46
@perfectra1n
try a context approach
cf0e924
@perfectra1n
it errors, but works
ef6ecdc
@perfectra1n
actually shows useful responses now
c1585c7
@perfectra1n
Make the sources section fancier
75e18e4
@perfectra1n
this is pretty close to opening a new tab?
bd97d97
@perfectra1n
when a user clicks on a source, don't swap focus
08626c7
@perfectra1n
Allow users to specify OpenAI embedding and chat models
4a4eac6
@perfectra1n
add anthropic options as well
c40c702
@perfectra1n
improve LLM response parsing
14acd1c
@perfectra1n
add additional options and provider sorting
7ee6cf6
@perfectra1n
add ability to fetch available models from openai
37f1dcd
@perfectra1n
improve embedding precedence
3268c43
@perfectra1n
add missing options
ebc5107
@perfectra1n
make the AI settings even fancier to setting precedence
43cf33c
@perfectra1n
draggable options for LLM provider too
ac40fff
@perfectra1n
openai finally works, respect embedding precedence
5ad730c
@perfectra1n
adapt or regenerate embeddings - allows users to decide
84a8473
@perfectra1n
add translations
558f6a9
@perfectra1n
add Voyage AI as Embedding provider
c372011
@perfectra1n
do a better job with similarity searches
08f7f19
@perfectra1n
set up embedding normalization
f05fe3f
@perfectra1n
oh my goodness, saving these settings finally works
8129f8f
@perfectra1n
stop the log spam
1a8ce96
@perfectra1n
set up agentic thinking
f6afb1d
@perfectra1n
clean up silly chat_widget that was in the wrong place
492c05b
@perfectra1n
add agentic thinking to chat
352204b
@perfectra1n
refactor "context" services
db4dd6d
@perfectra1n
yeet deprecated function
466b749
@perfectra1n
fix chat_service imports
d5efcfe
@perfectra1n
get rid of this unused file too
2348096
@perfectra1n
Merge branch 'develop' into ai-llm-integration
024b063
@perfectra1n
fix translation
5b81252
@perfectra1n
update agent tools
0d4b6a7
@perfectra1n
agent tools do something now
90db570
@perfectra1n
agentic thinking really works now 🗿
4ff3c5a
@perfectra1n
centralize all prompts
e566692
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
effort-high
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@perfectra1n @pano9000 @eliandoran