Skip to content

README.md

Latest commit

 

History

History
37 lines (33 loc) · 3.28 KB

README.md

File metadata and controls

37 lines (33 loc) · 3.28 KB

all-ai.cpp

Library of all 'local ai' projects specially ggml family. From local LLM to local Music Generation. So you can run everywhere!
I'm a big fan of running on-premise AI on every device I have at hand. From PCs and phones to smart watches, Arduino and ESP32 :)
And for such tasks, a huge and gramomatic python is often indispensable.
So I have collected for you a collection of all the projects built on the wonderful ggml lib for all platforms.
Feel free to supplement and send me pull requests about new tools and other cool stuff!

All Platforms (GGML)

  • llama.cpp LLM inference in C/C++ (LLMs, Compute Vision)
  • stable-diffusion.cpp Diffusion model inference in C/C++ (Image, Video, Editing)
  • whisper.cpp Port of OpenAI Whisper model in C/C++ (SpeachToText, voice activity detection)
  • TTS.cpp TTS inference in C/C++ (TextToSpeach)
  • qwen3-tts.cpp Qwen3 TTS model (TextToSpeach)
  • bark.cpp Sono bark speach model (TextToSpeach)
  • acestep.cpp ACE-Step 1.5 Music generation (Music generation)
  • bert.cpp Google BERT sentence analyzing (sentences)
  • vit.cpp Inference Vision Transformer (ViT) in C/C++ (More Vision)
  • minigpt4.cpp Port of MiniGPT4 in C++ (GPT LLMs)
  • clip.cpp Port of OpenAI CLIP model (semantic image search, image labeling)
  • demucs.cpp Separate music to bass, brums, vocal (music separation)
  • umx.cpp Music Demuxing implementation (Music demuxing)
  • rwkv.cpp RWKV language model
  • voxtral.cpp Mistral Voxtral ASR model (SpeachToText)
  • sam.cpp Meta Segment Anything Model in pure C/C++ (Segmets)
  • dinov2.cpp DINOv2 visual models in C/C++ (image/pixel visual tasks)

PC (Win/Linux)

  • koboldcpp KoboldCpp Big set of LLM, TTS, Image/Video gen and so on
  • lms LM Studio cli

Android

  • pocketpal Brings language models directly to your phone. (LLM, Vision)
  • AI Gallery Google gallery that showcases on-device ML/GenAI (ML, LLM, Vision, TTS, Interaction)
  • Stable-Diffusion-Android Stable Diffusion AI client app for Android (Gen Image, Edit)
  • local-dream Run Stable Diffusion on Android Devices with Snapdragon NPU acceleration (Gen Image, Edit)
  • ImageToolbox AI transforms for images and other usefull tools (rmbg, denoise, upsace, enhace, colorize, enhance, ...)