Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
346 commits
Select commit Hold shift + click to select a range
5df1501
Merge pull request #605 from nobodywho-ooo/android-build
MarcusDunn Jan 2, 2025
9b6bccb
Merge pull request #610 from utilityai/dependabot/cargo/cc-1.2.6
MarcusDunn Jan 2, 2025
93a4723
Bump version to 0.1.87 [skip ci]
actions-user Jan 3, 2025
a103be6
Merge pull request #612 from utilityai/version-bump-0.1.87
MarcusDunn Jan 3, 2025
38bb1c1
fix shared libs not found on windows #583
xutianyi1999 Jan 7, 2025
c3ad99b
chore(deps): bump docker/setup-qemu-action from 3.2.0 to 3.3.0
dependabot[bot] Jan 13, 2025
09ddb60
chore(deps): bump clap from 4.5.23 to 4.5.26
dependabot[bot] Jan 13, 2025
e1f49db
chore(deps): bump cc from 1.2.6 to 1.2.9
dependabot[bot] Jan 13, 2025
99dcef0
Merge pull request #615 from utilityai/dependabot/github_actions/dock…
MarcusDunn Jan 15, 2025
d260c48
Merge pull request #617 from utilityai/dependabot/cargo/cc-1.2.9
MarcusDunn Jan 15, 2025
6d0a361
Merge pull request #616 from utilityai/dependabot/cargo/clap-4.5.26
MarcusDunn Jan 15, 2025
edb812f
Merge pull request #614 from xutianyi1999/main
MarcusDunn Jan 15, 2025
276d165
Bump version to 0.1.88 [skip ci]
actions-user Jan 15, 2025
a5eaa70
Merge pull request #618 from utilityai/version-bump-0.1.88
MarcusDunn Jan 15, 2025
6cfcc22
chore(deps): bump enumflags2 from 0.7.10 to 0.7.11
dependabot[bot] Jan 20, 2025
badfe32
chore(deps): bump cc from 1.2.9 to 1.2.10
dependabot[bot] Jan 20, 2025
5a77fb7
Merge pull request #620 from utilityai/dependabot/cargo/cc-1.2.10
MarcusDunn Jan 20, 2025
904fbda
Merge pull request #619 from utilityai/dependabot/cargo/enumflags2-0.…
MarcusDunn Jan 20, 2025
29ae7fe
Bump version to 0.1.89 [skip ci]
actions-user Jan 20, 2025
6942e13
Update llama.cpp to latest version
nkoppel Jan 21, 2025
5dacedf
Resolve all clippy lints
nkoppel Jan 21, 2025
8d87ea6
Merge pull request #621 from utilityai/version-bump-0.1.89
MarcusDunn Jan 22, 2025
00f3bcb
Merge pull request #622 from nkoppel/update-llama-cpp
MarcusDunn Jan 22, 2025
7914de3
Bump version to 0.1.90 [skip ci]
actions-user Jan 22, 2025
5f49768
Merge pull request #623 from utilityai/version-bump-0.1.90
MarcusDunn Jan 22, 2025
02e8cb6
chore(deps): bump clap from 4.5.26 to 4.5.27
dependabot[bot] Jan 27, 2025
8955801
Merge pull request #625 from utilityai/dependabot/cargo/clap-4.5.27
MarcusDunn Jan 27, 2025
379b7bb
Bump version to 0.1.91 [skip ci]
actions-user Jan 27, 2025
68178db
Merge pull request #627 from utilityai/version-bump-0.1.91
MarcusDunn Jan 27, 2025
69d1fcf
Use FFI types directly instead of maintaining own c_char definition
vlovich Jan 29, 2025
e93e6be
Disable OpenMP on Android builds
vlovich Jan 29, 2025
73b2e07
Fix support for non-aarch64 systems
vlovich Jan 29, 2025
093115e
Link against dynamic C++ stdlib on Android by default.
vlovich Jan 29, 2025
9b54cac
Merge pull request #629 from vlovich/fix-android-build
MarcusDunn Jan 30, 2025
6edd962
Bump version to 0.1.92 [skip ci]
actions-user Jan 30, 2025
ef17b3d
Merge pull request #630 from utilityai/version-bump-0.1.92
MarcusDunn Jan 30, 2025
32628f1
Weird hack
vlovich Jan 31, 2025
90138e3
chore(deps): bump cc from 1.2.10 to 1.2.11
dependabot[bot] Feb 3, 2025
9e08188
chore(deps): bump cmake from 0.1.52 to 0.1.53
dependabot[bot] Feb 3, 2025
3c34943
chore(deps): bump openssl from 0.10.66 to 0.10.70
dependabot[bot] Feb 3, 2025
a58806a
Merge pull request #635 from utilityai/dependabot/cargo/openssl-0.10.70
MarcusDunn Feb 3, 2025
a956dad
Merge pull request #634 from utilityai/dependabot/cargo/cmake-0.1.53
MarcusDunn Feb 3, 2025
f35ccf7
Merge pull request #633 from utilityai/dependabot/cargo/cc-1.2.11
MarcusDunn Feb 3, 2025
3243683
Merge pull request #632 from vlovich/fix-windows-builds
MarcusDunn Feb 3, 2025
adab86a
Update README.md
MarcusDunn Feb 3, 2025
774626e
Bump version to 0.1.93 [skip ci]
actions-user Feb 3, 2025
8fc28b3
Merge pull request #636 from utilityai/version-bump-0.1.93
MarcusDunn Feb 4, 2025
2590bb6
Rebuild if llama.cpp build environment changes
vlovich Feb 4, 2025
6c2df25
Rebuild if llama.cpp source changes / minor build speedup
vlovich Feb 4, 2025
373f8c6
Redirect llama.cpp logs into tracing module.
vlovich Feb 4, 2025
773d2c0
Merge pull request #637 from vlovich/logging-intercept
MarcusDunn Feb 5, 2025
d789cac
undid making initialized_logits public
srv1n Feb 6, 2025
73a346c
Merge pull request #598 from srv1n/add-reranker-example
MarcusDunn Feb 6, 2025
fab2b9e
more reliable target directory estimation
peterwilli Feb 7, 2025
dec1651
Merge pull request #638 from ISAWarden/fix/improved-target-directory-…
MarcusDunn Feb 7, 2025
e59301b
Exclude generated build.cpp
vlovich Feb 10, 2025
a527297
Fix packaging problem
vlovich Feb 10, 2025
d89c4f2
chore(deps): bump docker/setup-buildx-action from 3.8.0 to 3.9.0
dependabot[bot] Feb 10, 2025
201f67a
chore(deps): bump docker/setup-qemu-action from 3.3.0 to 3.4.0
dependabot[bot] Feb 10, 2025
2e8265a
chore(deps): bump cmake from 0.1.53 to 0.1.54
dependabot[bot] Feb 10, 2025
5f7f14e
chore(deps): bump cc from 1.2.11 to 1.2.13
dependabot[bot] Feb 10, 2025
cbae562
Merge pull request #639 from vlovich/fix-packaging
MarcusDunn Feb 10, 2025
8cb8cd9
Merge pull request #642 from utilityai/dependabot/github_actions/dock…
MarcusDunn Feb 10, 2025
0e21c26
Merge pull request #643 from utilityai/dependabot/github_actions/dock…
MarcusDunn Feb 10, 2025
493e756
Merge pull request #644 from utilityai/dependabot/cargo/cmake-0.1.54
MarcusDunn Feb 10, 2025
8bc2fa6
Merge pull request #646 from utilityai/dependabot/cargo/cc-1.2.13
MarcusDunn Feb 10, 2025
b866663
chore(deps): bump clap from 4.5.27 to 4.5.28
dependabot[bot] Feb 10, 2025
c2dc99b
Merge pull request #645 from utilityai/dependabot/cargo/clap-4.5.28
MarcusDunn Feb 10, 2025
f600bf8
Fix llama.cpp build dirtying src and breaking packaging
vlovich Feb 10, 2025
0ee4e5a
Merge pull request #647 from vlovich/fix-packaging
MarcusDunn Feb 10, 2025
7326d32
Bump version to 0.1.94 [skip ci]
actions-user Feb 10, 2025
04e9e31
Merge pull request #648 from utilityai/version-bump-0.1.94
MarcusDunn Feb 10, 2025
7a29ac4
Cleanup chat template API
vlovich Feb 13, 2025
72c1255
Run cargo fmt on project
vlovich Feb 13, 2025
251b97e
Pure refactor - cleanup build script
vlovich Feb 13, 2025
5a4dbd4
Fix CPU inference performance when building MSVC Rust debug
vlovich Feb 13, 2025
5c8e81b
Merge pull request #651 from vlovich/fix-cpu-performance-debug-builds
MarcusDunn Feb 14, 2025
00f4163
Merge pull request #650 from vlovich/fix-chat-template
MarcusDunn Feb 14, 2025
1039ca3
Bump version to 0.1.95 [skip ci]
actions-user Feb 14, 2025
1b10ea0
Merge pull request #652 from utilityai/version-bump-0.1.95
MarcusDunn Feb 14, 2025
b808a68
Fast forward to https://github.com/ggerganov/llama.cpp/commit/300907b…
babichjacob Feb 14, 2025
7ba0b95
Fix the build crashing if target/ and src folders are on different disks
vlovich Feb 14, 2025
a2fe9a8
Merge pull request #655 from vlovich/fix-build
MarcusDunn Feb 15, 2025
e43b013
Merge pull request #654 from babichjacob/fast-forward-to-300907b
MarcusDunn Feb 15, 2025
6f3e3ec
Bump version to 0.1.96 [skip ci]
actions-user Feb 15, 2025
1a2742e
Merge pull request #657 from utilityai/version-bump-0.1.96
MarcusDunn Feb 15, 2025
c955583
Fix Android build
vlovich Feb 15, 2025
ecfcff1
Merge pull request #658 from vlovich/fix-android-build
MarcusDunn Feb 15, 2025
146c17d
Bump version to 0.1.97 [skip ci]
actions-user Feb 15, 2025
61543c7
Merge pull request #659 from utilityai/version-bump-0.1.97
MarcusDunn Feb 16, 2025
806b59e
chore(deps): bump clap from 4.5.28 to 4.5.29
dependabot[bot] Feb 17, 2025
868b243
chore(deps): bump cc from 1.2.13 to 1.2.14
dependabot[bot] Feb 17, 2025
2fec438
Merge pull request #662 from utilityai/dependabot/cargo/cc-1.2.14
MarcusDunn Feb 17, 2025
f4b9657
Merge pull request #661 from utilityai/dependabot/cargo/clap-4.5.29
MarcusDunn Feb 17, 2025
f321166
Add Logit Bias Sampler
nhaghighat Feb 20, 2025
1f83d19
Move logit_bias.rs to the correct location
nhaghighat Feb 20, 2025
e9b0bd7
Expose a bunch of information about the model
vlovich Feb 21, 2025
899c217
Expose additional information about the initialized backend
vlovich Feb 21, 2025
2560b35
Merge pull request #665 from nhaghighat/add_logit_bias_sampler
MarcusDunn Feb 21, 2025
3dca53f
Bump version to 0.1.98 [skip ci]
actions-user Feb 21, 2025
6b4e52c
Merge pull request #669 from utilityai/version-bump-0.1.98
MarcusDunn Feb 21, 2025
8b11c5c
Merge pull request #666 from vlovich/informational-methods
MarcusDunn Feb 21, 2025
30df407
Bump version to 0.1.99 [skip ci]
actions-user Feb 21, 2025
dabcb10
Add grammar_lazy sampler
nhaghighat Feb 22, 2025
c1e17d7
Add top_n_sigma sampler
nhaghighat Feb 22, 2025
71a8e22
Add reset sampler
nhaghighat Feb 22, 2025
914bce3
Add get_seed method
nhaghighat Feb 22, 2025
75de250
Create LISENCE-MIT
MarcusDunn Feb 24, 2025
1698d45
Create LICENSE-APACHE
MarcusDunn Feb 24, 2025
465f352
Merge pull request #678 from utilityai/LISENCE
MarcusDunn Feb 24, 2025
39223df
Merge pull request #670 from utilityai/version-bump-0.1.99
MarcusDunn Feb 24, 2025
97147ab
chore(deps): bump clap from 4.5.29 to 4.5.31
dependabot[bot] Feb 24, 2025
93a7644
chore(deps): bump cc from 1.2.14 to 1.2.15
dependabot[bot] Feb 24, 2025
f750a29
Merge pull request #679 from utilityai/dependabot/cargo/clap-4.5.31
MarcusDunn Feb 24, 2025
8624b3f
Merge pull request #675 from utilityai/dependabot/cargo/cc-1.2.15
MarcusDunn Feb 24, 2025
2031385
chore(deps): bump anyhow from 1.0.95 to 1.0.96
dependabot[bot] Feb 24, 2025
3997277
Bump version to 0.1.100 [skip ci]
actions-user Feb 24, 2025
d5a5645
Merge pull request #672 from nhaghighat/feature/add-samplers-and-life…
MarcusDunn Feb 24, 2025
ea77526
Merge pull request #680 from utilityai/version-bump-0.1.100
MarcusDunn Feb 24, 2025
7fac5a4
Merge pull request #674 from utilityai/dependabot/cargo/anyhow-1.0.96
MarcusDunn Feb 24, 2025
2946b7f
Bump version to 0.1.101 [skip ci]
actions-user Feb 24, 2025
7a53f90
Merge pull request #681 from utilityai/version-bump-0.1.101
MarcusDunn Feb 24, 2025
b30abeb
explicitly apply optimization flags to msvc compiler also on other pr…
AsbjornOlling Feb 25, 2025
1d49ebf
use CString::new instead of Cstring::from_Str to init chat template
AsbjornOlling Feb 25, 2025
8301d63
Merge pull request #682 from nobodywho-ooo/fix-msvc-flags-release-pro…
MarcusDunn Feb 25, 2025
cfa76bd
Don't imply dynamic llama.cpp just because CUDA is on
vlovich Feb 22, 2025
100f242
Merge pull request #671 from vlovich/cuda-static-build
MarcusDunn Feb 25, 2025
ef3a8a3
Bump version to 0.1.102 [skip ci]
actions-user Feb 25, 2025
375eb20
Merge pull request #684 from utilityai/version-bump-0.1.102
MarcusDunn Feb 25, 2025
045c5f2
Merge pull request #683 from nobodywho-ooo/fix-chat-template-initiali…
MarcusDunn Feb 25, 2025
748d58d
Bump version to 0.1.103 [skip ci]
actions-user Feb 25, 2025
51e9d99
Merge pull request #685 from utilityai/version-bump-0.1.103
MarcusDunn Feb 25, 2025
727419a
Fix to check should be the event recorded
kusaanko Feb 26, 2025
5f3a29e
copy src into target, not src
AsbjornOlling Feb 26, 2025
b0d355c
Merge pull request #688 from nobodywho-ooo/fix-buildinfo-copy-fail-fa…
MarcusDunn Feb 26, 2025
bde9248
Expose n_head_kv
vlovich Mar 1, 2025
4809af3
chore(deps): bump docker/setup-qemu-action from 3.4.0 to 3.6.0
dependabot[bot] Mar 3, 2025
c8a5690
chore(deps): bump anyhow from 1.0.96 to 1.0.97
dependabot[bot] Mar 3, 2025
209ad86
Merge pull request #689 from vlovich/expose-head-n-kv
MarcusDunn Mar 3, 2025
6ab83db
Merge pull request #687 from kusaanko/fix-event-dispatch
MarcusDunn Mar 3, 2025
5c02114
Merge pull request #690 from utilityai/dependabot/github_actions/dock…
MarcusDunn Mar 5, 2025
1221c48
Merge pull request #693 from utilityai/dependabot/cargo/anyhow-1.0.97
MarcusDunn Mar 5, 2025
792828a
chore(deps): bump docker/setup-buildx-action from 3.9.0 to 3.10.0
dependabot[bot] Mar 5, 2025
958a1d0
chore(deps): bump cc from 1.2.15 to 1.2.16
dependabot[bot] Mar 5, 2025
2249f82
Merge pull request #692 from utilityai/dependabot/cargo/cc-1.2.16
MarcusDunn Mar 6, 2025
d5e8612
Merge pull request #691 from utilityai/dependabot/github_actions/dock…
MarcusDunn Mar 6, 2025
4ba3962
chore(deps): bump ring from 0.17.8 to 0.17.13
dependabot[bot] Mar 7, 2025
c6bc131
Merge pull request #696 from utilityai/dependabot/cargo/ring-0.17.13
MarcusDunn Mar 8, 2025
e1b5448
chore(deps): bump clap from 4.5.31 to 4.5.32
dependabot[bot] Mar 17, 2025
0d8581c
Merge pull request #697 from utilityai/dependabot/cargo/clap-4.5.32
MarcusDunn Mar 20, 2025
1588265
chore(deps): bump cc from 1.2.16 to 1.2.17
dependabot[bot] Mar 24, 2025
d75f231
Merge pull request #698 from utilityai/dependabot/cargo/cc-1.2.17
MarcusDunn Mar 24, 2025
21eee35
reimplement get_chat_template
AsbjornOlling Mar 24, 2025
6c2640f
rename get_chat_template to chat_template
AsbjornOlling Mar 25, 2025
eaf0782
make LlamaModel::chat_template public again
AsbjornOlling Mar 26, 2025
6ed6248
rename references to get_chat_template in doc strings
AsbjornOlling Mar 26, 2025
593257e
remove unused error type
AsbjornOlling Mar 26, 2025
63791cb
Merge pull request #699 from nobodywho-ooo/chat-template-by-name
MarcusDunn Mar 26, 2025
ad4f7f5
chore(deps): bump clap from 4.5.32 to 4.5.34
dependabot[bot] Mar 31, 2025
ffb0427
Merge pull request #702 from utilityai/dependabot/cargo/clap-4.5.34
MarcusDunn Mar 31, 2025
cdb2cef
implement metadata fetching methods on LlamaModel
AsbjornOlling Mar 26, 2025
c33b4a5
doc comments on MetaValError, remove unused variant
AsbjornOlling Mar 26, 2025
ca28629
Merge pull request #700 from nobodywho-ooo/model-meta-val-stuff
MarcusDunn Apr 3, 2025
5369ff2
chore(deps): bump openssl from 0.10.70 to 0.10.72
dependabot[bot] Apr 4, 2025
2f88025
Merge pull request #703 from utilityai/dependabot/cargo/openssl-0.10.72
MarcusDunn Apr 4, 2025
26a3ec7
chore(deps): bump clap from 4.5.34 to 4.5.35
dependabot[bot] Apr 7, 2025
c9cbb3d
chore(deps): bump cc from 1.2.17 to 1.2.18
dependabot[bot] Apr 7, 2025
58f910d
Merge pull request #705 from utilityai/dependabot/cargo/cc-1.2.18
MarcusDunn Apr 7, 2025
a067acd
Merge pull request #704 from utilityai/dependabot/cargo/clap-4.5.35
MarcusDunn Apr 7, 2025
2641a6d
chore(deps): bump cc from 1.2.18 to 1.2.19
dependabot[bot] Apr 14, 2025
1fd0bd2
chore(deps): bump clap from 4.5.35 to 4.5.36
dependabot[bot] Apr 14, 2025
64d0f0a
Merge pull request #711 from utilityai/dependabot/cargo/clap-4.5.36
MarcusDunn Apr 14, 2025
5412545
Merge pull request #710 from utilityai/dependabot/cargo/cc-1.2.19
MarcusDunn Apr 14, 2025
9657f02
chore(deps): bump anyhow from 1.0.97 to 1.0.98
dependabot[bot] Apr 14, 2025
059afcf
Merge pull request #709 from utilityai/dependabot/cargo/anyhow-1.0.98
MarcusDunn Apr 28, 2025
7c0a01a
LLAMA_CURL=OFF
AsbjornOlling Apr 30, 2025
e5082c1
update llama.cpp to b5233
AsbjornOlling Apr 30, 2025
2450a23
Merge pull request #721 from AsbjornOlling/disable-llama-curl
MarcusDunn Apr 30, 2025
5d0ea24
add cmake to test build dockerfile
AsbjornOlling May 1, 2025
496c368
add git to dockerfile
AsbjornOlling May 1, 2025
ddd380a
change casing of 'AS' to fix docker build warning
AsbjornOlling May 1, 2025
9f7bd25
add llama backend init to the doc tests that depend on it
AsbjornOlling May 1, 2025
808c6c5
Merge pull request #723 from AsbjornOlling/fix-backend-dependant-doct…
MarcusDunn May 1, 2025
b910840
Merge branch 'main' into disable-llama-curl
MarcusDunn May 1, 2025
eed54cb
Fix common/minja missing in cargo publish
fellhorn May 2, 2025
4267c49
Merge branch 'main' into fix-common-minja-folder
MarcusDunn May 2, 2025
816d945
Merge pull request #722 from AsbjornOlling/disable-llama-curl
MarcusDunn May 2, 2025
ad9d48b
Merge branch 'main' into fix-common-minja-folder
MarcusDunn May 2, 2025
3835cbe
Merge pull request #724 from fellhorn/fix-common-minja-folder
MarcusDunn May 2, 2025
1587e0c
Bump version to 0.1.104 [skip ci]
actions-user May 3, 2025
92aaaa4
Merge pull request #728 from utilityai/version-bump-0.1.104
MarcusDunn May 3, 2025
fd06d21
Bump version to 0.1.105 [skip ci]
actions-user May 3, 2025
14bc196
Merge pull request #729 from utilityai/version-bump-0.1.105
MarcusDunn May 3, 2025
955f8d6
Bump version to 0.1.106 [skip ci]
actions-user May 3, 2025
3b14277
Merge pull request #730 from utilityai/version-bump-0.1.106
MarcusDunn May 3, 2025
e417032
chore(deps): bump clap from 4.5.36 to 4.5.37
dependabot[bot] May 3, 2025
1c1f888
chore(deps): bump cc from 1.2.19 to 1.2.20
dependabot[bot] May 3, 2025
37c2352
Merge pull request #717 from utilityai/dependabot/cargo/cc-1.2.20
MarcusDunn May 3, 2025
891683e
Merge pull request #716 from utilityai/dependabot/cargo/clap-4.5.37
MarcusDunn May 3, 2025
99f5e5c
Bump version to 0.1.107 [skip ci]
actions-user May 3, 2025
ec8f6c8
Merge pull request #732 from utilityai/version-bump-0.1.107
MarcusDunn May 3, 2025
4f41ba6
chore(deps): bump clap from 4.5.37 to 4.5.38
dependabot[bot] May 12, 2025
3597d01
chore(deps): bump cc from 1.2.21 to 1.2.22
dependabot[bot] May 12, 2025
8433b00
Merge pull request #736 from utilityai/dependabot/cargo/cc-1.2.22
MarcusDunn May 12, 2025
f358c53
Merge pull request #735 from utilityai/dependabot/cargo/clap-4.5.38
MarcusDunn May 12, 2025
7e13673
Fix MacOS build
windoze May 17, 2025
b6048f0
Use `TARGET` instead of `HOST`
windoze May 17, 2025
b9993ff
Use existing target
windoze May 17, 2025
9012e88
chore(deps): bump cc from 1.2.22 to 1.2.23
dependabot[bot] May 19, 2025
0f752a4
Merge pull request #738 from utilityai/dependabot/cargo/cc-1.2.23
MarcusDunn May 21, 2025
00385ef
Merge pull request #737 from windoze/main
MarcusDunn May 21, 2025
59864fd
remove deprecated kv view & rename kv cache -> kv self APIs
brittlewis12 May 24, 2025
b0839c3
update llama.cpp org-ref
brittlewis12 May 24, 2025
f8d986b
disable building tools post upstream reorganization
brittlewis12 May 24, 2025
ff4784e
cargo fmt in build.rs
brittlewis12 May 24, 2025
9bd1cc4
chore(deps): bump cc from 1.2.23 to 1.2.24
dependabot[bot] May 26, 2025
0ae78da
Merge pull request #740 from brittlewis12/catchup-upstream
MarcusDunn May 26, 2025
a91fd74
Merge pull request #741 from utilityai/dependabot/cargo/cc-1.2.24
MarcusDunn May 26, 2025
57afeb6
Bump version to 0.1.108 [skip ci]
actions-user May 26, 2025
451fea3
Merge pull request #742 from utilityai/version-bump-0.1.108
MarcusDunn May 26, 2025
af7b3f3
fixed llama.cpp build issue on ARM (Apple aarch64)
russellwmy May 27, 2025
2ad42a8
chore(deps): bump clap from 4.5.38 to 4.5.39
dependabot[bot] Jun 2, 2025
ff82d97
chore(deps): bump cc from 1.2.24 to 1.2.25
dependabot[bot] Jun 2, 2025
594be0c
Merge pull request #746 from utilityai/dependabot/cargo/cc-1.2.25
MarcusDunn Jun 4, 2025
2af0551
Merge pull request #745 from utilityai/dependabot/cargo/clap-4.5.39
MarcusDunn Jun 4, 2025
516bb35
Merge pull request #743 from russellwmy/main
MarcusDunn Jun 5, 2025
e83fa54
Bump version to 0.1.109 [skip ci]
actions-user Jun 5, 2025
37744a5
Merge pull request #748 from utilityai/version-bump-0.1.109
MarcusDunn Jun 5, 2025
46b42a8
chore(deps): bump cc from 1.2.25 to 1.2.26
dependabot[bot] Jun 9, 2025
04f6407
chore(deps): bump tracing-core from 0.1.33 to 0.1.34
dependabot[bot] Jun 9, 2025
944ce8a
Merge pull request #750 from utilityai/dependabot/cargo/tracing-core-…
MarcusDunn Jun 9, 2025
53eeaae
Merge pull request #749 from utilityai/dependabot/cargo/cc-1.2.26
MarcusDunn Jun 9, 2025
b2aa713
updated llama.cpp
Jun 17, 2025
fbf6887
bump llamacpp, remove weird build-info.cpp copy
AsbjornOlling Jun 17, 2025
a92e90b
explicitly link advapi32 on windows
AsbjornOlling Jun 18, 2025
245e424
add ci step for windows and vulkan
AsbjornOlling Jun 18, 2025
8703b11
bump llama.cpp to b5696
AsbjornOlling Jun 18, 2025
02a7c44
check and set long path setting in windows registry
AsbjornOlling Jun 18, 2025
56c89f2
disable msbuild filetracker
AsbjornOlling Jun 18, 2025
54990f6
try something else
AsbjornOlling Jun 18, 2025
9ba23d5
attempt: try and disable trackfileaccess
AsbjornOlling Jun 18, 2025
95a811b
attempt: spray and pray
AsbjornOlling Jun 18, 2025
0b59c41
attempt: whittle down
AsbjornOlling Jun 18, 2025
5539aa3
simplift workflow
AsbjornOlling Jun 18, 2025
6e504c9
fix reranker example
AsbjornOlling Jun 18, 2025
142dfb0
update workaround comment
AsbjornOlling Jun 18, 2025
63ab258
try with /FS
AsbjornOlling Jun 18, 2025
1142c95
set /fs differently
AsbjornOlling Jun 18, 2025
ca84af6
point submodule to my llama.cpp fork
AsbjornOlling Jul 7, 2025
ef7e279
verbose vulkan build
AsbjornOlling Jul 7, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 26 additions & 7 deletions .github/workflows/llama-cpp-rs-check.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ jobs:
runs-on: ubuntu-latest
steps:
- name: Checkout
uses: actions/checkout@eef61447b9ff4aafe5dcd4e0bbf5d482be7e7871
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683
with:
submodules: recursive
- name: Install Compile Deps
Expand All @@ -43,13 +43,13 @@ jobs:
target: [ linux/arm64, linux/amd64 ]
steps:
- name: checkout
uses: actions/checkout@eef61447b9ff4aafe5dcd4e0bbf5d482be7e7871
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683
- name: Setup QEMU
uses: docker/setup-qemu-action@49b3bc8e6bdd4a60e6116a5414239cba5943d3cf
uses: docker/setup-qemu-action@29109295f81e9208d7d86ff1c6c12d2833863392
with:
platforms: arm64,amd64
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@988b5a0280414f521da01fcc63a27aeeb4b104db
uses: docker/setup-buildx-action@b5ca514318bd6ebac0fb2aedd5d36ec1b5c232a2
- name: Build
uses: docker/build-push-action@v6
with:
Expand All @@ -61,7 +61,7 @@ jobs:
runs-on: macos-latest
steps:
- name: checkout
uses: actions/checkout@eef61447b9ff4aafe5dcd4e0bbf5d482be7e7871
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683
with:
submodules: recursive
- name: Setup Rust
Expand All @@ -73,12 +73,31 @@ jobs:
runs-on: windows-latest
steps:
- name: checkout
uses: actions/checkout@eef61447b9ff4aafe5dcd4e0bbf5d482be7e7871
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683
with:
submodules: recursive
- name: Setup Rust
uses: dtolnay/rust-toolchain@stable
- name: Build
run: cargo build --features sampler
- name: Test
run: cargo test --features sampler
run: cargo test --features sampler
windows-vulkan:
name: Check that it builds on windows with vulkan
runs-on: windows-latest
steps:
- name: checkout
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683
with:
submodules: recursive
- name: Setup Rust
uses: dtolnay/rust-toolchain@stable
- name: Install Vulkan SDK
uses: jakoch/[email protected]
with:
vulkan_version: 1.3.296.0
install_runtime: true
cache: true
stripdown: true
- name: Build
run: cargo build --features "sampler vulkan" --verbose
2 changes: 1 addition & 1 deletion .github/workflows/publish-upon-release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ jobs:
runs-on: ubuntu-latest

steps:
- uses: actions/checkout@eef61447b9ff4aafe5dcd4e0bbf5d482be7e7871
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683
with:
submodules: recursive
- name: Publish crates for llama-cpp-sys-2
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/update-llama-cpp.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ jobs:
steps:
- name: Set date
run: echo "DATE=$(date -I)" >> $GITHUB_ENV
- uses: actions/checkout@eef61447b9ff4aafe5dcd4e0bbf5d482be7e7871
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683
name: Checkout latest
with:
submodules: recursive
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/update-toml-version.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ jobs:

steps:
- name: Checkout code
uses: actions/checkout@eef61447b9ff4aafe5dcd4e0bbf5d482be7e7871
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683
with:
submodules: recursive

Expand Down
2 changes: 1 addition & 1 deletion .gitmodules
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
[submodule "llama-cpp-sys-2/llama.cpp"]
path = llama-cpp-sys-2/llama.cpp
url = https://github.com/ggerganov/llama.cpp
url = https://github.com/ggml-org/llama.cpp
Loading
Loading