[DONT MERGE] Bridge works aggregate since startover - #8

Open

hugolatendresse wants to merge 109 commits into

bridge_works_aggregate

Commits on Nov 29, 2024

run-persistent
hugolatendresse
committed
f1c2854
permission
Ubuntu
committed
e9a278d
docker_command
hugolatendresse
committed
bd89698
Merge branch 'dev_mixtral' of github.com:hugolatendresse/FlexFlow into dev_mixtral
hugolatendresse
committed
c6fd2a8
spacing
hugolatendresse
committed
16fcc3d
include ff
hugolatendresse
committed
0357628
persist all
hugolatendresse
committed
58de633
home
hugolatendresse
committed
682bd5c

Commits on Nov 30, 2024

detailed try..catch
hugolatendresse
committed
41f781a
try to revert but errors
hugolatendresse
committed
feb859c
add back else
hugolatendresse
committed
e09ec2e
echo docker command
hugolatendresse
committed
bdcfc94
no sliding window
hugolatendresse
committed
1c88058
read max_position_embeddings
hugolatendresse
committed
14f5820
run-persistent
hugolatendresse
committed
670b8cb
home once only
hugolatendresse
committed
812deb0

Commits on Dec 2, 2024

config
hugolatendresse
committed
318d052
with .
hugolatendresse
committed
17f162f

Commits on Dec 3, 2024

all _ instead of .
hugolatendresse
committed
f5c3f7f
_block
hugolatendresse
committed
22e2a58
try nullptr
hugolatendresse
committed
1cd424a
no comma
hugolatendresse
committed
df0c59b
debug
hugolatendresse
committed
3598ee9
debug
hugolatendresse
committed
06259f7

Commits on Dec 6, 2024

revert aggregate
hugolatendresse
committed
c89a327

Commits on Dec 7, 2024

one expert
hugolatendresse
committed
71c5d69
sync
hugolatendresse
committed
cb1eaa8
dont redefien mlpout
hugolatendresse
committed
286a1fe
sync
hugolatendresse
committed
8709035
sync
hugolatendresse
committed
51f9701
register tokenizer for mixtral
hugolatendresse
committed
a65e733
sync
hugolatendresse
committed
62bf012
rename weights
hugolatendresse
committed
61adc0f
sync
hugolatendresse
committed
8c69b8b
sync
hugolatendresse
committed
0b89169
permission
hugo
committed
76cac36
Merge branch 'nomlp2' of https://github.com/hugolatendresse/FlexFlow into nomlp2
hugo
committed
baa30a8
sync
hugolatendresse
committed
53a4cc4
Merge branch 'nomlp2' of github.com:hugolatendresse/FlexFlow into nomlp2
hugolatendresse
committed
bd1ffa0
sync
hugolatendresse
committed
aeb29e9
sync
hugolatendresse
committed
d27804f
sync
hugolatendresse
committed
ecb9675
which loading
hugolatendresse
committed
af665bd
sync
hugolatendresse
committed
16ab912
sync
hugolatendresse
committed
c3945e3
.o
hugolatendresse
committed
9385e82
sync
hugolatendresse
committed
ce91966
able to output with mixtral (!!!) but it's all etc etc etc
hugolatendresse
committed
7e558bc
try expert 1
hugolatendresse
committed
c8007fd
revert experts
hugolatendresse
committed
aa01156
tmp fix
hugolatendresse
committed
539b491
dummy gate
hugolatendresse
committed
28b2df0
bad softmax fix
hugolatendresse
committed
8ad9478

Commits on Dec 8, 2024

printf
hugolatendresse
committed
9dcb5c2
dims
hugolatendresse
committed
7ed7d65
sync
hugolatendresse
committed
a906c6a
sync
hugolatendresse
committed
0af8064
comments on dims
hugolatendresse
committed
4d26fb5
sync
hugolatendresse
committed
c0e4524
sync
hugolatendresse
committed
7462fb4
sync
hugolatendresse
committed
21ecf77
sync
hugolatendresse
committed
742ec59
sync
hugolatendresse
committed
b04af7a
sync
hugolatendresse
committed
99954e5
sync
hugolatendresse
committed
511fc25
sync
hugolatendresse
committed
e590ce5
sync
hugolatendresse
committed
1ed4bff
CHECKPOINT
hugolatendresse
committed
5700378
2222:22 port
hugolatendresse
committed
381d3cd
tmp_volume
hugolatendresse
committed
6309e70
revert changes
hugolatendresse
committed
11a78f2
printf dims
hugolatendresse
committed
7069082
sync
hugolatendresse
committed
4efc9eb
sync
hugolatendresse
committed
fe1f6f2
sync
hugolatendresse
committed
d71e674
sync
hugolatendresse
committed
3ae5a85
sync
hugolatendresse
committed
bf65efe
sync
hugolatendresse
committed
c989f57
sync
hugolatendresse
committed
f4c7d3a
sync
hugolatendresse
committed
41cf635
sync
hugolatendresse
committed
4121340
sync
hugolatendresse
committed
7f6a18b
I'm able to output with only one expert by commenting out groupby and aggregate
hugolatendresse
committed
3498538

Commits on Dec 9, 2024

sync
hugolatendresse
committed
344fe09
sync
hugolatendresse
committed
b9883c1
works without topk!
hugolatendresse
committed
65afc21
outputs tokens with softmax assertion not commented out
hugolatendresse
committed
4d6886c
sync
hugolatendresse
committed
e757567
sync
hugolatendresse
committed
d45edbc
use full precisoin
hugolatendresse
committed
8c422aa
sync
hugolatendresse
committed
c0e4824
sync
hugolatendresse
committed
1c13c1e
sync
hugolatendresse
committed
d31cbea
sync
hugolatendresse
committed
8c525c4
sync
hugolatendresse
committed
8b10df9
sync
hugolatendresse
committed
f8ea430
sync
hugolatendresse
committed
54e6adc
sync
hugolatendresse
committed
e5075fa
sync
hugolatendresse
committed
fe8e7fd
sync
hugolatendresse
committed
dbe3be6
sync
hugolatendresse
committed
0d2fa44
sync
hugolatendresse
committed
a0ad4c0
sync
hugolatendresse
committed
5473f2c
sync
hugolatendresse
committed
927356d
sync
hugolatendresse
committed
f7c6360
just run groupby
hugolatendresse
committed
88a7163
sync
hugolatendresse
committed
89f5a85
outputs tokens
hugolatendresse
committed
0eeaab4
comments
hugolatendresse
committed
17174d2