Skip to content

add PLaMo model #3557

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ggerganov merged 19 commits into from
Dec 24, 2023
+307 −15
Merged

add PLaMo model #3557

Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
feb0966
add plamo mock
okdshin Dec 16, 2023
4c585b4
add tensor loading
okdshin Dec 16, 2023
b2330f5
plamo convert
okdshin Dec 17, 2023
9d49236
update norm
okdshin Dec 17, 2023
4a3ef4f
able to compile
okdshin Dec 17, 2023
a22040a
fix norm_rms_eps hparam
okdshin Dec 17, 2023
86d5348
runnable
okdshin Dec 17, 2023
f76fd39
use inp_pos
okdshin Dec 17, 2023
ca8f698
seems ok
okdshin Dec 17, 2023
febc635
update kqv code
okdshin Dec 17, 2023
907b921
remove develop code
okdshin Dec 18, 2023
9339ffc
update README
okdshin Dec 18, 2023
db1b18d
shuffle attn_q.weight and attn_output.weight for broadcasting
okdshin Dec 24, 2023
26340a1
remove plamo_llm_build_kqv and use llm_build_kqv
okdshin Dec 24, 2023
700f7c6
fix style
okdshin Dec 24, 2023
602cc71
Merge branch 'master' into add_pfnet_plamo_13b_2
okdshin Dec 24, 2023
307481f
update
okdshin Dec 24, 2023
eedd434
llama : remove obsolete KQ_scale
ggerganov Dec 24, 2023
1949c95
plamo : fix tensor names for correct GPU offload
ggerganov Dec 24, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
plamo : fix tensor names for correct GPU offload
  • Loading branch information
@ggerganov
ggerganov committed Dec 24, 2023
commit 1949c95598536d6e7cdcb3e9ed99862c191dc9a0
7 changes: 4 additions & 3 deletions llama.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5704,13 +5704,14 @@ struct llm_build_context {
model.layers[il].ffn_gate, NULL,
model.layers[il].ffn_down, NULL,
LLM_FFN_SILU, LLM_FFN_PAR, cb, il);
cb(cur, "mlp_out", il);
cb(cur, "ffn_out", il);
}

cur = ggml_add(ctx0, cur, sa_out);
cb(cur, "mlp_out + sa_out", il);
cb(cur, "l_out", il);

cur = ggml_add(ctx0, cur, inpL);
cb(cur, "mlp_out + sa_out + inpL", il);
cb(cur, "l_out", il);

// input for next layer
inpL = cur;
Expand Down