Skip to content

Issues: alibaba/Pai-Megatron-Patch

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

44 Open 135 Closed
44 Open 135 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

llava sft embedding报错
#419 opened Jan 8, 2025 by ssn1771
1
tp/pp数增加，初始loss值会增加
#417 opened Jan 7, 2025 by GuokunWang
6
对Qwen2-VL的继续预训练异常，报No dot product attention support for the provided inputs!
#414 opened Jan 5, 2025 by yyli2022
SFT使用sequence packing后的数据训练报错
#413 opened Jan 5, 2025 by Eisenhower
转换误差是正常的吗？
#412 opened Jan 4, 2025 by haorannlp
PAI-Megatron-Patch llama3.1脚本128k上下文预训练速度慢
#410 opened Dec 30, 2024 by kkkeepgoing
Qwen2.5-7B 无法进行继续预训练
#409 opened Dec 29, 2024 by YueXiao1995
2
Run qwen2-vl train shell as demo, Output:TypeError: Attention.forward() got an unexpected keyword argument 'attention_bias'
#408 opened Dec 29, 2024 by jiazj-jiazj
4
Pretrain data processing will drop samples that containing special tokens?
#403 opened Dec 22, 2024 by juncaofish
tensor model parallel isn't handled properly for shared_expert_gate in Qwen2-MoE and kv_a_proj_with_mqa in DeepSeekV2
#397 opened Dec 15, 2024 by cosmosZhou
2 tasks
1
3
Qwen2.5-7B SFT NaN in local forward loss calculation
#392 opened Dec 5, 2024 by Eisenhower
1
qwen2.5 1.5B 无法正常训练
#386 opened Nov 24, 2024 by Traveller2001
2
PAI平台上训练llama-3.1-8b时有一个GPU使用率偏低
#383 opened Nov 20, 2024 by kkkeepgoing
1
RuntimeError: DataLoader worker exited unexpectedly
#378 opened Nov 15, 2024 by kkkeepgoing
1
关于qwen1.5-moe的数据格式问题
#375 opened Nov 4, 2024 by cdxzyc
最新版本是否支持conversation-sft，多轮对话？
#369 opened Oct 24, 2024 by gaohejiao
DeepSeekV2Tokenizer should use padding_side="right" in __init__()!
#368 opened Oct 23, 2024 by pqhgit
4
AssertionError: Rank 11: found NaN in local grad norm in backward pass before data-parallel communication collective. Device: 3
#366 opened Oct 21, 2024 by lanfengmo
3
关于LLAMA 3.1模型的适配问题
#361 opened Oct 14, 2024 by echo-valor
1
对qwen-2.5扩充词表后loss飙升
#360 opened Oct 9, 2024 by QianguoS
1
cannot import name 'TEDotProductAttentionMLA' when running examples/deepseek_v2/run_mcore_deepseek.sh
#359 opened Oct 4, 2024 by dreasysnail
4
llama3.1-8b转换megatron-mcore格式后模型大小从15G变成了71G，精度仍然为bf16，这是正常的吗
#356 opened Sep 26, 2024 by kkkeepgoing
3
qwen2.5转换脚本转换时报错
#354 opened Sep 25, 2024 by enze5088
1
加入群聊失败， 第二个群也不能扫码加入了
#351 opened Sep 23, 2024 by GeorgeSen
7
llama3.1 8b训练32k的上下文模型，训练时间长、并且loss偏大
#348 opened Sep 20, 2024 by ARQlalala
1
ProTip! Exclude everything labeled bug with -label:bug.