Skip to content

Issues: intelligent-machine-learning/dlrover

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

41 Open 167 Closed
41 Open 167 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[observability] OTEL Trace/Event for training rendezvous, gpu check, flash checkpoint, etc. enhancement New feature or request
#1132 opened May 17, 2024 by liyzcj
possible typo in the example of [tf_elasticjob_on_k8s]
#1123 opened May 14, 2024 by lichadehehehe
dlrover/blob/master/docs/tutorial/tf_elasticjob_on_k8s 【tf_elasticjob_on_k8s example failed to start】 【tf_elasticjob_on_k8s 示例启动失败】
#1121 opened May 14, 2024 by lichadehehehe
@hxdtest
make deploy IMG=easydl/elasticjob-controller:master
#1115 opened May 11, 2024 by yangzhipeng1108
1
Set join timeout value as timeout in rdzv params.
#1114 opened May 11, 2024 by workingloong
OSError: [Errno 98] Address already in use
#1113 opened May 10, 2024 by chencjcj
3
Use Gang Scheduling in ElasticJob of DLRover.
#1075 opened Apr 14, 2024 by workingloong
The job stops restarting workers and exits if the traceback is a code bug. enhancement New feature or request question Further information is requested
#1068 opened Apr 8, 2024 by workingloong
@BalaBalaYi
2
Can you share the training cases on Huawei acceleration card?
#1052 opened Mar 26, 2024 by felix0080
1
llama2 failed
#1037 opened Mar 19, 2024 by wwj-2017-1117
1
[RFC] Welcome to give requirements to use DLRover on nodes with AI chips.
#1017 opened Mar 6, 2024 by workingloong
We are going to build a LLM training agent help searching training strategy and babysitting model training to maxmimize MFU and effective training time.
#1005 opened Feb 22, 2024 by hxdtest
Does tfplus/kv_variable support TF2？
#938 opened Jan 10, 2024 by fuhailin
1
Bug: the rendezvous is not completed event if the number of waiting nodes > mini_nodes.
#903 opened Dec 20, 2023 by workingloong
@workingloong
Does DLRover have plan to support the MindSpore backend framework?
#888 opened Dec 14, 2023 by botieking98
4
Support saving the state dict from the shm to the storage periodically.
#872 opened Dec 7, 2023 by workingloong
@workingloong @liyzcj
Bug: the spawned processes by dlrover-run cannot exits when Ctrl-C
#858 opened Nov 30, 2023 by workingloong
How to use Flash Attention x TFPlus?
#823 opened Nov 15, 2023 by fuhailin
1
An English version of https://github.com/intelligent-machine-learning/dlrover/blob/master/docs/blogs/stabilize_llm_training_cn.md
#800 opened Nov 6, 2023 by skydoorkai
@workingloong
More LLM examples.
#778 opened Oct 25, 2023 by workingloong
@Antlera
1
Keep the batch size even in strategy generator. good first issue Good for newcomers
#706 opened Sep 16, 2023 by Antlera
@Antlera
1
Potential OOM issues in simple_strategy_generator
#704 opened Sep 16, 2023 by Antlera
@Antlera
1
Run DLRover in jupyter. enhancement New feature or request
#697 opened Sep 14, 2023 by Antlera
@workingloong @Antlera
[Feature]: Activation Checkpoint
#666 opened Sep 6, 2023 by samplise
[Feature]: Summarize the elapsed time of PyTorch ops in a training job.
#664 opened Sep 6, 2023 by workingloong
1
ProTip! Add no:assignee to see everything that’s not assigned.