Skip to content

Issues: huggingface/alignment-handbook

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

78 Open 34 Closed
78 Open 34 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

CI failing due to mistralai/Mistral-7B-Instruct-v0.2 being gated now
#166 opened May 8, 2024 by alvarobartt
FSDP + QDoRA Support
#159 opened Apr 24, 2024 by iseesaw
5
How to work with local data
#158 opened Apr 18, 2024 by pretidav
Clarification on dataset mixer
#157 opened Apr 18, 2024 by deep-diver
2
Dependency updates for QLoRA+FSDP
#155 opened Apr 16, 2024 by deep-diver
CPT training is giving pretty unstalbe results with the learning rate 2e-5.
#149 opened Apr 4, 2024 by shamanez
1
Multi-GPU Training with DPO Full Parameter Stucks
#147 opened Mar 31, 2024 by Taishi-N324
Constitutional AI models do not achieve MT-Bench scores as reported
#145 opened Mar 27, 2024 by JingtongSu
Can we please add the option to work with a tokenized dataset, escpailly for the CPT task.
#144 opened Mar 27, 2024 by shamanez
Efficient dialog data format for KTO training
#142 opened Mar 26, 2024 by DavidFarago
Can any one share the script what params should be passed to run_dpo.py
#141 opened Mar 26, 2024 by Oscarjia
1
How to select parts to bp in sft
#138 opened Mar 19, 2024 by Fu-Dayuan
Is there a way to freeze some layers of a model ?
#134 opened Mar 12, 2024 by shamanez
Early Stopping Issue when used with ConstantLengthDataset
#133 opened Mar 8, 2024 by sankydesai
Not able to run Zephyr 7B Gemma with 4 80GB A100s
#132 opened Mar 7, 2024 by TJ-Solergibert
1
Downloading latest CUDA version (11.6 or above) for MacOS to use FlashAttention
#130 opened Mar 5, 2024 by shubhamcs162
Minor question about PAD token and EOS token.
#127 opened Feb 26, 2024 by HaniItani
2
Major bug: Chat template is not actually applied in run_sft.py and run_dpo.py
#125 opened Feb 23, 2024 by AlexiaJM
7
cannot replicate DPO results of zephyr
#124 opened Feb 23, 2024 by AlexiaJM
5
Zephyr-dpo-full Checkpoints perform poorly on TruthfulQA.
#122 opened Feb 19, 2024 by xijiu9
1
DPO recipe saves a float32 model
#121 opened Feb 15, 2024 by tcapelle
(QLoRA) DPO without previous SFT
#120 opened Feb 8, 2024 by DavidFarago
1
Cost of Generating a Dataset for Constitutional AI
#118 opened Feb 7, 2024 by Ashish-Soni08
Using MT-Bench to evaluate zephyr
#114 opened Feb 2, 2024 by abgoswam
2
DPO loss on different datasets
#110 opened Feb 1, 2024 by wj210
ProTip! Follow long discussions with comments:>50.