New llama-factory code runs into batch["input_ids"] is None. The old version is ok.

[hnhoangdz]

Reminder

• I have read the README and searched the existing issues.

Reproduction

Traceback (most recent call last):
File "/root/LLaMA-Factory/src/train_bash.py", line 14, in
main()
File "/root/LLaMA-Factory/src/train_bash.py", line 5, in main
run_exp()
File "/root/LLaMA-Factory/src/llmtuner/train/tuner.py", line 31, in run_exp
run_pt(model_args, data_args, training_args, finetuning_args, callbacks)
File "/root/LLaMA-Factory/src/llmtuner/train/pt/workflow.py", line 47, in run_pt
train_result = trainer.train(resume_from_checkpoint=training_args.resume_from_checkpoint)
File "/root/anaconda3/envs/llama_factory/lib/python3.10/site-packages/transformers/trainer.py", line 1780, in train
return inner_training_loop(
File "/root/anaconda3/envs/llama_factory/lib/python3.10/site-packages/transformers/trainer.py", line 1843, in _inner_training_loop
num_train_tokens = self.num_tokens(train_dataloader) * args.num_train_epochs
File "/root/anaconda3/envs/llama_factory/lib/python3.10/site-packages/transformers/trainer.py", line 1360, in num_tokens
tokens = batch["input_ids"].numel()
TypeError: 'NoneType' object is not subscriptable

Expected behavior

No response

System Info

No response

Others

No response

[hiyouga]

please provide your training script for reproducing