[SDK] Use HuggingFace Data Collator for more Transformers in LLM Trainer

[andreyvelich]

More context: #2031 (comment).
Currently, we apply HuggingFace Data Collator only for AutoModelForCausalLM Transformer in HF LLM Trainer.

We need to investigate if we should apply it for other Transformers for language modelling models.

[live2awesome]

i am interested to contribute on this just i ping on this thread if any help is required
/assign

[live2awesome]

what type of transformer we are looking . i have look for given below transformer model Data Collator can be used

1. Masked Language Model - DataCollatorforLanguageModelling with mlm=True
2. AutoModelForSeq2SeqLM - DataCollatorForSeq2Seq
3. AutoModelForTokenClassification - DataCollatorForTokenClassification
4. AutoModelForSequenceClassification - simple padding is sufficient
   There are also option for Permutation Language Modelling and Whole word mask . Kindly suggest @andreyvelich @johnugeorge

[andreyvelich]

Thank you for your interest @live2awesome!
It would be nice if you could let us know what changes we need to make to our HF LLM Trainer to support Data Collators for other Transformers.
Also, we should discuss if we should add Data Collator by default to all supported transformers.