Improve First Token Latency for multi-GPU projects (by flash attention or alternative)

[moutainriver]

For multi-GPU solution, we still have challenges for First Token Latency. The breakdown data is shared in offline.
please help add more optimization features (like SDP/Flash Attention etc) to improve the First Token Latency.