alluxio fs distributedLoad loading failure causes the fluid cache to be unusable

[yangcheng-dev]

Alluxio Version:
alluxio-dev：2.9.0

Describe the bug
I use alluxioruntime cache through fluid to connect to a web page file webufs service. The specific error scenario is that when dataloading a large file (10g), an error will be reported, and then the file will stop pulling. If the file is smaller, the probability of this problem is much smaller. Please help analyze it!
I would like to ask everyone in the Alluxio community whether there is any maximum parameter limit here. The bottom layer of Fluid's DataLoad uses the alluxio fs distributedLoad command.
To Reproduce
Steps to reproduce the behavior (as minimally and precisely as possible)

1. use fluid create a dataset and alluxioruntime
2. For data preheating, use dataload.The bottom layer of Fluid's DataLoad uses the "alluxio fs distributedLoad" command.
3. Fluid's dataLoad interrupt

Expected behavior
dataLoad successed
Urgency

Are you planning to fix it
Please indicate if you are already working on a PR.

Additional context
Add any other context about the problem here.

[yangcheng-dev]

@jasondrogba
@YichuanSun
please help!

[jasondrogba]

you can take a look on #16094 and #16096
you can try to increase MaxDirectMemorySize.

export ALLUXIO_FUSE_JAVA_OPTS="-XX:MaxDirectMemorySize=128m"

[yangcheng-dev]

you can take a look on #16094 and #16096 you can try to increase MaxDirectMemorySize.

export ALLUXIO_FUSE_JAVA_OPTS="-XX:MaxDirectMemorySize=128m"

Thank you for your help, but I have configured the value to 32g. The problem still persists, similar to the issue below
#11611

[jasondrogba]

Maybe it is a problem with fluid #11611 (comment)

[yangcheng-dev]

Maybe it is a problem with fluid #11611 (comment)

Yes, but the problem has not been truly resolved so far.