[Bug]: HuggingFace Handler - pyarrow.lib.IpcWriteOptions size changed, may indicate binary incompatibility. Expected 88 from C header, got 72 from PyObject

[MinuraPunchihewa]

Short description of current behavior

The HuggingFace handler is currently in an unusable state due to the error:
pyarrow.lib.IpcWriteOptions size changed, may indicate binary incompatibility. Expected 88 from C header, got 72 from PyObject

The same issue has been reported here in the repository for the HuggingFace datasets package, however, the steps to be taken in order to resolve it are not entirely clear.

Video or screenshots

No response

Expected behavior

No response

How to reproduce the error

• Launch MindsDB either via source code, Docker or the Docker Desktop Extension.
• Install the dependencies for the HuggingFace handler.
• Notice that the handler is not usable either by attempting to run a CREATE ML_ENGINE command or from the 'Manage Integrations' page under Settings.

Docs for getting started via Docker: https://docs.mindsdb.com/setup/self-hosted/docker

Anything else?

No response