utility to auto download and auto convert a model?

[jondot]

Hi, i'm wondering if building a utility that auto downloads any model if missing, similar to the python lib, (and caches it) but also notices there's no ot file, and will run a conversion, if that kind of thing is feasible or there are too many case-by-case evaluation issues where this has to be a manual process?

[guillaume-be]

Hello @jondot ,

The library contains a helper script (Python based) to convert a Pytorch weights file to the C-array expected by this crate. Unfortunately Pytorch serialization uses Pickle by default meaning a Python installation is required to open these archive and convert them to a raw format.

The automated download utility exists to point to already-convert model files (via RemoteResource). Combining both would require starting a Python process within the Rust application which is not really desirable in my opinion.

What do you think?