Cuda Out of memory with DKMPalettizer #2172
Labels
ct.optimize
Question/issue related to the coremltool's optimization package
question
Response providing clarification needed. Will not be assigned to a release. (type)
❓Question
I'm trying to run training-time palletization with n_bits=4.
I always get an out-of-memory error on the first step (despite reducing batch size down to one.)
A few details:
Are there any tips to avoid this?
The text was updated successfully, but these errors were encountered: