No module named 'triton.common'

[enzoli977]

i was trying to fine tune llama model locally with Win10, after installing the necessary environment, I tried:
from unsloth import FastLanguageModel：
and got ：
No module named 'triton.common'
i installed triton 2.0.0 from https://huggingface.co/r4ziel/xformers_pre_built/tree/main
Did I install the wrong package? Thanks！

[danielhanchen]

@enzoli977 Oh no Windows is a complex beast :( Tbh only WSL and Linux and Apple devices with NVIDIA GPUs are mostly supported, so you'll have to follow #210 for Windows support

[NicolasMejiaPetit]

@enzoli977

Windows is a huge complicated garbage fire. Use the wheels I showed in the home.md in #210 along with installing the proper visual studio build tools, shown in a detailed picture at the bottom. It honestly isn’t supposed to work, it just does. I can’t expect this to work for ever, half the things are deprecated in Microsoft MVSC’s and some how that compiled triton works (in the home.md link) with it. Also I believe you didn’t install the triton libraries and add them to path, thats quite essential. Either way use my 2.1 triton wheel and the triton libraries I link in there. If you dont want a “trust me bro” find wkpark on github he made the wheels and libraries he might have made more up to date ones too. I only made the deepspeed wheels, to this date I still have no clue how he compiled triton wheels for windows. Still gotta figure it out, so if triton gets a major update I’m not screwed.

[madiator]

I see this on some linux instances in runpod.

[danielhanchen]

@madiator I'm assuming its torch 2.3 - change xformers to "xformers<0.0.26"