[BUG] UNSUPPORTED MEDIA TYPE for EmbedderOpenAICompatibleConfig

[piperino11]

I created a flask server to use SentenceTransformer("multi-qa-MiniLM-L6-cos-v1")

with EmbedderOpenAICompatibleConfig

I can't handle requests with error "POST /v1/embeddings HTTP/1.1" 415 -

In particular on the cat side I have the error
File "/app/cat/factory/custom_embedder.py", line 59, in embed_documents
ret.raise_for_status()
File "/usr/local/lib/python3.10/site-packages/httpx/_models.py", line 759, in raise_for_status
raise HTTPStatusError(message, request=request, response=self)
httpx.HTTPStatusError: Client error '415 UNSUPPORTED MEDIA TYPE' for url 'http://server:port/v1/embeddings'

The specification on the content-type of the Header seems to be missing or am I wrong?

[valentimarco]

hi, thanks for this bug report.
We encounter many issue with the OpenAICompatibleConfig, so needs a refactor!
Stay turn in discord for more updates,

Again, thanks for the report!

[piperino11]

@valentimarco Here are the corrections I made locally and now it works:
in cheshire-cat/core/cat/factory/custom_embedder.py:

` def embed_documents(self, texts: List[str]) -> List[List[float]]:
payload = json.dumps({"input": texts})
headers = {'Content-type': 'application/json', 'Accept': 'application/json'}

    ret = httpx.post(self.url, data=payload, timeout=None,headers=headers)
    ret.raise_for_status()
    return  [e['embedding'] for e in ret.json()['data']]


def embed_query(self, text: str) -> List[float]:
    payload = json.dumps({"input": text})
    headers = {'Content-type': 'application/json', 'Accept': 'application/json'}
    ret = httpx.post(self.url, data=payload, timeout=None,headers=headers)
    ret.raise_for_status()
    return ret.json()['data'][0]['embedding']`

[valentimarco]

@piperino11 would you like to open a PR? Would be great and we can move it on the fix of the all OpenAIcompatible class

[pieroit]

@piperino11 please check if the issue is still present in develop, should have been fixed already