New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Docker Image for running distilabel CLI #611
base: main
Are you sure you want to change the base?
Conversation
As suggested by @alvarobartt we should work with the nvidia base images. I'll copy here the comments:
FROM nvidia/cuda:12.3.0-base-ubuntu22.04 AS build
ARG DEBIAN_FRONTEND=noninteractive
RUN apt-get update && \
apt-get install python3 python3-pip -y
RUN ln -s /usr/bin/python3 /usr/bin/python
ENV PYTHON=/usr/bin/python
ARG TORCH="2.2.0"
RUN python -m pip install --no-cache-dir --upgrade pip && \
python -m pip install --no-cache-dir torch==${TORCH}
|
@plaguss should be good to go. As I talked with @alvarobartt yesterday, we are sticking to the runpod image for now. I added the build arguments, and as far as the research I did, there should be no problem on Windows. If it arises, happy to adapt it with more feedback. |
Closes #608
I've implemented the two images for running Distilabel, one that builds from
runpod/pytorch:2.1.1-py3.10-cuda12.1.1-devel-ubuntu22.04
and is able of using CUDA and one more constrained frompython:3.11-slim
. To try them out:I was unsure of which dependencies to include in the local image. Do you have any ideas @plaguss @gabrielmbmb ?