Is There Value in Generating ComfyUI JSON Files Through Fine-Tuning Llama3-8B?

[howyoungchen]

Hello everyone,

I'm considering a project: fine-tuning Llama3-8B to enable natural language-driven generation of ComfyUI JSON files. This means using natural language descriptions to automatically produce the corresponding JSON configurations.

here is a example: "Help me create a ComfyUI workflow that takes an input image, uses SAM to identify and inpaint watermarks for removal, then applies various methods to upscale the watermark-free image. Finally, arrange the different results side by side for me to compare the enhancement effects."

I'd like to discuss two main points:

Technically, is this feasible? Are there any known implementations? Commercially, is there a market demand for such a tool? Looking forward to your opinions, thanks.