Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Support stable diffusion.cpp as a WasmEdge plugin #3369

Open
hydai opened this issue Apr 26, 2024 · 1 comment
Open

feat: Support stable diffusion.cpp as a WasmEdge plugin #3369

hydai opened this issue Apr 26, 2024 · 1 comment
Labels
enhancement New feature or request OSPP Tasks for OSPP participants

Comments

@hydai
Copy link
Member

hydai commented Apr 26, 2024

Summary

Motivation

WasmEdge runtime provides inference support for AI models and LLMs (large language models, such as llama3 and phi-3-mini). Stable Diffusion is a popular category that we would like to support. We would like to build a WasmEdge plugin that uses stable-diffusion.cpp as the backend and a set of WASI extensions like WASI-NN for developers to use.

Details

Objectives

The primary objectives of this project are to create a WasmEdge plugin and an SDK to use these functions with the following features:

  • Support txt2img
  • Support img2img
  • Allow users to use Rust/C/C++ language to develop an application for using this plugin

Deliverables

Upon successful completion of this project, the following deliverables are expected:

  1. A Rust language framework for WasmEdge applications to support txt2img, img2img, and most of the options listed in this table
  2. A WasmEdge plugin that implements and integrates the stable diffusion features.
  3. Documentation and sample applications

Appendix

@hydai hydai added enhancement New feature or request OSPP Tasks for OSPP participants labels Apr 26, 2024
@staru09
Copy link

staru09 commented May 18, 2024

Are we making a rust wrapper for stable diffusion.cpp?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request OSPP Tasks for OSPP participants
Projects
None yet
Development

No branches or pull requests

2 participants