New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Create a chat webapp with elegant UI on mlc.ai #391
Comments
I've developed a web application integrating Web-LLM with NextChat (ChatGPT Next Web). You can access the live demo at https://chat.neet.coffee/ and here's a screenshot: Please note that this integration is currently in its preliminary demonstration phase. Further modifications and enhancements are necessary to ensure all functionalities work seamlessly. Nest steps:
|
The chat webapp https://chat.neet.coffee/ has been updated to:
As the next step, I will work on optimizing the model management and loading since currently the model loading still takes 20+ seconds with cache and it is required on every page load. |
Close issue and move tracking to https://github.com/mlc-ai/web-llm-chat |
It looks fantastic! // Perhaps it's time for a "projects built with WebLLM" section in the Github readme? It seems https://chat.neet.coffee/ has existed for quite some time. My mind is a little bit blown. Perhaps of interest: Secret Llama recently created what you describe as well: https://github.com/abi/secret-llama Perhaps it would be an idea to work with that project? FYI, I will also be releasing a 100% browser-based project soon that heavily builds on WebLLM. It will showcases it's many abilities. Some screenshots: |
This is interesting and thank you for sharing! The discussion there validates my assumption that a user-friendly, production-ready, streamlined UI for web-llm is expected by many users. I had a brief look of their codebase, and realized that the author created the project from scratch and the current stage of the webapp UI is still relatively premature. I did it in a different approach by integrating web-llm to a more mature open-source chat UI projects in hope to avoid reinvent the wheels and be able to quickly launch an elegant and user-friendly webapp product to the public. Therefore, I will continue working on this as a separate project, web-llm-chat, under mlc.ai, but I will try reach out to secret llama's authors for potential collaborations.
Your project looks very cool with a comprehensive set of features. Best luck on it! |
Currently, the UI of the Web-LLM demo hosted at webllm.mlc.ai serves its purpose as a basic demonstration. However, to enhance the marketability of the project, it's imperative to elevate the user experience by implementing a more elegant and user-friendly interface.
One effective approach to achieve this is by integrating Web-LLM into an open-source chatbot UI framework. A list of available candidates is Every ChatGPT GUI.
Integrating Web-LLM with a sophisticated chatbot UI not only improves its aesthetics but also enhances its usability and appeal to potential users and stakeholders. This integration will offer a seamless and intuitive interaction experience, contributing significantly to the project's marketability and adoption.
I'm interested in creating one and I'll post my update there in this issue thread.
The text was updated successfully, but these errors were encountered: