Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]: support for aixcoder #4679

Closed
chucksylar opened this issue May 8, 2024 · 2 comments
Closed

[Feature]: support for aixcoder #4679

chucksylar opened this issue May 8, 2024 · 2 comments
Labels
feature request

Comments

@chucksylar
Copy link

馃殌 The feature, motivation and pitch

consider support aixcoder

Alternatives

No response

Additional context

No response
@mgoin
Copy link
Collaborator

mgoin commented May 8, 2024

@chucksylar This model seems to just use the LlamaForCausalLM architecture, so they should already be supported in vLLM. Config file referenced here: https://huggingface.co/aiXcoder/aixcoder-7b-base/blob/main/config.json. Have to tried running it?

@chucksylar
Copy link
Author

@chucksylar This model seems to just use the LlamaForCausalLM architecture, so they should already be supported in vLLM. Config file referenced here: https://huggingface.co/aiXcoder/aixcoder-7b-base/blob/main/config.json. Have to tried running it?

You are absolutely right! Thanks for your reply.

@chucksylar chucksylar reopened this May 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mgoin @chucksylar