Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

💡 [REQUEST] - <title> 关于lora 模型合并的几个问题 #1226

Open
wangyao123456a opened this issue Apr 19, 2024 · 3 comments
Open
Labels
inactive question Further information is requested

Comments

@wangyao123456a
Copy link

起始日期 | Start Date

1

实现PR | Implementation PR

1

相关Issues | Reference Issues

1、请问base model 和lora model 合并完后,新模型的大小、参数量和base model 一样的吗?
2、推理时如果lora 和base 模型不合并,输出结果和模型合并后推理结果是否一致,有精度上的损失吗?

摘要 | Summary

1

基本示例 | Basic Example

1

缺陷 | Drawbacks

1

未解决问题 | Unresolved questions

1

@wangyao123456a wangyao123456a added the question Further information is requested label Apr 19, 2024
@wangyao123456a
Copy link
Author

1、请问base model 和lora model 合并完后,新模型的大小、参数量和base model 一样的吗?
2、推理时如果lora 和base 模型不合并,输出结果和模型合并后推理结果是否一致,有精度上的损失吗?

@jklj077
Copy link
Contributor

jklj077 commented Apr 19, 2024

  1. It should be the same.
  2. The difference should be negligible.

Copy link

This issue has been automatically marked as inactive due to lack of recent activity. Should you believe it remains unresolved and warrants attention, kindly leave a comment on this thread.
此问题由于长期未有新进展而被系统自动标记为不活跃。如果您认为它仍有待解决,请在此帖下方留言以补充信息。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
inactive question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants