Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

可以使用自己的数据微调吗 #10

Closed
Malestudents opened this issue Mar 14, 2023 · 5 comments
Closed

可以使用自己的数据微调吗 #10

Malestudents opened this issue Mar 14, 2023 · 5 comments
Labels
question Further information is requested

Comments

@Malestudents
Copy link

No description provided.

@yaleimeng
Copy link

是否可参考 #3 ？

@duzx16 duzx16 added the question Further information is requested label Mar 15, 2023
@cywjava
Copy link

cywjava commented Mar 29, 2023

可以的吧，我也是参考别人修改的微调，做了一个，把数据放进去，处理成要的格式不就行了吗？

https://github.com/chenyiwan/chatglm-6b-fine-tuning

@duzx16
Copy link
Member

duzx16 commented Mar 31, 2023 •
edited
Loading

已经实现了基于量化和ptuning的微调https://github.com/THUDM/ChatGLM-6B/tree/main/ptuning ，最低只需要7GB显存

@duzx16 duzx16 closed this as completed Mar 31, 2023
@EasyLuck
Copy link

这个对于数据集中数据长度有要求吗

@EasyLuck
Copy link

可以的吧，我也是参考别人修改的微调，做了一个，把数据放进去，处理成要的格式不就行了吗？

https://github.com/chenyiwan/chatglm-6b-fine-tuning

这个对于数据集中数据长度有要求吗

@zxy333666 zxy333666 mentioned this issue Jun 13, 2023
Open
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@yaleimeng @duzx16 @Malestudents @cywjava @EasyLuck