New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

扩充中文词汇表的细节 #34

Open

lyy-zz opened this issue Jun 6, 2023 · 1 comment

lyy-zz commented Jun 6, 2023 •

edited

Loading

你好，感谢分享
请问训练sentencepiece模型时，用了多少语料以及词汇量设置是多少？
SPM的训练语料和模型训练的中文语料是一样的吗？

Owner

Neutralzz commented Jun 8, 2023

https://github.com/Neutralzz/BiLLa/blob/main/train_codes/README.md

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment