Open Source Chinese LLMs

by kvathupoon 4/23/2023, 5:43 PMwith 1 comments

by kvathupoon 4/23/2023, 5:43 PM

Wanted to share since I haven't seen much discussion of LLM development in China other than Baidu-Wenxin (at least in US media). Sharing this particular one since it's open-source and apparently started by an undergrad [1]! That said, it seems to fine-tune atop [2] (a pre-trained LLM on Chinese characters). Some other open-source Chinese LLMs I stumbled upon are [3] and [4].

[1] - https://qiyuan-chen.github.io/

[2] - https://github.com/THUDM/ChatGLM-6B/blob/main/README_en.md

[3] - https://github.com/LianjiaTech/BELLE

[4] - https://github.com/ymcui/Chinese-LLaMA-Alpaca/blob/main/READ...