PENG Bo BlinkDL

RWKV is all you need

GitHub @BlinkDL_AI Website

Influence62rank 517

Stars, own repos29.6k29 repos

Stars, 30 daysn/a

Followers2.8kGitHub

Best work

RWKV-LM81 · Vouched RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding. 14.8k stars · Python Rides Deep learning Cooling +20% in a year Source on GitHub

ChatRWKV ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source. 9.5k stars · Python Rides PyTorch Growing +133% in a year Source on GitHub

AI-Writer AI 写小说，生成玄幻和言情网文等等。中文预训练生成模型。采用我的 RWKV 模型，类似 GPT-2 。AI写作。RWKV for Chinese novel generation. 3.9k stars · Python Source on GitHub

Builds inModels and researchPeaking+64% new repos in a year · forecast edging up