RWKV

RWKV-8 trained on the Pile w/ "20b tokenizer" (332115325534 tokens)

Here are early testing versions and I will iterate

How to run it:

https://github.com/BlinkDL/RWKV-LM/tree/main/RWKV-v7

Downloads last month
74
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Dataset used to train BlinkDL/rwkv-8-pile