PENG Bo

RWKV-LM. RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

ChatRWKV. ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

AI-Writer. AI 写小说，生成玄幻和言情网文等等。中文预训练生成模型。采用我的 RWKV 模型，类似 GPT-2 。AI写作。RWKV for Chinese novel generation.

Hua. Hua is an AI image editor with Stable Diffusion (and more).

RWKV-CUDA. The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )

nanoRWKV. RWKV in nanoGPT style

Albatross. RWKV-7 7.2B fp16 15000+ tps decoding @ single 5090

minGPT-tuned. A *tuned* minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

modded-nanogpt-rwkv. RWKV-7: Surpassing GPT

BlinkDL.github.io. A collection of State of the Art results in AI / ML / DL / RL / CV / NLP.

BlinkDL. A minimalist deep learning library in Javascript using WebGL + asm.js. Run convolutional neural network in your browser.

fast.c. Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.

RWKV-v2-RNN-Pile. RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.

LinearAttentionArena. Here we will test various linear attention designs.

SmallInitEmb. LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence

BookCNN. 《深度卷积网络：原理与实践》现已在淘宝天猫京东当当发售. 这里是其中的代码下载.

Agen. Agen is a minimalist language for agent loops and state machines.

WorldModel. Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business / finance / governance, and can align agents with human too.

LM-Trick-Questions. Here we collect trick questions and failed tasks for open source LLMs to improve them.

Basis. The Basis Programming Language

BlinkToDo. A minimalist ToDo.txt page. 如果你的ToDo有一百项以上，试试这个基于txt的极简事项管理工具。

RWKV.com. JavaScript

AntiAging. List of Anti-aging Research

zoology. Understand and test language model architectures on synthetic tasks.

Nala. The Nala markup, to turn a "Natural Language" sentence into a code-like statement. Nala 标注，将自然语言变为编程语言。

PathTracingJS. Path tracing demo with JS in your web browser. 用浏览器JS做路径跟踪渲染。

BlinkColorTheme. A colorful theme for HTML+JS+CSS.

Model_Leaderboard. Leaderboard of AI models.

MathBook. 一个较为系统的数学笔记（graduate level）

BasisLang.com. BasisLang.com