RWKV

Reinventing RNNs for the Transformer Era

Dromedary

Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision

LoRA

Low-Rank Adaptation of Large Language Models