Update
Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA
Google DeepMind posted “Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA , Google DeepMind.” A quick update for the record.
Quick note: Google DeepMind posted “Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA , Google DeepMind.” Logging it now. Context can come later if this turns into something bigger.