Implementation of Universal Transformer in Pytorch
-
Updated
Nov 19, 2018 - Python
#
universal-transformer
Here are 7 public repositories matching this topic...
The implementation of Adaptive Computation function used in RNN "https://arxiv.org/pdf/1603.08983.pdf" and Universal Transformer Network "https://arxiv.org/pdf/1807.03819.pdf"
-
Updated
Aug 30, 2018 - Python
Universal Transformers implementation in PyTorch
-
Updated
Jul 14, 2022 - Python
Unofficial Implementation of Universal Transformer https://arxiv.org/abs/1807.03819
machine-learning deep-learning tensorflow adaptive-computation-time tensor2tensor self-attention universal-transformer
-
Updated
Oct 14, 2018 - Python
When does recurrent depth beat width? Controlled experiments on length extrapolation, cheap test-time compute, and composition via orchestration.
machine-learning deep-learning transformers pytorch recurrent-neural-networks language-model reasoning interpretability universal-transformer llm length-extrapolation test-time-compute
-
Updated
Jun 27, 2026 - Python
Simple from-scratch implementations of transformer-based models that match the state of the art.
transformers transformer attention universal-transformer universal-transformers xlnet transformer-xl
-
Updated
Dec 8, 2022 - Python
Multi strategy logit fusion between Ouro-1.4B (Universal Transformer) and HRM-Text-1B (prefix-LM) for improved text generation
entropy transformers fusion benchmarks language-model kl-divergence perplexity universal-transformer logits llm ouro-1-4b hrm-text-1b js-div
-
Updated
Jun 22, 2026 - Python
Improve this page
Add a description, image, and links to the universal-transformer topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the universal-transformer topic, visit your repo's landing page and select "manage topics."