This is the official PyTorch implementation of NeurIPS 2024 paper Initializing Variable-sized Vision Transformers from Learngene with Learnable Transformation. In stage 1, we construct and train an ...

Python version Python 3.11.12 (main, Apr 16 2025, 04:16:58) [GCC 11.4.0] Operating system and processor architecture Linux-6.10.14-linuxkit-aarch64-with-glibc2.35 Installed packages agate @ file: ...