Successive Capacity Growth: Task-Complexity-Driven Width and Depth Expansion for Vision Transformer Encoders in JEPA World Models
AI models that grow smarter only when tasks demand it
Researchers developed a method called Successive Capacity Growth that lets AI vision models start tiny and expand only when needed, rather than being built large from the start. On complex vision tasks, the approach achieved 20% better performance while using 56 times fewer parameters than fixed large models, and even beat those large models on simpler tasks by 23%.
AI training consumes enormous computational resources and energy. This approach cuts the parameters needed by more than half while improving accuracy, which translates directly to cheaper training, faster inference, and lower energy costs. Since many real-world applications use models far more powerful than their tasks require, this adaptive scaling could make AI systems dramatically more efficient at deployment.