VASWANI A , SHAZEER N , PARMAR N , et al . Attention is all you need [J ] . Advances in Neural Information Processing Systems , 2017 ( 30 ): 5998 - 6008 .

CAI W , JIANG J , WANG F , et al . A survey on mixture of experts [J ] . arXiv preprint , arXiv: 2407.06204 , 2024 .

郭全中 , 杨元昭 . 大模型发展回顾与展望 [J ] . 中国传媒科技 , 2024 ( 2 ): 159 - 160 .

LI C Y , GAN Z , YANG Z Y , et al . Multimodal foundation models: from specialists to general-purpose assistants [J ] . Foundations and Trends® in Computer Graphics and Vision , 2024 , 16 ( 1-2 ): 1 - 214 .

KRIZHEVSKY A , SUTSKEVER I , HINTON G E . ImageNet classification with deep convolutional neural networks [J ] . Communications of the ACM , 2017 , 60 ( 6 ): 84 - 90 .

HINTON G , VINYALS O , DEAN J . Distilling the knowledge in a neural network [J ] . arXiv preprint , arXiv: 1503.02531 , 2015 .

OQUAB M , DARCET T , MOUTAKANNI T , et al . DINOv2: learning robust visual features without supervision [J ] . arXiv preprint , arXiv: 2304.07193 , 2023 .

Glenn Jocher . Yolov5 [EB ] . 2025 .