ERNIE-4. 5-VL-28B-A3B-Paddle_文心大模型_大语言模型_多模态模型-飞桨AI Studio星河社区 ERNIE 4 5 Highlights The advanced capabilities of the ERNIE 4 5 models, particularly the MoE-based A47B and A3B series, are underpinned by several key technical innovations: Multimodal Heterogeneous MoE Pre-Training: Our models are jointly trained on both textual and visual modalities to better capture the nuances of multimodal information and improve performance on tasks involving text