Describe the current behavior / 问题描述 (Mandatory / 必填)

pangu_c3网络在910B3上8p推理，精度50.9%达不到53.56%
模型仓地址：https://gitee.com/mindspore/models/tree/master/official/nlp/Pangu_alpha

Environment / 环境信息 (Mandatory / 必填)

• Hardware Environment(Ascend/GPU/CPU) / 硬件环境:

Please delete the backend not involved / 请删除不涉及的后端:
/device ascend910B3

• Software Environment / 软件环境 (Mandatory / 必填):
  -- MindSpore version (e.g., 1.7.0.Bxxx) :
  -- Python version (e.g., Python 3.7.5) :
  -- OS platform and distribution (e.g., Linux Ubuntu 16.04):
  -- GCC/Compiler version (if compiled from source):
  失败版本：
  run包：Milan_C17/20240321
  mindspore：r2.3.q1_20240322204955_5a94f41a4670

• Excute Mode / 执行模式 (Mandatory / 必填)(PyNative/Graph):

Please delete the mode not involved / 请删除不涉及的模式:
/mode graph

Related testcase / 关联用例 (Mandatory / 必填)

用例路径：MindFormers_Test/cases/pangu/train
关联用例：test_mf_pangu_2_6b_infer_check_accruacy_910_c8_8p_0001.py

Steps to reproduce the issue / 重现步骤 (Mandatory / 必填)

1. get code from models
2. cd scripts;bash -x run_distribute_eval.sh 8 [HCCL_JSON] strategy.ckpt tokenizer checkpoint_file 2.6B fp32 c3 [C3_DATA]
3. 验证网络是否训练成功
4. 推理精度能达到53.56%

Describe the expected behavior / 预期结果 (Mandatory / 必填)

网络训练成功，推理精度能达到53.56%

Related log / screenshot / 日志 / 截图 (Mandatory / 必填)

不涉及

Special notes for this issue/备注 (Optional / 选填)

走给唐慧康