2.3K Star 8.1K Fork 4.3K

GVPMindSpore / mindspore

 / 详情

[MT][910A/B][1p] DQN 训练时算子报错(Select-op0 op dtype is not same, type1:int32, type2:int64)

DONE
Bug-Report
创建于  
2024-04-28 16:30
name about labels
Bug Report Use this template for reporting a bug kind/bug

Describe the current behavior / 问题描述 (Mandatory / 必填)

DQN 训练时算子报错(Select-op0 op dtype is not same, type1:int32, type2:int64)

Environment / 环境信息 (Mandatory / 必填)

  • Hardware Environment(Ascend/GPU/CPU) / 硬件环境:

Please delete the backend not involved / 请删除不涉及的后端:
/device ascend

  • Software Environment / 软件环境 (Mandatory / 必填):
    -- MindSpore version (e.g., 1.7.0.Bxxx) :
    -- Python version (e.g., Python 3.7.5) :
    -- OS platform and distribution (e.g., Linux Ubuntu 16.04):
    -- GCC/Compiler version (if compiled from source):
    HiAI/Milan_C17/20240414
    master_20240426230938_a8763

  • Excute Mode / 执行模式 (Mandatory / 必填)(PyNative/Graph):

Please delete the mode not involved / 请删除不涉及的模式:
/mode graph

Related testcase / 关联用例 (Mandatory / 必填)

test_ms_dqn_train_infer_0001

Steps to reproduce the issue / 重现步骤 (Mandatory / 必填)

  1. cd solution_test/cases/02network/05rl/dqn/train/
  2. pytest -s test_ms_dqn_train_infer_0001.py

Describe the expected behavior / 预期结果 (Mandatory / 必填)

执行通过,性能及精度正常

Related log / screenshot / 日志 / 截图 (Mandatory / 必填)

[ERROR] OP(156528,python):2024-04-27-03:56:55.325.464 [/home/jenkins/agent-working-dir/workspace/Compile_Ascend_ARM_CentOS/mindspore/mindspore/ccsrc/plugin/device/ascend/kernel/aicpu/aicpu_ops/customize/op_proto/utils/util.cc:106][OP_PROTO][CheckTwoInputDtypeSame][156528] OpName:[Default/msrl-MSRL/actors-DQNActor/collect_policy-EpsilonGreedyPolicy/Select-op0] "The Default/msrl-MSRL/actors-DQNActor/collect_policy-EpsilonGreedyPolicy/Select-op0 op dtype is not same, type1:int32, type2:int64"
[ERROR] OP(156528,python):2024-04-27-03:56:55.325.495 [/home/jenkins/agent-working-dir/workspace/Compile_Ascend_ARM_CentOS/mindspore/mindspore/ccsrc/plugin/device/ascend/kernel/aicpu/aicpu_ops/customize/op_proto/selection_ops_proto.cc:147][OP_PROTO][SelectVerify][156528] OpName:[Default/msrl-MSRL/actors-DQNActor/collect_policy-EpsilonGreedyPolicy/Select-op0] "call function CheckTwoInputDtypeSame failed, data type of input[x1] is not same as input[x2]"
[ERROR] GE(156528,python):2024-04-27-03:56:55.325.647 [infershape_pass.cc:133]156528 InferShapeAndType: ErrorNo: 4294967295(failed) [COMP][PRE_OPT][Call][Verify] Verifying Default/msrl-MSRL/actors-DQNActor/collect_policy-EpsilonGreedyPolicy/Select-op0 failed.
[ERROR] GE(156528,python):2024-04-27-03:56:55.325.909 [infershape_pass.cc:123]156528 Infer: ErrorNo: 1343242270(Prepare Graph infershape failed) [COMP][PRE_OPT][Call][InferShapeAndType] for node:Default/msrl-MSRL/actors-DQNActor/collect_policy-EpsilonGreedyPolicy/Select-op0(Select) failed
[ERROR] GE(156528,python):2024-04-27-03:56:55.325.924 [infer_base_pass.cc:112]156528 InferAndUpdate: ErrorNo: 1343242270(Prepare Graph infershape failed) [COMP][PRE_OPT][Call][Infer] failed for node Default/msrl-MSRL/actors-DQNActor/collect_policy-EpsilonGreedyPolicy/Select-op0, ret: 1343242270
[ERROR] GE(156528,python):2024-04-27-03:56:55.325.935 [infer_base_pass.cc:69]156528 Run: ErrorNo: 1343242270(Prepare Graph infershape failed) [COMP][PRE_OPT][Call][InferAndUpdate] for node Default/msrl-MSRL/actors-DQNActor/collect_policy-EpsilonGreedyPolicy/Select-op0 failed! ret: 1343242270
[ERROR] GE(156528,python):2024-04-27-03:56:55.325.963 [base_pass.cc:574]156528 RunPassesOnNode: ErrorNo: 1343225860(Internal errors) [COMP][PRE_OPT][Process][Pass] InferShapePass on node Default/msrl-MSRL/actors-DQNActor/collect_policy-EpsilonGreedyPolicy/Select-op0 failed, result 4294967295, the passes will be terminated immediately.
[ERROR] GE(156528,python):2024-04-27-03:56:55.325.976 [base_pass.cc:522]156528 RunPassesNodeOnce: ErrorNo: 4294967295(failed) [COMP][PRE_OPT][Process][Passes] on node Default/msrl-MSRL/actors-DQNActor/collect_policy-EpsilonGreedyPolicy/Select-op0 type Select failed, error code:4294967295
[ERROR] GE(156528,python):2024-04-27-03:56:55.325.986 [base_pass.cc:478]156528 RunPassesGraphRepass: ErrorNo: 4294967295(failed) [COMP][PRE_OPT][Process][Passes] on node Default/msrl-MSRL/actors-DQNActor/collect_policy-EpsilonGreedyPolicy/Select-op0 type Select failed, error code:4294967295

Special notes for this issue/备注 (Optional / 选填)

当前戴仁杰定界中
定界完成再转给对应责任人

评论 (4)

wanlinhui_A 创建了Bug-Report
wanlinhui_A 添加了
 
kind/bug
标签
wanlinhui_A 添加了
 
device/ascend
标签
wanlinhui_A 添加了
 
v2.3.0.rc2
标签
wanlinhui_A 添加了
 
attr/function
标签
展开全部操作日志

Please assign maintainer to check this issue.
请为此issue分配处理人。
@wanlinhui_A

感谢您的提问,您可以评论//mindspore-assistant更快获取帮助:

  1. 如果您刚刚接触MindSpore,或许您可以在教程找到答案
  2. 如果您是资深Pytorch用户,您或许需要:
  1. 如果您遇到动态图问题,可以设置set_context(pynative_synchronize=True)查看报错栈协助定位
  2. 模型精度调优问题可参考官网调优指南
  3. 如果您反馈的是框架BUG,请确认您在ISSUE中提供了MindSpore版本、使用的后端类型(CPU、GPU、Ascend)、环境、训练的代码官方链接以及可以复现报错的代码的启动方式等必要的定位信息
  4. 如果您已经定位出问题根因,欢迎提交PR参与MindSpore开源社区,我们会尽快review
wanlinhui_A 修改了标题
fangwenyi 负责人wangbixing 修改为LiangZhibo
fangwenyi 添加协作者wangbixing
fangwenyi 里程碑B-SIG-TBD 修改为B-SIG-Compiler
wanlinhui_A 负责人LiangZhibo 修改为dairenjie
wanlinhui_A 添加协作者LiangZhibo
dairenjie 里程碑B-SIG-Compiler 修改为B-SIG-OPS
dairenjie 里程碑B-SIG-OPS 修改为B-SIG-MSLite

问题原因是算子yaml设置了输入类型一致性的校验,已删除该校验,后端算子能处理不同类型输入的场景

dairenjie 添加协作者dairenjie
dairenjie 负责人dairenjie 修改为wanlinhui_A
dairenjie 里程碑B-SIG-MSLite 修改为B-ComponentTest
dairenjie 任务状态TODO 修改为VALIDATION
wanlinhui_A 任务状态VALIDATION 修改为DONE

回归通过
HiAI/Milan_C17/20240414
mindspore-2.3.0rc2+20240504-cp37-cp37m-linux_aarch64.whl

fangwenyi 移除了
 
v2.3.0.rc2
标签
fangwenyi 添加了
 
master
标签

登录 后才可以发表评论

状态
负责人
项目
里程碑
Pull Requests
关联的 Pull Requests 被合并后可能会关闭此 issue
分支
开始日期   -   截止日期
-
置顶选项
优先级
预计工期 (小时)
参与者(5)
Python
1
https://gitee.com/mindspore/mindspore.git
git@gitee.com:mindspore/mindspore.git
mindspore
mindspore
mindspore

搜索帮助