Skip to content

[Bug] hive concurrent mode load udf error #5288

Closed

Description

@aiceflower

Search before asking

  • I searched the issues and found no similar issues.

Linkis Component

linkis-engineconnn-plugin

Steps to reproduce

  1. 在linkis管理台创建udf函数
  2. hive引擎启动并发模式 wds.linkis.engineconn.support.parallelism=true
  3. 提交hive任务使用创建的udf函数

执行任务报错,错误如下:
2025-11-17 19:06:38.387 [INFO ] [main ] o.a.l.e.c.e.c.ComputationExecutorManagerImpl (192) [getExecutorByLabels] [JobId-] - For a single Executor EC, if an Executor exists, it will be returned directly
2025-11-17 19:06:38.442 [INFO ] [main ] o.a.l.e.h.e.HiveEngineConcurrentConnExecutor (137) [executeLine] [JobId-] - HiveEngineConcurrentConnExecutor Ready to executeLine: use hadoop_ind
2025-11-17 19:06:38.444 [ERROR] [main ] o.a.l.e.c.e.h.HiveUseDatabaseEngineHook (129) [$anonfun$tryAndError$1] [JobId-] - java.util.NoSuchElementException: None.get
at scala.None$.get(Option.scala:529) ~[scala-library-2.12.17.jar:?]
at scala.None$.get(Option.scala:527) ~[scala-library-2.12.17.jar:?]
at org.apache.linkis.engineplugin.hive.executor.HiveEngineConcurrentConnExecutor.executeLine(HiveEngineConcurrentConnExecutor.scala:138) ~[linkis-engineplugin-hive-1.8.0.jar:1.8.0]
at org.apache.linkis.engineconn.computation.executor.hook.UseDatabaseEngineHook.$anonfun$afterExecutionExecute$1(UseDatabaseEngineHook.scala:73) ~[linkis-computation-engineconn-1.8.0.jar:1.8.0]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:51) ~[linkis-common-1.8.0.jar:1.8.0]
at org.apache.linkis.common.utils.Utils$.tryAndError(Utils.scala:117) ~[linkis-common-1.8.0.jar:1.8.0]
at org.apache.linkis.engineconn.computation.executor.hook.UseDatabaseEngineHook.afterExecutionExecute(UseDatabaseEngineHook.scala:51) ~[linkis-computation-engineconn-1.8.0.jar:1.8.0]
at org.apache.linkis.engineconn.launch.EngineConnServer$.$anonfun$main$5(EngineConnServer.scala:103) ~[linkis-engineconn-core-1.8.0.jar:1.8.0]
at org.apache.linkis.engineconn.launch.EngineConnServer$.$anonfun$main$5$adapted(EngineConnServer.scala:103) ~[linkis-engineconn-core-1.8.0.jar:1.8.0]
at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36) ~[scala-library-2.12.17.jar:?]
at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33) ~[scala-library-2.12.17.jar:?]
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:198) ~[scala-library-2.12.17.jar:?]
at org.apache.linkis.engineconn.launch.EngineConnServer$.main(EngineConnServer.scala:103) ~[linkis-engineconn-core-1.8.0.jar:1.8.0]
at org.apache.linkis.engineconn.launch.EngineConnServer.main(EngineConnServer.scala) ~[linkis-engineconn-core-1.8.0.jar:1.8.0]

2025-11-17 19:06:38.451 [INFO ] [main ] o.a.l.e.c.e.h.HiveInitSQLHook (64) [$anonfun$afterExecutionExecute$1] [JobId-] - hadoop engineConn skip execute init_sql

Expected behavior

code bug

Your environment

  • Linkis version used: 1.1.2
  • Environment name and version:
    • cdh-5.14.2
    • hdp-3.1.5
    • hive-2.1.1
    • spark-3.2.1
    • scala-2.12.2
    • jdk 1.8.0_121
    • ....

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Activity

  1. github-actions commented on Nov 19, 2025

    @github-actions

    😊 Welcome to the Apache Linkis community!!

    We are glad that you are contributing by opening this issue.

    Please make sure to include all the relevant context.
    We will be here shortly.

    If you are interested in contributing to our website project, please let us know!
    You can check out our contributing guide on
    👉 How to Participate in Project Contribution.

    Community

    WeChat Assistant WeChat Public Account

    Mailing Lists

    Name Description Subscribe Unsubscribe Archive
    dev@linkis.apache.org community activity information subscribe unsubscribe archive
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions