Repository navigation
[Bug] hive concurrent mode load udf error #5288
Description
Search before asking
- I searched the issues and found no similar issues.
Linkis Component
linkis-engineconnn-plugin
Steps to reproduce
- 在linkis管理台创建udf函数
- hive引擎启动并发模式 wds.linkis.engineconn.support.parallelism=true
- 提交hive任务使用创建的udf函数
执行任务报错,错误如下:
2025-11-17 19:06:38.387 [INFO ] [main ] o.a.l.e.c.e.c.ComputationExecutorManagerImpl (192) [getExecutorByLabels] [JobId-] - For a single Executor EC, if an Executor exists, it will be returned directly
2025-11-17 19:06:38.442 [INFO ] [main ] o.a.l.e.h.e.HiveEngineConcurrentConnExecutor (137) [executeLine] [JobId-] - HiveEngineConcurrentConnExecutor Ready to executeLine: use hadoop_ind
2025-11-17 19:06:38.444 [ERROR] [main ] o.a.l.e.c.e.h.HiveUseDatabaseEngineHook (129) [$anonfun$tryAndError$1] [JobId-] - java.util.NoSuchElementException: None.get
at scala.None$.get(Option.scala:529) ~[scala-library-2.12.17.jar:?]
at scala.None$.get(Option.scala:527) ~[scala-library-2.12.17.jar:?]
at org.apache.linkis.engineplugin.hive.executor.HiveEngineConcurrentConnExecutor.executeLine(HiveEngineConcurrentConnExecutor.scala:138) ~[linkis-engineplugin-hive-1.8.0.jar:1.8.0]
at org.apache.linkis.engineconn.computation.executor.hook.UseDatabaseEngineHook.$anonfun$afterExecutionExecute$1(UseDatabaseEngineHook.scala:73) ~[linkis-computation-engineconn-1.8.0.jar:1.8.0]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:51) ~[linkis-common-1.8.0.jar:1.8.0]
at org.apache.linkis.common.utils.Utils$.tryAndError(Utils.scala:117) ~[linkis-common-1.8.0.jar:1.8.0]
at org.apache.linkis.engineconn.computation.executor.hook.UseDatabaseEngineHook.afterExecutionExecute(UseDatabaseEngineHook.scala:51) ~[linkis-computation-engineconn-1.8.0.jar:1.8.0]
at org.apache.linkis.engineconn.launch.EngineConnServer$.$anonfun$main$5(EngineConnServer.scala:103) ~[linkis-engineconn-core-1.8.0.jar:1.8.0]
at org.apache.linkis.engineconn.launch.EngineConnServer$.$anonfun$main$5$adapted(EngineConnServer.scala:103) ~[linkis-engineconn-core-1.8.0.jar:1.8.0]
at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36) ~[scala-library-2.12.17.jar:?]
at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33) ~[scala-library-2.12.17.jar:?]
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:198) ~[scala-library-2.12.17.jar:?]
at org.apache.linkis.engineconn.launch.EngineConnServer$.main(EngineConnServer.scala:103) ~[linkis-engineconn-core-1.8.0.jar:1.8.0]
at org.apache.linkis.engineconn.launch.EngineConnServer.main(EngineConnServer.scala) ~[linkis-engineconn-core-1.8.0.jar:1.8.0]
2025-11-17 19:06:38.451 [INFO ] [main ] o.a.l.e.c.e.h.HiveInitSQLHook (64) [$anonfun$afterExecutionExecute$1] [JobId-] - hadoop engineConn skip execute init_sql
Expected behavior
code bug
Your environment
- Linkis version used: 1.1.2
- Environment name and version:
- cdh-5.14.2
- hdp-3.1.5
- hive-2.1.1
- spark-3.2.1
- scala-2.12.2
- jdk 1.8.0_121
- ....
Anything else
No response
Are you willing to submit a PR?
- Yes I am willing to submit a PR!
Activity
github-actions commentedon Nov 19, 2025
😊 Welcome to the Apache Linkis community!!
We are glad that you are contributing by opening this issue.
Please make sure to include all the relevant context.
We will be here shortly.
If you are interested in contributing to our website project, please let us know!
You can check out our contributing guide on
👉 How to Participate in Project Contribution.
Community
Mailing Lists