FAQ-离线同步任务写入starrocks报错:No route to host
更新时间: 2025-04-27 18:43:54
阅读 11
FAQ-离线同步任务写入starrocks报错:No route to host
问题描述/异常栈
问题症状描述数据传输写入starrocks,stream load方式,报错:
25/04/27 13:28:48 ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)
java.net.NoRouteToHostException: No route to host (Host unreachable)
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:374)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108)
at com.netease.da.music.transfer.doris.DorisStreamLoadClient.sendData(DorisStreamLoadClient.java:208)
at com.netease.da.music.transfer.doris.util.DorisUtils$.savePartition(DorisUtils.scala:70)
at com.netease.da.music.transfer.doris.writer.DorisStreamLoadWriter.$anonfun$writeByStreamLoad$1(DorisStreamLoadWriter.scala:100)
at com.netease.da.music.transfer.doris.writer.DorisStreamLoadWriter.$anonfun$writeByStreamLoad$1$adapted(DorisStreamLoadWriter.scala:97)
at org.apache.spark.rdd.RDD.$anonfun$foreachPartition$2(RDD.scala:1014)
at org.apache.spark.rdd.RDD.$anonfun$foreachPartition$2$adapted(RDD.scala:1014)
at org.apache.spark.SparkContext.$anonfun$runJob$5(SparkContext.scala:2322)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:136)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:548)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1508)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:551)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
解决方案
临时方案:datanode节点要与sr的8030,9030,8040端口网络通畅问题原因
网络不通作者:刘家有
文档反馈
以上内容对您是否有帮助?