FAQ -hive2es写入超时

问题描述/异常栈
23/07/24 15:14:08 ERROR Executor: Exceptionin task 622.0 in stage 0.0 (TID 85)oxg,elastioserh hadop.xesthadogpoodesletrpthon: metimn err hel metwork d/r pry setmgs)- a des led; tr .92-0.23004.2at org.elasticsearch.hadoop.rest.NetworkClient.execute(NetworkClient.java:160)at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:432at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.iaya:428at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:408)at org.elasticsearch.hadoop.rest.RestClient.bulk(RestClient.java:226)at org.elasticsearch.hadoop.rest.bulk.BulkProcessor.tryFlush(BulkProcessor.java:196)at org.elasticsearch.hadoop.rest.bulk.BulkProcessor.flush(BulkProcessor.java:499)at org.elasticsearch.hadoop.rest.bulk.BulkProcessor.add(BulkProcessor.java:113)at org.elasticsearch.hadoop.rest.RestRepository.dowriteToIndex(RestRepository.java:192)at org.elasticsearch.hadoop.rest.RestRepository.writeToIndex(RestRepository.java:172)at org.elasticsearch. spark.rdd.EsRDDWriter.write(EsRDDWriter.scala:74)at org.elasticsearch.spark. sql.EsSparkSQL$$anonfun$saveToEs$1.apply(EsSparkSqL.scala:101)at org.elasticsearch. spark. sql.EsSparkSQL$$anonfu$saveToEs$1. apply(EsSparkSQL. scala:101)at org.apache.spark.scheduler.ResultTask.runTask (ResultTask.scala:87)scheduler.Task.run(Task.scala:109)at orgapachespark.at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:345)at java.util.concurrent.ThreadPoolExecutorunWorker(ThreadPoolExecutor.java:1149)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)at java.lang.Thread.run(Thread.java:748)23/07/24 15:14:08 INFO CoarseGrainedExecutorBackend: Got assigned task 160
发现版本
LTS 650
解决方案
1、确认地址端口通
FAQ -hive2es写入超时 - 图1
2、batchSize比较大，超时时间比较小。引入es写入超时
问题原因
根据情况进行补充

作者：林帅