FAQ-数据传输去向段为es报type错误,无法插入数据
更新时间: 2024-03-11 02:46:42
阅读 2890
问题描述
问题描述/异常栈
021-12-15 15:11:00 CST Yarn application final status: FAILED, process: 1.0 2021-12-15 15:11:00 CST Diagnostics: User class threw exception:
org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in stage 0.0 failed 4 times, most recent failure: Lost task 1.3 in stage 0.0 (TID 13, edadatacenter07, executor 3):
org.apache.spark.util.TaskCompletionListenerException: Could not write all entries for bulk operation [1/1]. Error sample (first [5] error messages):
org.elasticsearch.hadoop.rest.EsHadoopRemoteException: illegal_argument_exception: Rejecting mapping update to [cdma_20211201] as the final mapping would have more than 1 type:
[HEMS_CDMA_USER_PORTRAIT_CUR_Z, doc] {"update":{"_id":"1-1008DPCZ"}}
{"doc_as_upsert":true,"doc":{"ASSET_INTEG_ID":"1-
1008DPCZ","CCUST_ID":"176334190076","DATE_CD":1639411200000,"PROM_INTEG_ID":"1004799955082","ASSET_ROW_ID":"1-100WTVM2","ACCS_NBR":"18067719557","CACCT_ROW_ID":"1-8PJTSWQ","CCUST_ROW_ID":"1-8PG4NWO","CORP_USER_NAME":"公众客户","CPRD_NAME":"移动电话 ","CUR_DS_LARGE_CDSC_LIST":"","GIS_CLUSTER_ID":"","LATN_ID":15,"ADDR_OWNER_NAME":"台州市黄岩区江口","AGE":57,"AGE_FLG":"[45岁,60岁)","Birth_Day":-184147200000,"CCUST_NAME":"程益
民","CCUST_BRD_CNT":1,"CCUST_C_CNT":4,"CCUST_C_FK_CNT":3,"CCUST_C_ZK_CNT":1,"CCUST_FIX_CNT":1,"CCUST_ITV_CNT":1,"CCUST_PRD_TYPE":"宽||固||ITV||CDMA","CDMA_AGREE_FLG":1,"CCUST_TEL":"TEL:
13806580078","COMPLAINT_DESCRIPTION":"-1","COMPLAINT_DESCRIPTION_CAUSE":"-1","COPING_SKILLS":"-1","CUST_ABA_NBR":"13357660909","CUST_STATTP_NAME":"大客户","FREEZE_FLAG":0,"GENDER":"男","ID_NBR":"332603196403022499","ID_TYPE_NAME":"身份证","LINKMAN_NAME":"程益民","MANAGER_ID":37236.0,"MKT_CUST_STATTP_NAME":
"商客D","MKT_STAR_GRADE_NAME":"5","GO_ABROAD_LAST_DT":-2209017600000,"GO_ABROAD_LAST_DUR":0.0,"GO_ABROAD_HOLIDAY_LIST":"","COMPANY"
:"","ISP":"","NETWORK_STANDARD":"","OPERATING_SYSTEM":"","TER_CHANGE":"三星 SCH-I699I&2015-05-09&43个月&599元","TER_MODEL":"","TER_TYPE_NAME":"未知","TERM_MODEL":"","TERM_MODEL_NAME_NEW":"","TERM_ROW_ID":"","AREA_ID":183651.0,"BLACK_USER_FLG":0,"CACCT_ID":"276388249
解决方案
检查一下type是否有问题
问题原因
一个index只能有一个type,type不止有一个导致的
作者:常惠渊
文档反馈
以上内容对您是否有帮助?