FAQ-模板xxxxxx

问题描述/异常栈
23/06/13 14:03:12 ERROR ApplicationMaster: User class threw exception: java.lang.IllegalArgumentException: '' does not exist in "bireport_dev"."ads_cmn_mtrl_label" table java.lang.IllegalArgumentException: '' does not exist in "bireport_dev"."ads_cmn_mtrl_label" table at io.pivotal.greenplum.spark.GreenplumRelationProvider.createRelation(GreenplumRelationProvider.scala:54) at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:341) at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:239) at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:227) at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:164) at com.netease.music.da.transfer.common.reader.AbstractSparkReader.read(AbstractSparkReader.scala:15) at com.netease.music.da.transfer.greenplum.reader.GreenplumReader.doRead(GreenplumReader.scala:19) at com.netease.music.da.transfer.common.reader.AbstractDataReader.read(AbstractDataReader.scala:22) at com.netease.music.da.transfer.common.Worker$.main(Worker.scala:73) at com.netease.music.da.transfer.common.Worker.main(Worker.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:678) FAQ-Greenplum '' does not exist in table - 图1
发现版本
LTS 650
解决方案
更换为pg数据源登记
问题原因
源端读必须有partitionColumn字段，但该数据源分区字段类型与传输要求不一致

作者：林帅