DEMO-DataGrip对接Hive/Impala

适用模块

客户端

具体说明

客户端工具对接集群

使用示例

DataGrip连接Hive

DataGrip可通过jdbc方式连接Hive/Impala;
驱动依赖Jar包如下:

commons-collections-3.2.2.jar
commons-configuration-1.6.jar
commons-httpclient-3.0.1.jar
commons-logging-1.1.3.jar
curator-client-2.10.0.jar
curator-framework-2.10.0.jar
hadoop-auth-2.9.2.jar
hadoop-common-2.9.2.jar
hive-common-2.1.1.jar
hive-exec-2.1.1.jar
hive-jdbc-2.1.1.jar
hive-metastore-2.1.1.jar
hive-service-2.1.1.jar
httpclient-4.5.6.jar
httpcore-4.4.6.jar
log4j-api-2.16.0.jar
log4j-core-2.16.0.jar
slf4j-api-1.7.25.jar
stax2-api-3.1.4.jar
woodstox-core-5.0.3.jar
zookeeper-3.4.6.jar

连接信息配置:将URL选项配置为完整JDBC连接串即可

8Qao33

Kerberos支持

通过高级选项添加jvm参数实现kerberos支持

com.sun.security.jgss.initiate{
      com.sun.security.auth.module.Krb5LoginModule required
      useKeyTab=true
      useTicketCache=false
      keyTab="/Users/semon/wks/tools/dsc_support.keytab"
      principal="dsc_support/dev@BDMS.163.COM"
      doNotPrompt=true
      debug=true
      debugNative=true;
   };

VM options配置如下:

-Djava.security.auth.login.config=/Users/semon/wks/tools/initKerberos.auth  -Djava.security.krb5.conf=/00-conf/demo-krb/krb5.conf -Djavax.security.auth.useSubjectCredsOnly=false

OkZISb

windows版本
jdbc:hive2://bigdata-demo1.jdlt.163.org:9999/;principal=hive/_HOST@BDMS.163.COM

Demo-DataGrip对接Hive - 图3

驱动下载:wget -nHd -m -r -l1 --no-parent --cut-dirs=2 --ftp-user=public --ftp-password=Public@163 ftp://59.111.93.226:60021/jdbc-drivers/

Demo-DataGrip对接Hive - 图4

-Djava.security.auth.login.config=C:\Users\linshuai\Documents\kerberosconf\krb5.conf -Djava.security.krb5.conf=C:\Users\linshuai\Documents\kerberosconf\krb5.ini  -Djavax.security.auth.useSubjectCredsOnly=false

Demo-DataGrip对接Hive - 图5

krb5.ini配置
[libdefaults]
  default_realm=BDMS.163.COM
  allow_weak_crypto=true
  dns_lookup_realm=false
  dns_lookup_kdc=false
  ticket_lifetime=24h
  renew_lifetime=7d
  forwardable=true
  udp_preference_limit=1

[domain_realm]
  jd.163.org=BDMS.163.COM
  .jd.163.org=BDMS.163.COM

[realms]
  BDMS.163.COM={
    admin_server=bigdata-demo1.jdlt.163.org
    kdc=bigdata-demo1.jdlt.163.org
    kdc=bigdata-demo2.jdlt.163.org
  }

krb5.conf配置
com.sun.security.jgss.initiate{
      com.sun.security.auth.module.Krb5LoginModule required
      useKeyTab=true
      useTicketCache=false
      keyTab="C:\\Users\\linshuai\\Documents\\kerberosconf\\bdms.keytab"
      principal="bdms/dev@BDMS.163.COM";
};
连接测试

Demo-DataGrip对接Hive - 图6 Demo-DataGrip对接Hive - 图7

作者:wangsong