问题描述

问题描述/异常栈

ERROR SftpHandler: connect failed
com.jcraft.jsch.JSchException: java.io.IOException: Pipe closed
    at com.jcraft.jsch.ChannelSftp.start(ChannelSftp.java:315)
    at com.jcraft.jsch.Channel.connect(Channel.java:152)
    at com.jcraft.jsch.Channel.connect(Channel.java:145)
    at com.netease.bdms.ndi.common.ftp.SftpHandler.loginFtpServer(SftpHandler.java:138)
    at com.netease.music.da.transfer.ftp.reader.FtpReader.loginFtpServer(FtpReader.scala:325)
    at com.netease.music.da.transfer.ftp.reader.FtpReader.<init>(FtpReader.scala:32)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at com.netease.music.da.transfer.common.reader.DataReader$.apply(DataReader.scala:20)
    at com.netease.music.da.transfer.common.Worker$.main(Worker.scala:39)
    at com.netease.music.da.transfer.common.Worker.main(Worker.scala)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:678)

解决方案

1.检查ftp服务器网络是否畅通
2.登录ftp服务器是否可以登录

问题原因

ftp服务器网络不通或者ftp账号密码问题

作者:常惠渊