SSH Tunnel to access EC2 Hadoop Cluster -

-

background :

  1. i have installl 3 node cloudera hadoop cluster on ec2 instance workin expected.

  2. client program on windows machine load data machine hdfs.

details :

my client program has developed in java reads data windows local disk , write hdfs.

for trying create ssh tunnel through putty , trying login windows username remote ec2 instance not working. able login unix username. wanted understand correct behavior?

i don't know have created tunnel correctly or not after when try run client program gives me below error :

my client program has developed in java reads data windows local disk , write hdfs. when trying run programs givin me below error.

priviledgedactionexception as:ubuntu (auth:simple) cause:java.io.ioexception: file /user/ubuntu/features.json replicated 0 nodes instead of minreplication (=1).  there 3 datanode(s) running , 3 node(s) excluded in operation.  6:32:45.711 pm     info     org.apache.hadoop.ipc.server       ipc server handler 13 on 8020, call org.apache.hadoop.hdfs.protocol.clientprotocol.addblock 108.161.91.186:54097: error: java.io.ioexception: file /user/ubuntu/features.json replicated 0 nodes instead of minreplication (=1).  there 3 datanode(s) running , 3 node(s) excluded in operation. java.io.ioexception: file /user/ubuntu/features.json replicated 0 nodes instead of minreplication (=1).  there 3 datanode(s) running , 3 node(s) excluded in operation.     @ org.apache.hadoop.hdfs.server.blockmanagement.blockmanager.choosetarget(blockmanager.java:1331)     @ org.apache.hadoop.hdfs.server.namenode.fsnamesystem.getadditionalblock(fsnamesystem.java:2198)     @ org.apache.hadoop.hdfs.server.namenode.namenoderpcserver.addblock(namenoderpcserver.java:480)     @ org.apache.hadoop.hdfs.protocolpb.clientnamenodeprotocolserversidetranslatorpb.addblock(clientnamenodeprotocolserversidetranslatorpb.java:299)     @ org.apache.hadoop.hdfs.protocol.proto.clientnamenodeprotocolprotos$clientnamenodeprotocol$2.callblockingmethod(clientnamenodeprotocolprotos.java:44954)     @ org.apache.hadoop.ipc.protobufrpcengine$server$protobufrpcinvoker.call(protobufrpcengine.java:453)     @ org.apache.hadoop.ipc.rpc$server.call(rpc.java:1002)     @ org.apache.hadoop.ipc.server$handler$1.run(server.java:1701)     @ org.apache.hadoop.ipc.server$handler$1.run(server.java:1697)     @ java.security.accesscontroller.doprivileged(native method)     @ javax.security.auth.subject.doas(subject.java:396)     @ org.apache.hadoop.security.usergroupinformation.doas(usergroupinformation.java:1408)     @ org.apache.hadoop.ipc.server$handler.run(server.java:1695)

any idea?

you can verify hdfs cluster health hdfs fsck / -delete, can rebalance datanodes.


Comments

Post a Comment

Popular posts from this blog

ios - UICollectionView Self Sizing Cells with Auto Layout -

-
Image
i'm trying self sizing uicollectionviewcells working auto layout, can't seem cells size content. i'm having trouble understanding how cell's size updated contents of what's inside cell's contentview. here's setup i've tried: custom uicollectionviewcell uitextview in contentview. scrolling uitextview disabled. the contentview's horizontal constraint is: "h:|[_textview(320)]", i.e. uitextview pinned left of cell explicit width of 320. the contentview's vertical constraint is: "v:|-0-[_textview]", i.e. uitextview pinned top of cell. the uitextview has height constraint set constant uitextview reports fit text. here's looks cell background set red, , uitextview background set blue: i put project i've been playing on github here . updated ios 9 after seeing github solution break under ios 9 got time investigate issue fully. have updated repo include several examples of different configurations s
Read more

node.js - ldapjs - write after end error -

-
i have created authentication service using following code in node.js , ldapjs. var when = require ('when'); var authenticationerror = require('../errors/authenticationerror'); var sessionmanagerservice = require('./sessionmanagerservice'); var ldap = require('ldapjs'); var client = ldap.createclient({ url: 'ldaps://ad.mycompany.com:636', tlsoptions: {'rejectunauthorized': false} }); module.exports = { signin: function (email, password) { return this.ldapbind(email, password).then( function () { return sessionmanagerservice.createsessionhash({email: email}); } ); }, ldapbind: function (email, password) { var deferred = when.defer(); client.bind(email, password, function(err) { if (err) { deferred.reject (new authenticationerror('invalid username and/or password!', 'authentication.signin.error')
Read more

DOM Manipulation in Wordpress (and elsewhere) using php -

-
DOM Manipulation in Wordpress (and elsewhere) using php - i'm quite new dom manipulation world , head start in order avoid mutual errors. i looking efficient way manipulate content generated wordpress using php. @ moment using simple html dom seems work fine. found domdocument , few others , helpfull if cleared out 1 faster, improve or @ to the lowest degree generate less errors in case of bad markup. also on side can explain syntax (instead of $html @$html) thank much php wordpress domdocument simple-html-dom
Read more