[kepler-dev] Hadoop problems

[Jianwu Wang]

Hi Viet,

     Your messages include "cloudera at localhost's password", which 
probably means you didn't set up ssh localhost login without password. 
It might cause some problems.

     One more thing worthy to be noted is that you should run 
bin/format-namenode.sh before bin/start-hadoop.sh to format namenode.

Best wishes

Sincerely yours

Jianwu WANG, Ph.D.
jianwu at sdsc.edu
http://users.sdsc.edu/~jianwu/

Assistant Director for Research
Workflows for Data Science (WorDS) Center of Excellence
San Diego Supercomputer Center (SDSC)
University of California, San Diego (UCSD)

On 9/27/14, 8:33 AM, Viet Truong Xuan wrote:
> Dear all,
>
> I'm trying to run the examples of Hadoop on Kepler 2.4, but get some 
> problems with it.
> When I start the Hadoop service (with correct passwords as required) with:
> *bin/start-hadoop.sh
> *
> /The output is as the following and the worklows cannot be run:/
>
> bin
> bin=.
> bin=/home/cloudera/KeplerData/workflows/module/hadoop-1.0.0/tools/bin
> starting namenode, logging to 
> /home/cloudera/KeplerData/workflows/module/hadoop-1.0.0/tools/bin/../logs/hadoop-cloudera-namenode-quickstart.cloudera.out
> cloudera at localhost's password:
> localhost: starting datanode, logging to 
> /home/cloudera/KeplerData/workflows/module/hadoop-1.0.0/tools/bin/../logs/hadoop-cloudera-datanode-quickstart.cloudera.out
> cloudera at localhost's password:
> localhost: starting secondarynamenode, logging to 
> /home/cloudera/KeplerData/workflows/module/hadoop-1.0.0/tools/bin/../logs/hadoop-cloudera-secondarynamenode-quickstart.cloudera.out
> localhost: Exception in thread "main" java.lang.NoClassDefFoundError: 
> com.sun.security.auth.UnixPrincipal
> localhost:    at 
> org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformation.java:313)
> localhost:    at java.lang.Class.initializeClass(libgcj.so.10)
> localhost:    at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.initialize(SecondaryNameNode.java:144)
> localhost:    at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.<init>(SecondaryNameNode.java:125)
> localhost:    at 
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:579)
> DEPRECATED: Use of this script to execute hdfs command is deprecated.
> Instead use the hdfs command for it.
>
> Exception in thread "main" java.lang.NoClassDefFoundError: 
> com.sun.security.auth.UnixPrincipal
>    at 
> org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformation.java:313)
>    at java.lang.Class.initializeClass(libgcj.so.10)
>    at 
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1953)
>    at 
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1945)
>    at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1807)
>    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:265)
>    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:146)
>    at org.apache.hadoop.fs.FsShell.init(FsShell.java:85)
>    at org.apache.hadoop.hdfs.tools.DFSAdmin.run(DFSAdmin.java:981)
>    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>    at org.apache.hadoop.hdfs.tools.DFSAdmin.main(DFSAdmin.java:1068)
> starting jobtracker, logging to 
> /home/cloudera/KeplerData/workflows/module/hadoop-1.0.0/tools/bin/../logs/hadoop-cloudera-jobtracker-quickstart.cloudera.out
> cloudera at localhost's password:
> localhost: starting tasktracker, logging to 
> /home/cloudera/KeplerData/workflows/module/hadoop-1.0.0/tools/bin/../logs/hadoop-cloudera-tasktracker-quickstart.cloudera.out*
>
> *
> If there are some body can give me a help?
>
> Thanks,
>
> Truong Xuan Viet*
> *
>
>
> _______________________________________________
> Kepler-dev mailing list
> Kepler-dev at kepler-project.org
> http://lists.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nceas.ucsb.edu/kepler/pipermail/kepler-dev/attachments/20140927/7e098311/attachment.html>