[kepler-dev] Hadoop problems
Jianwu Wang
jianwu at sdsc.edu
Sun Sep 28 06:03:03 PDT 2014
Hi Viet,
It looks your Hadoop namenode was not correctly formatted and
started. It's a very common hadoop problem. The solution I usually use
is 1) first kill running hadoop processes if you have any; 2) clean the
files and directories; 3) try namenode format again. In your case, the
clean command should be "rm -rf /tmp/hadoop-cloudera*"
Best wishes
Sincerely yours
Jianwu WANG, Ph.D.
jianwu at sdsc.edu
http://users.sdsc.edu/~jianwu/
Assistant Director for Research
Workflows for Data Science (WorDS) Center of Excellence
San Diego Supercomputer Center (SDSC)
University of California, San Diego (UCSD)
On 9/28/14, 8:02 AM, Viet Truong Xuan wrote:
> Hi Mr. Jianwu Wang,
>
> Thanks for for answer, the cloudera at localhost's password is already
> entered (it's not showed in the screen as usual). I have changed the
> the permission to the /root/ user, but it's not run yet.
> I have tried to run bin/format-namenode.sh, it seems better but there
> exist still errors:
>
> /localhost/127.0.0.1:54310 <http://127.0.0.1:54310>. Already tried 0
> time(s).
> ...
> Bad connection to FS. command aborted
>
> /
> If you have some advises for this problem?/
>
> /
> Thanks/,
>
> /
> Viet/
> /
>
> On Sun, Sep 28, 2014 at 7:00 PM, Viet Truong Xuan <txviet26 at gmail.com
> <mailto:txviet26 at gmail.com>> wrote:
>
> Hi Mr. Jianwu Wang,
>
> Thanks for for answer, the cloudera at localhost's password is
> already entered (it's not showed in the screen as usual). I have
> changed the the permission to the /root/ user, but it's not run yet.
>
> I have tried to run bin/format-namenode.sh, it seems better but
> the there are still errors:
>
>
> On Sun, Sep 28, 2014 at 9:12 AM, Jianwu Wang <jianwu at sdsc.edu
> <mailto:jianwu at sdsc.edu>> wrote:
>
> Hi Viet,
>
> Your messages include "cloudera at localhost's password",
> which probably means you didn't set up ssh localhost login
> without password. It might cause some problems.
>
> One more thing worthy to be noted is that you should run
> bin/format-namenode.sh before bin/start-hadoop.sh to format
> namenode.
>
> Best wishes
>
> Sincerely yours
>
> Jianwu WANG, Ph.D.
> jianwu at sdsc.edu <mailto:jianwu at sdsc.edu>
> http://users.sdsc.edu/~jianwu/ <http://users.sdsc.edu/%7Ejianwu/>
>
> Assistant Director for Research
> Workflows for Data Science (WorDS) Center of Excellence
> San Diego Supercomputer Center (SDSC)
> University of California, San Diego (UCSD)
>
> On 9/27/14, 8:33 AM, Viet Truong Xuan wrote:
>> Dear all,
>>
>> I'm trying to run the examples of Hadoop on Kepler 2.4, but
>> get some problems with it.
>> When I start the Hadoop service (with correct passwords as
>> required) with:
>> *bin/start-hadoop.sh
>> *
>> /The output is as the following and the worklows cannot be run:/
>>
>> bin
>> bin=.
>> bin=/home/cloudera/KeplerData/workflows/module/hadoop-1.0.0/tools/bin
>> starting namenode, logging to
>> /home/cloudera/KeplerData/workflows/module/hadoop-1.0.0/tools/bin/../logs/hadoop-cloudera-namenode-quickstart.cloudera.out
>> cloudera at localhost's password:
>> localhost: starting datanode, logging to
>> /home/cloudera/KeplerData/workflows/module/hadoop-1.0.0/tools/bin/../logs/hadoop-cloudera-datanode-quickstart.cloudera.out
>> cloudera at localhost's password:
>> localhost: starting secondarynamenode, logging to
>> /home/cloudera/KeplerData/workflows/module/hadoop-1.0.0/tools/bin/../logs/hadoop-cloudera-secondarynamenode-quickstart.cloudera.out
>> localhost: Exception in thread "main"
>> java.lang.NoClassDefFoundError:
>> com.sun.security.auth.UnixPrincipal
>> localhost: at
>> org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformation.java:313)
>> localhost: at java.lang.Class.initializeClass(libgcj.so.10)
>> localhost: at
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.initialize(SecondaryNameNode.java:144)
>> localhost: at
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.<init>(SecondaryNameNode.java:125)
>> localhost: at
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:579)
>> DEPRECATED: Use of this script to execute hdfs command is
>> deprecated.
>> Instead use the hdfs command for it.
>>
>> Exception in thread "main" java.lang.NoClassDefFoundError:
>> com.sun.security.auth.UnixPrincipal
>> at
>> org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformation.java:313)
>> at java.lang.Class.initializeClass(libgcj.so.10)
>> at
>> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1953)
>> at
>> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1945)
>> at
>> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1807)
>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:265)
>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:146)
>> at org.apache.hadoop.fs.FsShell.init(FsShell.java:85)
>> at
>> org.apache.hadoop.hdfs.tools.DFSAdmin.run(DFSAdmin.java:981)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>> at
>> org.apache.hadoop.hdfs.tools.DFSAdmin.main(DFSAdmin.java:1068)
>> starting jobtracker, logging to
>> /home/cloudera/KeplerData/workflows/module/hadoop-1.0.0/tools/bin/../logs/hadoop-cloudera-jobtracker-quickstart.cloudera.out
>> cloudera at localhost's password:
>> localhost: starting tasktracker, logging to
>> /home/cloudera/KeplerData/workflows/module/hadoop-1.0.0/tools/bin/../logs/hadoop-cloudera-tasktracker-quickstart.cloudera.out*
>>
>> *
>> If there are some body can give me a help?
>>
>> Thanks,
>>
>> Truong Xuan Viet*
>> *
>>
>>
>> _______________________________________________
>> Kepler-dev mailing list
>> Kepler-dev at kepler-project.org <mailto:Kepler-dev at kepler-project.org>
>> http://lists.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-dev
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nceas.ucsb.edu/kepler/pipermail/kepler-dev/attachments/20140928/ac929283/attachment-0001.html>
More information about the Kepler-dev
mailing list