> Unexpected Internal
> Error 1200: Failed To Create Datastorage
Error 1200: Failed To Create Datastorage
Browse other questions tagged hadoop apache-pig or ask your own question. This distribution will need additional classpath settings and java settings to run with mapr.Refer to [No FileSystem for scheme: maprfs](http://answers.mapr.com/questions/567/no-filesystem-for-scheme-maprfs), an earlier post with similar issues.In your case, set
and Below I am including my system's information, hopefully thiswill be useful for a diagnosis.The log file has the following:Error before Pig is launched----------------------------ERROR 2999: Unexpected internal error. Any ideas on what to do tofix this?
Aug 09 2014 11:02 AM Your Answer 0% Click on this icon to add code snippet. Should I be saving 'input.txt' and the original 'wordcount.pig' script to some special folder inside the directory pig-0.11.1? Failed to create DataStorage2015-01-23 11:59:37,527 [main] WARN org.apache.pig.Main - There is no log file to write to.2015-01-23 11:59:37,527 [main] ERROR org.apache.pig.Main - java.lang.RuntimeException: Failed to create DataStorageat org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75)at org.apache.pig.backend.hadoop.datastorage.HDataStorage.(HDataStorage.java:58)at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:215)at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:122)at apache hadoop apache-pig data-storage share|improve this question asked Aug 2 '11 at 16:13 seagaia 8117 add a comment| 1 Answer 1 active oldest votes up vote 1 down vote Check https://cwiki.apache.org/confluence/display/PIG/FAQ#FAQ-Q%3AWhatshallIdoifIsaw%22FailedtocreateDataStorage%22%3F http://stackoverflow.com/questions/6915133/failed-to-create-datastorage-error-when-using-pig-with-hadoop
Error 1200: Failed To Create Datastorage
Failed to create DataStorage Strange problem with Pig 0.7.0 and Hadoop 0.20.2 and Failed to create DataStorage Failed to create DataStorage pig connecting to hadoop - Failed to create DataStorage rpc In your example the path is absolute so it doesn't matter. Thanks again for your answers!!! –user2450223 Jun 4 '13 at 16:35 Turns out the problem was the mapred-site.xml was not set properly under Hadoop's conf directory and then Hadoop
Then, whenyou run pig, put the pig-withouthadoop.jar on your classpath as well as yourhadoop jar. Can I also type at the grunt shell prompt: grunt>cd ~/Desktop and then grunt> wordcount.pig, assuming that input.txt and wordcount.pig were both in Desktop? In my case, I found that scripts only worked if I additionallymanually registered the antlr jar:register /path/to/pig/build/ivy/lib/Pig/antlr-runtime-3.2.jar;2011/5/23 Rui Miguel Forte Hello,I have been trying to set up pig 0.8.1 to work Notify me of new posts via email.
Then, when you run pig, put the pig-withouthadoop.jar on your classpath as well as your hadoop jar. Error 2999 Unexpected Internal Error Null Fill in your details below or click an icon to log in: Email (required) (Address never made public) Name (required) Website You are commenting using your WordPress.com account. (LogOut/Change) You are Below I am including my system's information, hopefully thiswill be useful for a diagnosis.The log file has the following:Error before Pig is launched----------------------------ERROR 2999: Unexpected internal error. I already have Pig 0.11.1 downloaded on my local machine, as well as Hadoop, and Java 6.
I am not clear on what you mean by register the antlr jar script though. Please help© 2016 Jive Software | Powered by Jive SoftwareHome | Top of page | HelpJive Software Version: 2016.2.5.1, revision: 20160908201010.1a61f7a.hotfix_2016.2.5.1 Call us 1-844-696-6465 (US Toll Free) Home Courses Big Data Why were Navajo code talkers used during WW2? Does DFT produces the same output as FFT?
- Storage (HDFS, HBase...
- I am not clear onwhat you mean by register the antlr jar script though.
- Then, make sure the following two environment variables are set correctly: export PIG_CLASSPATH=~/hadoop-0.23.4/etc/hadoop export HADOOP_HOME=~/hadoop-0.23.4 Share this:TwitterFacebookLike this:Like Loading...
- Does Nietzsche's rejection of Socrates mean that he is a relativist about ethics? "Squeezing out of a dead man" proverb Split python tuple in subtuples with capacity limit in functional programming
- Then, whenyou run pig, put the pig-withouthadoop.jar on your classpath as well as yourhadoop jar.
- What game is the guard playing in this picture?
- Failed to create DataStorage Does pig-0.8.1 works with hadoop-0.20.2-cdh3u0 pig 0.8.1 and hadoop 0.20.203 rpc error which invoking pig -x mapreduce Timed out waiting for rpc response Error Failed to create
- Is it an incompatibility issue or something I am doingwrong?
- You say you have downloaded Hadoop -- have you installed it?
Error 2999 Unexpected Internal Error Null
Why does removing Iceweasel nuke GNOME? It's good to do a tar -xzvf pig..tar.gz from terminal. Make sure u are running Hadoop before u execute pig -x local kind of commands. Failed to create DataStorageDetails at logfile: /home/miguel/pig_1306168509838.logHadoop itself runs normally on my system.
Thanks again for your answer! –user2450223 Jun 4 '13 at 15:43 You can do it however you want. If you copy and paste the script in, of course it doesn't matter where it is saved; you can also run it with RUN /path/to/script;. If you use absolute paths you'll never have an issue. –reo katoa Jun 4 '13 at 15:58 Thanks. Show 3 comments3 RepliesNameEmail AddressWebsite AddressName(Required)Email Address(Required, will not be published)Website Addressricha Oct 4, 2011 5:06 AMUnmark CorrectCorrect AnswerIs there a reason why you are pointing your PIG\_CONF\_DIR to hadoop's conf
Dealing with a nasty recruiter Is Certificate validation done completely local? Enable Wireless on Fresh Debian Build How can I make two cutting lines close to each other? Any ideas on what to do to fix this?
Linked 1 Error in pig on spark while executing Related 215Difference between Pig and Hive?
Why have both?2ORDER BY job failed in the Pig script while running EmbeddedPig using Java1Nested Flatten in Pig1Getting error in apche Pig when running over yarn “org.apache.hadoop.ipc.Client - Retrying connect to Former boss asking me to do presentations How to apply for UK visit visa after four refusal My 21-year-old adult son hates me Player claims their wizard character knows everything (from Failed to create DataStorage Date Mon, 23 May 2011 16:49:33 GMT Hello, I have been trying to set up pig 0.8.1 to work with hadoop 0.20.203 without success. Join them; it only takes a minute: Sign up “Failed to create DataStorage” error when using Pig with Hadoop up vote 5 down vote favorite I've been trying to get Pig
Never do a right click --> extract here, when dealing with tar.gz files. If the path in the LOAD statement is relative, then it will look in the directory you're in when you launch Grunt. current community chat Stack Overflow Meta Stack Overflow your communities Sign up or log in to customize your list. Failed to create DataStoragejava.lang.RuntimeException: Failed to create DataStorageatorg.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75)atorg.apache.pig.backend.hadoop.datastorage.HDataStorage.(HDataStorage.java:58)atorg.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:214)atorg.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:134)at org.apache.pig.impl.PigContext.connect(PigContext.java:183)at org.apache.pig.PigServer.(PigServer.java:226)at org.apache.pig.PigServer.(PigServer.java:215)at org.apache.pig.tools.grunt.Grunt.(Grunt.java:55)at org.apache.pig.Main.run(Main.java:452)at org.apache.pig.Main.main(Main.java:107)Caused by: java.io.IOException: Call to localhost/127.0.0.1:54310failed on local exception: java.io.EOFExceptionat org.apache.hadoop.ipc.Client.wrapException(Client.java:775)at org.apache.hadoop.ipc.Client.call(Client.java:743)at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)at $Proxy0.getProtocolVersion(Unknown Source)at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)atorg.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:207)at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:170)atorg.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)atorg.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)at
If so, then when you make a pig script, begin it with: register /path/to/pig/build/ivy/lib/Pig/antlr-runtime-3.2.jar; 2011/5/26 Rui Miguel Forte Jonathan Coveney at May 26, 2011 at 2:06 pm ⇧ Did you build Failed to create DataStorage Rui Miguel ForteMay 23, 2011 at 4:50 pm Hello,I have been trying to set up pig 0.8.1 to work with hadoop 0.20.203without success. If u want to run *.pig files from grunt> prompt, use: grunt> exec *.pig If u want to run pig files outside grunt> prompt, use: $ pig -x local *.pig share|improve I am not clear onwhat you mean by register the antlr jar script though.
In my case, I found that scripts only worked if I additionallymanually registered the antlr jar:register /path/to/pig/build/ivy/lib/Pig/antlr-runtime-3.2.jar;2011/5/23 Rui Miguel Forte Hello,I have been trying to set up pig 0.8.1 to work Failed to create DataStorage Not entirely sure where to go from here.