hadoop - Unable to run Pig Script in Psudo-distributed mode -


i trying write pig script.i have working in local mode, getting error when launch pig in psudo-distributed mode. here script: —————————————————————————————————————————————

register 'myfolder/target/myfunc-with-dependencies.jar'; set mapred.cache.files /tmp/scripts#scripts,/tmp/my_rules#my_rules; set mapred.create.symlink yes;  %default input 'test.seq' %default output 'final.out' %default timeout_ms '180000' %default use_devshm 'true'  data = load '$input' using com.pack.loaders.mytextloader('$timeout_ms'); store data '$output'

i following error: —————————————————————————————————————————————

2013-09-03 08:08:44,314 [main] warn org.apache.pig.backend.hadoop.executionengine.mapreducelayer.mapreducelauncher - ooops! job has failed! specify -stop_on_failure if want pig stop on failure. 2013-09-03 08:08:44,316 [main] info  org.apache.pig.backend.hadoop.executionengine.mapreducelayer.mapreducelauncher - job job_201309030605_0019 has failed! stop running dependent jobs 2013-09-03 08:08:44,319 [main] info  org.apache.pig.backend.hadoop.executionengine.mapreducelayer.mapreducelauncher - 100% complete 2013-09-03 08:08:44,323 [main] error org.apache.pig.tools.pigstats.pigstatsutil - 1 map reduce job(s) failed! 2013-09-03 08:08:44,323 [main] warn  org.apache.pig.tools.pigstats.scriptstate - unable read pigs manifest file 2013-09-03 08:08:44,325 [main] info  org.apache.pig.tools.pigstats.simplepigstats - script statistics:   hadoopversion   pigversion  userid  startedat   finishedat  features 1.2.1       vmuser  2013-09-03 08:07:57 2013-09-03 08:08:44 unknown  failed!  failed jobs: jobid   alias   feature message outputs job_201309030605_0019   data    map_only    message: job failed! error - jobcleanup task failure, task: task_201309030605_0019_m_000001 hdfs://localhost:9000/user/vmuser/final.out,  input(s): failed read data "hdfs://localhost:9000/user/vmuser/test.seq"  output(s): failed produce result in "hdfs://localhost:9000/user/vmuser/final.out"

—————————————————————————————————————————————

the file exist on hdfs , script doesn't register jar , uses pigstorage() instead of udf working fine. there other way register jar , call udf? appreciated.

the contents of pig log file :

pig stack trace

error 2244: job failed, hadoop not return error message  org.apache.pig.backend.executionengine.execexception: error 2244: job failed, hadoop not return error message     @ org.apache.pig.tools.grunt.gruntparser.executebatch(gruntparser.java:145)     @ org.apache.pig.tools.grunt.gruntparser.parsestoponerror(gruntparser.java:198)     @ org.apache.pig.tools.grunt.gruntparser.parsestoponerror(gruntparser.java:170)     @ org.apache.pig.tools.grunt.grunt.exec(grunt.java:84)     @ org.apache.pig.main.run(main.java:604)     @ org.apache.pig.main.main(main.java:157)     @ sun.reflect.nativemethodaccessorimpl.invoke0(native method)     @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57)     @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43)     @ java.lang.reflect.method.invoke(method.java:606)     @ org.apache.hadoop.util.runjar.main(runjar.java:160)

might link helps you: invoking program through java jar used in pig , give complete path of jar file hadoop can locate anywhere.


Comments

Post a Comment

Popular posts from this blog

html - How to style widget with post count different than without post count -

i have border below li elements in wordpress widget types appropriate. element inside set block gives them nice easy click full width. the problem, when choose option "show post count" when adding widget such categories or archives displays post count plain text after tag , because tag block pushes post number text line below. whether choose show post count or not show post count still gives exact same element identifyer example "widget_categories". how style post count not on next line still keep links non post count list items full width? here's example on sidebar www.bbmthemes.com/themes/modular/blog-standard/ in order solve problem need remove display:block; for ul.widgets ul a , add in it's place line-height: 33px; what going achieve have same visual effect. what going lose doing links going work on text , not on "box". the other way out of find post count coming , make changes this. example change text count i...
Read more

How to remove text and logo OR add Overflow on Android ActionBar using AppCompat on API 8? -

have researched death , cannot find answer. i have actionbar using appcompat. supporting api v7 (api v8 do). actionbar works api v11. api < v11 has problem of removing icon (and feature) actionbar without supplying overflow. big picture have app logo, app title, , 3 icons squidging same actionbar on low end phone. trying make room! i happy 1 of 2 solutions. either: a method of getting overflow functionality can retrieved pull down. (preferred) method of removing icon , text actionbar below current xml api 11+: <resources> <!-- base application theme api 11+. theme replaces appbasetheme res/values/styles.xml on api 11+ devices. --> <style name="appbasetheme" parent="theme.appcompat.light.darkactionbar"> <item name="android:actionbarstyle">@style/liteactionbarstyle</item> <item name="actionbarstyle">@style/liteactionbarstyle</item> </st...
Read more

IIS->Tomcat Redirect: multiple worker with default -

i trying configure multiple instances of tomcat (7) behind single domain in iis. tomcat instances both run on separate ports. have installed tomcat isapi_rediect.dll , configured iis. everything works redirector, except (you knew coming) being told "all other traffic must mapped 1 of 2 instances (they different applications). more accurate requests except specific pattern need mapped 1 worker , specific pattern (/rpt) needs go other worker. i have 2 workers defined in workers.properties: worker.list=ajp13_1,ajp13_2 worker.ajp13_1.port=8009 worker.ajp13_2.port=8010 and following in uriworkermap.properties: /wxx|/*=ajp13_1 /rpt|/*=ajp13_2 with this, seems fine. except (considerable) number of request not include wxx scope. need map rpt , sub content ajp3_2 , other requests ajp3_1. if add /|*=ajp13_1 then ajp3_2 becomes unreachable , wildchar match maps /rpt/* uri ajp3_1. is there way trying do? appreciate help- have spent time reading same references ...
Read more