Unable to setup the load function

Discussion in 'Big Data and Analytics' started by ishan, Feb 22, 2016.

  1. ishan

    ishan Member
    Alumni

    Joined:
    Oct 5, 2015
    Messages:
    6
    Likes Received:
    0
    While loading a file in local mode in pig and illustrating the same, I am getting the below error.

    grunt> illustrate rec;2016-02-22 19:23:45,985 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:///2016-02-22 19:23:46,149 [main] INFO org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer - {RULES_ENABLED=[ConstantCalculator, LoadTypeCastInserter, PredicatePushdownOptimizer, StreamTypeCastInserter], RULES_DISABLED=[AddForEach, ColumnMapKeyPrune, GroupByConstParallelSetter, LimitOptimizer, MergeFilter, MergeForEach, PartitionFilterOptimizer, PushDownForEachFlatten, PushUpFilter, SplitFilter]}2016-02-22 19:23:46,269 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File concatenation threshold: 100 optimistic? false2016-02-22 19:23:46,299 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before optimization: 12016-02-22 19:23:46,299 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after optimization: 12016-02-22 19:23:46,318 [main] INFO org.apache.pig.tools.pigstats.mapreduce.MRScriptState - Pig script settings are added to the job2016-02-22 19:23:46,326 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.32016-02-22 19:23:46,537 [main] WARN org.apache.pig.data.SchemaTupleBackend - SchemaTupleBackend has already been initialized2016-02-22 19:23:46,561 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map - Aliases being processed per job phase (AliasName[line,offset]): M: rec[1,6] C: R: 2016-02-22 19:23:46,579 [main] ERROR org.apache.pig.pen.ExampleGenerator - Error reading data. Unable to setup the load function.org.apache.pig.backend.executionengine.ExecException: ERROR 2081: Unable to setup the load function. at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLoad.getNextTuple(POLoad.java:131) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:279) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:274) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:64) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) at org.apache.pig.pen.LocalMapReduceSimulator.launchPig(LocalMapReduceSimulator.java:202) at org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:259) at org.apache.pig.pen.ExampleGenerator.readBaseData(ExampleGenerator.java:223) at org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:155) at org.apache.pig.PigServer.getExamples(PigServer.java:1346) at org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java:812) at org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(PigScriptParser.java:818) at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:385) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205) at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66) at org.apache.pig.Main.run(Main.java:565) at org.apache.pig.Main.main(Main.java:177) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136)Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/home/aa69b7d2bddad2a029dbdad4902352/1.txt at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387) at org.apache.pig.impl.io.ReadToEndLoader.init(ReadToEndLoader.java:190) at org.apache.pig.impl.io.ReadToEndLoader.<init>(ReadToEndLoader.java:146) at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLoad.setUp(POLoad.java:99) at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLoad.getNextTuple(POLoad.java:127) ... 23 more
     
    #1
  2. DeshDeep Singh

    DeshDeep Singh Well-Known Member
    Simplilearn Support Alumni

    Joined:
    Sep 22, 2015
    Messages:
    935
    Likes Received:
    66

    Hi Ishan,

    There are lot more known issues with this command, why don't you try describe or Dump.
     
    #2
  3. ishan

    ishan Member
    Alumni

    Joined:
    Oct 5, 2015
    Messages:
    6
    Likes Received:
    0
    Hi DeshDeep,

    I have tried to use dump as well but getting the same error. I am thinking is this required any prerequisites while running the pig script.
     
    #3
  4. DeshDeep Singh

    DeshDeep Singh Well-Known Member
    Simplilearn Support Alumni

    Joined:
    Sep 22, 2015
    Messages:
    935
    Likes Received:
    66
    Hi Ishan,

    I will connect to you through mail and will help you resolve it.
     
    #4

Share This Page