Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-8998

[fiware-stackoverflow] Error while trying to run a MapReduce job on FIWARE-Cosmos using Tidoop REST API

        Details

          Description

          Created question in FIWARE Q/A platform on 13-05-2016 at 15:05
          Please, ANSWER this question AT https://stackoverflow.com/questions/37211519/error-while-trying-to-run-a-mapreduce-job-on-fiware-cosmos-using-tidoop-rest-api

          Question:
          Error while trying to run a MapReduce job on FIWARE-Cosmos using Tidoop REST API

          Description:
          I am following this guide on Github and I am not able run the example mapreduced job mentioned in Step 5.

          I am aware that this file no longer exists:

          /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar

          And I am aware that the same file can now be found here:

          /usr/lib/hadoop-0.20/hadoop-examples-0.20.2-cdh3u6.jar

          So I form my call as below:

          curl -v -X POST "http://computing.cosmos.lab.fiware.org:12000/tidoop/v1/user/$user/jobs" -d '

          {"jar":"/usr/lib/hadoop-0.20/hadoop-examples-0.20.2-cdh3u6.jar","class_name":"WordCount","lib_jars":"/usr/lib/hadoop-0.20/hadoop-examples-0.20.2-cdh3u6.jar","input":"testdir","output":"testoutput"}

          ' -H "Content-Type: application/json" -H "X-Auth-Token: $TOKEN"

          The input directory exists in my hdfs user space and there is a file called testdata.txt inside it. The testoutput folder does not exist in my hdfs user space since I know it creates problems.

          When I execute this curl command, the error I get is

          {"success":"false","error":1}

          which is not very descriptive. Is there something I am missing here?

            Activity

            Descending order - Click to sort in ascending order
            Transition Time In Source Status Execution Times Last Executer Last Execution Date
            Open Open In Progress In Progress
            		2h 55m 1 Backlog Manager 22/May/17 6:08 PM
            In Progress In Progress Closed Closed
            		3h 1 Backlog Manager 22/May/17 9:08 PM
            fla Fernando Lopez made changes -
            Fix Version/s 2021 [ 12600 ]
            fla Fernando Lopez made changes -
            Assignee Backlog Manager [ backlogmanager ]
            veronika Veronika Vlnkova made changes -
            HD-Enabler Cosmos [ 10872 ]
            Hide
            Permalink
            backlogmanager Backlog Manager added a comment -

            2017-05-22 21:10|UPDATED status: transition Finish| # answers= 1, accepted answer= True

            Show
            backlogmanager Backlog Manager added a comment - 2017-05-22 21:10|UPDATED status: transition Finish| # answers= 1, accepted answer= True
            backlogmanager Backlog Manager made changes -
            Resolution Done [ 10000 ]
            Status In Progress [ 3 ] Closed [ 6 ]
            Hide
            Permalink
            backlogmanager Backlog Manager added a comment -

            2017-05-22 18:10|UPDATED status: transition Answer| # answers= 1, accepted answer= True

            Show
            backlogmanager Backlog Manager added a comment - 2017-05-22 18:10|UPDATED status: transition Answer| # answers= 1, accepted answer= True
            backlogmanager Backlog Manager made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            backlogmanager Backlog Manager made changes -
            Field Original Value New Value
            Component/s FIWARE-TECH-HELP [ 10278 ]
            Hide
            Permalink
            backlogmanager Backlog Manager added a comment -

            2017-05-22 15:14|CREATED monitor | # answers= 1, accepted answer= True

            Show
            backlogmanager Backlog Manager added a comment - 2017-05-22 15:14|CREATED monitor | # answers= 1, accepted answer= True
            backlogmanager Backlog Manager created issue -

              People

              • Assignee:
                backlogmanager Backlog Manager
                Reporter:
                backlogmanager Backlog Manager
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: