Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-6590

FIWARE.Question.Tech.Data.BigData-Analysis.Error while trying to run a MapReduce job on FIWARE-Cosmos using Tidoop REST API

    Details

      Description

      Created question in FIWARE Q/A platform on 13-05-2016 at 15:05
      Please, ANSWER this question AT http://stackoverflow.com/questions/37211519/error-while-trying-to-run-a-mapreduce-job-on-fiware-cosmos-using-tidoop-rest-api

      Question:
      Error while trying to run a MapReduce job on FIWARE-Cosmos using Tidoop REST API

      Description:
      I am following this guide on Github and I am not able run the example mapreduced job mentioned in Step 5.

      I am aware that this file no longer exists:

      /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar

      And I am aware that the same file can now be found here:

      /usr/lib/hadoop-0.20/hadoop-examples-0.20.2-cdh3u6.jar

      So I form my call as below:

      curl -v -X POST "http://computing.cosmos.lab.fiware.org:12000/tidoop/v1/user/$user/jobs" -d '

      {"jar":"/usr/lib/hadoop-0.20/hadoop-examples-0.20.2-cdh3u6.jar","class_name":"WordCount","lib_jars":"/usr/lib/hadoop-0.20/hadoop-examples-0.20.2-cdh3u6.jar","input":"testdir","output":"testoutput"}

      ' -H "Content-Type: application/json" -H "X-Auth-Token: $TOKEN"

      The input directory exists in my hdfs user space and there is a file called testdata.txt inside it. The testoutput folder does not exist in my hdfs user space since I know it creates problems.

      When I execute this curl command, the error I get is

      {"success":"false","error":1}

      which is not very descriptive. Is there something I am missing here?

        Activity

        Hide
        backlogmanager Backlog Manager added a comment -

        2016-05-13 18:05|CREATED monitor | # answers= 0, accepted answer= False

        Show
        backlogmanager Backlog Manager added a comment - 2016-05-13 18:05|CREATED monitor | # answers= 0, accepted answer= False
        Hide
        burak Karaboga, Burak added a comment -

        Hi Francisco,

        Are there any updates on this?

        Regards,

        Burak

        Show
        burak Karaboga, Burak added a comment - Hi Francisco, Are there any updates on this? Regards, Burak
        Hide
        burak Karaboga, Burak added a comment -

        Hi Francisco,

        Thanks for your answer on the Stack Overflow. Please note that there is still a pending question on the comment to your answer.

        Regards,

        Burak

        Show
        burak Karaboga, Burak added a comment - Hi Francisco, Thanks for your answer on the Stack Overflow. Please note that there is still a pending question on the comment to your answer. Regards, Burak
        Hide
        backlogmanager Backlog Manager added a comment -

        2016-05-23 18:05|UPDATED status: transition Finish| # answers= 1, accepted answer= True

        Show
        backlogmanager Backlog Manager added a comment - 2016-05-23 18:05|UPDATED status: transition Finish| # answers= 1, accepted answer= True

          People

          • Assignee:
            frb Francisco Romero
            Reporter:
            backlogmanager Backlog Manager
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: