Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-6698

FIWARE.Question.Tech.Data.BigData-Analysis.Unable to use custom Mapreduce jar files in Cosmos

        Details

          Description

          Created question in FIWARE Q/A platform on 31-05-2016 at 15:05
          Please, ANSWER this question AT http://stackoverflow.com/questions/37546569/unable-to-use-custom-mapreduce-jar-files-in-cosmos

          Question:
          Unable to use custom Mapreduce jar files in Cosmos

          Description:
          I created my own Mapreduce jar file and tested in the Cosmos' old Hadoop cluster successfully using the HDFS shell commands. The next step was to test the same jar in the new cluster, so I uploaded it to the
          new cluster's HDFS, to my home folder (user/my.username).

          When I try to start a Mapreduce job using the curl post below,

          curl -X POST "http://computing.cosmos.lab.fiware.org:12000/tidoop/v1/user/my.username/jobs" -d '

          {"jar":"dt.jar","class_name":"DistanceTest","lib_jars":"dt.jar","input":"input","output":"output"}

          ' -H "Content-Type: application/json" -H "X-Auth-Token: xxxxxxxxxxxxxxxxxxx"

          I get:

          {"success":"false","error":255}

          I tried different path values for the jar and I get the same result. Do I have to upload my jar to somewhere else or am I missing some necessary steps?

            Activity

            Descending order - Click to sort in ascending order
            Transition Time In Source Status Execution Times Last Executer Last Execution Date
            Open Open In Progress In Progress
            		2h 59m 1 Backlog Manager 31/May/16 6:07 PM
            In Progress In Progress Closed Closed
            		3h 1 Backlog Manager 31/May/16 9:07 PM
            fla Fernando Lopez made changes -
            Fix Version/s 2021 [ 12600 ]
            backlogmanager Backlog Manager made changes -
            Summary [fiware-stackoverflow] Unable to use custom Mapreduce jar files in Cosmos FIWARE.Question.Tech.Data.BigData-Analysis.Unable to use custom Mapreduce jar files in Cosmos
            HD-Node Unknown [ 10852 ]
            Hide
            Permalink
            backlogmanager Backlog Manager added a comment -

            2016-05-31 21:05|UPDATED status: transition Finish| # answers= 1, accepted answer= True

            Show
            backlogmanager Backlog Manager added a comment - 2016-05-31 21:05|UPDATED status: transition Finish| # answers= 1, accepted answer= True
            backlogmanager Backlog Manager made changes -
            Resolution Done [ 10000 ]
            Status In Progress [ 3 ] Closed [ 6 ]
            Hide
            Permalink
            backlogmanager Backlog Manager added a comment -

            2016-05-31 18:05|UPDATED status: transition Answer| # answers= 1, accepted answer= True

            Show
            backlogmanager Backlog Manager added a comment - 2016-05-31 18:05|UPDATED status: transition Answer| # answers= 1, accepted answer= True
            backlogmanager Backlog Manager made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            backlogmanager Backlog Manager made changes -
            Assignee Francisco Romero [ frb ]
            backlogmanager Backlog Manager made changes -
            HD-Chapter Unknown [ 10845 ] Data [ 10838 ]
            mev Manuel Escriche made changes -
            HD-Enabler Unknown [ 10910 ] Cosmos [ 10872 ]
            backlogmanager Backlog Manager made changes -
            HD-Enabler Unknown [ 10910 ]
            HD-Chapter Unknown [ 10845 ]
            HD-Node Unknown [ 10852 ]
            backlogmanager Backlog Manager made changes -
            Field Original Value New Value
            Component/s FIWARE-TECH-HELP [ 10278 ]
            Hide
            Permalink
            backlogmanager Backlog Manager added a comment -

            2016-05-31 15:05|CREATED monitor | # answers= 0, accepted answer= False

            Show
            backlogmanager Backlog Manager added a comment - 2016-05-31 15:05|CREATED monitor | # answers= 0, accepted answer= False
            backlogmanager Backlog Manager created issue -

              People

              • Assignee:
                frb Francisco Romero
                Reporter:
                backlogmanager Backlog Manager
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: