Details
-
Type:
Monitor
-
Status: Closed
-
Priority:
Major
-
Resolution: Done
-
Affects Version/s: None
-
Fix Version/s: 2021
-
Component/s: FIWARE-TECH-HELP
-
Labels:
-
HD-Chapter:Data
-
HD-Enabler:Cosmos
Description
Created question in FIWARE Q/A platform on 13-05-2016 at 15:05
Please, ANSWER this question AT http://stackoverflow.com/questions/37211519/error-while-trying-to-run-a-mapreduce-job-on-fiware-cosmos-using-tidoop-rest-api
Question:
Error while trying to run a MapReduce job on FIWARE-Cosmos using Tidoop REST API
Description:
I am following this guide on Github and I am not able run the example mapreduced job mentioned in Step 5.
I am aware that this file no longer exists:
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar
And I am aware that the same file can now be found here:
/usr/lib/hadoop-0.20/hadoop-examples-0.20.2-cdh3u6.jar
So I form my call as below:
curl -v -X POST "http://computing.cosmos.lab.fiware.org:12000/tidoop/v1/user/$user/jobs" -d '
{"jar":"/usr/lib/hadoop-0.20/hadoop-examples-0.20.2-cdh3u6.jar","class_name":"WordCount","lib_jars":"/usr/lib/hadoop-0.20/hadoop-examples-0.20.2-cdh3u6.jar","input":"testdir","output":"testoutput"}' -H "Content-Type: application/json" -H "X-Auth-Token: $TOKEN"
The input directory exists in my hdfs user space and there is a file called testdata.txt inside it. The testoutput folder does not exist in my hdfs user space since I know it creates problems.
When I execute this curl command, the error I get is
{"success":"false","error":1}which is not very descriptive. Is there something I am missing here?
Activity
| Transition | Time In Source Status | Execution Times | Last Executer | Last Execution Date | |||||
|---|---|---|---|---|---|---|---|---|---|
|
5d 14h 10m | 1 | Francisco Romero | 19/May/16 8:17 AM | |||||
|
1s | 1 | Francisco Romero | 19/May/16 8:17 AM | |||||
|
4d 9h 49m | 1 | Backlog Manager | 23/May/16 6:07 PM |
