Details
-
Type:
Monitor
-
Status: Closed
-
Priority:
Major
-
Resolution: Done
-
Affects Version/s: None
-
Fix Version/s: 2021
-
Component/s: FIWARE-TECH-HELP
-
Labels:
-
HD-Chapter:Data
-
HD-Enabler:Cosmos
Description
Created question in FIWARE Q/A platform on 29-08-2015 at 16:08
Please, ANSWER this question AT https://stackoverflow.com/questions/32287272/dump-twitter-tweets-from-mongodb-to-cosmos
Question:
Dump Twitter tweets from MongoDB to COSMOS
Description:
I'm wondering what should be the best approach to dump a lot of tweets obtained from Twitter Streaming API into COSMOS in order to run a very simple MR job.
I was thinking on converting the collection documents to CSV, one per line probably, and then scp those to COSMOS. But I'm not sure if I need HIVE to run MR job once there or I can run the job in a more manual way. I was thinking on using Python for this, I prefer not having to use Java.
Thanks
Activity
| Field | Original Value | New Value |
|---|---|---|
| Component/s | FIWARE-TECH-HELP [ 10278 ] |
| Status | Open [ 1 ] | In Progress [ 3 ] |
| Status | In Progress [ 3 ] | Answered [ 10104 ] |
| Assignee | Francisco Romero [ frb ] |
| HD-Enabler | Cosmos [ 10872 ] | |
| Description |
Created question in FIWARE Q/A platform on 29-08-2015 at 16:08 {color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/32287272/dump-twitter-tweets-from-mongodb-to-cosmos +Question:+ Dump Twitter tweets from MongoDB to COSMOS +Description:+ I'm wondering what should be the best approach to dump a lot of tweets obtained from Twitter Streaming API into COSMOS in order to run a very simple MR job. I was thinking on converting the collection documents to CSV, one per line probably, and then scp those to COSMOS. But I'm not sure if I need HIVE to run MR job once there or I can run the job in a more manual way. I was thinking on using Python for this, I prefer not having to use Java. Thanks |
Created question in FIWARE Q/A platform on 29-08-2015 at 16:08
{color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/32287272/dump-twitter-tweets-from-mongodb-to-cosmos +Question:+ Dump Twitter tweets from MongoDB to COSMOS +Description:+ I'm wondering what should be the best approach to dump a lot of tweets obtained from Twitter Streaming API into COSMOS in order to run a very simple MR job. I was thinking on converting the collection documents to CSV, one per line probably, and then scp those to COSMOS. But I'm not sure if I need HIVE to run MR job once there or I can run the job in a more manual way. I was thinking on using Python for this, I prefer not having to use Java. Thanks |
| HD-Chapter | Data [ 10838 ] |
| Resolution | Done [ 10000 ] | |
| Status | Answered [ 10104 ] | Closed [ 6 ] |
| Fix Version/s | 2021 [ 12600 ] |