Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-9268

[fiware-stackoverflow] Dump Twitter tweets from MongoDB to COSMOS

        Details

          Description

          Created question in FIWARE Q/A platform on 29-08-2015 at 16:08
          Please, ANSWER this question AT https://stackoverflow.com/questions/32287272/dump-twitter-tweets-from-mongodb-to-cosmos

          Question:
          Dump Twitter tweets from MongoDB to COSMOS

          Description:
          I'm wondering what should be the best approach to dump a lot of tweets obtained from Twitter Streaming API into COSMOS in order to run a very simple MR job.

          I was thinking on converting the collection documents to CSV, one per line probably, and then scp those to COSMOS. But I'm not sure if I need HIVE to run MR job once there or I can run the job in a more manual way. I was thinking on using Python for this, I prefer not having to use Java.

          Thanks

            Activity

            Descending order - Click to sort in ascending order
            Transition Time In Source Status Execution Times Last Executer Last Execution Date
            Open Open In Progress In Progress
            		2h 59m 1 Backlog Manager 27/May/17 6:04 PM
            In Progress In Progress Answered Answered
            		3h 1 Backlog Manager 27/May/17 9:04 PM
            Answered Answered Closed Closed
            		1d 10h 51m 1 Fernando Lopez 29/May/17 7:55 AM
            fla Fernando Lopez made changes -
            Fix Version/s 2021 [ 12600 ]
            fla Fernando Lopez made changes -
            Resolution Done [ 10000 ]
            Status Answered [ 10104 ] Closed [ 6 ]
            fla Fernando Lopez made changes -
            HD-Enabler Cosmos [ 10872 ]
            Description
            Created question in FIWARE Q/A platform on 29-08-2015 at 16:08
            {color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/32287272/dump-twitter-tweets-from-mongodb-to-cosmos


            +Question:+
            Dump Twitter tweets from MongoDB to COSMOS

            +Description:+
            I'm wondering what should be the best approach to dump a lot of tweets obtained from Twitter Streaming API into COSMOS in order to run a very simple MR job.

            I was thinking on converting the collection documents to CSV, one per line probably, and then scp those to COSMOS. But I'm not sure if I need HIVE to run MR job once there or I can run the job in a more manual way. I was thinking on using Python for this, I prefer not having to use Java.

            Thanks
            		 Created question in FIWARE Q/A platform on 29-08-2015 at 16:08
            {color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/32287272/dump-twitter-tweets-from-mongodb-to-cosmos


            +Question:+
            Dump Twitter tweets from MongoDB to COSMOS

            +Description:+
            I'm wondering what should be the best approach to dump a lot of tweets obtained from Twitter Streaming API into COSMOS in order to run a very simple MR job.

            I was thinking on converting the collection documents to CSV, one per line probably, and then scp those to COSMOS. But I'm not sure if I need HIVE to run MR job once there or I can run the job in a more manual way. I was thinking on using Python for this, I prefer not having to use Java.

            Thanks
            HD-Chapter Data [ 10838 ]
            fla Fernando Lopez made changes -
            Assignee Francisco Romero [ frb ]
            Hide
            Permalink
            backlogmanager Backlog Manager added a comment -

            2017-05-27 21:05|UPDATED status: transition Answered| # answers= 1, accepted answer= False

            Show
            backlogmanager Backlog Manager added a comment - 2017-05-27 21:05|UPDATED status: transition Answered| # answers= 1, accepted answer= False
            backlogmanager Backlog Manager made changes -
            Status In Progress [ 3 ] Answered [ 10104 ]
            Hide
            Permalink
            backlogmanager Backlog Manager added a comment -

            2017-05-27 18:05|UPDATED status: transition Answer| # answers= 1, accepted answer= False

            Show
            backlogmanager Backlog Manager added a comment - 2017-05-27 18:05|UPDATED status: transition Answer| # answers= 1, accepted answer= False
            backlogmanager Backlog Manager made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            backlogmanager Backlog Manager made changes -
            Field Original Value New Value
            Component/s FIWARE-TECH-HELP [ 10278 ]
            Hide
            Permalink
            backlogmanager Backlog Manager added a comment -

            2017-05-27 15:05|CREATED monitor | # answers= 1, accepted answer= False

            Show
            backlogmanager Backlog Manager added a comment - 2017-05-27 15:05|CREATED monitor | # answers= 1, accepted answer= False
            backlogmanager Backlog Manager created issue -

              People

              • Assignee:
                frb Francisco Romero
                Reporter:
                backlogmanager Backlog Manager
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: