Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-14535

[Fiware-tech-help] Questions for Fiware-Tidoop Project

    Details

    • Type: extRequest
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Fix Version/s: 2021
    • Component/s: FIWARE-TECH-HELP
    • Labels:
      None
    • HD-Enabler:
      Cosmos

      Description

      Hi Team,

      I hope this mail finds you well.

      This is regarding a question that is related to your fiware-tidoop project for ckan file transfer. I want to use your project for ckan file transfer from HDFS file format and vise-versa. I have tried your project for transferring a simple csv/txt file from ckan to hdfs & vice versa and I am unable to see the file getting transferred in correct file format. Basically I have made the file format changes in run function as "TextInputFormat.class" for the hdfs side but I the job runs and creates an empty file for both upload/download from ckan. Can you please help us resolving this issue. Am I doing the correct changes for making this project customizable for hdfs to ckan transfer.

      Link of the project: https://github.com/telefonicaid/fiware-tidoop/tree/master/tidoop-hadoop-ext#section3.1.4<https://github.com/telefonicaid/fiware-tidoop/tree/master/tidoop-hadoop-ext%23section3.1.4>

      Do you have any example code for ckan to hdfs file transfer or vice-versa. Please let me know if need more information regarding this.
      Any help is appreciable here.

      Thanks & Regards,
      Ankan Ghosh
      State of California Project - Accenture
      +91 9610188122 | HDC3

      ________________________________

      This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security and assessment of internal compliance with Accenture policy. Your privacy is important to us. Accenture uses your personal data only in compliance with data protection laws. For further information on how Accenture processes your personal data, please see our privacy statement at https://www.accenture.com/us-en/privacy-policy.
      ______________________________________________________________________________________

      www.accenture.com

      __________________________________________________________________________________________

      You can get more information about our cookies and privacy policies on the following links:

      Fiware-tech-help mailing list
      Fiware-tech-help@lists.fiware.org
      https://lists.fiware.org/listinfo/fiware-tech-help

      [Created via e-mail received from: "Ghosh, Ankan" <ankan.ghosh@accenture.com>]

        Activity

        Hide
        andres.munoza Andres Muñoz added a comment -

        Hi Ankan,

        Currently we are working on adapting new Big data components to Fiware ecosystem because now better solutions and tools that are replacing map reduce have been released. That is the reason why we are not deployed or supporting new things related to map reduce (including tidoop). But if you need, you can contact directly to the maintainer of the repo () in case they can help you with your request https://github.com/telefonicaid/fiware-tidoop/tree/master/tidoop-hadoop-ext.

        Moreover, if you want to share us what are the things you need to perform using big data tools, we can provide you some tips or tools that could help you to solve your problem.

        Show
        andres.munoza Andres Muñoz added a comment - Hi Ankan, Currently we are working on adapting new Big data components to Fiware ecosystem because now better solutions and tools that are replacing map reduce have been released. That is the reason why we are not deployed or supporting new things related to map reduce (including tidoop). But if you need, you can contact directly to the maintainer of the repo () in case they can help you with your request https://github.com/telefonicaid/fiware-tidoop/tree/master/tidoop-hadoop-ext . Moreover, if you want to share us what are the things you need to perform using big data tools, we can provide you some tips or tools that could help you to solve your problem.

          People

          • Assignee:
            andres.munoza Andres Muñoz
            Reporter:
            fw.ext.user FW External User
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: