Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-4757

FIWARE.Request.Tech.Data.BigData-Analysis.CosmosAuthentication

    Details

    • Type: extRequest
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Fix Version/s: 2021
    • Component/s: FIWARE-TECH-HELP
    • Labels:
      None

      Description

      Hello,

      i am providing technical support for FRACTALS accelerator project and i
      have received the issue below.
      Any help would be appreciated!

      -------------
      I am facing a difficulty with the Comsos integration. I've set up an FiLab
      instance to work as a proxy server between my application server (external
      to FiLab) and the global Cosmos instance. After trying to connect from my
      application server, I found out that "all the documented connections to
      such global instance (except for ssh connections and the Cosmos portal)
      must be done from a FI-LAB virtual machine; on the contrary, the firewall
      will stop them". That's why I created a proxy server in FiLab.

      I connect successfully using ssh to both the proxy server and the Cosmos
      instance, but when I try to upload a file from the proxy to Cosmos, using
      Hadoop, it asks for a token in the headers. The request I send is as shown
      in the documentation
      <http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/BigData_Analysis_-_Quick_Start_for_Programmers>
      in
      the "Upload some data to HDFS" section.

      I have tried to get my token using the API explained here
      <https://github.com/telefonicaid/fiware-cosmos/tree/master/cosmos-auth>,
      using as <your_idm_username> and <your_idm_password> the credentials I use
      to login to FiLab. The response I get is "The request you have made
      requires authentication", with a status code 401 (Unauthorized).

      Also, I have declared the https://cosmos.lab.fiware.org/ as my user's
      application in FiLab, with the permissions as shown here
      <http://fiware-idm.readthedocs.org/en/latest/user_guide.html>.

      Can you you help me with that? Thanks in advance.
      -------------

      BR,
      Aggelos

      Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
      Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
      _______________________________________________
      Fiware-tech-help mailing list
      Fiware-tech-help@lists.fiware.org
      https://lists.fiware.org/listinfo/fiware-tech-help
      [Created via e-mail received from: Aggelos Groumas <gkraggel@di.uoa.gr>]

        Activity

        Hide
        frb Francisco Romero added a comment -

        Which kind of connections do you want to stablish with the global instance of Cosmos in FIWARE Lab? Connections to following ports are not longer dropped by the firewall:

        • 22 (ssh)
        • 10000 (Hive)
        • 11000 (Oozie)
        • 13000 (OAuth2 tokens generator)
        • 14000 (HttpFS, a WebHDFS gateway)

        Being said that, it is true the HttpFS (WebHDFS) connections must be secured by using a n OAuth2 token. It seems the Quick Start Guide must be updated, nevertheless you may find useful information about using HttpFS+OAUuth2 in this link:

        http://stackoverflow.com/questions/31187977/oauth2-access-to-cosmos-webhdfs-in-fiware-lab

        Hope this helps!

        Show
        frb Francisco Romero added a comment - Which kind of connections do you want to stablish with the global instance of Cosmos in FIWARE Lab? Connections to following ports are not longer dropped by the firewall: 22 (ssh) 10000 (Hive) 11000 (Oozie) 13000 (OAuth2 tokens generator) 14000 (HttpFS, a WebHDFS gateway) Being said that, it is true the HttpFS (WebHDFS) connections must be secured by using a n OAuth2 token. It seems the Quick Start Guide must be updated, nevertheless you may find useful information about using HttpFS+OAUuth2 in this link: http://stackoverflow.com/questions/31187977/oauth2-access-to-cosmos-webhdfs-in-fiware-lab Hope this helps!
        Hide
        mev Manuel Escriche added a comment -

        Francisco, will you please use instructions in the link below to answer.
        http://backlog.fiware.org/guide/tracker.html#email-issue

        The comment you wrote on 19.October wasn't received by the end user.

        Show
        mev Manuel Escriche added a comment - Francisco, will you please use instructions in the link below to answer. http://backlog.fiware.org/guide/tracker.html#email-issue The comment you wrote on 19.October wasn't received by the end user.
        Hide
        mev Manuel Escriche added a comment -

        Dear Aggelos,

        Please, check the answer provided by the GE owner is helpful to you.
        Apologies for late communication. There was a mistake in the process.

        Kind regards,
        Manuel

        Show
        mev Manuel Escriche added a comment - Dear Aggelos, Please, check the answer provided by the GE owner is helpful to you. Apologies for late communication. There was a mistake in the process. Kind regards, Manuel
        Hide
        frb Francisco Romero added a comment -

        Closing since no more feedback has been received.

        Show
        frb Francisco Romero added a comment - Closing since no more feedback has been received.

          People

          • Assignee:
            frb Francisco Romero
            Reporter:
            fw.ext.user FW External User
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: