Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-9130

[fiware-stackoverflow] The Hive table is not creating in cosmos

    Details

      Description

      Created question in FIWARE Q/A platform on 06-10-2015 at 16:10
      Please, ANSWER this question AT https://stackoverflow.com/questions/32972603/the-hive-table-is-not-creating-in-cosmos

      Question:
      The Hive table is not creating in cosmos

      Description:
      We have the context broker configured with cygnus, and the problem that we are getting, is quite strange.

      It happen whhen I inserted a new type of element in Context Broker, and we have a subscription to send that element to cosmos. Cygnus send it properly, and create the corresponding hdfs file in cosmos, but when cosmos try to create the Hive table occurs an error.

      That is what the cygnus log says.

      05 oct 2015 12:51:43,777 INFO [SinkRunner-PollingRunner-DefaultSinkProcessor]
      (com.telefonica.iot.cygnus.backends.hdfs.HDFSBackendImpl.provisionHiveTable:225)

      • Creating Hive external table=[table_name]

      After some hours, we get the following message:

      05 oct 2015 18:00:02,489 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor]
      (com.telefonica.iot.cygnus.backends.hive.HiveBackend.doCreateTable:77)

      • Runtime error (The Hive table cannot be created.
        Hive query='create external table [table_name] (columns) row format serde
        'org.openx.data.jsonserde.JsonSerDe' location '[hdfs_folder_location]''.
        Details=org.apache.thrift.transport.TTransportException)
        05 oct 2015 18:00:02,490 WARN [SinkRunner-PollingRunner-DefaultSinkProcessor]
        (com.telefonica.iot.cygnus.backends.hdfs.HDFSBackendImpl.provisionHiveTable:237)
      • The HiveQL external table could not be created, but Cygnus can continue working... Check your Hive/Shark installation

      Between those two events all the actions that should be added in hdfs, they won't be added until we get the error.

      Cygnus Version is: 0.8.2

      We are using the open cosmos.

        Activity

        Hide
        backlogmanager Backlog Manager added a comment -

        2017-05-22 15:19|CREATED monitor | # answers= 1, accepted answer= True

        Show
        backlogmanager Backlog Manager added a comment - 2017-05-22 15:19|CREATED monitor | # answers= 1, accepted answer= True
        Hide
        backlogmanager Backlog Manager added a comment -

        2017-05-22 18:12|UPDATED status: transition Answer| # answers= 1, accepted answer= True

        Show
        backlogmanager Backlog Manager added a comment - 2017-05-22 18:12|UPDATED status: transition Answer| # answers= 1, accepted answer= True
        Hide
        backlogmanager Backlog Manager added a comment -

        2017-05-22 21:13|UPDATED status: transition Finish| # answers= 1, accepted answer= True

        Show
        backlogmanager Backlog Manager added a comment - 2017-05-22 21:13|UPDATED status: transition Finish| # answers= 1, accepted answer= True

          People

          • Assignee:
            backlogmanager Backlog Manager
            Reporter:
            backlogmanager Backlog Manager
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: