Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-4681

FIWARE.Question.Tech.Data.BigData-Analysis.The Hive table is not creating in cosmos

    Details

      Description

      Created question in FIWARE Q/A platform on 06-10-2015 at 16:10
      Please, ANSWER this question AT http://stackoverflow.com/questions/32972603/the-hive-table-is-not-creating-in-cosmos

      Question:
      The Hive table is not creating in cosmos

      Description:
      We have the context broker configured with cygnus, and the problem that we are getting, is quite strange.

      It happen whhen I inserted a new type of element in Context Broker, and we have a subscription to send that element to cosmos. Cygnus send it properly, and create the corresponding hdfs file in cosmos, but when cosmos try to create the Hive table occurs an error.

      That is what the cygnus log says.

      05 oct 2015 12:51:43,777 INFO [SinkRunner-PollingRunner-DefaultSinkProcessor]
      (com.telefonica.iot.cygnus.backends.hdfs.HDFSBackendImpl.provisionHiveTable:225)

      • Creating Hive external table=[table_name]

      After some hours, we get the following message:

      05 oct 2015 18:00:02,489 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor]
      (com.telefonica.iot.cygnus.backends.hive.HiveBackend.doCreateTable:77)

      • Runtime error (The Hive table cannot be created.
        Hive query='create external table [table_name] (columns) row format serde
        'org.openx.data.jsonserde.JsonSerDe' location '[hdfs_folder_location]''.
        Details=org.apache.thrift.transport.TTransportException)
        05 oct 2015 18:00:02,490 WARN [SinkRunner-PollingRunner-DefaultSinkProcessor]
        (com.telefonica.iot.cygnus.backends.hdfs.HDFSBackendImpl.provisionHiveTable:237)
      • The HiveQL external table could not be created, but Cygnus can continue working... Check your Hive/Shark installation

      Between those two events all the actions that should be added in hdfs, they won't be added until we get the error.

      Cygnus Version is: 0.8.2

      We are using the open cosmos.

        Activity

        fla Fernando Lopez made changes -
        Fix Version/s 2021 [ 12600 ]
        mev Manuel Escriche made changes -
        HD-Enabler Cosmos [ 10872 ]
        HD-Chapter Data [ 10838 ]
        mev Manuel Escriche made changes -
        Summary FIWARE.Question.Tech.The Hive table is not creating in cosmos FIWARE.Question.Tech.Data.BigData-Analysis.The Hive table is not creating in cosmos
        mev Manuel Escriche made changes -
        Summary FIWARE.Question.Tech.FIWARE.Question.Tech.The Hive table is not creating in cosmos FIWARE.Question.Tech.The Hive table is not creating in cosmos
        mev Manuel Escriche made changes -
        Summary FIWARE.Question.Tech.The Hive table is not creating in cosmos FIWARE.Question.Tech.FIWARE.Question.Tech.The Hive table is not creating in cosmos
        mev Manuel Escriche made changes -
        Summary [fiware-stackoverflow] The Hive table is not creating in cosmos FIWARE.Question.Tech.The Hive table is not creating in cosmos
        backlogmanager Backlog Manager made changes -
        Resolution Done [ 10000 ]
        Status In Progress [ 3 ] Closed [ 6 ]
        backlogmanager Backlog Manager made changes -
        Status Open [ 1 ] In Progress [ 3 ]
        mev Manuel Escriche made changes -
        Assignee Francisco Romero [ frb ]
        backlogmanager Backlog Manager made changes -
        Field Original Value New Value
        Component/s FIWARE-TECH-HELP [ 10278 ]
        backlogmanager Backlog Manager created issue -

          People

          • Assignee:
            frb Francisco Romero
            Reporter:
            backlogmanager Backlog Manager
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: