Details
-
Type:
Monitor
-
Status: Closed
-
Priority:
Major
-
Resolution: Done
-
Affects Version/s: None
-
Fix Version/s: 2021
-
Component/s: FIWARE-TECH-HELP
-
Labels:
-
HD-Enabler:Cosmos
Description
Created question in FIWARE Q/A platform on 06-10-2015 at 16:10
Please, ANSWER this question AT https://stackoverflow.com/questions/32972603/the-hive-table-is-not-creating-in-cosmos
Question:
The Hive table is not creating in cosmos
Description:
We have the context broker configured with cygnus, and the problem that we are getting, is quite strange.
It happen whhen I inserted a new type of element in Context Broker, and we have a subscription to send that element to cosmos. Cygnus send it properly, and create the corresponding hdfs file in cosmos, but when cosmos try to create the Hive table occurs an error.
That is what the cygnus log says.
05 oct 2015 12:51:43,777 INFO [SinkRunner-PollingRunner-DefaultSinkProcessor]
(com.telefonica.iot.cygnus.backends.hdfs.HDFSBackendImpl.provisionHiveTable:225)
- Creating Hive external table=[table_name]
After some hours, we get the following message:
05 oct 2015 18:00:02,489 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor]
(com.telefonica.iot.cygnus.backends.hive.HiveBackend.doCreateTable:77)
- Runtime error (The Hive table cannot be created.
Hive query='create external table [table_name] (columns) row format serde
'org.openx.data.jsonserde.JsonSerDe' location '[hdfs_folder_location]''.
Details=org.apache.thrift.transport.TTransportException)
05 oct 2015 18:00:02,490 WARN [SinkRunner-PollingRunner-DefaultSinkProcessor]
(com.telefonica.iot.cygnus.backends.hdfs.HDFSBackendImpl.provisionHiveTable:237) - The HiveQL external table could not be created, but Cygnus can continue working... Check your Hive/Shark installation
Between those two events all the actions that should be added in hdfs, they won't be added until we get the error.
Cygnus Version is: 0.8.2
We are using the open cosmos.
Activity
Field | Original Value | New Value |
---|---|---|
Component/s | FIWARE-TECH-HELP [ 10278 ] |
Status | Open [ 1 ] | In Progress [ 3 ] |
Resolution | Done [ 10000 ] | |
Status | In Progress [ 3 ] | Closed [ 6 ] |
HD-Enabler | Cosmos [ 10872 ] |
Assignee | Backlog Manager [ backlogmanager ] |
Fix Version/s | 2021 [ 12600 ] |
Transition | Time In Source Status | Execution Times | Last Executer | Last Execution Date | |||||
---|---|---|---|---|---|---|---|---|---|
|
2h 53m | 1 | Backlog Manager | 22/May/17 6:11 PM | |||||
|
3h | 1 | Backlog Manager | 22/May/17 9:11 PM |
2017-05-22 15:19|CREATED monitor | # answers= 1, accepted answer= True