PiraeusU Node Helpdesk added a comment - 20/Jan/15 3:14 PM Please send the answer to this request to gioakbombaci@gmail.com

Francisco Romero added a comment - 05/Feb/15 11:34 AM Conversation maintained by email: Hi Antonio, Sorry for the delay in continuing the conversation. I’ve seen that these tables, associated to your username, have been created: gioakbombaci_pm10_142245780725_observations gioakbombaci_pm10_142245909633_observations gioakbombaci_pm10_142245960442_observations gioakbombaci_pm10_142246020579_observations gioakbombaci_pm10_142246134747_observations gioakbombaci_pm10_142246257881_observations gioakbombaci_pm10_142246363018_observations gioakbombaci_pm10_142246475644_observations gioakbombaci_pm10_14224658677_observations gioakbombaci_pm10_142246691926_observations gioakbombaci_pm10_14224683607_observations gioakbombaci_pressure_142245780725_observations gioakbombaci_pressure_142245909633_observations gioakbombaci_pressure_142245960442_observations gioakbombaci_pressure_142246020579_observations gioakbombaci_pressure_142246134747_observations gioakbombaci_pressure_142246257881_observations gioakbombaci_pressure_142246363018_observations gioakbombaci_pressure_142246475644_observations gioakbombaci_pressure_14224658677_observations gioakbombaci_pressure_142246691926_observations gioakbombaci_pressure_14224683607_observations gioakbombaci_temperature_142245780725_observations gioakbombaci_temperature_142245909633_observations gioakbombaci_temperature_142245960442_observations gioakbombaci_temperature_142246020579_observations gioakbombaci_temperature_142246134747_observations gioakbombaci_temperature_142246257881_observations gioakbombaci_temperature_142246363018_observations gioakbombaci_temperature_142246475644_observations gioakbombaci_temperature_14224658677_observations gioakbombaci_temperature_142246691926_observations gioakbombaci_temperature_14224683607_observations Did you created them manually or were they created by Cygnus? Regards, Francisco De: antonio caristia a.caristia@gmail.com Enviado el: lunes, 19 de enero de 2015 11:13 Para: FRANCISCO ROMERO BUENO Asunto: Re: Automatic creation of the hive tables on cosmos Hi Francisco, have you any news for my issue? If it is not possible to resolve at this moment, can you give me some info how to create the tables manually or with bash/python scripts? I can't test my widgets without data to query. Thanks in advance, best regards. Antonio 2015-01-15 16:57 GMT+01:00 antonio caristia <a.caristia@gmail.com>: Hi Francisco, I have modified cygnus.conf and created matching_table.conf on [MY_CYGNUS_HOME] /conf. I have no more the error in flume.log but cygnys does not create the tables yet. I have attached my flume.log and cygnus.conf. Regards, Antonio 2015-01-15 12:08 GMT+01:00 FRANCISCO ROMERO BUENO <francisco.romerobueno@telefonica.com>: Hi Antonio, A couple of questions: • Where do you want to persist your context data? Only Cosmos/HDFS for Hive querying? Because you have also activated the MySQL and CKAN sinks, which is leading to lot of errors due these sinks are not properly configured. Just edit these lines: o cygnusagent.sinks = hdfs-sink # i.e. remove mysql-sink ckan-sink o cygnusagent.channels = hdfs-channel @ i.e. remove mysql-channel ckan-channel o The OrionMySQLSink, OrionCKANSink, ckan-channel and mysql-channel configuration parts may be removed as well. • Do you have such /usr/cygnus/conf/matching_table.conf file? This is the default location for the destination extractor matching rules, when installing through the RPM. How did you installed Cygnus? If you installed from sources, just create an empty matching_table.conf file under [YOUR_CYGNUS_HOME] /conf folder. I’m not sure if these issues are related or not to the Hive table problem, but fixing them will lead to a more clean log file  Regards, Francisco De: antonio caristia a.caristia@gmail.com Enviado el: jueves, 15 de enero de 2015 10:50 Para: FRANCISCO ROMERO BUENO Asunto: Re: Automatic creation of the hive tables on cosmos Hi Francisco, I do not use any matching rules, in the log file i have this no such file error. [root@orionold logs] # cat flume.log |grep table 09 Jan 2015 10:30:09,306 ERROR [lifecycleSupervisor-1-2] (es.tid.fiware.fiwareconnectors.cygnus.interceptors.DestinationExtractor.initialize:84) - Runtime error (File not found. Details=/usr/cygnus/conf/matching_table.conf (No such file or directory)) 09 Jan 2015 11:04:15,009 INFO [SinkRunner-PollingRunner-DefaultSinkProcessor] (es.tid.fiware.fiwareconnectors.cygnus.backends.hdfs.HDFSBackend.provisionHiveTable:135) - Creating Hive external table=gioakbombaci_def_serv_Taxi1_Taxi_column 13 Jan 2015 12:33:42,158 ERROR [lifecycleSupervisor-1-3] (es.tid.fiware.fiwareconnectors.cygnus.interceptors.DestinationExtractor.initialize:84) - Runtime error (File not found. Details=/usr/cygnus/conf/matching_table.conf (No such file or directory)) 13 Jan 2015 12:36:18,190 ERROR [lifecycleSupervisor-1-2] (es.tid.fiware.fiwareconnectors.cygnus.interceptors.DestinationExtractor.initialize:84) - Runtime error (File not found. Details=/usr/cygnus/conf/matching_table.conf (No such file or directory)) 13 Jan 2015 12:57:12,137 ERROR [lifecycleSupervisor-1-2] (es.tid.fiware.fiwareconnectors.cygnus.interceptors.DestinationExtractor.initialize:84) - Runtime error (File not found. Details=/usr/cygnus/conf/matching_table.conf (No such file or directory)) This is the url https://drive.google.com/file/d/0B5QWQPdKi7qvbzE5aVkyZi03NUU/view?usp=sharing on my google drive where you can find flume.log The Entity is Taxi1, the type is Taxi. These are the attributes: 1. name = temperature, type = centigrade 2. name = pressure, type = mmHg 3. name = PM10, type = concentration 4. name = taxiPosition, type = coords 5. name = Service1, type = text Thanks for your help, best regards. Antonio 2015-01-15 9:27 GMT+01:00 FRANCISCO ROMERO BUENO <francisco.romerobueno@telefonica.com>: Hi Antonio, The configuration seems to be OK. Can you send me the related logs? In addition, which is the name and type of the NGIS entity whose data is being persisted through Cygnus? Are you using any matching rule at the destination extractor matching table? Regards, Francisco De: antonio caristia a.caristia@gmail.com Enviado el: martes, 13 de enero de 2015 16:21 Para: FRANCISCO ROMERO BUENO Asunto: Re: Automatic creation of the hive tables on cosmos Hi Francisco, thanks for your reply. I use cygnus 0.6, i have attached my cygnus.conf. Thanks for your help, best regards. Antonio 2015-01-13 13:13 GMT+01:00 FRANCISCO ROMERO BUENO <francisco.romerobueno@telefonica.com>: Hi Antonio, Sorry for the delay, but I was on vacations  Can you send me the Cygnus configuration you are using? Which Cygnus version indeed? Regards, Francisco De: antonio caristia a.caristia@gmail.com Enviado el: viernes, 09 de enero de 2015 12:08 Para: FRANCISCO ROMERO BUENO Asunto: Automatic creation of the hive tables on cosmos Hi Francisco, I have an Orion context broker and i use cygnus to send data on my cosmos account. Cygnus create correctly the txt files with the data on my cosmos account, but it does not create the tables for hive. I would query my data through an hive client. Is there a configuration paramater to set in cygnus.conf to do that? How can i solve? Thanks in advance. Best regards,