[HELP-14062] [Fiware-tech-help] Unable to run Cygnus with MySQL agent - JIRA

Hide

Permalink

FW External User added a comment - 03/May/18 3:41 PM

+ pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
+ fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>
+francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>
+ german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>
+ ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>

Looking forward for your guidance.

Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also.

Regards,
Krishan
From: Krishan Babbar
Sent: Monday, April 30, 2018 7:59 PM
To: fiware-tech-help@lists.fiware.org; José Ignacio Carretero <joseignacio.carretero@fiware.org>; herman.junge@telefonica.com
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>
Subject: Unable to run Cygnus with MySQL agent

Hi All,

I am trying to setup and understand Cygnus. But I am facing issue during installation.
I followed below given steps.

1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common)

2. Executed version command (curl http://172.17.0.2:8081/v1/version) which gave following response

a.

{"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"}

3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash

4. Created new file named "agent_mysql.conf" in "/opt/apache-flume/conf/" folder. Please see attached file for configuration details.

5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one.

a. $

{FLUME_HOME}

/bin/cygnus-flume-ng agent --conf $

{CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH}

/agent_mysql.conf -n cygnus-ngsi -p $

{CYGNUS_API_PORT}

-Dflume.root.logger=$

{CYGNUS_LOG_LEVEL}

,$

{CYGNUS_LOG_APPENDER}

-Dfile.encoding=UTF-8

6. Exited Docker container and came back to Ubuntu.

7. Stop and restart Docker container.

8. And I am getting following errors in logs

Please check and let me know what am I doing wrong? Appreciate your help.

n$AgentConfiguration[1016] : Processing:mysql-sink
time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration[140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi]
time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[150] : Creating channels
time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory[40] : Creating instance of channel mysql-channel type memory
time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[205] : Created channel mysql-channel
time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory[39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource
time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource[113] : Error while configuring HTTPSource. Exception follows.
java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider[366] : Source http-source has been removed due to an error during configuration
java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at com.google.common.base.Throwables.propagate(Throwables.java:156)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
... 11 more
time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory[40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable[142] : Failed to load configuration data. Exception follows.
org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69)
at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67)
... 11 more

Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA

Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================

============================================================================================================================

Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html <http://www.techmahindra.com/Disclaimer.html> externally http://tim.techmahindra.com/tim/disclaimer.html <http://tim.techmahindra.com/tim/disclaimer.html> internally within TechMahindra.

============================================================================================================================

Show

FW External User added a comment - 03/May/18 3:41 PM + pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > + fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com > +francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com > + german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com > + ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com > Looking forward for your guidance. Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also. Regards, Krishan From: Krishan Babbar Sent: Monday, April 30, 2018 7:59 PM To: fiware-tech-help@lists.fiware.org; José Ignacio Carretero <joseignacio.carretero@fiware.org>; herman.junge@telefonica.com Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com> Subject: Unable to run Cygnus with MySQL agent Hi All, I am trying to setup and understand Cygnus. But I am facing issue during installation. I followed below given steps. 1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common) 2. Executed version command (curl http://172.17.0.2:8081/v1/version ) which gave following response a. {"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"} 3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash 4. Created new file named "agent_mysql.conf" in "/opt/apache-flume/conf/" folder. Please see attached file for configuration details. 5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one. a. $ {FLUME_HOME} /bin/cygnus-flume-ng agent --conf $ {CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH} /agent_mysql.conf -n cygnus-ngsi -p $ {CYGNUS_API_PORT} -Dflume.root.logger=$ {CYGNUS_LOG_LEVEL} ,$ {CYGNUS_LOG_APPENDER} -Dfile.encoding=UTF-8 6. Exited Docker container and came back to Ubuntu. 7. Stop and restart Docker container. 8. And I am getting following errors in logs Please check and let me know what am I doing wrong? Appreciate your help. n$AgentConfiguration [1016] : Processing:mysql-sink time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration [140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi] time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider [150] : Creating channels time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory [40] : Creating instance of channel mysql-channel type memory time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider [205] : Created channel mysql-channel time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory [39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource [113] : Error while configuring HTTPSource. Exception follows. java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102) at org.apache.flume.conf.Configurables.configure(Configurables.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider [366] : Source http-source has been removed due to an error during configuration java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at com.google.common.base.Throwables.propagate(Throwables.java:156) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114) at org.apache.flume.conf.Configurables.configure(Configurables.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102) ... 11 more time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory [40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable [142] : Failed to load configuration data. Exception follows. org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69) at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67) ... 11 more Thanks & Regards, Krishan Babbar Technical Architect IES Internet of Things | Tech Mahindra Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996 ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. =========================================================================================================================== ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html < http://www.techmahindra.com/Disclaimer.html > externally http://tim.techmahindra.com/tim/disclaimer.html < http://tim.techmahindra.com/tim/disclaimer.html > internally within TechMahindra. ============================================================================================================================

Hide

Permalink

José Ignacio Carretero Guarde added a comment - 04/May/18 10:39 AM

I've answered in https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent

Regards,
José Ignacio

Show

José Ignacio Carretero Guarde added a comment - 04/May/18 10:39 AM I've answered in https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent Regards, José Ignacio

Hide

Permalink

Spain Node Support Team added a comment - 04/May/18 10:51 AM

I've answered the Stackoverflow question.

Regards,
José Ignacio

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation
FIWARE Foundation
Franklinstrasse 13A
10587 Berlin
email: joseignacio.carretero@fiware.org
<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

__________________________________________________________________________________________

You can get more information about our cookies and privacy policies on the following links:

Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Show

Spain Node Support Team added a comment - 04/May/18 10:51 AM I've answered the Stackoverflow question. Regards, José Ignacio – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation FIWARE Foundation Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org < joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero __________________________________________________________________________________________ You can get more information about our cookies and privacy policies on the following links: http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/FIWARE_Privacy_Policy http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Cookies_Policy_FIWARE Fiware-tech-help mailing list Fiware-tech-help@lists.fiware.org https://lists.fiware.org/listinfo/fiware-tech-help

Hide

Permalink

FW External User added a comment - 04/May/18 11:41 AM

Thanks Jose,

I ran following commands
1.
docker run --name=mysqlser -d mysql/mysql-server
2.
docker run -d --name cygnus-mysql1 --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=<Root_Password> fiware/cygnus-ngsi

I logged into MySQL Container but did not see any DB.
I could see only following DBs.
docker exec -it mysqlser mysql -u root -p

mysql> show databases;
--------------------
--------------------
--------------------
4 rows in set (0.00 sec)
What would be the expected behavior?
How to cross check if MySQL Sink is working fine?

Regards,
Krishan

From: José Ignacio Carretero <joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 2:19 PM
To: Krishan Babbar <KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org; herman.junge@telefonica.com; ivan.ariasleon@telefonica.com; german.torodelvalle@telefonica.com; francisco.romerobueno@telefonica.com; fermin.galanmarquez@telefonica.com; pablo.coellovillalba@telefonica.com
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

I've answered the Stackoverflow question.

Regards,
José Ignacio

El 03/05/18 a las 15:37, Krishan Babbar escribió:
+ pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
+ fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>
+francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>
+ german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>
+ ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>

Looking forward for your guidance.

Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also.

Regards,
Krishan
From: Krishan Babbar
Sent: Monday, April 30, 2018 7:59 PM
To: fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>; herman.junge@telefonica.com<herman.junge@telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Unable to run Cygnus with MySQL agent

Hi All,

I am trying to setup and understand Cygnus. But I am facing issue during installation.
I followed below given steps.

1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common)

2. Executed version command (curl http://172.17.0.2:8081/v1/version) which gave following response

a.

{"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"}

3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash

4. Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Please see attached file for configuration details.

5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one.

a. $

{FLUME_HOME}

/bin/cygnus-flume-ng agent --conf $

{CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH}

/agent_mysql.conf -n cygnus-ngsi -p $

{CYGNUS_API_PORT}

-Dflume.root.logger=$

{CYGNUS_LOG_LEVEL}

,$

{CYGNUS_LOG_APPENDER}

-Dfile.encoding=UTF-8

6. Exited Docker container and came back to Ubuntu.

7. Stop and restart Docker container.

8. And I am getting following errors in logs

Please check and let me know what am I doing wrong? Appreciate your help.

n$AgentConfiguration[1016] : Processing:mysql-sink
time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration[140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi]
time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[150] : Creating channels
time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory[40] : Creating instance of channel mysql-channel type memory
time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[205] : Created channel mysql-channel
time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory[39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource
time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource[113] : Error while configuring HTTPSource. Exception follows.
java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider[366] : Source http-source has been removed due to an error during configuration
java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at com.google.common.base.Throwables.propagate(Throwables.java:156)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
... 11 more
time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory[40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable[142] : Failed to load configuration data. Exception follows.
org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69)
at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67)
... 11 more

Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
============================================================================================================================

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

__________________________________________________________________________________________

You can get more information about our cookies and privacy policies on the following links:

Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Show

FW External User added a comment - 04/May/18 11:41 AM Thanks Jose, I ran following commands 1. docker run --name=mysqlser -d mysql/mysql-server 2. docker run -d --name cygnus-mysql1 --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=<Root_Password> fiware/cygnus-ngsi I logged into MySQL Container but did not see any DB. I could see only following DBs. docker exec -it mysqlser mysql -u root -p mysql> show databases; -------------------- -------------------- -------------------- 4 rows in set (0.00 sec) What would be the expected behavior? How to cross check if MySQL Sink is working fine? Regards, Krishan From: José Ignacio Carretero <joseignacio.carretero@fiware.org> Sent: Friday, May 4, 2018 2:19 PM To: Krishan Babbar <KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org; herman.junge@telefonica.com; ivan.ariasleon@telefonica.com; german.torodelvalle@telefonica.com; francisco.romerobueno@telefonica.com; fermin.galanmarquez@telefonica.com; pablo.coellovillalba@telefonica.com Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com> Subject: Re: Unable to run Cygnus with MySQL agent I've answered the Stackoverflow question. Regards, José Ignacio El 03/05/18 a las 15:37, Krishan Babbar escribió: + pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > + fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com > +francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com > + german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com > + ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com > Looking forward for your guidance. Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also. Regards, Krishan From: Krishan Babbar Sent: Monday, April 30, 2018 7:59 PM To: fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org >; herman.junge@telefonica.com< herman.junge@telefonica.com > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Unable to run Cygnus with MySQL agent Hi All, I am trying to setup and understand Cygnus. But I am facing issue during installation. I followed below given steps. 1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common) 2. Executed version command (curl http://172.17.0.2:8081/v1/version ) which gave following response a. {"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"} 3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash 4. Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Please see attached file for configuration details. 5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one. a. $ {FLUME_HOME} /bin/cygnus-flume-ng agent --conf $ {CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH} /agent_mysql.conf -n cygnus-ngsi -p $ {CYGNUS_API_PORT} -Dflume.root.logger=$ {CYGNUS_LOG_LEVEL} ,$ {CYGNUS_LOG_APPENDER} -Dfile.encoding=UTF-8 6. Exited Docker container and came back to Ubuntu. 7. Stop and restart Docker container. 8. And I am getting following errors in logs Please check and let me know what am I doing wrong? Appreciate your help. n$AgentConfiguration [1016] : Processing:mysql-sink time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration [140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi] time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider [150] : Creating channels time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory [40] : Creating instance of channel mysql-channel type memory time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider [205] : Created channel mysql-channel time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory [39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource [113] : Error while configuring HTTPSource. Exception follows. java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102) at org.apache.flume.conf.Configurables.configure(Configurables.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider [366] : Source http-source has been removed due to an error during configuration java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at com.google.common.base.Throwables.propagate(Throwables.java:156) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114) at org.apache.flume.conf.Configurables.configure(Configurables.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102) ... 11 more time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory [40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable [142] : Failed to load configuration data. Exception follows. org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69) at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67) ... 11 more Thanks & Regards, Krishan Babbar Technical Architect IES Internet of Things | Tech Mahindra Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA • Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996 ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. =========================================================================================================================== ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. ============================================================================================================================ – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero __________________________________________________________________________________________ You can get more information about our cookies and privacy policies on the following links: http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/FIWARE_Privacy_Policy http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Cookies_Policy_FIWARE Fiware-tech-help mailing list Fiware-tech-help@lists.fiware.org https://lists.fiware.org/listinfo/fiware-tech-help

Hide

Permalink

FW External User added a comment - 04/May/18 2:35 PM

Thanks Jose,

And sorry for bothering you again.

I created subscription using below JSON. Data reached to Cygnus but I am getting errors in logs (given below). What am I doing wrong?
{
"description": "Update controller ph1Vol",
"subject": {
"entities": [

{ "idPattern": ".*", "type": "Controller" }

],
"condition":

{ "attrs": [ "ph1Vol" ] }

},
"notification": {
"mqtt":

{ "url": "http://IPAddress:5050/notify" }

,
"http":

{ "url": "http://IPAddress:5050/notify" }

,
"attrs": [
"id",
"type",
"name",
"ph1Vol",
"current"
]
},
"expires": "2020-04-05T14:00:00.00Z",
"throttling": 5
}

Logs
time=2018-05-04T09:23:15.026Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=getLogLevel | msg=com.telefonica.iot.cygnus.management.LogHandlers[1029] : Cygnus logging level successfully obtained
time=2018-05-04T12:13:00.017Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[294] : [NGSIRestHandler] Starting internal transaction (0d2b65a1-0be4-4371-8d83-4426d281b83d)
time=2018-05-04T12:13:00.024Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[312] : [NGSIRestHandler] Received data ({"subscriptionId":"5aec4e4b7ef878ae8ebac1d9","data":[{"id":"ctrl_chandigrah","type":"Controller","name":{"type":"Text","value":"Noida-SEZ Controller 2","metadata":{}},"ph1Vol":{"type":"Text","value":"228","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-04T12:02:46.398Z"}}}}]})
time=2018-05-04T12:13:00.122Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses
time=2018-05-04T12:13:00.123Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet[186] : Received bad request from client.
org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses
at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335)
at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:725)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:814)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

Regards,
Krishan

From: José Ignacio Carretero <joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 3:16 PM
To: Krishan Babbar <KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org; herman.junge@telefonica.com; ivan.ariasleon@telefonica.com; german.torodelvalle@telefonica.com; francisco.romerobueno@telefonica.com; fermin.galanmarquez@telefonica.com; pablo.coellovillalba@telefonica.com
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

Databases will be created as data comes. Please, use your Orion CB to push some data into Cygnus (through subscriptions).

Regards,
José Ignacio

El 04/05/18 a las 11:40, Krishan Babbar escribió:
Thanks Jose,

I ran following commands
1.
docker run --name=mysqlser -d mysql/mysql-server
2.
docker run -d --name cygnus-mysql1 --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=<Root_Password> fiware/cygnus-ngsi

I logged into MySQL Container but did not see any DB.
I could see only following DBs.
docker exec -it mysqlser mysql -u root -p

mysql> show databases;
--------------------
--------------------
--------------------
4 rows in set (0.00 sec)
What would be the expected behavior?
How to cross check if MySQL Sink is working fine?

Regards,
Krishan

From: José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 2:19 PM
To: Krishan Babbar <KB00449283@TechMahindra.com><KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; herman.junge@telefonica.com<herman.junge@telefonica.com>; ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>; german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>; francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>; fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>; pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

I've answered the Stackoverflow question.

Regards,
José Ignacio

El 03/05/18 a las 15:37, Krishan Babbar escribió:
+ pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
+ fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>
+francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>
+ german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>
+ ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>

Looking forward for your guidance.

Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also.

Regards,
Krishan
From: Krishan Babbar
Sent: Monday, April 30, 2018 7:59 PM
To: fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>; herman.junge@telefonica.com<herman.junge@telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Unable to run Cygnus with MySQL agent

Hi All,

I am trying to setup and understand Cygnus. But I am facing issue during installation.
I followed below given steps.

1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common)

2. Executed version command (curl http://172.17.0.2:8081/v1/version) which gave following response

a.

{"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"}

3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash

4. Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Please see attached file for configuration details.

5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one.

a. $

{FLUME_HOME}

/bin/cygnus-flume-ng agent --conf $

{CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH}

/agent_mysql.conf -n cygnus-ngsi -p $

{CYGNUS_API_PORT}

-Dflume.root.logger=$

{CYGNUS_LOG_LEVEL}

,$

{CYGNUS_LOG_APPENDER}

-Dfile.encoding=UTF-8

6. Exited Docker container and came back to Ubuntu.

7. Stop and restart Docker container.

8. And I am getting following errors in logs

Please check and let me know what am I doing wrong? Appreciate your help.

n$AgentConfiguration[1016] : Processing:mysql-sink
time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration[140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi]
time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[150] : Creating channels
time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory[40] : Creating instance of channel mysql-channel type memory
time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[205] : Created channel mysql-channel
time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory[39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource
time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource[113] : Error while configuring HTTPSource. Exception follows.
java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider[366] : Source http-source has been removed due to an error during configuration
java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at com.google.common.base.Throwables.propagate(Throwables.java:156)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
... 11 more
time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory[40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable[142] : Failed to load configuration data. Exception follows.
org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69)
at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67)
... 11 more

Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
============================================================================================================================

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

__________________________________________________________________________________________

You can get more information about our cookies and privacy policies on the following links:

Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Show

FW External User added a comment - 04/May/18 2:35 PM Thanks Jose, And sorry for bothering you again. I created subscription using below JSON. Data reached to Cygnus but I am getting errors in logs (given below). What am I doing wrong? { "description": "Update controller ph1Vol", "subject": { "entities": [ { "idPattern": ".*", "type": "Controller" } ], "condition": { "attrs": [ "ph1Vol" ] } }, "notification": { "mqtt": { "url": "http://IPAddress:5050/notify" } , "http": { "url": "http://IPAddress:5050/notify" } , "attrs": [ "id", "type", "name", "ph1Vol", "current" ] }, "expires": "2020-04-05T14:00:00.00Z", "throttling": 5 } Logs time=2018-05-04T09:23:15.026Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=getLogLevel | msg=com.telefonica.iot.cygnus.management.LogHandlers [1029] : Cygnus logging level successfully obtained time=2018-05-04T12:13:00.017Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [294] : [NGSIRestHandler] Starting internal transaction (0d2b65a1-0be4-4371-8d83-4426d281b83d) time=2018-05-04T12:13:00.024Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [312] : [NGSIRestHandler] Received data ({"subscriptionId":"5aec4e4b7ef878ae8ebac1d9","data": [{"id":"ctrl_chandigrah","type":"Controller","name":{"type":"Text","value":"Noida-SEZ Controller 2","metadata":{}},"ph1Vol":{"type":"Text","value":"228","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-04T12:02:46.398Z"}}}}] }) time=2018-05-04T12:13:00.122Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses time=2018-05-04T12:13:00.123Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet [186] : Received bad request from client. org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335) at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184) at javax.servlet.http.HttpServlet.service(HttpServlet.java:725) at javax.servlet.http.HttpServlet.service(HttpServlet.java:814) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Regards, Krishan From: José Ignacio Carretero <joseignacio.carretero@fiware.org> Sent: Friday, May 4, 2018 3:16 PM To: Krishan Babbar <KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org; herman.junge@telefonica.com; ivan.ariasleon@telefonica.com; german.torodelvalle@telefonica.com; francisco.romerobueno@telefonica.com; fermin.galanmarquez@telefonica.com; pablo.coellovillalba@telefonica.com Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com> Subject: Re: Unable to run Cygnus with MySQL agent Databases will be created as data comes. Please, use your Orion CB to push some data into Cygnus (through subscriptions). Regards, José Ignacio El 04/05/18 a las 11:40, Krishan Babbar escribió: Thanks Jose, I ran following commands 1. docker run --name=mysqlser -d mysql/mysql-server 2. docker run -d --name cygnus-mysql1 --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=<Root_Password> fiware/cygnus-ngsi I logged into MySQL Container but did not see any DB. I could see only following DBs. docker exec -it mysqlser mysql -u root -p mysql> show databases; -------------------- -------------------- -------------------- 4 rows in set (0.00 sec) What would be the expected behavior? How to cross check if MySQL Sink is working fine? Regards, Krishan From: José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org > Sent: Friday, May 4, 2018 2:19 PM To: Krishan Babbar <KB00449283@TechMahindra.com>< KB00449283@TechMahindra.com >; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; herman.junge@telefonica.com< herman.junge@telefonica.com >; ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com >; german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com >; francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com >; fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com >; pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Re: Unable to run Cygnus with MySQL agent I've answered the Stackoverflow question. Regards, José Ignacio El 03/05/18 a las 15:37, Krishan Babbar escribió: + pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > + fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com > +francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com > + german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com > + ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com > Looking forward for your guidance. Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also. Regards, Krishan From: Krishan Babbar Sent: Monday, April 30, 2018 7:59 PM To: fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org >; herman.junge@telefonica.com< herman.junge@telefonica.com > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Unable to run Cygnus with MySQL agent Hi All, I am trying to setup and understand Cygnus. But I am facing issue during installation. I followed below given steps. 1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common) 2. Executed version command (curl http://172.17.0.2:8081/v1/version ) which gave following response a. {"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"} 3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash 4. Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Please see attached file for configuration details. 5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one. a. $ {FLUME_HOME} /bin/cygnus-flume-ng agent --conf $ {CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH} /agent_mysql.conf -n cygnus-ngsi -p $ {CYGNUS_API_PORT} -Dflume.root.logger=$ {CYGNUS_LOG_LEVEL} ,$ {CYGNUS_LOG_APPENDER} -Dfile.encoding=UTF-8 6. Exited Docker container and came back to Ubuntu. 7. Stop and restart Docker container. 8. And I am getting following errors in logs Please check and let me know what am I doing wrong? Appreciate your help. n$AgentConfiguration [1016] : Processing:mysql-sink time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration [140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi] time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider [150] : Creating channels time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory [40] : Creating instance of channel mysql-channel type memory time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider [205] : Created channel mysql-channel time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory [39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource [113] : Error while configuring HTTPSource. Exception follows. java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102) at org.apache.flume.conf.Configurables.configure(Configurables.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider [366] : Source http-source has been removed due to an error during configuration java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at com.google.common.base.Throwables.propagate(Throwables.java:156) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114) at org.apache.flume.conf.Configurables.configure(Configurables.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102) ... 11 more time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory [40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable [142] : Failed to load configuration data. Exception follows. org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69) at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67) ... 11 more Thanks & Regards, Krishan Babbar Technical Architect IES Internet of Things | Tech Mahindra Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA • Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996 ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. =========================================================================================================================== ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. ============================================================================================================================ – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero __________________________________________________________________________________________ You can get more information about our cookies and privacy policies on the following links: http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/FIWARE_Privacy_Policy http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Cookies_Policy_FIWARE Fiware-tech-help mailing list Fiware-tech-help@lists.fiware.org https://lists.fiware.org/listinfo/fiware-tech-help

Hide

Permalink

FW External User added a comment - 04/May/18 3:15 PM

It seems some issue in configuration or so.
Similar issue is mentioned at https://ask.fiware.org/question/825/error-at-cygnus-when-receives-a-notification-from-orion-context-broker-fiware-servicepath-header-value-does-not-match-the-number-of-notified-context/
But still no solution.

Regards,
Krishan

From: José Ignacio Carretero <joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 6:18 PM
To: Krishan Babbar <KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

I removed people @telefonica.com who are no longer in the project since about 1 year ago. But I guess the key is here:
org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses

El 04/05/18 a las 14:33, Krishan Babbar escribió:
Thanks Jose,

And sorry for bothering you again.

I created subscription using below JSON. Data reached to Cygnus but I am getting errors in logs (given below). What am I doing wrong?
{
"description": "Update controller ph1Vol",
"subject": {
"entities": [

{ "idPattern": ".*", "type": "Controller" }

],
"condition":

{ "attrs": [ "ph1Vol" ] }

},
"notification": {
"mqtt":

{ "url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify> }

,
"http":

{ "url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify> }

,
"attrs": [
"id",
"type",
"name",
"ph1Vol",
"current"
]
},
"expires": "2020-04-05T14:00:00.00Z",
"throttling": 5
}

Logs
time=2018-05-04T09:23:15.026Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=getLogLevel | msg=com.telefonica.iot.cygnus.management.LogHandlers[1029] : Cygnus logging level successfully obtained
time=2018-05-04T12:13:00.017Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[294] : [NGSIRestHandler] Starting internal transaction (0d2b65a1-0be4-4371-8d83-4426d281b83d)
time=2018-05-04T12:13:00.024Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[312] : [NGSIRestHandler] Received data ({"subscriptionId":"5aec4e4b7ef878ae8ebac1d9","data":[{"id":"ctrl_chandigrah","type":"Controller","name":{"type":"Text","value":"Noida-SEZ Controller 2","metadata":{}},"ph1Vol":{"type":"Text","value":"228","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-04T12:02:46.398Z"}}}}]})
time=2018-05-04T12:13:00.122Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses
time=2018-05-04T12:13:00.123Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet[186] : Received bad request from client.
org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses
at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335)
at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:725)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:814)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

Regards,
Krishan

From: José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 3:16 PM
To: Krishan Babbar <KB00449283@TechMahindra.com><KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; herman.junge@telefonica.com<herman.junge@telefonica.com>; ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>; german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>; francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>; fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>; pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

Databases will be created as data comes. Please, use your Orion CB to push some data into Cygnus (through subscriptions).

Regards,
José Ignacio

El 04/05/18 a las 11:40, Krishan Babbar escribió:
Thanks Jose,

I ran following commands
1.
docker run --name=mysqlser -d mysql/mysql-server
2.
docker run -d --name cygnus-mysql1 --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=<Root_Password> fiware/cygnus-ngsi

I logged into MySQL Container but did not see any DB.
I could see only following DBs.
docker exec -it mysqlser mysql -u root -p

mysql> show databases;
--------------------
--------------------
--------------------
4 rows in set (0.00 sec)
What would be the expected behavior?
How to cross check if MySQL Sink is working fine?

Regards,
Krishan

From: José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 2:19 PM
To: Krishan Babbar <KB00449283@TechMahindra.com><KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; herman.junge@telefonica.com<herman.junge@telefonica.com>; ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>; german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>; francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>; fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>; pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

I've answered the Stackoverflow question.

Regards,
José Ignacio

El 03/05/18 a las 15:37, Krishan Babbar escribió:
+ pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
+ fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>
+francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>
+ german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>
+ ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>

Looking forward for your guidance.

Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also.

Regards,
Krishan
From: Krishan Babbar
Sent: Monday, April 30, 2018 7:59 PM
To: fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>; herman.junge@telefonica.com<herman.junge@telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Unable to run Cygnus with MySQL agent

Hi All,

I am trying to setup and understand Cygnus. But I am facing issue during installation.
I followed below given steps.

1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common)

2. Executed version command (curl http://172.17.0.2:8081/v1/version) which gave following response

a.

{"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"}

3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash

4. Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Please see attached file for configuration details.

5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one.

a. $

{FLUME_HOME}

/bin/cygnus-flume-ng agent --conf $

{CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH}

/agent_mysql.conf -n cygnus-ngsi -p $

{CYGNUS_API_PORT}

-Dflume.root.logger=$

{CYGNUS_LOG_LEVEL}

,$

{CYGNUS_LOG_APPENDER}

-Dfile.encoding=UTF-8

6. Exited Docker container and came back to Ubuntu.

7. Stop and restart Docker container.

8. And I am getting following errors in logs

Please check and let me know what am I doing wrong? Appreciate your help.

n$AgentConfiguration[1016] : Processing:mysql-sink
time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration[140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi]
time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[150] : Creating channels
time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory[40] : Creating instance of channel mysql-channel type memory
time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[205] : Created channel mysql-channel
time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory[39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource
time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource[113] : Error while configuring HTTPSource. Exception follows.
java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider[366] : Source http-source has been removed due to an error during configuration
java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at com.google.common.base.Throwables.propagate(Throwables.java:156)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
... 11 more
time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory[40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable[142] : Failed to load configuration data. Exception follows.
org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69)
at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67)
... 11 more

Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
============================================================================================================================

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

__________________________________________________________________________________________

You can get more information about our cookies and privacy policies on the following links:

Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Show

FW External User added a comment - 04/May/18 3:15 PM It seems some issue in configuration or so. Similar issue is mentioned at https://ask.fiware.org/question/825/error-at-cygnus-when-receives-a-notification-from-orion-context-broker-fiware-servicepath-header-value-does-not-match-the-number-of-notified-context/ But still no solution. Regards, Krishan From: José Ignacio Carretero <joseignacio.carretero@fiware.org> Sent: Friday, May 4, 2018 6:18 PM To: Krishan Babbar <KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com> Subject: Re: Unable to run Cygnus with MySQL agent I removed people @telefonica.com who are no longer in the project since about 1 year ago. But I guess the key is here: org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses El 04/05/18 a las 14:33, Krishan Babbar escribió: Thanks Jose, And sorry for bothering you again. I created subscription using below JSON. Data reached to Cygnus but I am getting errors in logs (given below). What am I doing wrong? { "description": "Update controller ph1Vol", "subject": { "entities": [ { "idPattern": ".*", "type": "Controller" } ], "condition": { "attrs": [ "ph1Vol" ] } }, "notification": { "mqtt": { "url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify> } , "http": { "url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify> } , "attrs": [ "id", "type", "name", "ph1Vol", "current" ] }, "expires": "2020-04-05T14:00:00.00Z", "throttling": 5 } Logs time=2018-05-04T09:23:15.026Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=getLogLevel | msg=com.telefonica.iot.cygnus.management.LogHandlers [1029] : Cygnus logging level successfully obtained time=2018-05-04T12:13:00.017Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [294] : [NGSIRestHandler] Starting internal transaction (0d2b65a1-0be4-4371-8d83-4426d281b83d) time=2018-05-04T12:13:00.024Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [312] : [NGSIRestHandler] Received data ({"subscriptionId":"5aec4e4b7ef878ae8ebac1d9","data": [{"id":"ctrl_chandigrah","type":"Controller","name":{"type":"Text","value":"Noida-SEZ Controller 2","metadata":{}},"ph1Vol":{"type":"Text","value":"228","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-04T12:02:46.398Z"}}}}] }) time=2018-05-04T12:13:00.122Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses time=2018-05-04T12:13:00.123Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet [186] : Received bad request from client. org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335) at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184) at javax.servlet.http.HttpServlet.service(HttpServlet.java:725) at javax.servlet.http.HttpServlet.service(HttpServlet.java:814) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Regards, Krishan From: José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org > Sent: Friday, May 4, 2018 3:16 PM To: Krishan Babbar <KB00449283@TechMahindra.com>< KB00449283@TechMahindra.com >; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; herman.junge@telefonica.com< herman.junge@telefonica.com >; ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com >; german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com >; francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com >; fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com >; pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Re: Unable to run Cygnus with MySQL agent Databases will be created as data comes. Please, use your Orion CB to push some data into Cygnus (through subscriptions). Regards, José Ignacio El 04/05/18 a las 11:40, Krishan Babbar escribió: Thanks Jose, I ran following commands 1. docker run --name=mysqlser -d mysql/mysql-server 2. docker run -d --name cygnus-mysql1 --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=<Root_Password> fiware/cygnus-ngsi I logged into MySQL Container but did not see any DB. I could see only following DBs. docker exec -it mysqlser mysql -u root -p mysql> show databases; -------------------- -------------------- -------------------- 4 rows in set (0.00 sec) What would be the expected behavior? How to cross check if MySQL Sink is working fine? Regards, Krishan From: José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org > Sent: Friday, May 4, 2018 2:19 PM To: Krishan Babbar <KB00449283@TechMahindra.com>< KB00449283@TechMahindra.com >; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; herman.junge@telefonica.com< herman.junge@telefonica.com >; ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com >; german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com >; francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com >; fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com >; pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Re: Unable to run Cygnus with MySQL agent I've answered the Stackoverflow question. Regards, José Ignacio El 03/05/18 a las 15:37, Krishan Babbar escribió: + pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > + fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com > +francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com > + german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com > + ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com > Looking forward for your guidance. Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also. Regards, Krishan From: Krishan Babbar Sent: Monday, April 30, 2018 7:59 PM To: fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org >; herman.junge@telefonica.com< herman.junge@telefonica.com > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Unable to run Cygnus with MySQL agent Hi All, I am trying to setup and understand Cygnus. But I am facing issue during installation. I followed below given steps. 1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common) 2. Executed version command (curl http://172.17.0.2:8081/v1/version ) which gave following response a. {"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"} 3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash 4. Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Please see attached file for configuration details. 5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one. a. $ {FLUME_HOME} /bin/cygnus-flume-ng agent --conf $ {CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH} /agent_mysql.conf -n cygnus-ngsi -p $ {CYGNUS_API_PORT} -Dflume.root.logger=$ {CYGNUS_LOG_LEVEL} ,$ {CYGNUS_LOG_APPENDER} -Dfile.encoding=UTF-8 6. Exited Docker container and came back to Ubuntu. 7. Stop and restart Docker container. 8. And I am getting following errors in logs Please check and let me know what am I doing wrong? Appreciate your help. n$AgentConfiguration [1016] : Processing:mysql-sink time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration [140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi] time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider [150] : Creating channels time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory [40] : Creating instance of channel mysql-channel type memory time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider [205] : Created channel mysql-channel time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory [39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource [113] : Error while configuring HTTPSource. Exception follows. java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102) at org.apache.flume.conf.Configurables.configure(Configurables.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider [366] : Source http-source has been removed due to an error during configuration java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at com.google.common.base.Throwables.propagate(Throwables.java:156) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114) at org.apache.flume.conf.Configurables.configure(Configurables.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102) ... 11 more time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory [40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable [142] : Failed to load configuration data. Exception follows. org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69) at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67) ... 11 more Thanks & Regards, Krishan Babbar Technical Architect IES Internet of Things | Tech Mahindra Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA • Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996 ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. =========================================================================================================================== ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. ============================================================================================================================ – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero __________________________________________________________________________________________ You can get more information about our cookies and privacy policies on the following links: http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/FIWARE_Privacy_Policy http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Cookies_Policy_FIWARE Fiware-tech-help mailing list Fiware-tech-help@lists.fiware.org https://lists.fiware.org/listinfo/fiware-tech-help

Hide

Permalink

FW External User added a comment - 08/May/18 11:34 AM

Hi Jose,

I created new data again as given below, and still getting the same error. Details are given below.

Entity
Headers:
fiware-service: smartcitytechm
fiware-servicepath: /

{
"id": "reader-jp-id",
"type": "Reader",
"parcelNo": {
"type": "Text",
"value": "0101102195a3",
"metadata": {}
},
"readerId": {
"type": "Text",
"value": "566",
"metadata": {}
},
"tagNo": {
"type": "Text",
"value": "69219163",
"metadata": {}
},
"trnxDateTiem": {
"type": "Text",
"value": "Monday, May 7, 2018 4:08 PM",
"metadata": {}
}
}

Service

{ "_id": "5af02c19d047df057cfa063f", "subservice": "/", "service": "smartcitytechm", "apikey": "swm-reader-service", "resource": "/iot/json", "attributes": [], "lazy": [], "commands": [], "entity_type": "Reader", "internal_attributes": [], "static_attributes": [] }

Device
{
"count": 1,
"devices": [
{
"device_id": "reader-device-id",
"service": "smartcitytechm",
"service_path": "/",
"entity_name": "reader-jp-id",
"entity_type": "Reader",
"transport": "HTTP",
"attributes": [

{ "object_id": "tn", "name": "tagNo", "type": "Text" }

,

{ "object_id": "pn", "name": "parcelNo", "type": "Text" }

,

{ "object_id": "ri", "name": "readerId", "type": "Text" }

,

{ "object_id": "tdt", "name": "trnxDateTiem", "type": "Text" }

],
"lazy": [],
"commands": [],
"static_attributes": [],
"protocol": "HTTP"
}
]
}

Subscription
[
{
"id": "5af02f9f7ef878ae8ebac1dd",
"description": "Update reader data",
"expires": "2020-04-05T14:00:00.00Z",
"status": "active",
"subject": {
"entities": [

{ "idPattern": ".*", "type": "Reader" }

],
"condition":

{ "attrs": [ "tagNo", "parcelNo", "readerId", "trnxDateTiem" ] }

},
"notification": {
"timesSent": 1,
"lastNotification": "2018-05-07T10:51:11.00Z",
"attrs": [
"tagNo",
"parcelNo",
"readerId",
"trnxDateTiem"
],
"attrsFormat": "normalized",
"http":

{ "url": "http://<MyIP>:5050/notify" }

,
"lastSuccess": "2018-05-07T10:51:11.00Z"
},
"throttling": 5
}
]

Update Entity (Through MQTT). Now I am using “iotagent-json”. Earlier I was using “iotagent-UL” and updating entity using Send Measurement (on HTTP) and was getting same error.
mosquitto_pub -h <myIP> -u <MyEmail> -P <MyPassword> -t /swm-reader-service/reader-device-id/attrs -m '

{"tn": "7777", "pn": "123456", "ri": "98765", "tdt":"Monday, May 7, 2018 4:31 PM"}

'

Entity after update
{
"id": "reader-jp-id",
"type": "Reader",
"TimeInstant": {
"type": "ISO8601",
"value": "2018-05-07T11:07:43.00Z",
"metadata": {}
},
"parcelNo": {
"type": "Text",
"value": "123456",
"metadata": {
"TimeInstant":

{ "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" }

}
},
"readerId": {
"type": "Text",
"value": "98765",
"metadata": {
"TimeInstant":

{ "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" }

}
},
"tagNo": {
"type": "Text",
"value": "7777",
"metadata": {
"TimeInstant":

{ "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" }

}
},
"trnxDateTiem": {
"type": "Text",
"value": "Monday, May 7, 2018 4:31 PM",
"metadata": {
"TimeInstant":

{ "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" }

}
}
}

Cygnus Error Logs
time=2018-05-07T11:07:43.108Z | lvl=INFO | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[294] : [NGSIRestHandler] Starting internal transaction (5a089c42-032b-46d2-869e-dc944a4167c0)
time=2018-05-07T11:07:43.108Z | lvl=INFO | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[312] : [NGSIRestHandler] Received data ({"subscriptionId":"5af02f9f7ef878ae8ebac1dd","data":[{"id":"reader-jp-id","type":"Reader","tagNo":{"type":"Text","value":"7777","metadata":{"TimeInstant":

{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}

}},"parcelNo":{"type":"Text","value":"123456","metadata":{"TimeInstant":

{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}

}},"readerId":{"type":"Text","value":"98765","metadata":{"TimeInstant":

{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}

}},"trnxDateTiem":{"type":"Text","value":"Monday, May 7, 2018 4:31 PM","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}}}}]})
time=2018-05-07T11:07:43.111Z | lvl=WARN | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses
time=2018-05-07T11:07:43.111Z | lvl=WARN | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet[186] : Received bad request from client.
org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses
at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335)
at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:725)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:814)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

My Docker Containers:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
65b96b1bc07f fiware/cygnus-ngsi "/cygnus-entrypoint.…" 3 days ago Up 3 days 0.0.0.0:5050->5050/tcp, 0.0.0.0:8081->8081/tcp cygnus-mysql1
c7d1d0ed4742 mysql/mysql-server "/entrypoint.sh mysq…" 3 days ago Up 3 days (healthy) 3306/tcp, 33060/tcp mysqlser
971ada7b5eb0 fiware/orion "/usr/bin/contextBro…" 10 days ago Up 10 days 0.0.0.0:1026->1026/tcp ubuntu_orion_1
7104c27ce1e1 mongo:3.2 "docker-entrypoint.s…" 10 days ago Up 10 days 0.0.0.0:27017->27017/tcp ubuntu_mongo_1
2e6baf2fc953 ansi/mosquitto "/usr/local/sbin/mos…" 10 days ago Up 10 days 0.0.0.0:1883->1883/tcp ubuntu_mosquitto_1

Thanks again for all your help.

Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================

From: José Ignacio Carretero <joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 7:55 PM
To: Krishan Babbar <KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

I can't reproduce what you are doing — How did you get there? What are you sending to CB and the Cygnus register?
Best regards,
José Ignacio
El 04/05/18 a las 15:13, Krishan Babbar escribió:
It seems some issue in configuration or so.
Similar issue is mentioned at https://ask.fiware.org/question/825/error-at-cygnus-when-receives-a-notification-from-orion-context-broker-fiware-servicepath-header-value-does-not-match-the-number-of-notified-context/
But still no solution.

Regards,
Krishan

From: José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 6:18 PM
To: Krishan Babbar <KB00449283@TechMahindra.com><KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

I removed people @telefonica.com who are no longer in the project since about 1 year ago. But I guess the key is here:
org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses

El 04/05/18 a las 14:33, Krishan Babbar escribió:
Thanks Jose,

And sorry for bothering you again.

I created subscription using below JSON. Data reached to Cygnus but I am getting errors in logs (given below). What am I doing wrong?
{
"description": "Update controller ph1Vol",
"subject": {
"entities": [

{ "idPattern": ".*", "type": "Controller" }

],
"condition":

{ "attrs": [ "ph1Vol" ] }

},
"notification": {
"mqtt":

{ "url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify> }

,
"http":

{ "url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify> }

,
"attrs": [
"id",
"type",
"name",
"ph1Vol",
"current"
]
},
"expires": "2020-04-05T14:00:00.00Z",
"throttling": 5
}

Logs
time=2018-05-04T09:23:15.026Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=getLogLevel | msg=com.telefonica.iot.cygnus.management.LogHandlers[1029] : Cygnus logging level successfully obtained
time=2018-05-04T12:13:00.017Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[294] : [NGSIRestHandler] Starting internal transaction (0d2b65a1-0be4-4371-8d83-4426d281b83d)
time=2018-05-04T12:13:00.024Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[312] : [NGSIRestHandler] Received data ({"subscriptionId":"5aec4e4b7ef878ae8ebac1d9","data":[{"id":"ctrl_chandigrah","type":"Controller","name":{"type":"Text","value":"Noida-SEZ Controller 2","metadata":{}},"ph1Vol":{"type":"Text","value":"228","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-04T12:02:46.398Z"}}}}]})
time=2018-05-04T12:13:00.122Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses
time=2018-05-04T12:13:00.123Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet[186] : Received bad request from client.
org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses
at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335)
at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:725)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:814)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

Regards,
Krishan

From: José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 3:16 PM
To: Krishan Babbar <KB00449283@TechMahindra.com><KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; herman.junge@telefonica.com<herman.junge@telefonica.com>; ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>; german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>; francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>; fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>; pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

Databases will be created as data comes. Please, use your Orion CB to push some data into Cygnus (through subscriptions).

Regards,
José Ignacio

El 04/05/18 a las 11:40, Krishan Babbar escribió:
Thanks Jose,

I ran following commands
1.
docker run --name=mysqlser -d mysql/mysql-server
2.
docker run -d --name cygnus-mysql1 --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=<Root_Password> fiware/cygnus-ngsi

I logged into MySQL Container but did not see any DB.
I could see only following DBs.
docker exec -it mysqlser mysql -u root -p

mysql> show databases;
--------------------
--------------------
--------------------
4 rows in set (0.00 sec)
What would be the expected behavior?
How to cross check if MySQL Sink is working fine?

Regards,
Krishan

From: José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 2:19 PM
To: Krishan Babbar <KB00449283@TechMahindra.com><KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; herman.junge@telefonica.com<herman.junge@telefonica.com>; ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>; german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>; francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>; fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>; pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

I've answered the Stackoverflow question.

Regards,
José Ignacio

El 03/05/18 a las 15:37, Krishan Babbar escribió:
+ pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
+ fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>
+francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>
+ german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>
+ ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>

Looking forward for your guidance.

Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also.

Regards,
Krishan
From: Krishan Babbar
Sent: Monday, April 30, 2018 7:59 PM
To: fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>; herman.junge@telefonica.com<herman.junge@telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Unable to run Cygnus with MySQL agent

Hi All,

I am trying to setup and understand Cygnus. But I am facing issue during installation.
I followed below given steps.

1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common)

2. Executed version command (curl http://172.17.0.2:8081/v1/version) which gave following response

a.

{"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"}

3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash

4. Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Please see attached file for configuration details.

5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one.

a. $

{FLUME_HOME}

/bin/cygnus-flume-ng agent --conf $

{CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH}

/agent_mysql.conf -n cygnus-ngsi -p $

{CYGNUS_API_PORT}

-Dflume.root.logger=$

{CYGNUS_LOG_LEVEL}

,$

{CYGNUS_LOG_APPENDER}

-Dfile.encoding=UTF-8

6. Exited Docker container and came back to Ubuntu.

7. Stop and restart Docker container.

8. And I am getting following errors in logs

Please check and let me know what am I doing wrong? Appreciate your help.

n$AgentConfiguration[1016] : Processing:mysql-sink
time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration[140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi]
time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[150] : Creating channels
time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory[40] : Creating instance of channel mysql-channel type memory
time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[205] : Created channel mysql-channel
time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory[39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource
time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource[113] : Error while configuring HTTPSource. Exception follows.
java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider[366] : Source http-source has been removed due to an error during configuration
java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at com.google.common.base.Throwables.propagate(Throwables.java:156)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
... 11 more
time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory[40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable[142] : Failed to load configuration data. Exception follows.
org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69)
at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67)
... 11 more

Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
============================================================================================================================

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

__________________________________________________________________________________________

You can get more information about our cookies and privacy policies on the following links:

Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Show

FW External User added a comment - 08/May/18 11:34 AM Hi Jose, I created new data again as given below, and still getting the same error. Details are given below. Entity Headers: fiware-service: smartcitytechm fiware-servicepath: / { "id": "reader-jp-id", "type": "Reader", "parcelNo": { "type": "Text", "value": "0101102195a3", "metadata": {} }, "readerId": { "type": "Text", "value": "566", "metadata": {} }, "tagNo": { "type": "Text", "value": "69219163", "metadata": {} }, "trnxDateTiem": { "type": "Text", "value": "Monday, May 7, 2018 4:08 PM", "metadata": {} } } Service { "_id": "5af02c19d047df057cfa063f", "subservice": "/", "service": "smartcitytechm", "apikey": "swm-reader-service", "resource": "/iot/json", "attributes": [], "lazy": [], "commands": [], "entity_type": "Reader", "internal_attributes": [], "static_attributes": [] } Device { "count": 1, "devices": [ { "device_id": "reader-device-id", "service": "smartcitytechm", "service_path": "/", "entity_name": "reader-jp-id", "entity_type": "Reader", "transport": "HTTP", "attributes": [ { "object_id": "tn", "name": "tagNo", "type": "Text" } , { "object_id": "pn", "name": "parcelNo", "type": "Text" } , { "object_id": "ri", "name": "readerId", "type": "Text" } , { "object_id": "tdt", "name": "trnxDateTiem", "type": "Text" } ], "lazy": [], "commands": [], "static_attributes": [], "protocol": "HTTP" } ] } Subscription [ { "id": "5af02f9f7ef878ae8ebac1dd", "description": "Update reader data", "expires": "2020-04-05T14:00:00.00Z", "status": "active", "subject": { "entities": [ { "idPattern": ".*", "type": "Reader" } ], "condition": { "attrs": [ "tagNo", "parcelNo", "readerId", "trnxDateTiem" ] } }, "notification": { "timesSent": 1, "lastNotification": "2018-05-07T10:51:11.00Z", "attrs": [ "tagNo", "parcelNo", "readerId", "trnxDateTiem" ], "attrsFormat": "normalized", "http": { "url": "http://<MyIP>:5050/notify" } , "lastSuccess": "2018-05-07T10:51:11.00Z" }, "throttling": 5 } ] Update Entity (Through MQTT). Now I am using “iotagent-json”. Earlier I was using “iotagent-UL” and updating entity using Send Measurement (on HTTP) and was getting same error. mosquitto_pub -h <myIP> -u <MyEmail> -P <MyPassword> -t /swm-reader-service/reader-device-id/attrs -m ' {"tn": "7777", "pn": "123456", "ri": "98765", "tdt":"Monday, May 7, 2018 4:31 PM"} ' Entity after update { "id": "reader-jp-id", "type": "Reader", "TimeInstant": { "type": "ISO8601", "value": "2018-05-07T11:07:43.00Z", "metadata": {} }, "parcelNo": { "type": "Text", "value": "123456", "metadata": { "TimeInstant": { "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" } } }, "readerId": { "type": "Text", "value": "98765", "metadata": { "TimeInstant": { "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" } } }, "tagNo": { "type": "Text", "value": "7777", "metadata": { "TimeInstant": { "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" } } }, "trnxDateTiem": { "type": "Text", "value": "Monday, May 7, 2018 4:31 PM", "metadata": { "TimeInstant": { "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" } } } } Cygnus Error Logs time=2018-05-07T11:07:43.108Z | lvl=INFO | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [294] : [NGSIRestHandler] Starting internal transaction (5a089c42-032b-46d2-869e-dc944a4167c0) time=2018-05-07T11:07:43.108Z | lvl=INFO | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [312] : [NGSIRestHandler] Received data ({"subscriptionId":"5af02f9f7ef878ae8ebac1dd","data":[{"id":"reader-jp-id","type":"Reader","tagNo":{"type":"Text","value":"7777","metadata":{"TimeInstant": {"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"} }},"parcelNo":{"type":"Text","value":"123456","metadata":{"TimeInstant": {"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"} }},"readerId":{"type":"Text","value":"98765","metadata":{"TimeInstant": {"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"} }},"trnxDateTiem":{"type":"Text","value":"Monday, May 7, 2018 4:31 PM","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}}}}]}) time=2018-05-07T11:07:43.111Z | lvl=WARN | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses time=2018-05-07T11:07:43.111Z | lvl=WARN | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet [186] : Received bad request from client. org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335) at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184) at javax.servlet.http.HttpServlet.service(HttpServlet.java:725) at javax.servlet.http.HttpServlet.service(HttpServlet.java:814) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) My Docker Containers: CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 65b96b1bc07f fiware/cygnus-ngsi "/cygnus-entrypoint.…" 3 days ago Up 3 days 0.0.0.0:5050->5050/tcp, 0.0.0.0:8081->8081/tcp cygnus-mysql1 c7d1d0ed4742 mysql/mysql-server "/entrypoint.sh mysq…" 3 days ago Up 3 days (healthy) 3306/tcp, 33060/tcp mysqlser 971ada7b5eb0 fiware/orion "/usr/bin/contextBro…" 10 days ago Up 10 days 0.0.0.0:1026->1026/tcp ubuntu_orion_1 7104c27ce1e1 mongo:3.2 "docker-entrypoint.s…" 10 days ago Up 10 days 0.0.0.0:27017->27017/tcp ubuntu_mongo_1 2e6baf2fc953 ansi/mosquitto "/usr/local/sbin/mos…" 10 days ago Up 10 days 0.0.0.0:1883->1883/tcp ubuntu_mosquitto_1 Thanks again for all your help. Thanks & Regards, Krishan Babbar Technical Architect IES Internet of Things | Tech Mahindra Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA • Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996 ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. =========================================================================================================================== From: José Ignacio Carretero <joseignacio.carretero@fiware.org> Sent: Friday, May 4, 2018 7:55 PM To: Krishan Babbar <KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com> Subject: Re: Unable to run Cygnus with MySQL agent I can't reproduce what you are doing — How did you get there? What are you sending to CB and the Cygnus register? Best regards, José Ignacio El 04/05/18 a las 15:13, Krishan Babbar escribió: It seems some issue in configuration or so. Similar issue is mentioned at https://ask.fiware.org/question/825/error-at-cygnus-when-receives-a-notification-from-orion-context-broker-fiware-servicepath-header-value-does-not-match-the-number-of-notified-context/ But still no solution. Regards, Krishan From: José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org > Sent: Friday, May 4, 2018 6:18 PM To: Krishan Babbar <KB00449283@TechMahindra.com>< KB00449283@TechMahindra.com >; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Re: Unable to run Cygnus with MySQL agent I removed people @telefonica.com who are no longer in the project since about 1 year ago. But I guess the key is here: org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses El 04/05/18 a las 14:33, Krishan Babbar escribió: Thanks Jose, And sorry for bothering you again. I created subscription using below JSON. Data reached to Cygnus but I am getting errors in logs (given below). What am I doing wrong? { "description": "Update controller ph1Vol", "subject": { "entities": [ { "idPattern": ".*", "type": "Controller" } ], "condition": { "attrs": [ "ph1Vol" ] } }, "notification": { "mqtt": { "url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify> } , "http": { "url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify> } , "attrs": [ "id", "type", "name", "ph1Vol", "current" ] }, "expires": "2020-04-05T14:00:00.00Z", "throttling": 5 } Logs time=2018-05-04T09:23:15.026Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=getLogLevel | msg=com.telefonica.iot.cygnus.management.LogHandlers [1029] : Cygnus logging level successfully obtained time=2018-05-04T12:13:00.017Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [294] : [NGSIRestHandler] Starting internal transaction (0d2b65a1-0be4-4371-8d83-4426d281b83d) time=2018-05-04T12:13:00.024Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [312] : [NGSIRestHandler] Received data ({"subscriptionId":"5aec4e4b7ef878ae8ebac1d9","data": [{"id":"ctrl_chandigrah","type":"Controller","name":{"type":"Text","value":"Noida-SEZ Controller 2","metadata":{}},"ph1Vol":{"type":"Text","value":"228","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-04T12:02:46.398Z"}}}}] }) time=2018-05-04T12:13:00.122Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses time=2018-05-04T12:13:00.123Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet [186] : Received bad request from client. org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335) at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184) at javax.servlet.http.HttpServlet.service(HttpServlet.java:725) at javax.servlet.http.HttpServlet.service(HttpServlet.java:814) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Regards, Krishan From: José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org > Sent: Friday, May 4, 2018 3:16 PM To: Krishan Babbar <KB00449283@TechMahindra.com>< KB00449283@TechMahindra.com >; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; herman.junge@telefonica.com< herman.junge@telefonica.com >; ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com >; german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com >; francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com >; fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com >; pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Re: Unable to run Cygnus with MySQL agent Databases will be created as data comes. Please, use your Orion CB to push some data into Cygnus (through subscriptions). Regards, José Ignacio El 04/05/18 a las 11:40, Krishan Babbar escribió: Thanks Jose, I ran following commands 1. docker run --name=mysqlser -d mysql/mysql-server 2. docker run -d --name cygnus-mysql1 --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=<Root_Password> fiware/cygnus-ngsi I logged into MySQL Container but did not see any DB. I could see only following DBs. docker exec -it mysqlser mysql -u root -p mysql> show databases; -------------------- -------------------- -------------------- 4 rows in set (0.00 sec) What would be the expected behavior? How to cross check if MySQL Sink is working fine? Regards, Krishan From: José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org > Sent: Friday, May 4, 2018 2:19 PM To: Krishan Babbar <KB00449283@TechMahindra.com>< KB00449283@TechMahindra.com >; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; herman.junge@telefonica.com< herman.junge@telefonica.com >; ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com >; german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com >; francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com >; fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com >; pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Re: Unable to run Cygnus with MySQL agent I've answered the Stackoverflow question. Regards, José Ignacio El 03/05/18 a las 15:37, Krishan Babbar escribió: + pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > + fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com > +francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com > + german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com > + ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com > Looking forward for your guidance. Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also. Regards, Krishan From: Krishan Babbar Sent: Monday, April 30, 2018 7:59 PM To: fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org >; herman.junge@telefonica.com< herman.junge@telefonica.com > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Unable to run Cygnus with MySQL agent Hi All, I am trying to setup and understand Cygnus. But I am facing issue during installation. I followed below given steps. 1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common) 2. Executed version command (curl http://172.17.0.2:8081/v1/version ) which gave following response a. {"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"} 3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash 4. Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Please see attached file for configuration details. 5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one. a. $ {FLUME_HOME} /bin/cygnus-flume-ng agent --conf $ {CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH} /agent_mysql.conf -n cygnus-ngsi -p $ {CYGNUS_API_PORT} -Dflume.root.logger=$ {CYGNUS_LOG_LEVEL} ,$ {CYGNUS_LOG_APPENDER} -Dfile.encoding=UTF-8 6. Exited Docker container and came back to Ubuntu. 7. Stop and restart Docker container. 8. And I am getting following errors in logs Please check and let me know what am I doing wrong? Appreciate your help. n$AgentConfiguration [1016] : Processing:mysql-sink time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration [140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi] time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider [150] : Creating channels time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory [40] : Creating instance of channel mysql-channel type memory time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider [205] : Created channel mysql-channel time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory [39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource [113] : Error while configuring HTTPSource. Exception follows. java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102) at org.apache.flume.conf.Configurables.configure(Configurables.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider [366] : Source http-source has been removed due to an error during configuration java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at com.google.common.base.Throwables.propagate(Throwables.java:156) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114) at org.apache.flume.conf.Configurables.configure(Configurables.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102) ... 11 more time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory [40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable [142] : Failed to load configuration data. Exception follows. org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69) at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67) ... 11 more Thanks & Regards, Krishan Babbar Technical Architect IES Internet of Things | Tech Mahindra Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA • Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996 ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. =========================================================================================================================== ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. ============================================================================================================================ – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero __________________________________________________________________________________________ You can get more information about our cookies and privacy policies on the following links: http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/FIWARE_Privacy_Policy http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Cookies_Policy_FIWARE Fiware-tech-help mailing list Fiware-tech-help@lists.fiware.org https://lists.fiware.org/listinfo/fiware-tech-help

Hide

Permalink

Spain Node Support Team added a comment - 09/May/18 11:37 AM

Hi,

I mean in the subscription you provided a couple of days ago, find the "attrsFormat" in the json payload. Instead of writing "normalized", please, change it for "legacy".

Regards,
José Ignacio

⁣Enviado desde BlueMail

__________________________________________________________________________________________

You can get more information about our cookies and privacy policies on the following links:

Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Show

Spain Node Support Team added a comment - 09/May/18 11:37 AM Hi, I mean in the subscription you provided a couple of days ago, find the "attrsFormat" in the json payload. Instead of writing "normalized", please, change it for "legacy". Regards, José Ignacio ⁣Enviado desde BlueMail __________________________________________________________________________________________ You can get more information about our cookies and privacy policies on the following links: http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/FIWARE_Privacy_Policy http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Cookies_Policy_FIWARE Fiware-tech-help mailing list Fiware-tech-help@lists.fiware.org https://lists.fiware.org/listinfo/fiware-tech-help

Hide

Permalink

FW External User added a comment - 09/May/18 2:08 PM

Thanks Jose,

Now I am getting DB connection error. I Googled and did following steps. Please suggest.
1.
docker run --name=mysqlser -e MYSQL_ROOT_HOST=% -d mysql/mysql-server

And change root user’s password.

2.
docker run -d --name cygnus-mysql --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=mypassword -e CYGNUS_LOG_LEVEL='DEBUG' fiware/cygnus-ngsi

3.
Changed Agent file and keep only mysql-sink. Restarted Cygnus container.
cygnus-ngsi.sinks = mysql-sink
cygnus-ngsi.channels = mysql-channel

4.
mosquitto_pub -h <myIP> -u <MyEmail> -P <MyPassword> -t /swm-reader-service/reader-device-id/attrs -m '

{"tn": "7777", "pn": "123456", "ri": "98765", "tdt":"Monday, May 7, 2018 4:31 PM"}

'

MySQL Docker Container’s IP = 172.17.0.2
Cygnus Docker Container’s IP = 172.17.0.3

Error Logs:
Connecting to jdbc:mysql://172.17.0.2:3306/?user=root&password=XXXXXXXXXX
time=2018-05-09T11:58:37.212Z | lvl=ERROR | corr=4e308fde-5380-11e8-9a32-0242ac120004 | trans=b33b7c8c-90c1-493a-835c-ef6c44a451b1 | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=processNewBatches | msg=com.telefonica.iot.cygnus.sinks.NGSISink[569] : CygnusPersistenceError (SQLException). Connection error (Could not create connection to database server.). Stack trace: [com.telefonica.iot.cygnus.backends.mysql.MySQLBackendImpl$MySQLDriver.getConnection(MySQLBackendImpl.java:416), com.telefonica.iot.cygnus.backends.mysql.MySQLBackendImpl.createDatabase(MySQLBackendImpl.java:86), com.telefonica.iot.cygnus.sinks.NGSIMySQLSink.persistAggregation(NGSIMySQLSink.java:552), com.telefonica.iot.cygnus.sinks.NGSIMySQLSink.persistBatch(NGSIMySQLSink.java:200), com.telefonica.iot.cygnus.sinks.NGSISink.processNewBatches(NGSISink.java:558), com.telefonica.iot.cygnus.sinks.NGSISink.process(NGSISink.java:370), org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68), org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147), java.lang.Thread.run(Thread.java:748)]

Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================

From: Jose Ignacio Carretero <joseignacio.carretero@fiware.org>
Sent: Wednesday, May 9, 2018 2:51 PM
To: Krishan Babbar <KB00449283@TechMahindra.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>; fiware-tech-help@lists.fiware.org; Fernando López Aguilar <fernando.lopez@fiware.org>
Subject: RE: Unable to run Cygnus with MySQL agent

Hi,
I mean in the subscription you provided a couple of days ago, find the "attrsFormat" in the json payload. Instead of writing "normalized", please, change it for "legacy".
Regards,
José Ignacio
Enviado desde BlueMail<http://www.bluemail.me/r?b=12874>
En 9 may. 2018, en 11:10, Krishan Babbar <kb00449283@techmahindra.com<kb00449283@techmahindra.com>> escribió:
Thanks Jose,

Could you please provide an example or reference URL showing what to change and how to use it ?

Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================

From: José Ignacio Carretero <joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>>
Sent: Wednesday, May 9, 2018 4:49 AM
To: Yugal Kishor Mullick <YM00106030@TechMahindra.com<YM00106030@TechMahindra.com>>; Krishan Babbar <KB00449283@TechMahindra.com<KB00449283@TechMahindra.com>>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; Fernando López Aguilar <fernando.lopez@fiware.org<fernando.lopez@fiware.org>>
Subject: Re: Unable to run Cygnus with MySQL agent

Hi,

After doing some research, I think that the problem may come because of the Cygnus subscription. As Cygnus just works with NGSIv1, attrsFormat should be "legacy" instead of "normalized".

Regards,
José Ignacio

El 08/05/18 a las 15:12, Yugal Kishor Mullick escribió:
Dear Fiware Team,

Tried to reach you for urgent help…no luck.

Look forward for you earliest support on this matter below..pls. This is critical for business.

Thanks for extending your support so far.

----------------------------------
Regards,
Yugal | Smart City- Global
Mobile: (+91)-77.98.78.4888

From: Yugal Kishor Mullick
Sent: Tuesday, May 8, 2018 1:08 PM
To: Krishan Babbar <KB00449283@TechMahindra.com><KB00449283@TechMahindra.com>; José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; 'Fernando López Aguilar' <fernando.lopez@fiware.org><fernando.lopez@fiware.org>
Subject: RE: Unable to run Cygnus with MySQL agent

++ Fernando

----------------------------------
Regards,
Yugal | Smart City- Global
Mobile: (+91)-77.98.78.4888

From: Krishan Babbar
Sent: Monday, May 7, 2018 4:57 PM
To: José Ignacio Carretero <joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com<YM00106030@TechMahindra.com>>
Subject: RE: Unable to run Cygnus with MySQL agent

Hi Jose,

I created new data again as given below, and still getting the same error. Details are given below.

Entity
Headers:
fiware-service: smartcitytechm
fiware-servicepath: /

{
"id": "reader-jp-id",
"type": "Reader",
"parcelNo": {
"type": "Text",
"value": "0101102195a3",
"metadata": {}
},
"readerId": {
"type": "Text",
"value": "566",
"metadata": {}
},
"tagNo": {
"type": "Text",
"value": "69219163",
"metadata": {}
},
"trnxDateTiem": {
"type": "Text",
"value": "Monday, May 7, 2018 4:08 PM",
"metadata": {}
}
}

Service

{ "_id": "5af02c19d047df057cfa063f", "subservice": "/", "service": "smartcitytechm", "apikey": "swm-reader-service", "resource": "/iot/json", "attributes": [], "lazy": [], "commands": [], "entity_type": "Reader", "internal_attributes": [], "static_attributes": [] }

Device
{
"count": 1,
"devices": [
{
"device_id": "reader-device-id",
"service": "smartcitytechm",
"service_path": "/",
"entity_name": "reader-jp-id",
"entity_type": "Reader",
"transport": "HTTP",
"attributes": [

{ "object_id": "tn", "name": "tagNo", "type": "Text" }

,

{ "object_id": "pn", "name": "parcelNo", "type": "Text" }

,

{ "object_id": "ri", "name": "readerId", "type": "Text" }

,

{ "object_id": "tdt", "name": "trnxDateTiem", "type": "Text" }

],
"lazy": [],
"commands": [],
"static_attributes": [],
"protocol": "HTTP"
}
]
}

Subscription
[
{
"id": "5af02f9f7ef878ae8ebac1dd",
"description": "Update reader data",
"expires": "2020-04-05T14:00:00.00Z",
"status": "active",
"subject": {
"entities": [

{ "idPattern": ".*", "type": "Reader" }

],
"condition":

{ "attrs": [ "tagNo", "parcelNo", "readerId", "trnxDateTiem" ] }

},
"notification": {
"timesSent": 1,
"lastNotification": "2018-05-07T10:51:11.00Z",
"attrs": [
"tagNo",
"parcelNo",
"readerId",
"trnxDateTiem"
],
"attrsFormat": "normalized",
"http":

{ "url": "http://<MyIP>:5050/notify<http://%3cMyIP%3e:5050/notify>" }

,
"lastSuccess": "2018-05-07T10:51:11.00Z"
},
"throttling": 5
}
]

Update Entity (Through MQTT). Now I am using “iotagent-json”. Earlier I was using “iotagent-UL” and updating entity using Send Measurement (on HTTP) and was getting same error.
mosquitto_pub -h <myIP> -u <MyEmail> -P <MyPassword> -t /swm-reader-service/reader-device-id/attrs -m '

{"tn": "7777", "pn": "123456", "ri": "98765", "tdt":"Monday, May 7, 2018 4:31 PM"}

'

Entity after update
{
"id": "reader-jp-id",
"type": "Reader",
"TimeInstant": {
"type": "ISO8601",
"value": "2018-05-07T11:07:43.00Z",
"metadata": {}
},
"parcelNo": {
"type": "Text",
"value": "123456",
"metadata": {
"TimeInstant":

{ "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" }

}
},
"readerId": {
"type": "Text",
"value": "98765",
"metadata": {
"TimeInstant":

{ "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" }

}
},
"tagNo": {
"type": "Text",
"value": "7777",
"metadata": {
"TimeInstant":

{ "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" }

}
},
"trnxDateTiem": {
"type": "Text",
"value": "Monday, May 7, 2018 4:31 PM",
"metadata": {
"TimeInstant":

{ "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" }

}
}
}

Cygnus Error Logs
time=2018-05-07T11:07:43.108Z | lvl=INFO | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[294] : [NGSIRestHandler] Starting internal transaction (5a089c42-032b-46d2-869e-dc944a4167c0)
time=2018-05-07T11:07:43.108Z | lvl=INFO | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[312] : [NGSIRestHandler] Received data ({"subscriptionId":"5af02f9f7ef878ae8ebac1dd","data":[{"id":"reader-jp-id","type":"Reader","tagNo":{"type":"Text","value":"7777","metadata":{"TimeInstant":

{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}

}},"parcelNo":{"type":"Text","value":"123456","metadata":{"TimeInstant":

{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}

}},"readerId":{"type":"Text","value":"98765","metadata":{"TimeInstant":

{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}

}},"trnxDateTiem":{"type":"Text","value":"Monday, May 7, 2018 4:31 PM","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}}}}]})
time=2018-05-07T11:07:43.111Z | lvl=WARN | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses
time=2018-05-07T11:07:43.111Z | lvl=WARN | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet[186] : Received bad request from client.
org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses
at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335)
at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:725)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:814)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

My Docker Containers:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
65b96b1bc07f fiware/cygnus-ngsi "/cygnus-entrypoint.…" 3 days ago Up 3 days 0.0.0.0:5050->5050/tcp, 0.0.0.0:8081->8081/tcp cygnus-mysql1
c7d1d0ed4742 mysql/mysql-server "/entrypoint.sh mysq…" 3 days ago Up 3 days (healthy) 3306/tcp, 33060/tcp mysqlser
971ada7b5eb0 fiware/orion "/usr/bin/contextBro…" 10 days ago Up 10 days 0.0.0.0:1026->1026/tcp ubuntu_orion_1
7104c27ce1e1 mongo:3.2 "docker-entrypoint.s…" 10 days ago Up 10 days 0.0.0.0:27017->27017/tcp ubuntu_mongo_1
2e6baf2fc953 ansi/mosquitto "/usr/local/sbin/mos…" 10 days ago Up 10 days 0.0.0.0:1883->1883/tcp ubuntu_mosquitto_1

Thanks again for all your help.

Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================

From: José Ignacio Carretero <joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>>
Sent: Friday, May 4, 2018 7:55 PM
To: Krishan Babbar <KB00449283@TechMahindra.com<KB00449283@TechMahindra.com>>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com<YM00106030@TechMahindra.com>>
Subject: Re: Unable to run Cygnus with MySQL agent

I can't reproduce what you are doing — How did you get there? What are you sending to CB and the Cygnus register?
Best regards,
José Ignacio
El 04/05/18 a las 15:13, Krishan Babbar escribió:
It seems some issue in configuration or so.
Similar issue is mentioned at https://ask.fiware.org/question/825/error-at-cygnus-when-receives-a-notification-from-orion-context-broker-fiware-servicepath-header-value-does-not-match-the-number-of-notified-context/
But still no solution.

Regards,
Krishan

From: José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 6:18 PM
To: Krishan Babbar <KB00449283@TechMahindra.com><KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

I removed people @telefonica.com who are no longer in the project since about 1 year ago. But I guess the key is here:
org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses

El 04/05/18 a las 14:33, Krishan Babbar escribió:
Thanks Jose,

And sorry for bothering you again.

I created subscription using below JSON. Data reached to Cygnus but I am getting errors in logs (given below). What am I doing wrong?
{
"description": "Update controller ph1Vol",
"subject": {
"entities": [

{ "idPattern": ".*", "type": "Controller" }

],
"condition":

{ "attrs": [ "ph1Vol" ] }

},
"notification": {
"mqtt":

{ "url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify> }

,
"http":

{ "url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify> }

,
"attrs": [
"id",
"type",
"name",
"ph1Vol",
"current"
]
},
"expires": "2020-04-05T14:00:00.00Z",
"throttling": 5
}

Logs
time=2018-05-04T09:23:15.026Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=getLogLevel | msg=com.telefonica.iot.cygnus.management.LogHandlers[1029] : Cygnus logging level successfully obtained
time=2018-05-04T12:13:00.017Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[294] : [NGSIRestHandler] Starting internal transaction (0d2b65a1-0be4-4371-8d83-4426d281b83d)
time=2018-05-04T12:13:00.024Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[312] : [NGSIRestHandler] Received data ({"subscriptionId":"5aec4e4b7ef878ae8ebac1d9","data":[{"id":"ctrl_chandigrah","type":"Controller","name":{"type":"Text","value":"Noida-SEZ Controller 2","metadata":{}},"ph1Vol":{"type":"Text","value":"228","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-04T12:02:46.398Z"}}}}]})
time=2018-05-04T12:13:00.122Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses
time=2018-05-04T12:13:00.123Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet[186] : Received bad request from client.
org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses
at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335)
at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:725)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:814)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

Regards,
Krishan

From: José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 3:16 PM
To: Krishan Babbar <KB00449283@TechMahindra.com><KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; herman.junge@telefonica.com<herman.junge@telefonica.com>; ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>; german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>; francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>; fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>; pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

Databases will be created as data comes. Please, use your Orion CB to push some data into Cygnus (through subscriptions).

Regards,
José Ignacio

El 04/05/18 a las 11:40, Krishan Babbar escribió:
Thanks Jose,

I ran following commands
1.
docker run --name=mysqlser -d mysql/mysql-server
2.
docker run -d --name cygnus-mysql1 --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=<Root_Password> fiware/cygnus-ngsi

I logged into MySQL Container but did not see any DB.
I could see only following DBs.
docker exec -it mysqlser mysql -u root -p

mysql> show databases;
--------------------
--------------------
--------------------
4 rows in set (0.00 sec)
What would be the expected behavior?
How to cross check if MySQL Sink is working fine?

Regards,
Krishan

From: José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>
Sent: Friday, May 4, 2018 2:19 PM
To: Krishan Babbar <KB00449283@TechMahindra.com><KB00449283@TechMahindra.com>; fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; herman.junge@telefonica.com<herman.junge@telefonica.com>; ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>; german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>; francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>; fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>; pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent

I've answered the Stackoverflow question.

Regards,
José Ignacio

El 03/05/18 a las 15:37, Krishan Babbar escribió:
+ pablo.coellovillalba@telefonica.com<pablo.coellovillalba@telefonica.com>
+ fermin.galanmarquez@telefonica.com<fermin.galanmarquez@telefonica.com>
+francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>
+ german.torodelvalle@telefonica.com<german.torodelvalle@telefonica.com>
+ ivan.ariasleon@telefonica.com<ivan.ariasleon@telefonica.com>

Looking forward for your guidance.

Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also.

Regards,
Krishan
From: Krishan Babbar
Sent: Monday, April 30, 2018 7:59 PM
To: fiware-tech-help@lists.fiware.org<fiware-tech-help@lists.fiware.org>; José Ignacio Carretero <joseignacio.carretero@fiware.org><joseignacio.carretero@fiware.org>; herman.junge@telefonica.com<herman.junge@telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com><YM00106030@TechMahindra.com>
Subject: Unable to run Cygnus with MySQL agent

Hi All,

I am trying to setup and understand Cygnus. But I am facing issue during installation.
I followed below given steps.

1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common)

2. Executed version command (curl http://172.17.0.2:8081/v1/version) which gave following response

a.

{"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"}

3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash

4. Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Please see attached file for configuration details.

5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one.

a. $

{FLUME_HOME}

/bin/cygnus-flume-ng agent --conf $

{CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH}

/agent_mysql.conf -n cygnus-ngsi -p $

{CYGNUS_API_PORT}

-Dflume.root.logger=$

{CYGNUS_LOG_LEVEL}

,$

{CYGNUS_LOG_APPENDER}

-Dfile.encoding=UTF-8

6. Exited Docker container and came back to Ubuntu.

7. Stop and restart Docker container.

8. And I am getting following errors in logs

Please check and let me know what am I doing wrong? Appreciate your help.

n$AgentConfiguration[1016] : Processing:mysql-sink
time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration[140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi]
time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[150] : Creating channels
time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory[40] : Creating instance of channel mysql-channel type memory
time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[205] : Created channel mysql-channel
time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory[39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource
time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource[113] : Error while configuring HTTPSource. Exception follows.
java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider[366] : Source http-source has been removed due to an error during configuration
java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at com.google.common.base.Throwables.propagate(Throwables.java:156)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
... 11 more
time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory[40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable[142] : Failed to load configuration data. Exception follows.
org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69)
at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67)
... 11 more

Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================

============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
============================================================================================================================

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

–
−−−
José Ignacio Carretero

FIWARE Cloud and Platform Expert
FIWARE Foundation

[FIWARE Foundation]

Franklinstrasse 13A
10587 Berlin

email: joseignacio.carretero@fiware.org<joseignacio.carretero@fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero

__________________________________________________________________________________________

You can get more information about our cookies and privacy policies on the following links:

Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Show

FW External User added a comment - 09/May/18 2:08 PM Thanks Jose, Now I am getting DB connection error. I Googled and did following steps. Please suggest. 1. docker run --name=mysqlser -e MYSQL_ROOT_HOST=% -d mysql/mysql-server And change root user’s password. 2. docker run -d --name cygnus-mysql --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=mypassword -e CYGNUS_LOG_LEVEL='DEBUG' fiware/cygnus-ngsi 3. Changed Agent file and keep only mysql-sink. Restarted Cygnus container. cygnus-ngsi.sinks = mysql-sink cygnus-ngsi.channels = mysql-channel 4. mosquitto_pub -h <myIP> -u <MyEmail> -P <MyPassword> -t /swm-reader-service/reader-device-id/attrs -m ' {"tn": "7777", "pn": "123456", "ri": "98765", "tdt":"Monday, May 7, 2018 4:31 PM"} ' MySQL Docker Container’s IP = 172.17.0.2 Cygnus Docker Container’s IP = 172.17.0.3 Error Logs: Connecting to jdbc:mysql://172.17.0.2:3306/?user=root&password=XXXXXXXXXX time=2018-05-09T11:58:37.212Z | lvl=ERROR | corr=4e308fde-5380-11e8-9a32-0242ac120004 | trans=b33b7c8c-90c1-493a-835c-ef6c44a451b1 | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=processNewBatches | msg=com.telefonica.iot.cygnus.sinks.NGSISink [569] : CygnusPersistenceError (SQLException). Connection error (Could not create connection to database server.). Stack trace: [com.telefonica.iot.cygnus.backends.mysql.MySQLBackendImpl$MySQLDriver.getConnection(MySQLBackendImpl.java:416), com.telefonica.iot.cygnus.backends.mysql.MySQLBackendImpl.createDatabase(MySQLBackendImpl.java:86), com.telefonica.iot.cygnus.sinks.NGSIMySQLSink.persistAggregation(NGSIMySQLSink.java:552), com.telefonica.iot.cygnus.sinks.NGSIMySQLSink.persistBatch(NGSIMySQLSink.java:200), com.telefonica.iot.cygnus.sinks.NGSISink.processNewBatches(NGSISink.java:558), com.telefonica.iot.cygnus.sinks.NGSISink.process(NGSISink.java:370), org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68), org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147), java.lang.Thread.run(Thread.java:748)] Thanks & Regards, Krishan Babbar Technical Architect IES Internet of Things | Tech Mahindra Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA • Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996 ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. =========================================================================================================================== From: Jose Ignacio Carretero <joseignacio.carretero@fiware.org> Sent: Wednesday, May 9, 2018 2:51 PM To: Krishan Babbar <KB00449283@TechMahindra.com> Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>; fiware-tech-help@lists.fiware.org; Fernando López Aguilar <fernando.lopez@fiware.org> Subject: RE: Unable to run Cygnus with MySQL agent Hi, I mean in the subscription you provided a couple of days ago, find the "attrsFormat" in the json payload. Instead of writing "normalized", please, change it for "legacy". Regards, José Ignacio Enviado desde BlueMail< http://www.bluemail.me/r?b=12874 > En 9 may. 2018, en 11:10, Krishan Babbar <kb00449283@techmahindra.com< kb00449283@techmahindra.com >> escribió: Thanks Jose, Could you please provide an example or reference URL showing what to change and how to use it ? Thanks & Regards, Krishan Babbar Technical Architect IES Internet of Things | Tech Mahindra Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA • Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996 ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. =========================================================================================================================== From: José Ignacio Carretero <joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org >> Sent: Wednesday, May 9, 2018 4:49 AM To: Yugal Kishor Mullick <YM00106030@TechMahindra.com< YM00106030@TechMahindra.com >>; Krishan Babbar <KB00449283@TechMahindra.com< KB00449283@TechMahindra.com >>; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; Fernando López Aguilar <fernando.lopez@fiware.org< fernando.lopez@fiware.org >> Subject: Re: Unable to run Cygnus with MySQL agent Hi, After doing some research, I think that the problem may come because of the Cygnus subscription. As Cygnus just works with NGSIv1, attrsFormat should be "legacy" instead of "normalized". Regards, José Ignacio El 08/05/18 a las 15:12, Yugal Kishor Mullick escribió: Dear Fiware Team, Tried to reach you for urgent help…no luck. Look forward for you earliest support on this matter below..pls. This is critical for business. Thanks for extending your support so far. ---------------------------------- Regards, Yugal | Smart City- Global Mobile: (+91)-77.98.78.4888 From: Yugal Kishor Mullick Sent: Tuesday, May 8, 2018 1:08 PM To: Krishan Babbar <KB00449283@TechMahindra.com>< KB00449283@TechMahindra.com >; José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org >; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; 'Fernando López Aguilar' <fernando.lopez@fiware.org>< fernando.lopez@fiware.org > Subject: RE: Unable to run Cygnus with MySQL agent ++ Fernando ---------------------------------- Regards, Yugal | Smart City- Global Mobile: (+91)-77.98.78.4888 From: Krishan Babbar Sent: Monday, May 7, 2018 4:57 PM To: José Ignacio Carretero <joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org >>; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com< YM00106030@TechMahindra.com >> Subject: RE: Unable to run Cygnus with MySQL agent Hi Jose, I created new data again as given below, and still getting the same error. Details are given below. Entity Headers: fiware-service: smartcitytechm fiware-servicepath: / { "id": "reader-jp-id", "type": "Reader", "parcelNo": { "type": "Text", "value": "0101102195a3", "metadata": {} }, "readerId": { "type": "Text", "value": "566", "metadata": {} }, "tagNo": { "type": "Text", "value": "69219163", "metadata": {} }, "trnxDateTiem": { "type": "Text", "value": "Monday, May 7, 2018 4:08 PM", "metadata": {} } } Service { "_id": "5af02c19d047df057cfa063f", "subservice": "/", "service": "smartcitytechm", "apikey": "swm-reader-service", "resource": "/iot/json", "attributes": [], "lazy": [], "commands": [], "entity_type": "Reader", "internal_attributes": [], "static_attributes": [] } Device { "count": 1, "devices": [ { "device_id": "reader-device-id", "service": "smartcitytechm", "service_path": "/", "entity_name": "reader-jp-id", "entity_type": "Reader", "transport": "HTTP", "attributes": [ { "object_id": "tn", "name": "tagNo", "type": "Text" } , { "object_id": "pn", "name": "parcelNo", "type": "Text" } , { "object_id": "ri", "name": "readerId", "type": "Text" } , { "object_id": "tdt", "name": "trnxDateTiem", "type": "Text" } ], "lazy": [], "commands": [], "static_attributes": [], "protocol": "HTTP" } ] } Subscription [ { "id": "5af02f9f7ef878ae8ebac1dd", "description": "Update reader data", "expires": "2020-04-05T14:00:00.00Z", "status": "active", "subject": { "entities": [ { "idPattern": ".*", "type": "Reader" } ], "condition": { "attrs": [ "tagNo", "parcelNo", "readerId", "trnxDateTiem" ] } }, "notification": { "timesSent": 1, "lastNotification": "2018-05-07T10:51:11.00Z", "attrs": [ "tagNo", "parcelNo", "readerId", "trnxDateTiem" ], "attrsFormat": "normalized", "http": { "url": "http://<MyIP>:5050/notify<http://%3cMyIP%3e:5050/notify>" } , "lastSuccess": "2018-05-07T10:51:11.00Z" }, "throttling": 5 } ] Update Entity (Through MQTT). Now I am using “iotagent-json”. Earlier I was using “iotagent-UL” and updating entity using Send Measurement (on HTTP) and was getting same error. mosquitto_pub -h <myIP> -u <MyEmail> -P <MyPassword> -t /swm-reader-service/reader-device-id/attrs -m ' {"tn": "7777", "pn": "123456", "ri": "98765", "tdt":"Monday, May 7, 2018 4:31 PM"} ' Entity after update { "id": "reader-jp-id", "type": "Reader", "TimeInstant": { "type": "ISO8601", "value": "2018-05-07T11:07:43.00Z", "metadata": {} }, "parcelNo": { "type": "Text", "value": "123456", "metadata": { "TimeInstant": { "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" } } }, "readerId": { "type": "Text", "value": "98765", "metadata": { "TimeInstant": { "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" } } }, "tagNo": { "type": "Text", "value": "7777", "metadata": { "TimeInstant": { "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" } } }, "trnxDateTiem": { "type": "Text", "value": "Monday, May 7, 2018 4:31 PM", "metadata": { "TimeInstant": { "type": "ISO8601", "value": "2018-05-07T11:07:43.010Z" } } } } Cygnus Error Logs time=2018-05-07T11:07:43.108Z | lvl=INFO | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [294] : [NGSIRestHandler] Starting internal transaction (5a089c42-032b-46d2-869e-dc944a4167c0) time=2018-05-07T11:07:43.108Z | lvl=INFO | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [312] : [NGSIRestHandler] Received data ({"subscriptionId":"5af02f9f7ef878ae8ebac1dd","data":[{"id":"reader-jp-id","type":"Reader","tagNo":{"type":"Text","value":"7777","metadata":{"TimeInstant": {"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"} }},"parcelNo":{"type":"Text","value":"123456","metadata":{"TimeInstant": {"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"} }},"readerId":{"type":"Text","value":"98765","metadata":{"TimeInstant": {"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"} }},"trnxDateTiem":{"type":"Text","value":"Monday, May 7, 2018 4:31 PM","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}}}}]}) time=2018-05-07T11:07:43.111Z | lvl=WARN | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses time=2018-05-07T11:07:43.111Z | lvl=WARN | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet [186] : Received bad request from client. org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335) at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184) at javax.servlet.http.HttpServlet.service(HttpServlet.java:725) at javax.servlet.http.HttpServlet.service(HttpServlet.java:814) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) My Docker Containers: CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 65b96b1bc07f fiware/cygnus-ngsi "/cygnus-entrypoint.…" 3 days ago Up 3 days 0.0.0.0:5050->5050/tcp, 0.0.0.0:8081->8081/tcp cygnus-mysql1 c7d1d0ed4742 mysql/mysql-server "/entrypoint.sh mysq…" 3 days ago Up 3 days (healthy) 3306/tcp, 33060/tcp mysqlser 971ada7b5eb0 fiware/orion "/usr/bin/contextBro…" 10 days ago Up 10 days 0.0.0.0:1026->1026/tcp ubuntu_orion_1 7104c27ce1e1 mongo:3.2 "docker-entrypoint.s…" 10 days ago Up 10 days 0.0.0.0:27017->27017/tcp ubuntu_mongo_1 2e6baf2fc953 ansi/mosquitto "/usr/local/sbin/mos…" 10 days ago Up 10 days 0.0.0.0:1883->1883/tcp ubuntu_mosquitto_1 Thanks again for all your help. Thanks & Regards, Krishan Babbar Technical Architect IES Internet of Things | Tech Mahindra Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA • Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996 ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. =========================================================================================================================== From: José Ignacio Carretero <joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org >> Sent: Friday, May 4, 2018 7:55 PM To: Krishan Babbar <KB00449283@TechMahindra.com< KB00449283@TechMahindra.com >>; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com< YM00106030@TechMahindra.com >> Subject: Re: Unable to run Cygnus with MySQL agent I can't reproduce what you are doing — How did you get there? What are you sending to CB and the Cygnus register? Best regards, José Ignacio El 04/05/18 a las 15:13, Krishan Babbar escribió: It seems some issue in configuration or so. Similar issue is mentioned at https://ask.fiware.org/question/825/error-at-cygnus-when-receives-a-notification-from-orion-context-broker-fiware-servicepath-header-value-does-not-match-the-number-of-notified-context/ But still no solution. Regards, Krishan From: José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org > Sent: Friday, May 4, 2018 6:18 PM To: Krishan Babbar <KB00449283@TechMahindra.com>< KB00449283@TechMahindra.com >; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Re: Unable to run Cygnus with MySQL agent I removed people @telefonica.com who are no longer in the project since about 1 year ago. But I guess the key is here: org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses El 04/05/18 a las 14:33, Krishan Babbar escribió: Thanks Jose, And sorry for bothering you again. I created subscription using below JSON. Data reached to Cygnus but I am getting errors in logs (given below). What am I doing wrong? { "description": "Update controller ph1Vol", "subject": { "entities": [ { "idPattern": ".*", "type": "Controller" } ], "condition": { "attrs": [ "ph1Vol" ] } }, "notification": { "mqtt": { "url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify> } , "http": { "url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify> } , "attrs": [ "id", "type", "name", "ph1Vol", "current" ] }, "expires": "2020-04-05T14:00:00.00Z", "throttling": 5 } Logs time=2018-05-04T09:23:15.026Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=getLogLevel | msg=com.telefonica.iot.cygnus.management.LogHandlers [1029] : Cygnus logging level successfully obtained time=2018-05-04T12:13:00.017Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [294] : [NGSIRestHandler] Starting internal transaction (0d2b65a1-0be4-4371-8d83-4426d281b83d) time=2018-05-04T12:13:00.024Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [312] : [NGSIRestHandler] Received data ({"subscriptionId":"5aec4e4b7ef878ae8ebac1d9","data": [{"id":"ctrl_chandigrah","type":"Controller","name":{"type":"Text","value":"Noida-SEZ Controller 2","metadata":{}},"ph1Vol":{"type":"Text","value":"228","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-04T12:02:46.398Z"}}}}] }) time=2018-05-04T12:13:00.122Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler [332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses time=2018-05-04T12:13:00.123Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet [186] : Received bad request from client. org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335) at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184) at javax.servlet.http.HttpServlet.service(HttpServlet.java:725) at javax.servlet.http.HttpServlet.service(HttpServlet.java:814) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Regards, Krishan From: José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org > Sent: Friday, May 4, 2018 3:16 PM To: Krishan Babbar <KB00449283@TechMahindra.com>< KB00449283@TechMahindra.com >; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; herman.junge@telefonica.com< herman.junge@telefonica.com >; ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com >; german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com >; francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com >; fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com >; pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Re: Unable to run Cygnus with MySQL agent Databases will be created as data comes. Please, use your Orion CB to push some data into Cygnus (through subscriptions). Regards, José Ignacio El 04/05/18 a las 11:40, Krishan Babbar escribió: Thanks Jose, I ran following commands 1. docker run --name=mysqlser -d mysql/mysql-server 2. docker run -d --name cygnus-mysql1 --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=<Root_Password> fiware/cygnus-ngsi I logged into MySQL Container but did not see any DB. I could see only following DBs. docker exec -it mysqlser mysql -u root -p mysql> show databases; -------------------- -------------------- -------------------- 4 rows in set (0.00 sec) What would be the expected behavior? How to cross check if MySQL Sink is working fine? Regards, Krishan From: José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org > Sent: Friday, May 4, 2018 2:19 PM To: Krishan Babbar <KB00449283@TechMahindra.com>< KB00449283@TechMahindra.com >; fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; herman.junge@telefonica.com< herman.junge@telefonica.com >; ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com >; german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com >; francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com >; fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com >; pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Re: Unable to run Cygnus with MySQL agent I've answered the Stackoverflow question. Regards, José Ignacio El 03/05/18 a las 15:37, Krishan Babbar escribió: + pablo.coellovillalba@telefonica.com< pablo.coellovillalba@telefonica.com > + fermin.galanmarquez@telefonica.com< fermin.galanmarquez@telefonica.com > +francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com > + german.torodelvalle@telefonica.com< german.torodelvalle@telefonica.com > + ivan.ariasleon@telefonica.com< ivan.ariasleon@telefonica.com > Looking forward for your guidance. Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also. Regards, Krishan From: Krishan Babbar Sent: Monday, April 30, 2018 7:59 PM To: fiware-tech-help@lists.fiware.org< fiware-tech-help@lists.fiware.org >; José Ignacio Carretero <joseignacio.carretero@fiware.org>< joseignacio.carretero@fiware.org >; herman.junge@telefonica.com< herman.junge@telefonica.com > Cc: Yugal Kishor Mullick <YM00106030@TechMahindra.com>< YM00106030@TechMahindra.com > Subject: Unable to run Cygnus with MySQL agent Hi All, I am trying to setup and understand Cygnus. But I am facing issue during installation. I followed below given steps. 1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common) 2. Executed version command (curl http://172.17.0.2:8081/v1/version ) which gave following response a. {"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"} 3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash 4. Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Please see attached file for configuration details. 5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one. a. $ {FLUME_HOME} /bin/cygnus-flume-ng agent --conf $ {CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH} /agent_mysql.conf -n cygnus-ngsi -p $ {CYGNUS_API_PORT} -Dflume.root.logger=$ {CYGNUS_LOG_LEVEL} ,$ {CYGNUS_LOG_APPENDER} -Dfile.encoding=UTF-8 6. Exited Docker container and came back to Ubuntu. 7. Stop and restart Docker container. 8. And I am getting following errors in logs Please check and let me know what am I doing wrong? Appreciate your help. n$AgentConfiguration [1016] : Processing:mysql-sink time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration [140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi] time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider [150] : Creating channels time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory [40] : Creating instance of channel mysql-channel type memory time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider [205] : Created channel mysql-channel time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory [39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource [113] : Error while configuring HTTPSource. Exception follows. java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102) at org.apache.flume.conf.Configurables.configure(Configurables.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider [366] : Source http-source has been removed due to an error during configuration java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at com.google.common.base.Throwables.propagate(Throwables.java:156) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114) at org.apache.flume.conf.Configurables.configure(Configurables.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102) ... 11 more time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory [40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable [142] : Failed to load configuration data. Exception follows. org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69) at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41) at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67) ... 11 more Thanks & Regards, Krishan Babbar Technical Architect IES Internet of Things | Tech Mahindra Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA • Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996 ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. =========================================================================================================================== ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. ============================================================================================================================ – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero – −−− José Ignacio Carretero FIWARE Cloud and Platform Expert FIWARE Foundation [FIWARE Foundation] Franklinstrasse 13A 10587 Berlin email: joseignacio.carretero@fiware.org< joseignacio.carretero@fiware.org > www: http://fiware.org twitter: @jicarreterogu @FIWARE skype: jicarretero __________________________________________________________________________________________ You can get more information about our cookies and privacy policies on the following links: http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/FIWARE_Privacy_Policy http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Cookies_Policy_FIWARE Fiware-tech-help mailing list Fiware-tech-help@lists.fiware.org https://lists.fiware.org/listinfo/fiware-tech-help

[Fiware-tech-help] Unable to run Cygnus with MySQL agent

Details

Description

Attachments

Activity

People

Dates

Agile