Details
-
Type: Monitor
-
Status: Closed
-
Priority: Major
-
Resolution: Done
-
Affects Version/s: None
-
Fix Version/s: 2021
-
Component/s: None
-
Labels:
-
HD-Enabler:Cygnus
Description
Created question in FIWARE Q/A platform on 03-05-2018 at 15:05
Please, ANSWER this question AT https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/
Question:
Unable to run Cygnus with MySQL agent
Description:
Hi All,
I am trying to setup and understand Cygnus. But I am facing issue during installation.
I followed below given steps.
Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common)
Executed version command (curl http://172.17.0.2:8081/v1/version) which gave following response
Login into Cygnus container using command docker exec -it /bin/bash
Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder.
Configuration details given below
cygnus-ngsi.sources = http-source
cygnus-ngsi.sinks = mysql-sink
cygnus-ngsi.channels = mysql-channel
cygnus-ngsi.sources.http-source.channels = mysql-channel
cygnus-ngsi.sources.http-source.type = org.apache.flume.source.http.HTTPSource
cygnus-ngsi.sources.http-source.port = 5050
cygnus-ngsi.sources.http-source.handler = com.telefonica.iot.cygnus.handlers.NGSIRestHandler
cygnus-ngsi.sources.http-source.handler.notificationtarget = /notify
cygnus-ngsi.sources.http-source.handler.defaultservice = defserv
cygnus-ngsi.sources.http-source.handler.defaultservicepath = defservpath
cygnus-ngsi.sources.http-source.handler.eventsttl = 2
cygnus-ngsi.sources.http-source.interceptors = ts gi
cygnus-ngsi.sources.http-source.interceptors.ts.type = timestamp
cygnus-ngsi.sources.http-source.interceptors.gi.type = com.telefonica.iot.cygnus.interceptors.NGSIGroupingInterceptor$Builder
cygnus-ngsi.sources.http-source.interceptors.gi.groupingrulesconffile = /Applications/apache-flume-1.4.0-bin/conf/grouping_rules.conf
cygnus-ngsi.channels.mysql-channel.type = memory
cygnus-ngsi.channels.mysql-channel.capacity = 1000
cygnus-ngsi.channels.mysql-channel.transactionCapacity = 100
cygnus-ngsi.sinks.mysql-sink.channel = mysql-channel
cygnus-ngsi.sinks.mysql-sink.type = com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
cygnus-ngsi.sinks.mysql-sink.mysqlhost = localhost
cygnus-ngsi.sinks.mysql-sink.mysqlport = 3306
cygnus-ngsi.sinks.mysql-sink.mysqlusername = root
cygnus-ngsi.sinks.mysql-sink.mysqlpassword = <mypassword>
cygnus-ngsi.sinks.mysql-sink.attr_persistence = row
Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one.
$
/bin/cygnus-flume-ng agent --conf $
{CYGNUSCONFPATH} -f ${CYGNUSCONFPATH}/agentmysql.conf -n cygnus-ngsi -p $
{CYGNUSAPIPORT}-Dflume.root.logger=$
{CYGNUSLOGLEVEL},$
{CYGNUSLOGAPPENDER} -Dfile.encoding=UTF-8
Exited Docker container and came back to Ubuntu.
Stop and restart Docker container.
And I am getting following errors in logs
Please check and let me know what am I doing wrong? Appreciate your help.
LOGS
n$AgentConfiguration[1016] : Processing:mysql-sink
time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration[140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi]
time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[150] : Creating channels
time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory[40] : Creating instance of channel mysql-channel type memory
time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[205] : Created channel mysql-channel
time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A ... (more)
Activity
Field | Original Value | New Value |
---|---|---|
Assignee | Joaquín Salvachúa [ joaquin.salvachua ] |
Status | Open [ 1 ] | In Progress [ 3 ] |
Status | In Progress [ 3 ] | Answered [ 10104 ] |
Resolution | Done [ 10000 ] | |
Status | Answered [ 10104 ] | Closed [ 6 ] |
HD-Enabler | Cygnus [ 11304 ] | |
Description |
Created question in FIWARE Q/A platform on 03-05-2018 at 15:05 {color: red}Please, ANSWER this question AT{color} https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ +Question:+ Unable to run Cygnus with MySQL agent +Description:+ Hi All, I am trying to setup and understand Cygnus. But I am facing issue during installation. I followed below given steps. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common) Executed version command (curl http://172.17.0.2:8081/v1/version) which gave following response {"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"} Login into Cygnus container using command docker exec -it /bin/bash Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Configuration details given below cygnus-ngsi.sources = http-source cygnus-ngsi.sinks = mysql-sink cygnus-ngsi.channels = mysql-channel cygnus-ngsi.sources.http-source.channels = mysql-channel cygnus-ngsi.sources.http-source.type = org.apache.flume.source.http.HTTPSource cygnus-ngsi.sources.http-source.port = 5050 cygnus-ngsi.sources.http-source.handler = com.telefonica.iot.cygnus.handlers.NGSIRestHandler cygnus-ngsi.sources.http-source.handler.notificationtarget = /notify cygnus-ngsi.sources.http-source.handler.defaultservice = defserv cygnus-ngsi.sources.http-source.handler.defaultservicepath = defservpath cygnus-ngsi.sources.http-source.handler.eventsttl = 2 cygnus-ngsi.sources.http-source.interceptors = ts gi cygnus-ngsi.sources.http-source.interceptors.ts.type = timestamp cygnus-ngsi.sources.http-source.interceptors.gi.type = com.telefonica.iot.cygnus.interceptors.NGSIGroupingInterceptor$Builder cygnus-ngsi.sources.http-source.interceptors.gi.groupingrulesconffile = /Applications/apache-flume-1.4.0-bin/conf/grouping_rules.conf cygnus-ngsi.channels.mysql-channel.type = memory cygnus-ngsi.channels.mysql-channel.capacity = 1000 cygnus-ngsi.channels.mysql-channel.transactionCapacity = 100 cygnus-ngsi.sinks.mysql-sink.channel = mysql-channel cygnus-ngsi.sinks.mysql-sink.type = com.telefonica.iot.cygnus.sinks.NGSIMySQLSink cygnus-ngsi.sinks.mysql-sink.mysqlhost = localhost cygnus-ngsi.sinks.mysql-sink.mysqlport = 3306 cygnus-ngsi.sinks.mysql-sink.mysqlusername = root cygnus-ngsi.sinks.mysql-sink.mysqlpassword = <mypassword> cygnus-ngsi.sinks.mysql-sink.attr_persistence = row Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one. ${FLUMEHOME}/bin/cygnus-flume-ng agent --conf ${CYGNUSCONFPATH} -f ${CYGNUSCONFPATH}/agentmysql.conf -n cygnus-ngsi -p ${CYGNUSAPIPORT} -Dflume.root.logger=${CYGNUSLOGLEVEL},${CYGNUSLOGAPPENDER} -Dfile.encoding=UTF-8 Exited Docker container and came back to Ubuntu. Stop and restart Docker container. And I am getting following errors in logs Please check and let me know what am I doing wrong? Appreciate your help. LOGS n$AgentConfiguration[1016] : Processing:mysql-sink time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration[140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi] time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[150] : Creating channels time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory[40] : Creating instance of channel mysql-channel type memory time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[205] : Created channel mysql-channel time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A ... (more) |
Created question in FIWARE Q/A platform on 03-05-2018 at 15:05
{color: red}Please, ANSWER this question AT{color} https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ +Question:+ Unable to run Cygnus with MySQL agent +Description:+ Hi All, I am trying to setup and understand Cygnus. But I am facing issue during installation. I followed below given steps. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common) Executed version command (curl http://172.17.0.2:8081/v1/version) which gave following response {"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"} Login into Cygnus container using command docker exec -it /bin/bash Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Configuration details given below cygnus-ngsi.sources = http-source cygnus-ngsi.sinks = mysql-sink cygnus-ngsi.channels = mysql-channel cygnus-ngsi.sources.http-source.channels = mysql-channel cygnus-ngsi.sources.http-source.type = org.apache.flume.source.http.HTTPSource cygnus-ngsi.sources.http-source.port = 5050 cygnus-ngsi.sources.http-source.handler = com.telefonica.iot.cygnus.handlers.NGSIRestHandler cygnus-ngsi.sources.http-source.handler.notificationtarget = /notify cygnus-ngsi.sources.http-source.handler.defaultservice = defserv cygnus-ngsi.sources.http-source.handler.defaultservicepath = defservpath cygnus-ngsi.sources.http-source.handler.eventsttl = 2 cygnus-ngsi.sources.http-source.interceptors = ts gi cygnus-ngsi.sources.http-source.interceptors.ts.type = timestamp cygnus-ngsi.sources.http-source.interceptors.gi.type = com.telefonica.iot.cygnus.interceptors.NGSIGroupingInterceptor$Builder cygnus-ngsi.sources.http-source.interceptors.gi.groupingrulesconffile = /Applications/apache-flume-1.4.0-bin/conf/grouping_rules.conf cygnus-ngsi.channels.mysql-channel.type = memory cygnus-ngsi.channels.mysql-channel.capacity = 1000 cygnus-ngsi.channels.mysql-channel.transactionCapacity = 100 cygnus-ngsi.sinks.mysql-sink.channel = mysql-channel cygnus-ngsi.sinks.mysql-sink.type = com.telefonica.iot.cygnus.sinks.NGSIMySQLSink cygnus-ngsi.sinks.mysql-sink.mysqlhost = localhost cygnus-ngsi.sinks.mysql-sink.mysqlport = 3306 cygnus-ngsi.sinks.mysql-sink.mysqlusername = root cygnus-ngsi.sinks.mysql-sink.mysqlpassword = <mypassword> cygnus-ngsi.sinks.mysql-sink.attr_persistence = row Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one. ${FLUMEHOME}/bin/cygnus-flume-ng agent --conf ${CYGNUSCONFPATH} -f ${CYGNUSCONFPATH}/agentmysql.conf -n cygnus-ngsi -p ${CYGNUSAPIPORT} -Dflume.root.logger=${CYGNUSLOGLEVEL},${CYGNUSLOGAPPENDER} -Dfile.encoding=UTF-8 Exited Docker container and came back to Ubuntu. Stop and restart Docker container. And I am getting following errors in logs Please check and let me know what am I doing wrong? Appreciate your help. LOGS n$AgentConfiguration[1016] : Processing:mysql-sink time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration[140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi] time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[150] : Creating channels time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory[40] : Creating instance of channel mysql-channel type memory time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[205] : Created channel mysql-channel time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A ... (more) |
Assignee | Joaquín Salvachúa [ joaquin.salvachua ] | Andres Muñoz [ andres.munoza ] |
Fix Version/s | 2021 [ 12600 ] |