Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-14397

FIWARE.Request.Lab.FIWARE MAG2 Cygnus support.

    Details

    • HD-Enabler:
      Cygnus

      Description

      Dear FIWARE help desk
      We are working at FrontierCities2 MAG2 project but we have some issue with Cygnus GE.

      In particular, our idea is to gather data from Orion GE and to push them into postgreSQL and CKAN by using the Cygnus GE.
      We installed cygnus v 1.9.0 by means of docker

      Regarding CKAN (v 2.8.0) we have the Exception reported below:

      "18/07/10 11:04:36 ERROR flume.SinkRunner: Unable to deliver event. Exception follows.
      java.lang.IllegalStateException: begin() called when transaction is OPEN!
      at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
      at org.apache.flume.channel.BasicTransactionSemantics.begin(BasicTransactionSemantics.java:131)
      at com.telefonica.iot.cygnus.sinks.NGSISink.processNewBatches(NGSISink.java:482)
      at com.telefonica.iot.cygnus.sinks.NGSISink.process(NGSISink.java:370)
      at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
      at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
      at java.lang.Thread.run(Thread.java:748)"

      We tried to find a solution using Google, in particular, we modified the file "agent.conf" to set ckan sink and ckan channel.
      But, we have still problems. Indeed, during the update of Orion Context Broker the istance "cygnus-ngsi" start the transaction
      to update the data on our ckan platform but the exception reported above.

      Instead, regarding postgresql (9.15.13) the istance, before start a transaction, throws this error:
      "ERROR sinks.NGSISink: CygnusPersistenceError. -, null. Stack trace: [com.telefonica.iot.cygnus.sinks.NGSIPostgreSQLSink.persistAggregation(NGSIPostgreSQLSink.java:504), com.telefonica.iot.cygnus.sinks.NGSIPostgreSQLSink.persistBatch(NGSIPostgreSQLSink.java:231), com.telefonica.iot.cygnus.sinks.NGSISink.processRollbackedBatches(NGSISink.java:390), com.telefonica.iot.cygnus.sinks.NGSISink.process(NGSISink.java:372), org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68), org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147), java.lang.Thread.run(Thread.java:748)]".

      Enclosed I'm sending you our configuration file.
      Please, May you help us?
      Thank you a lot. Best regards

      __________________________________________________________________________________________

      You can get more information about our cookies and privacy policies on the following links:

      Fiware-lab-help mailing list
      Fiware-lab-help@lists.fiware.org
      https://lists.fiware.org/listinfo/fiware-lab-help

      [Created via e-mail received from: Antonino Galletta <angalletta@unime.it>]

      1. agent.conf
        10 kB
        FW External User

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open In Progress In Progress
        12m 37s 1 Daniele Santoro 11/Jul/18 10:33 AM
        In Progress In Progress Impeded Impeded
        8d 31m 1 Andres Muñoz 19/Jul/18 11:04 AM
        Impeded Impeded In Progress In Progress
        21d 6h 1 Andres Muñoz 09/Aug/18 5:04 PM
        In Progress In Progress Closed Closed
        5s 1 Andres Muñoz 09/Aug/18 5:05 PM
        fla Fernando Lopez made changes -
        Fix Version/s 2021 [ 12600 ]
        fla Fernando Lopez made changes -
        Labels frontierCities2
        backlogmanager Backlog Manager made changes -
        Component/s FIWARE-TECH-HELP [ 10278 ]
        Component/s FIWARE-LAB-HELP [ 10279 ]
        fla Fernando Lopez made changes -
        HD-Enabler Cygnus [ 11304 ]
        backlogmanager Backlog Manager made changes -
        Summary [Fiware-lab-help] FIWARE MAG2 Cygnus support FIWARE.Request.Lab.FIWARE MAG2 Cygnus support.
        andres.munoza Andres Muñoz made changes -
        Resolution Done [ 10000 ]
        Status In Progress [ 3 ] Closed [ 6 ]
        andres.munoza Andres Muñoz made changes -
        Status Impeded [ 10004 ] In Progress [ 3 ]
        Hide
        andres.munoza Andres Muñoz added a comment -

        No feedback from user, close due to inactivity

        Show
        andres.munoza Andres Muñoz added a comment - No feedback from user, close due to inactivity
        Hide
        andres.munoza Andres Muñoz added a comment -

        Waiting for feedback

        Show
        andres.munoza Andres Muñoz added a comment - Waiting for feedback
        andres.munoza Andres Muñoz made changes -
        Status In Progress [ 3 ] Impeded [ 10004 ]
        Hide
        andres.munoza Andres Muñoz added a comment -

        HI,

        I have been checking your conf file and I notice that you have a configuration for other sinks like mongo, mysql, etc. Could you tell me if you also have problems with those sinks?.

        Show
        andres.munoza Andres Muñoz added a comment - HI, I have been checking your conf file and I notice that you have a configuration for other sinks like mongo, mysql, etc. Could you tell me if you also have problems with those sinks?.
        joaquin.salvachua Joaquín Salvachúa made changes -
        Assignee Joaquín Salvachúa [ joaquin.salvachua ] Andres Muñoz [ andres.munoza ]
        danieles Daniele Santoro made changes -
        External Participants
        Hide
        danieles Daniele Santoro added a comment -

        The issue has been emailed:

        • Time sent: 11/Jul/18 11:05 AM
        • To: *fdelavega@conwet.com *
        • with subject: *(HELP-14397) [Fiware-lab-help] FIWARE MAG2 Cygnus support *

        From FIWARE JIRA - Main Help Desk ----

        -------------------------------------------------------------------------------
        Comments:

        Daniele Santoro - Today 11:03 AM
        ------------------
        Dear, I've forwarded your ticket to the second level support. In particular you can refer to joaquin.salvachua@upm.es for Cygnus support and to fdelavega@fi.upm.es for CKAN support.

        ------------------------
        Issue id: HELP-14397
        Description:
        Dear FIWARE help desk
        We are working at FrontierCities2 MAG2 project but we have some issue with Cygnus GE.

        In particular, our idea is to gather data from Orion GE and to push them into postgreSQL and CKAN by using the Cygnus GE.
        We installed cygnus v 1.9.0 by means of docker

        Regarding CKAN (v 2.8.0) we have the Exception reported below:

        "18/07/10 11:04:36 ERROR flume.SinkRunner: Unable to deliver event. Exception follows.
        java.lang.IllegalStateException: begin() called when transaction is OPEN!
        at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
        at org.apache.flume.channel.BasicTransactionSemantics.begin(BasicTransactionSemantics.java:131)
        at com.telefonica.iot.cygnus.sinks.NGSISink.processNewBatches(NGSISink.java:482)
        at com.telefonica.iot.cygnus.sinks.NGSISink.process(NGSISink.java:370)
        at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
        at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
        at java.lang.Thread.run(Thread.java:748)"

        We tried to find a solution using Google, in particular, we modified the file "agent.conf" to set ckan sink and ckan channel.
        But, we have still problems. Indeed, during the update of Orion Context Broker the istance "cygnus-ngsi" start the transaction
        to update the data on our ckan platform but the exception reported above.

        Instead, regarding postgresql (9.15.13) the istance, before start a transaction, throws this error:
        "ERROR sinks.NGSISink: CygnusPersistenceError. -, null. Stack trace: [com.telefonica.iot.cygnus.sinks.NGSIPostgreSQLSink.persistAggregation(NGSIPostgreSQLSink.java:504), com.telefonica.iot.cygnus.sinks.NGSIPostgreSQLSink.persistBatch(NGSIPostgreSQLSink.java:231), com.telefonica.iot.cygnus.sinks.NGSISink.processRollbackedBatches(NGSISink.java:390), com.telefonica.iot.cygnus.sinks.NGSISink.process(NGSISink.java:372), org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68), org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147), java.lang.Thread.run(Thread.java:748)]".

        Enclosed I'm sending you our configuration file.
        Please, May you help us?
        Thank you a lot. Best regards

        __________________________________________________________________________________________

        You can get more information about our cookies and privacy policies on the following links:

        Fiware-lab-help mailing list
        Fiware-lab-help@lists.fiware.org
        https://lists.fiware.org/listinfo/fiware-lab-help

        [Created via e-mail received from: Antonino Galletta <angalletta@unime.it>]

        FIWARE Chapter:
        FIWARE GEri:

        Status: In Progress

        ---------------------
        This email was generated by FIWARE JIRA following an email received into the Main Help Desk.

        Show
        danieles Daniele Santoro added a comment - The issue has been emailed: Time sent: 11/Jul/18 11:05 AM To: *fdelavega@conwet.com * with subject: *( HELP-14397 ) [Fiware-lab-help] FIWARE MAG2 Cygnus support * From FIWARE JIRA - Main Help Desk ---- ------------------------------------------------------------------------------- Comments: Daniele Santoro - Today 11:03 AM ------------------ Dear, I've forwarded your ticket to the second level support. In particular you can refer to joaquin.salvachua@upm.es for Cygnus support and to fdelavega@fi.upm.es for CKAN support. ------------------------ Issue id: HELP-14397 Description: Dear FIWARE help desk We are working at FrontierCities2 MAG2 project but we have some issue with Cygnus GE. In particular, our idea is to gather data from Orion GE and to push them into postgreSQL and CKAN by using the Cygnus GE. We installed cygnus v 1.9.0 by means of docker Regarding CKAN (v 2.8.0) we have the Exception reported below: "18/07/10 11:04:36 ERROR flume.SinkRunner: Unable to deliver event. Exception follows. java.lang.IllegalStateException: begin() called when transaction is OPEN! at com.google.common.base.Preconditions.checkState(Preconditions.java:145) at org.apache.flume.channel.BasicTransactionSemantics.begin(BasicTransactionSemantics.java:131) at com.telefonica.iot.cygnus.sinks.NGSISink.processNewBatches(NGSISink.java:482) at com.telefonica.iot.cygnus.sinks.NGSISink.process(NGSISink.java:370) at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68) at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147) at java.lang.Thread.run(Thread.java:748)" We tried to find a solution using Google, in particular, we modified the file "agent.conf" to set ckan sink and ckan channel. But, we have still problems. Indeed, during the update of Orion Context Broker the istance "cygnus-ngsi" start the transaction to update the data on our ckan platform but the exception reported above. Instead, regarding postgresql (9.15.13) the istance, before start a transaction, throws this error: "ERROR sinks.NGSISink: CygnusPersistenceError. -, null. Stack trace: [com.telefonica.iot.cygnus.sinks.NGSIPostgreSQLSink.persistAggregation(NGSIPostgreSQLSink.java:504), com.telefonica.iot.cygnus.sinks.NGSIPostgreSQLSink.persistBatch(NGSIPostgreSQLSink.java:231), com.telefonica.iot.cygnus.sinks.NGSISink.processRollbackedBatches(NGSISink.java:390), com.telefonica.iot.cygnus.sinks.NGSISink.process(NGSISink.java:372), org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68), org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147), java.lang.Thread.run(Thread.java:748)] ". Enclosed I'm sending you our configuration file. Please, May you help us? Thank you a lot. Best regards __________________________________________________________________________________________ You can get more information about our cookies and privacy policies on the following links: http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/FIWARE_Privacy_Policy http://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Cookies_Policy_FIWARE Fiware-lab-help mailing list Fiware-lab-help@lists.fiware.org https://lists.fiware.org/listinfo/fiware-lab-help [Created via e-mail received from: Antonino Galletta <angalletta@unime.it>] FIWARE Chapter: FIWARE GEri: Status: In Progress --------------------- This email was generated by FIWARE JIRA following an email received into the Main Help Desk.
        Hide
        danieles Daniele Santoro added a comment -

        Dear, I've forwarded your ticket to the second level support. In particular you can refer to joaquin.salvachua@upm.es for Cygnus support and to fdelavega@fi.upm.es for CKAN support.

        Show
        danieles Daniele Santoro added a comment - Dear, I've forwarded your ticket to the second level support. In particular you can refer to joaquin.salvachua@upm.es for Cygnus support and to fdelavega@fi.upm.es for CKAN support.
        danieles Daniele Santoro made changes -
        Assignee Daniele Santoro [ danieles ] Joaquín Salvachúa [ joaquin.salvachua ]
        danieles Daniele Santoro made changes -
        Status Open [ 1 ] In Progress [ 3 ]
        danieles Daniele Santoro made changes -
        Assignee Daniele Santoro [ danieles ]
        backlogmanager Backlog Manager made changes -
        Field Original Value New Value
        Component/s FIWARE-LAB-HELP [ 10279 ]
        fw.ext.user FW External User created issue -

          People

          • Assignee:
            andres.munoza Andres Muñoz
            Reporter:
            fw.ext.user FW External User
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: