Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-14259

[fiware-askbot] Strange Comet issues

    Details

    • Type: Monitor
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 2021
    • Component/s: None

      Description

      Created question in FIWARE Q/A platform on 09-06-2018 at 13:06
      Please, ANSWER this question AT https://ask.fiware.org/question/1002/strange-comet-issues/

      Question:
      Strange Comet issues

      Description:
      Dear Fiware,

      I am trying to connect STH Comet to Orion in order to aggregate some events.

      However I am having some errors:

      In order to reproduce this errors for you to analyze, I have created this small project that isolates Orion and STH Comet, and reproduces the error in the log messages: https://github.com/PedroD/comet_demo

      When you run it, you will find log messages.

      These log messages contain all commands that the coordinator app sends to Orion and STH Comet, so that you don't need to worry about the Kotlin project's source.

      In sum, the issues we are having are:

      1) Comet is, for some reason, overflowing like this:

      sth_1 | time=2018-06-09T11:04:02.626Z | lvl=WARN | corr=n/a | trans=n/a | op=OPER_STH_DB_LOG | from=n/a | srv=n/a | subsrv=n/a | comp=STH | msg=The size in bytes of the namespace for storing the aggregated data ("sth_sensei_service" plus "sth_/sensei,/sensei,/sensei,/sensei,/sensei,/sensei,/sensei,/sensei,/sensei,/sensei_PersonDetection_PersonDetection.aggr", 138 bytes) is bigger than 120 bytes

      2) Comet is for some reason, having issues persisting some data in mongo, despite that the coordinator only tries to register the entities once:

      sth_1 | time=2018-06-09T11:04:12.870Z | lvl=ERROR | corr=d78056a4-6bd4-11e8-97dd-0242ac120005 | trans=745ad73e-ebd0-49a4-b843-261981c8f9b2 | op=OPER_STH_POST | from=n/a | srv=sensei_service | subsrv=/sensei | comp=STH | msg=Error when getting the raw data collection for storing:MongoError: a collection 'sth_sensei_service.sth_/sensei_PersonDetection_PersonDetection' already exists

      3) When asked for aggregations, using the url below, Comet returns empty values:

      URL: http://sth:8666/STH/v1/contextEntities/type/PersonDetection/id/PersonDetection/attributes/positionX?aggrMethod=sum&aggrPeriod=second&dateFrom=2016-02-01T00:00:00.000Z&dateTo=2019-01-01T23:59:59.999Z

      demo_1 | Requesting aggregation to Comet:
      demo_1 | {"contextResponses":[{"contextElement":{"attributes":[

      {"name":"positionX","values":[]}

      ],"id":"PersonDetection","isPattern":false,"type":"PersonDetection"},"statusCode":{"code":"200","reasonPhrase":"OK"}}]}
      demo_1 |
      demo_1 | Comet seems to be sending an empty "values" array. What is going on?
      demo_1 |

      What is going on? How can we solve these issues?

      Thanks!

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open In Progress In Progress
        1d 20h 1 Backlog Manager 11/Jun/18 10:05 AM
        In Progress In Progress Answered Answered
        59m 57s 1 Backlog Manager 11/Jun/18 11:05 AM
        Answered Answered Closed Closed
        52d 5h 49m 1 Veronika Vlnkova 02/Aug/18 4:54 PM
        fla Fernando Lopez made changes -
        Fix Version/s 2021 [ 12600 ]
        fla Fernando Lopez made changes -
        HD-Enabler STH-Comet [ 11303 ]
        Description
        Created question in FIWARE Q/A platform on 09-06-2018 at 13:06
        {color: red}Please, ANSWER this question AT{color} https://ask.fiware.org/question/1002/strange-comet-issues/


        +Question:+
        Strange Comet issues

        +Description:+
        Dear Fiware,

        I am trying to connect STH Comet to Orion in order to aggregate some events.

        However I am having some errors:

        In order to reproduce this errors for you to analyze, I have created this small project that isolates Orion and STH Comet, and reproduces the error in the log messages: https://github.com/PedroD/comet_demo

        When you run it, you will find log messages.

        These log messages contain all commands that the coordinator app sends to Orion and STH Comet, so that you don't need to worry about the Kotlin project's source.

        In sum, the issues we are having are:

        1) Comet is, for some reason, overflowing like this:


        sth_1 | time=2018-06-09T11:04:02.626Z | lvl=WARN | corr=n/a | trans=n/a | op=OPER_STH_DB_LOG | from=n/a | srv=n/a | subsrv=n/a | comp=STH | msg=The size in bytes of the namespace for storing the aggregated data ("sth_sensei_service" plus "sth_/sensei,/sensei,/sensei,/sensei,/sensei,/sensei,/sensei,/sensei,/sensei,/sensei_PersonDetection_PersonDetection.aggr", 138 bytes) is bigger than 120 bytes


        2) Comet is for some reason, having issues persisting some data in mongo, despite that the coordinator only tries to register the entities once:


        sth_1 | time=2018-06-09T11:04:12.870Z | lvl=ERROR | corr=d78056a4-6bd4-11e8-97dd-0242ac120005 | trans=745ad73e-ebd0-49a4-b843-261981c8f9b2 | op=OPER_STH_POST | from=n/a | srv=sensei_service | subsrv=/sensei | comp=STH | msg=Error when getting the raw data collection for storing:MongoError: a collection 'sth_sensei_service.sth_/sensei_PersonDetection_PersonDetection' already exists


        3) When asked for aggregations, using the url below, Comet returns empty values:

        URL: http://sth:8666/STH/v1/contextEntities/type/PersonDetection/id/PersonDetection/attributes/positionX?aggrMethod=sum&aggrPeriod=second&dateFrom=2016-02-01T00:00:00.000Z&dateTo=2019-01-01T23:59:59.999Z


        demo_1 | Requesting aggregation to Comet:
        demo_1 | {"contextResponses":[{"contextElement":{"attributes":[{"name":"positionX","values":[]}],"id":"PersonDetection","isPattern":false,"type":"PersonDetection"},"statusCode":{"code":"200","reasonPhrase":"OK"}}]}
        demo_1 |
        demo_1 | Comet seems to be sending an empty "values" array. What is going on?
        demo_1 |


        What is going on? How can we solve these issues?

        Thanks!
        Created question in FIWARE Q/A platform on 09-06-2018 at 13:06
        {color: red}Please, ANSWER this question AT{color} https://ask.fiware.org/question/1002/strange-comet-issues/


        +Question:+
        Strange Comet issues

        +Description:+
        Dear Fiware,

        I am trying to connect STH Comet to Orion in order to aggregate some events.

        However I am having some errors:

        In order to reproduce this errors for you to analyze, I have created this small project that isolates Orion and STH Comet, and reproduces the error in the log messages: https://github.com/PedroD/comet_demo

        When you run it, you will find log messages.

        These log messages contain all commands that the coordinator app sends to Orion and STH Comet, so that you don't need to worry about the Kotlin project's source.

        In sum, the issues we are having are:

        1) Comet is, for some reason, overflowing like this:


        sth_1 | time=2018-06-09T11:04:02.626Z | lvl=WARN | corr=n/a | trans=n/a | op=OPER_STH_DB_LOG | from=n/a | srv=n/a | subsrv=n/a | comp=STH | msg=The size in bytes of the namespace for storing the aggregated data ("sth_sensei_service" plus "sth_/sensei,/sensei,/sensei,/sensei,/sensei,/sensei,/sensei,/sensei,/sensei,/sensei_PersonDetection_PersonDetection.aggr", 138 bytes) is bigger than 120 bytes


        2) Comet is for some reason, having issues persisting some data in mongo, despite that the coordinator only tries to register the entities once:


        sth_1 | time=2018-06-09T11:04:12.870Z | lvl=ERROR | corr=d78056a4-6bd4-11e8-97dd-0242ac120005 | trans=745ad73e-ebd0-49a4-b843-261981c8f9b2 | op=OPER_STH_POST | from=n/a | srv=sensei_service | subsrv=/sensei | comp=STH | msg=Error when getting the raw data collection for storing:MongoError: a collection 'sth_sensei_service.sth_/sensei_PersonDetection_PersonDetection' already exists


        3) When asked for aggregations, using the url below, Comet returns empty values:

        URL: http://sth:8666/STH/v1/contextEntities/type/PersonDetection/id/PersonDetection/attributes/positionX?aggrMethod=sum&aggrPeriod=second&dateFrom=2016-02-01T00:00:00.000Z&dateTo=2019-01-01T23:59:59.999Z


        demo_1 | Requesting aggregation to Comet:
        demo_1 | {"contextResponses":[{"contextElement":{"attributes":[{"name":"positionX","values":[]}],"id":"PersonDetection","isPattern":false,"type":"PersonDetection"},"statusCode":{"code":"200","reasonPhrase":"OK"}}]}
        demo_1 |
        demo_1 | Comet seems to be sending an empty "values" array. What is going on?
        demo_1 |


        What is going on? How can we solve these issues?

        Thanks!
        veronika Veronika Vlnkova made changes -
        Resolution Done [ 10000 ]
        Status Answered [ 10104 ] Closed [ 6 ]
        veronika Veronika Vlnkova made changes -
        Assignee Joaquín Salvachúa [ joaquin.salvachua ]
        Hide
        backlogmanager Backlog Manager added a comment -

        2018-06-11 11:05|UPDATED status: transition Answered| # answers= 2, accepted answer= False

        Show
        backlogmanager Backlog Manager added a comment - 2018-06-11 11:05|UPDATED status: transition Answered| # answers= 2, accepted answer= False
        backlogmanager Backlog Manager made changes -
        Status In Progress [ 3 ] Answered [ 10104 ]
        Hide
        backlogmanager Backlog Manager added a comment -

        2018-06-11 10:05|UPDATED status: transition Answer| # answers= 1, accepted answer= False

        Show
        backlogmanager Backlog Manager added a comment - 2018-06-11 10:05|UPDATED status: transition Answer| # answers= 1, accepted answer= False
        backlogmanager Backlog Manager made changes -
        Field Original Value New Value
        Status Open [ 1 ] In Progress [ 3 ]
        Hide
        backlogmanager Backlog Manager added a comment -

        2018-06-09 14:05|CREATED monitor | # answers= 0, accepted answer= False

        Show
        backlogmanager Backlog Manager added a comment - 2018-06-09 14:05|CREATED monitor | # answers= 0, accepted answer= False
        backlogmanager Backlog Manager created issue -

          People

          • Assignee:
            joaquin.salvachua Joaquín Salvachúa
            Reporter:
            backlogmanager Backlog Manager
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: