Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-5898

FIWARE.Question.Tech.Data.BigData-Analysis.Fiware: Data loss prevention

    Details

      Description

      Created question in FIWARE Q/A platform on 17-02-2016 at 09:02
      Please, ANSWER this question AT http://stackoverflow.com/questions/35451531/fiware-data-loss-prevention

      Question:
      Fiware: Data loss prevention

      Description:
      I’m working with the 0.27.0 version of context broker. I'm using the Cygnus generic enabler and I have established a MQTT agent that connects external devices to the context broker.

      My major concern right now is how to prevent from data loss. I established the context broker and the Cygnus mongodb databases as replica sets, but that won't ensure that all data will be persisted into the databases. I have seen that Cygnus uses Apache flume. Looking at its configuration, the re-injection retries can be configured:

      1. Number of channel re-injection retries before a Flume event is definitely discarded (-1 means infinite retries)
        cygnusagent.sources.http-source.handler.events_ttl = -1

      ¿It is a good idea to establish the retries value to -1? I have read about events re-injected in the channel forever.
      ¿What can be done to ensure that all the data will be persisted?
      ¿Is there any functionality into fiware ecosystem oriented to that purpose?

        Activity

        backlogmanager Backlog Manager created issue -
        backlogmanager Backlog Manager made changes -
        Field Original Value New Value
        Component/s FIWARE-TECH-HELP [ 10278 ]
        mev Manuel Escriche made changes -
        Assignee Francisco Romero [ frb ]
        backlogmanager Backlog Manager made changes -
        Status Open [ 1 ] In Progress [ 3 ]
        backlogmanager Backlog Manager made changes -
        Status In Progress [ 3 ] Answered [ 10104 ]
        backlogmanager Backlog Manager made changes -
        Resolution Done [ 10000 ]
        Status Answered [ 10104 ] Closed [ 6 ]
        backlogmanager Backlog Manager made changes -
        Summary [fiware-stackoverflow] Fiware: Data loss prevention FIWARE.Question.Tech.Fiware: Data loss prevention
        mev Manuel Escriche made changes -
        HD-Enabler Cosmos [ 10872 ]
        HD-Chapter Data [ 10838 ]
        backlogmanager Backlog Manager made changes -
        Summary FIWARE.Question.Tech.Fiware: Data loss prevention FIWARE.Question.Tech.Data.BigData-Analysis.Fiware: Data loss prevention
        fla Fernando Lopez made changes -
        Fix Version/s 2021 [ 12600 ]

          People

          • Assignee:
            frb Francisco Romero
            Reporter:
            backlogmanager Backlog Manager
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: