Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-20090

FIWARE.Question.Tech.Using Fiware Draco 2.1.0 How to setup NiFi cluster using external zookeeper.

    Details

      Description

      Created question in FIWARE Q/A platform on 23-09-2022 at 10:09
      Please, ANSWER this question AT https://stackoverflow.com/questions/73826331/using-fiware-draco-2-1-0-how-to-setup-nifi-cluster-using-external-zookeeper

      Question:
      Using Fiware Draco 2.1.0 How to setup NiFi cluster using external zookeeper

      Description:
      I'm trying to set up a NiFi cluster using an external zookeeper version is 3.4.10 container is run kubectl pod.
      I have changed the following things in nifi.properties

      1. cluster node properties (only configure for cluster nodes) #
        nifi.cluster.is.node=true
        nifi.cluster.node.address=XXXXXXXXXXXXXXXX
        nifi.cluster.node.protocol.port=8082
        nifi.cluster.node.protocol.max.threads=50
        nifi.cluster.node.event.history.size=25
        nifi.cluster.node.connection.timeout=5 sec
        nifi.cluster.node.read.timeout=5 sec
        nifi.cluster.node.max.concurrent.requests=100
        nifi.cluster.firewall.file=
        nifi.cluster.flow.election.max.wait.time=1 min
        nifi.cluster.flow.election.max.candidates=
      1. cluster load balancing properties #
        nifi.cluster.load.balance.host=
        nifi.cluster.load.balance.port=6342
        nifi.cluster.load.balance.connections.per.node=1
        nifi.cluster.load.balance.max.thread.count=8
        nifi.cluster.load.balance.comms.timeout=30 sec
      1. zookeeper properties, used for cluster management #
        nifi.zookeeper.connect.string=xxxx:2181,xxxx:2181,xxxx:2181
        nifi.zookeeper.connect.timeout=10 secs
        nifi.zookeeper.session.timeout=10 secs
        nifi.zookeeper.root.node=/nifi

      I am not able to connect zookeeper getting a connection error
      2022-09-23 10:13:23,665 ERROR [main-EventThread] o.a.c.f.imps.CuratorFrameworkImpl Background operation retry gave up
      org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
      at org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
      at org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:885)
      at org.apache.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:677)
      at org.apache.curator.framework.imps.WatcherRemovalFacade.processBackgroundOperation(WatcherRemovalFacade.java:152)
      at org.apache.curator.framework.imps.GetConfigBuilderImpl$2.processResult(GetConfigBuilderImpl.java:222)
      at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:601)
      at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510)
      2022-09-23 10:13:24,331 INFO [main-EventThread] o.a.c.f.state.ConnectionStateManager State change: RECONNECTED
      2022-09-23 10:13:24,331 INFO [Curator-ConnectionStateManager-0] o.a.n.c.l.e.CuratorLeaderElectionManager org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@30dbc287 Connection State changed to RECONNECTED
      2022-09-23 10:13:24,431 INFO [main-EventThread] o.a.c.f.state.ConnectionStateManager State change: SUSPENDED
      2022-09-23 10:13:24,431 INFO [Curator-ConnectionStateManager-0] o.a.n.c.l.e.CuratorLeaderElectionManager org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@30dbc287 Connection State changed to SUSPENDED

      Connection State continues changing reconnecting and suspending
      How can I set up a NiFi cluster for using an external zookeeper connection?
      Did any one is facing simiar issues with this combination?
      Can you please assist

        Activity

        backlogmanager Backlog Manager created issue -
        backlogmanager Backlog Manager made changes -
        Field Original Value New Value
        Component/s FIWARE-TECH-HELP [ 10278 ]
        backlogmanager Backlog Manager made changes -
        HD-Enabler Unknown [ 10910 ]
        HD-Chapter Unknown [ 10845 ]
        HD-Node Unknown [ 10852 ]
        fla Fernando Lopez made changes -
        Assignee Andres Muñoz [ andres.munoza ]
        andres.munoza Andres Muñoz made changes -
        Resolution Dismissed [ 10102 ]
        Status Open [ 1 ] Closed [ 6 ]
        backlogmanager Backlog Manager made changes -
        Summary [fiware-stackoverflow] Using Fiware Draco 2.1.0 How to setup NiFi cluster using external zookeeper FIWARE.Question.Tech.Using Fiware Draco 2.1.0 How to setup NiFi cluster using external zookeeper.
        HD-Enabler Unknown [ 10910 ]
        HD-Chapter Unknown [ 10845 ]
        HD-Node Unknown [ 10852 ]

          People

          • Assignee:
            andres.munoza Andres Muñoz
            Reporter:
            backlogmanager Backlog Manager
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: