Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-20090

FIWARE.Question.Tech.Using Fiware Draco 2.1.0 How to setup NiFi cluster using external zookeeper.

    Details

      Description

      Created question in FIWARE Q/A platform on 23-09-2022 at 10:09
      Please, ANSWER this question AT https://stackoverflow.com/questions/73826331/using-fiware-draco-2-1-0-how-to-setup-nifi-cluster-using-external-zookeeper

      Question:
      Using Fiware Draco 2.1.0 How to setup NiFi cluster using external zookeeper

      Description:
      I'm trying to set up a NiFi cluster using an external zookeeper version is 3.4.10 container is run kubectl pod.
      I have changed the following things in nifi.properties

      1. cluster node properties (only configure for cluster nodes) #
        nifi.cluster.is.node=true
        nifi.cluster.node.address=XXXXXXXXXXXXXXXX
        nifi.cluster.node.protocol.port=8082
        nifi.cluster.node.protocol.max.threads=50
        nifi.cluster.node.event.history.size=25
        nifi.cluster.node.connection.timeout=5 sec
        nifi.cluster.node.read.timeout=5 sec
        nifi.cluster.node.max.concurrent.requests=100
        nifi.cluster.firewall.file=
        nifi.cluster.flow.election.max.wait.time=1 min
        nifi.cluster.flow.election.max.candidates=
      1. cluster load balancing properties #
        nifi.cluster.load.balance.host=
        nifi.cluster.load.balance.port=6342
        nifi.cluster.load.balance.connections.per.node=1
        nifi.cluster.load.balance.max.thread.count=8
        nifi.cluster.load.balance.comms.timeout=30 sec
      1. zookeeper properties, used for cluster management #
        nifi.zookeeper.connect.string=xxxx:2181,xxxx:2181,xxxx:2181
        nifi.zookeeper.connect.timeout=10 secs
        nifi.zookeeper.session.timeout=10 secs
        nifi.zookeeper.root.node=/nifi

      I am not able to connect zookeeper getting a connection error
      2022-09-23 10:13:23,665 ERROR [main-EventThread] o.a.c.f.imps.CuratorFrameworkImpl Background operation retry gave up
      org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
      at org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
      at org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:885)
      at org.apache.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:677)
      at org.apache.curator.framework.imps.WatcherRemovalFacade.processBackgroundOperation(WatcherRemovalFacade.java:152)
      at org.apache.curator.framework.imps.GetConfigBuilderImpl$2.processResult(GetConfigBuilderImpl.java:222)
      at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:601)
      at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510)
      2022-09-23 10:13:24,331 INFO [main-EventThread] o.a.c.f.state.ConnectionStateManager State change: RECONNECTED
      2022-09-23 10:13:24,331 INFO [Curator-ConnectionStateManager-0] o.a.n.c.l.e.CuratorLeaderElectionManager org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@30dbc287 Connection State changed to RECONNECTED
      2022-09-23 10:13:24,431 INFO [main-EventThread] o.a.c.f.state.ConnectionStateManager State change: SUSPENDED
      2022-09-23 10:13:24,431 INFO [Curator-ConnectionStateManager-0] o.a.n.c.l.e.CuratorLeaderElectionManager org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@30dbc287 Connection State changed to SUSPENDED

      Connection State continues changing reconnecting and suspending
      How can I set up a NiFi cluster for using an external zookeeper connection?
      Did any one is facing simiar issues with this combination?
      Can you please assist

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Closed Closed
        122d 9h 42m 1 Andres Muñoz 24/Jan/23 4:14 PM

          People

          • Assignee:
            andres.munoza Andres Muñoz
            Reporter:
            backlogmanager Backlog Manager
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: