Installing Apache NiFi Cluster on Linux is pretty straightforward, to be honest. If you follow the steps mentioned in this article, you can set up the NiFi cluster pretty easily. Please follow the steps mentioned here. If there is any question, you can write in the comment box of the article.
Table of Contents
Step 1: Update hosts file entry with below
10.128.0.4 nifi01
10.128.0.7 nifi03
10.128.0.5 nifi02
Step 2: Update zookeeper.properties File on all the servers
server.1=nifi01:2888:3888;2181
server.2=nifi02:2888:3888;2181
server.3=nifi03:2888:3888;2181
Step 3: Create myid File
Create ./state/zookeeper/myid file on all the 3 instances
Step 4: Update content of myid file
Update the value of the myid file to 1 on instance 1, 2 and 3
Step 5: Update nifi.properties file
Update these properties on all the three nodes.
nifi.state.management.embedded.zookeeper.start=true
nifi.zookeeper.connect.string=nifi01:2181,nifi02:2181,nifi03:2181
On node1
nifi.cluster.is.node=true
nifi.cluster.node.address=nifi01
nifi.cluster.node.protocol.port=9991
nifi.cluster.node.load.balance.port=6342
nifi.remote.input.host=nifi01
nifi.remote.input.secure=false
nifi.remote.input.socket.port=10000
nifi.web.http.host=nifi01
On node2
nifi.cluster.is.node=true
nifi.cluster.node.address=nifi02
nifi.cluster.node.protocol.port=9991
nifi.cluster.node.load.balance.port=6342
nifi.remote.input.host=nifi02
nifi.remote.input.secure=false
nifi.remote.input.socket.port=10000
nifi.web.http.host=nifi02
On node3
nifi.cluster.is.node=true
nifi.cluster.node.address=nifi03
nifi.cluster.node.protocol.port=9991
nifi.cluster.node.load.balance.port=6342
nifi.remote.input.host=nifi03
nifi.remote.input.secure=false
nifi.remote.input.socket.port=10000
nifi.web.http.host=nifi03
Hopefully, you liked this article Installing Apache NiFi Cluster on Linux. You can read more about Apache NiFi from official documentation which is available here. You can read more about Apache NiFi from any of the below articles. I would really appreciate if you support by subscribing to my Youtube Channel. I do post weekly videos about Apache NiFi on my channel.
how you cluster Nifi using docker?
Can you please share the installation document for installing nifi in secure mode.
You can check my course on Udemy for this.