79161500

Date: 2024-11-06 06:21:25
Score: 1
Natty:
Report link

I have resolved all these isssues by switching from the technology stack from HDP2.5 to standalone hadoop installation on my windows 11 machine. Becuase HDP2.5 had no more support available thats why unable to resolve the internal ips for datanodes while replicating. The following hdfs-site.xml and core-site.xml i have included in apache nifi installation directory that is

C:\nifi-1.28.0-bin\nifi-1.28.0\conf

core-site.xml

<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9820</value>
</property>
</configuration>

hdfs-site.xml

<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>file:///C:/hadoopsetup/hadoop-3.2.4/data/dfs/namenode</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>file:///C:/hadoopsetup/hadoop-3.2.4/data/dfs/datanode</value>
</property>
</configuration>

for hadoop installation i have reffered this tutorial:

https://apsaggu.wordpress.com/2023/06/29/installation-of-apache-hadoop-on-windows-11/

Reasons:
  • Blacklisted phrase (1): this tutorial
  • Long answer (-0.5):
  • Has code block (-0.5):
  • Self-answer (0.5):
  • Low reputation (0.5):
Posted by: Filbadeha