hdfs

internet:

• namenode web monitor port dfs.http.address: 50070
• datanode web monitor port dfs.datanode.http.address: 50075
• dfs.secondary.http.address: 50090
• dfs.backup.http.address: 50105
• mapred.job.tracker.http.address: 50030
• mapred.task.tracker.http.address: 50060

localnet:

• dfs.datanode.address: 50010
  • for data transmition
• journal node: 8485

hbase

• port: 60010

hive

• port:

kylin

• port: 7070

zookeeper

• ps: QuorumPeerMain

• 2181: zookeeper client connection
• 3888: connecting other server
• 61862:

spark

localnet

• port: 6066
• spark master port: 7077

internet

• 4040: for each job monitor
• 18080: for history server
• 8080: for the whole monitor

yarn

localnet:

• yarn.nodemanager.localizer.address(localizer IPC): 8040

• yarn.nodemanager.address(container manager port):8041

• yarn.resourcemanager.scheduler.address: 8030

• yarn.resourcemanager.resource-tracker.address: 8031

• yarn.resourcemanager.address(The address of the applications manager interface in the RM): 8032

• yarn.resourcemanager.admin.address(The address of the RM admin interface): 8033

• mapreduce.jobhistory.address: 10020

• yarn.timeline-service.webapp.address: 8188

• yarn.timeline-service.webapp.https.address: 8190

• yarn.timeline-service.address: 10200

• mapred.job.tracker: 8021

internet:

• yarn.resourcemanager.webapp.address: 8088

• mapreduce.jobhistory.webapp.address: 19888

• yarn.nodemanager.webapp.address(http port for nodes): 8042

HUE

internet

• port: 8887

Zeeplin

• port: 7878

OOZIE

internet

• port: 11000

default ports that use yarn

50010 ，9000(只有06没开) hdfs 通信

2181 2888 zookeeper

50075 DataNode Http Server

50020 IPC server

spark程序在yarn cluster模式下输出的log在nodemanager 的 hadoop路径下的logs/userlogs 下面

8025, 50111, 8141, 10020, 8190, 45454, 40815, 2049, 4040 - 4050, 50070, 19888, 6666, 21, 18081, 8050, 10001 3888 2181 9083 8030 50075 6188 50010 8188 8088 9441

2888 60200 9440 8042 50475 10000

50470 8020 10200

3000 3306 8010