北京IDC服务器信息¶

Note

参考，线上变动后请及时更新

服务器地址¶

当前IP	主机名	S/N	型号	内存	机柜号
10.11.20.11	dbj-01	DP70M82	R630	64G	i06
10.11.20.12	dbj-02	DPH4K82	R630	64G	i06
10.11.20.13	dbj-03	DPGZL82	R630	192G	i06
10.11.20.14	dbj-04	DPGXL82	R630	256G	i06
10.11.20.15	dbj-05	17HD882	R630	256G	i06
10.11.20.16	dbj-06	17B6882	R630	256G	i06
10.11.20.17	dbj-07	17FC882	R630	256G	i06
10.11.20.18	dbj-08	17H5882	R630	256G	i06
10.11.20.19	dbj-09	DP78K82	R630	256G	i06
10.11.20.20	dbj-10	F5L1JD2	R630	64G	i16
10.11.20.21	dbj-11	F5HXHD2	R630	64G	i16
10.11.20.22	dbj-12	F5J2JD2	R630	96G	i16
10.11.20.23	dbj-13	F5KXHD2	R630	64G	i16
10.11.20.24	dbj-14	F5LVHD2	R630	64G	i16
10.11.20.25	dbj-15	F5K1JD2	R630	64G	i16
10.11.20.26	dbj-16	F5LWHD2	R630	64G	i16
10.11.20.27	dbj-17	F5KYHD2	R630	64G	i16
10.11.20.28	dbj-18	F5J0JD2	R630	64G	i16
10.11.20.29	dbj-19	F5LYHD2	R630	64G	i16
10.11.20.30	dbj-20	F5M2JD2	R630	64G	i16
10.11.20.31	dbj-21	F6MWHD2	R630	64G	i16
10.11.20.32	dbj-22	F6M3JD2	R630	64G	i16
10.11.20.33	dbj-23	CFNPFD2	R630	64G	i16
10.11.20.34	dbj-24	CCDLFD2	R630	64G	i16
10.11.20.35	dbj-25	CFPGFD2	R630	64G	i16
10.11.20.36	dbj-26	9STHC92	R630	64G	i16
10.11.20.37	dbj-27	CCCKFD2	R630	64G	i16
10.11.20.38	dbj-28	DP75K82	R630	64G	i16
10.11.20.39	dbj-29	9RTDC92	R630	64G	i01
10.11.20.40	dbj-30	9RVCC92	R630	64G	i01
10.11.20.41	dbj-31	JZT2G42	R620	64G	i01
10.11.20.42	dbj-32	9RTJC92	R630	64G	i01
10.11.20.43	dbj-33	F6LVHD2	R630	64G	i01
10.11.20.44	dbj-34	9JG2G42	R620	64G	i01
10.11.20.45	dbj-35	CJG2G42	R620	64G	i01
10.11.20.46	dbj-36	CQF2G42	R620	64G	i01
10.11.20.47	dbj-37	DJG2G42	R620	64G	i01
10.11.20.48	dbj-38	BHV7G42	R620	64G	i01
10.11.20.57	dbj-39	H471BC2	R730	128G	i17
10.11.20.58	dbj-40	H464BC2	R730	128G	i17
10.11.20.59	dbj-41	H3X5BC2	R730	128G	i17
10.11.20.60	dbj-42	H475BC2	R730	128G	i17
10.11.20.61	dbj-43	H436BC2	R730	128G	i17
10.11.20.62	dbj-44	H412BC2	R730	128G	i17
10.11.20.63	dbj-45	H446BC2	R730	128G	i17
10.11.20.64	dbj-46	H457BC2	R730	128G	i18
10.11.20.65	dbj-47	H451BC2	R730	128G	i18
10.11.20.66	dbj-48	H466BC2	R730	128G	i18
10.11.20.67	dbj-49	H493BC2	R730	128G	i18
10.11.20.68	dbj-50	H486BC2	R730	128G	i18
10.11.20.10	dbj-51	8JG2G42	R630	64G	i01

角色分配¶

nginx:

dbj-[01-07]

zookeeper:

dbj-[07 08 09]

glusterfs vip: 10.11.20.199:

dbj-[07 08 09]

flume vip:10.11.20.99:

dbj-[01-10] dbj-[41-50]

dns vip: 10.11.20.200:

dbj-[05 06]

fetch-01（不属于北京D机房） ip:10.10.145.116:

fetchupdate服务，以docker容器单实例运行

dproxy/urlserver/collector/socksproxy/httpNotice:

dbj-[01 02]

sync:

dbj-[03 04]

grandet:

dbj-[11 12 13 14 ]：每个物理机各有一个grandet容器在跑，nginx做负载均衡。为了减少数据同步的风险grandet只有北京有
docker run -d --name grandet -p 9029:9029 -v /opt/zyz/extcb:/zyz/extcb --restart always reghub.optaim.com/grandet:201804021611 -cluster bj

tracker:

dbj-[11 12 13 14 ]
glusterfs: mkdir /mnt/dstore/tracker  && chown zyz:zyz /mnt/dstore/tracker
北京old tracker机器 拷贝文件 /opt/zyz/user_tag_rule.dat
docker run -d --name tracker -p 9039:9039 -v /mnt/dstore/tracker:/zyz/data --restart always reghub.optaim.com/tracker:201804091402 -cluster bj

mailserver:

dbj-01

docker1 (集群名称：bjA):

dbj-[11-20]

docker2（集群名称：bjB）:

dbj-[21-30]

docker3（集群名称：bjC）:

dbj-[31-40]

docker_debug（集群名称：bj_debug）:

dbj-[41 42 43 44]

elastic search cluster:

dbj-[45 46 47]

kibana:

dbj-45

prometheus、alert manager、grafana:

dbj-46

fluentd cluster VIP 10.11.20.201:

dbj-[48 49 50]

redis dbj-[11-44]:

cost redis: 4x10MB port:6380 存放曝光、点击和广告主消耗金额
   dbj-[12 13 14 15]
freq redis: 4x6GB port:6380 存放曝光和点击的次数，用于频控
   主：dbj-[11 16 23 28]
   备：dbj-[06 08 05 07]
cookie mapping redis: 14x20GB port:6379
   dbj-[11 12 13 14 15 16 17 18 19 20 21 22 23 24]
mobile uds redis: 10x18GB port:6379
   dbj-[25 26 27 28 29 30 31 32 33 34]
pc uds offline redis: 10x22GB  port:6379
   dbj-[35 36 37 38 39 40 41 42 43 44]
url redis: 2x10MB port:6380
   dbj-[17 18]
click callback redis: 5x10MB  port:6380
   dbj-[24 25 26 27 29]
pc uds online redis: 4x20MB  port:6380
   dbj-[19 20 21 22]
fraud click redis:1x10MB   port:6380
   dbj-30
new item redis:1x10MB   port:6380
   dbj-31

Important

下面列表内容是线上freq redis主从分布

master	slave
10.11.20.21.	10.11.20.16
10.11.20.26.	10.11.20.18
10.11.20.33.	10.11.20.15
10.11.20.38.	10.11.20.17

监控&日志部署¶

fluentd:

docker run -d --name fluentd --network host -p 24224:24224 -e BIND=10.11.20.66 -e ES_HOSTS=10.11.20.63:9200,10.11.20.64:9200,10.11.20.65:9200 -e ES_USER=elastic -e ES_PASSWORD=changeme --restart always reghub.optaim.com/fluentd:v0.12

es:

docker run -d --name="es" --restart always -p 9200:9200 -p 9300:9300 --ulimit memlock=-1 -v /opt/elastic/config/:/usr/share/elasticsearch/config/ -v /opt/esdata:/opt/esdata -v /opt/eslog:/opt/eslog reghub.optaim.com/elasticsearch/elasticsearch:5.4.3

alertmanager:

docker run -d -p 9093:9093 --name alertmanager --restart=always -v /etc/prom/alertmanager/alert.yml:/etc/prometheus/alert.yml reghub.optaim.com/alertmanager:v0.5.0 -config.file /etc/prometheus/alert.yml -log.level info -web.external-url http://localhost:9093

grafana:

docker run -d -p 3000:3000 --name grafana -e "GF_SECURITY_ADMIN_PASSWORD=secret" --restart=always reghub.optaim.com/grafana:4.0.2

promethus:

docker run -d -p 9090:9090 --name prometheus --restart=always -v /etc/prom/prometheus/:/etc/prometheus/ -v /var/prometheus/storage:/prometheus reghub.optaim.com/prometheus:v1.4.1 -alertmanager.url=http://10.11.20.64:9093 -config.file /etc/prometheus/prometheus.yml -query.staleness-delta 20s -log.level info -web.external-url http://localhost:9090

kibana:

docker run -d --name kibana --restart always -p 5601:5601 -e ELASTICSEARCH_URL=http://10.11.20.63:9200 -v /opt/kibana/kibana.yml:/etc/kibana/kibana.yml reghub.optaim.com/kibana/kibana:5.4.3