Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
D
doc
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
frank.chen
doc
Commits
09aa4720
You need to sign in or sign up before continuing.
Commit
09aa4720
authored
May 21, 2024
by
frank.chen
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
完善
parent
351fa6e1
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
54 additions
and
25 deletions
+54
-25
proxy.md
baiduyun/proxy.md
+33
-19
升级git.md
baiduyun/杂项/升级git.md
+0
-0
概览.md
baiduyun/概览.md
+21
-6
No files found.
baiduyun/proxy.md
View file @
09aa4720
## 概述
*
以前是2台机器,用于代理请求dmp预测。
*
后来增加2台,用于代理请求dsp。
*
配置上,4台机器,功能是全的,各服务器请求时,可以配置使用任意代理服务器。一般dmp请求使用旧的2台,dsp使用新加2台。
## 通用
-
nginx
-
nginx 日志压缩
-
/etc/logrotate.d/nginx 压缩 dmp 日志
-
/etc/logrotate.d/nginx-dsp 压缩 dsp 日志
-
dsp 日志,除了3点外,其他时间点做额外压缩
-
`0 0,6,9,12,15,18,21 * * * /usr/sbin/logrotate -vf /etc/logrotate.d/nginx-dsp`
## proxy-1
*
相比其他,这台机器还会统计头条dmp的预测超时率,并发送邮件。
*
crontab
` 0 8 * * * cd /var/log/nginx/analyze && nohup python main.py &`
*
python 代码托管在git上,http://git.DT-DTG5.com/ops/proxy_status.git
*
另外,还有一个服务,dsp-notify,用于转发dsp的win和loss通知。
*
adx服务器在请求了dsp广告,并做了广告筛选,需要通知dsp: 选中和未选中结果回执(也就是win和loss通知)。
-
统计 dsp 超时率
-
http://git.dt-dtg5.com/ops/proxy_status.git
-
`*/10 * * * * cd /data/pycode/proxy_status && python main.py > /dev/null 2>&1`
## proxy-3
,4
*
因dsp请求量大,日志太大,所以日志分割策略不一样。
## proxy-3
-
定时任务在
`/var/spool/cron/root`
## 通用
*
配置 nginx /etc/nginx/conf/default.conf
*
crontab
*
/etc/cron.daily/logrotate
*
注意 /etc/logrotate.d/nginx 有调整。
\ No newline at end of file
-
统计头条dmp的预测超时率,并发送邮件。(旧)
-
http://git.dt-dtg5.com/ops/proxy_dmp_analyze.git
-
` 0 8 * * * cd /var/log/nginx/analyze && nohup python main.py &`
-
统计其他dmp预测超时率
-
http://git.dt-dtg5.com/ops/proxy_dmp_analyze2.git
-
`0 7 * * * cd /data/proxy_dmp_analyze2 && nohup python main.py colourdata >>log.log &`
-
`5 7 * * * cd /data/proxy_dmp_analyze2 && nohup python main.py samsung-proxy >>log.log &`
-
dsp-notify,用于转发dsp的win和loss通知。
-
http://git.dt-dtg5.com/ops/dsp-notify.git
-
服务启动
`/usr/lib/systemd/system/dsp-notify.service`
-
ops-notify 统一发送邮件
-
http://git.dt-dtg5.com/ops/ops-notify.git
-
服务启动
`/usr/lib/systemd/system/ops-notify.service`
-
ssreader-notify
-
action-report
`http://git.dt-dtg5.com/t1/adx-cn.git`
-
三星阅读额外上报
-
`*/1 * * * * cd /data/action-report/release && ./bin/ssreader-notify -f conf/app-prd.ini > /dev/null 2>&1`
baiduyun/升级git.md
→
baiduyun/
杂项/
升级git.md
View file @
09aa4720
File moved
baiduyun/概览.md
View file @
09aa4720
## 概述
-
这里是大纲,不涉及细节,看到整体即可。
### 服务器
-
ssp nginx 10台
-
dsp+dmp proxy 2台
-
trace 2台
-
huitoutiao 3台
-
appstore-api 1台
## proxy
-
nginx
-
/data/action-report (proxy-3)
-
/data/dsp-notify (proxy-3)
-
/data/ops-notify (proxy-3)
-
nginx
-
logrotate
-
dsp超时率统计
-
dmp超时率统计 (proxy-3)
-
`/data/action-report`
(proxy-3)
-
`/data/dsp-notify`
(proxy-3)
-
`/data/ops-notify`
(proxy-3)
-
ssreader-notify (proxy-3)
## ssp nginx
-
nginx
...
...
@@ -22,7 +28,17 @@
-
adx-trace
## huitoutiao
-
Thriftc
-
ssp-core
-
ssp-web
-
cpt-bid
-
cpt-trace
\ No newline at end of file
-
cpt-trace
## appstore-api
-
`/data/appstore-api/tools/installer_sync`
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment