|
2020-08-14
§
|
| 17:32 |
<Operator873> |
Operator873 restart CVNBot6-9 & 19 in @cvn-sw |
[cvn] |
| 17:30 |
<Operator873> |
12:30:23 @Operator873 CVNBot5 restart |
[cvn] |
| 17:29 |
<Operator873> |
12:27:01 @Operator873 CVNBot15 restart |
[cvn] |
| 17:09 |
<bstorm> |
backing up the old proxy config to NFS and deleting paws-proxy-02 T211096 |
[paws] |
| 17:04 |
<bstorm> |
deleting instances "tools-paws-master-01", "tools-paws-worker-1005", "tools-paws-worker-1006", "tools-paws-worker-1003", "tools-paws-worker-1002", "tools-paws-worker-1001", "tools-paws-worker-1007", "tools-paws-worker-1013", "tools-paws-worker-1016", "tools-paws-worker-1017", "tools-paws-worker-1010", "tools-paws-worker-1019" T211096 |
[tools.paws] |
| 16:58 |
<cdanis> |
done deploying 'allow nameservers of Jio AS55836 to skip RPKI validation I9fcff8' to all routers T260449 |
[production] |
| 16:44 |
<cdanis> |
❌cdanis@cumin1001.eqiad.wmnet ~ 🕧☕ homer 'cr2-esams*' commit 'allow nameservers of Jio AS55836 to skip RPKI validation I9fcff8' |
[production] |
| 16:39 |
<cdanis> |
✔️ cdanis@cumin1001.eqiad.wmnet ~ 🕧☕ homer 'cr1-codfw*' commit 'allow nameservers of Jio AS55836 to skip RPKI validation I9fcff8' |
[production] |
| 16:36 |
<cdanis> |
❌cdanis@cumin1001.eqiad.wmnet ~ 🕧☕ homer 'cr2-codfw*' commit 'allow nameservers of Jio AS55836 to skip RPKI validation I9fcff8' |
[production] |
| 13:06 |
<hashar> |
Successfully tagged docker-registry.discovery.wmnet/releng/rust:1.45.2-1 # T256827 |
[releng] |
| 09:13 |
<fdans> |
restarting refine to apply T257860 |
[analytics] |
| 02:41 |
<eileen> |
tools revision changed from 9a89f45974 to b4ebd1e564 |
[production] |
| 00:49 |
<wm-bot> |
<bd808> Switched to node10 container and deployed https://github.com/toolforge/tool-hatjitsu/commit/d04e1d7 |
[tools.hatjitsu] |
|
2020-08-13
§
|
| 23:39 |
<tzatziki> |
removing 3 files for legal compliance |
[production] |
| 22:03 |
<mutante> |
switching xhgui from tungsten to xhgui1001 - ran puppet on webperf*001 - T180761 T158837 |
[production] |
| 21:54 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@f3dcb29]: fix proxy in project-local domain --bug T260388 (duration: 03m 53s) |
[production] |
| 21:50 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@f3dcb29]: fix proxy in project-local domain --bug T260388 |
[production] |
| 21:11 |
<mutante> |
rsyncing /var/lib/jenkins from releases1001 to releases1002 and then all other releases* servers. 57GB, overwriting existing data from manual config (T247652) |
[production] |
| 20:53 |
<kormat> |
dropping xhgui.xhgui on m2 |
[production] |
| 19:50 |
<Urbanecm> |
Run `delete from ignored;` |
[tools.stewardbots] |
| 19:35 |
<thcipriani@deploy1001> |
Synchronized php-1.36.0-wmf.4/extensions/DiscussionTools: [[gerrit:620030|Revert new reply API (again)]] T259855 (duration: 00m 57s) |
[production] |
| 19:27 |
<Urbanecm> |
Restart stewardbots |
[tools.stewardbots] |
| 19:27 |
<Urbanecm> |
pip install sseclient |
[tools.stewardbots] |
| 19:25 |
<Urbanecm> |
Deploy 987cd61 |
[tools.stewardbots] |
| 18:09 |
<greg-g> |
deleting Phab user @Forza1000 cf: T260380 |
[releng] |
| 18:06 |
<herron> |
restarted ES on logstash1010 |
[production] |
| 18:05 |
<dpifke@deploy1001> |
Synchronized wmf-config/ProductionServices.php: Enabling new XHGui backend (T180761) (duration: 00m 56s) |
[production] |
| 17:16 |
<hnowlan> |
deployed ATS and varnish rules to route api.wikimedia.org |
[production] |
| 16:26 |
<hnowlan> |
created api.wikimedia.org |
[production] |
| 16:13 |
<fdans> |
restarting webrequest bundle |
[analytics] |
| 15:49 |
<hnowlan> |
moving api-gateway service to state production. critical set to false |
[production] |
| 15:41 |
<herron> |
restart ES on logstash1012 |
[production] |
| 14:56 |
<fdans@deploy1001> |
Finished deploy [analytics/refinery@ba1a439]: Regular analytics weekly train (duration: 11m 34s) |
[production] |
| 14:45 |
<ema> |
repool mw1382 with kernel memory accounting disabled T260281 |
[production] |
| 14:45 |
<fdans@deploy1001> |
Started deploy [analytics/refinery@ba1a439]: Regular analytics weekly train |
[production] |
| 14:44 |
<fdans> |
deploying refinery |
[analytics] |
| 14:41 |
<oblivian@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 14:40 |
<oblivian@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 14:38 |
<ema> |
reboot mw1382 with kernel memory accounting disabled T260281 |
[production] |
| 14:34 |
<oblivian@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 14:34 |
<_joe_> |
rebooting mw1381 with a newer kernel, mw1383 as control with the old kernel T260329 |
[production] |
| 14:33 |
<oblivian@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 14:31 |
<_joe_> |
installing kernel 4.19.0-0.bpo.9 on mw1381 T260329 |
[production] |
| 14:13 |
<fdans> |
updating refinery source symlinks |
[analytics] |
| 14:05 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
| 14:00 |
<elukey> |
create schema[12]00[34] in ganeti - T260347 |
[production] |
| 13:59 |
<elukey@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 13:58 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
| 13:53 |
<elukey@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 13:51 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |