|
2020-04-06
§
|
| 08:29 |
<RhinosF1> |
wiki out of read only |
[tools.zppixbot] |
| 08:26 |
<RhinosF1> |
wiki to read only, updating all submodules: 'tools.zppixbot@tools-sgebastion-07:~/ZppixBot/public_html/wiki$ git submodule foreach git pull origin REL1_34' |
[tools.zppixbot] |
| 08:18 |
<_joe_> |
conversion of codfw api done |
[production] |
| 08:07 |
<marostegui> |
Deploy schema change on dbstore1003:3311 |
[production] |
| 07:54 |
<vgutierrez> |
rolling restart of ats-tls to disable wmf-analytics log - T249335 T237993 |
[production] |
| 07:50 |
<dcausse> |
search index: deleting stale index wikidatawiki_content_1585224806 on cloudelastic:9243 |
[production] |
| 07:49 |
<_joe_> |
eqiad API migrated to envoy for local TLS termination, now starting codfw |
[production] |
| 07:35 |
<elukey> |
restart elasticsearch_6@cloudelastic-chi-eqiad on cloudelastic1003 as attempt to fix heavy GC runs (old gen) - T231517 |
[production] |
| 07:35 |
<marostegui> |
Rename wb_terms on eqiad excluding labsdb1009, labdb1010, labsdb1011 - T248086 |
[production] |
| 07:06 |
<marostegui> |
Rename wb_terms on codfw - T248086 |
[production] |
| 06:45 |
<XioNoX> |
delete BGP to AS25074 in amsix |
[production] |
| 06:36 |
<_joe_> |
converting the api servers to envoy for TLS in eqiad |
[production] |
| 06:30 |
<marostegui> |
Upgrade dbproxy1019 - T231520 |
[production] |
| 06:29 |
<elukey> |
allow all analytics-privatedata-users to use the GPUs on stat1005/8 |
[analytics] |
| 06:18 |
<marostegui> |
Deploy schema change on s1 codfw master, this will generate lag on codfw |
[production] |
| 05:54 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 05:54 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 05:50 |
<vgutierrez> |
ats-tls restart in cp3056, cp3058 and cp3062 - T249335 |
[production] |
| 05:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1079 after schema change', diff saved to https://phabricator.wikimedia.org/P10897 and previous config saved to /var/cache/conftool/dbconfig/20200406-054559-marostegui.json |
[production] |
| 05:18 |
<marostegui> |
Deploy schema change on db1079 (this will generate lag on s7 labs) |
[production] |
| 05:17 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1079 for schema change', diff saved to https://phabricator.wikimedia.org/P10896 and previous config saved to /var/cache/conftool/dbconfig/20200406-051744-marostegui.json |
[production] |
| 05:16 |
<vgutierrez> |
Enable inbound TLSv1.3 in upload@eqiad - T170567 |
[production] |
| 05:16 |
<vgutierrez> |
Enable TLS Session Tickets on eqiad - T245616 |
[production] |
| 05:01 |
<vgutierrez> |
ats-tls restart in cp1075, cp1081 and cp1087 - T249335 |
[production] |
|
2020-04-03
§
|
| 22:40 |
<bstorm_> |
shut down tools-redis-1001/2 T248929 |
[tools] |
| 22:32 |
<bstorm_> |
switch tools-redis-1003 to the active redis server T248929 |
[tools] |
| 22:12 |
<RhinosF1> |
restarted webservice due to update after fiddling with git - now updating submodules, then composer |
[tools.zppixbot] |
| 21:57 |
<RhinosF1> |
stopping webservice for now |
[tools.zppixbot] |
| 21:35 |
<RhinosF1> |
reset and force the above due to conflict crazy |
[tools.zppixbot] |
| 21:19 |
<RhinosF1> |
tools.zppixbot@tools-sgebastion-07:~/ZppixBot/public_html/wiki$ git pull |
[tools.zppixbot] |
| 21:17 |
<andrewbogott> |
ugpraded wikitech-static to 1.34.1 |
[production] |
| 21:15 |
<RhinosF1> |
START - MediaWiki Upgrade - T249368 |
[tools.zppixbot] |
| 20:41 |
<bstorm_> |
deleting tools-redis-1003/4 to attach them to an anti-affinity group T248929 |
[tools] |
| 20:30 |
<brennen> |
Updating dev-images docker-pkg files on contint1001 for T246953 |
[releng] |
| 20:18 |
<bd808> |
Syncing prod techblog db to develop server (upstream, not Cloud VPS) |
[techblog] |
| 19:02 |
<longma> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/584701 |
[releng] |
| 18:55 |
<tgr> |
deleting roebling and appleton, not used and triggering alarms |
[wikispore] |
| 18:53 |
<bstorm_> |
spin up tools-redis-1004 on stretch and connect to cluster T248929 |
[tools] |
| 18:23 |
<bstorm_> |
spin up tools-redis-1003 on stretch and connect to the cluster T248929 |
[tools] |
| 17:58 |
<mutante> |
rsync home dirs from install1002 to apt1001:/srv/home_install1002... |
[production] |
| 16:50 |
<bstorm_> |
launching tools-redis-03 (Buster) to see what happens |
[tools] |
| 15:43 |
<ema> |
cp3061: restart varnish-fe T249344 |
[production] |
| 15:30 |
<hnowlan@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . |
[production] |
| 15:19 |
<hnowlan@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . |
[production] |
| 15:18 |
<hnowlan@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . |
[production] |