|
2019-10-28
§
|
| 13:07 |
<ema@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:05 |
<effie> |
enable puppet on mw2* servers, depool and repool to reload apache - T229792 |
[production] |
| 13:01 |
<jynus> |
stop db1114 for testing |
[production] |
| 12:30 |
<ema> |
depool cp5007 and reimage as text_ats T227432 |
[production] |
| 12:24 |
<arturo> |
upload image `coredns` v1.3.1 (eb516548c180) to docker registry (T236249) |
[tools] |
| 12:23 |
<arturo> |
upload image `kube-apiserver` v1.15.1 (68c3eb07bfc3) to docker registry (T236249) |
[tools] |
| 12:22 |
<effie> |
depool mw2150 |
[production] |
| 12:22 |
<arturo> |
upload image `kube-controller-manager` v1.15.1 (d75082f1d121) to docker registry (T236249) |
[tools] |
| 12:20 |
<arturo> |
upload image `kube-proxy` v1.15.1 (89a062da739d) to docker registry (T236249) |
[tools] |
| 12:18 |
<arturo> |
upload image `kube-scheduler` v1.15.1 (b0b3c4c404da) to docker registry (T236249) |
[tools] |
| 12:04 |
<arturo> |
upload image `calico/node` v3.8.0 (cd3efa20ff37) to docker registry (T236249) |
[tools] |
| 12:03 |
<arturo> |
upload image `calico/calico/pod2daemon-flexvol` v3.8.0 (f68c8f870a03) to docker registry (T236249) |
[tools] |
| 12:01 |
<arturo> |
upload image `calico/cni` v3.8.0 (539ca36a4c13) to docker registry (T236249) |
[tools] |
| 11:58 |
<arturo> |
upload image `calico/kube-controllers` v3.8.0 (df5ff96cd966) to docker registry (T236249) |
[tools] |
| 11:56 |
<twentyafterfour@deploy1001> |
Finished deploy [phabricator/deployment@e4e2b22]: testing deployment of phabricator to phab1001 (duration: 00m 05s) |
[production] |
| 11:56 |
<twentyafterfour@deploy1001> |
Started deploy [phabricator/deployment@e4e2b22]: testing deployment of phabricator to phab1001 |
[production] |
| 11:47 |
<arturo> |
upload image `nginx-ingress-controller` v0.25.1 (0439eb3e11f1) to docker registry (T236249) |
[tools] |
| 11:34 |
<Urbanecm> |
EU SWAT done |
[production] |
| 11:33 |
<urbanecm@deploy1001> |
Synchronized php-1.35.0-wmf.3/extensions/VisualEditor/includes/ApiVisualEditorEdit.php: SWAT: 8caf681: Dont log missing ETags when creating a new page, thats normal (T233320) (duration: 00m 54s) |
[production] |
| 11:33 |
<effie> |
Disable puppet on mw* for 545652 - T229792 |
[production] |
| 11:12 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: dd2f06c: Add Translate channel for the Translate extension (T221119) (duration: 00m 53s) |
[production] |
| 11:07 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: ff17666: Adjust wgUploadNavigationUrl for azwiki to point to commons UpWiz (T236307) (duration: 00m 53s) |
[production] |
| 11:05 |
<urbanecm@deploy1001> |
Synchronized dblists/commonsuploads.dblist: SWAT: 7e26ef4: Revert "Restrict uploads on azwiki" (T236307) (duration: 00m 53s) |
[production] |
| 11:02 |
<moritzm> |
installing OpenJDK security updates on elastic* |
[production] |
| 10:40 |
<jdrewniak@deploy1001> |
Synchronized portals: Wikimedia Portals Update: [[gerrit:546442| Bumping portals to master (T128546)]] (duration: 00m 53s) |
[production] |
| 10:39 |
<jdrewniak@deploy1001> |
Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:546442| Bumping portals to master (T128546)]] (duration: 00m 54s) |
[production] |
| 10:10 |
<fdans> |
mediarequest per file backfilling suspended |
[analytics] |
| 09:14 |
<elukey> |
manual re-run of cassandra-coord-pageview-per-article-daily - 26/10/2019 - as attempt to see if the error is reproducible or not (timeout while inserting into cassandra) |
[analytics] |
| 08:48 |
<godog> |
bump udp_localhost kafka-logging topics to 6 partitions and roll-restart logstash and rsyslog - T215904 |
[production] |
| 08:26 |
<volans> |
manually cleanup changes reverted in https://gerrit.wikimedia.org/r/546407 on icinga[12]001 - T222074 |
[production] |
| 08:25 |
<moritzm> |
installing file/libmagic security updates |
[production] |
| 08:16 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@447981b]: Parsoid: Shim content-language and vary headers only for the PHP variant - T230791 (duration: 13m 42s) |
[production] |
| 08:15 |
<godog> |
swift eqiad-prod: final weight to ms-be105[1-6] - T232367 |
[production] |
| 08:02 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@447981b]: Parsoid: Shim content-language and vary headers only for the PHP variant - T230791 |
[production] |
| 07:40 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@c500d7a]: Add the Parsoid proxy for JS/PHP variants, add top mediarequests end point and add mnwwiki and ge.wm.org - T230791 T235744 T236389 (duration: 13m 44s) |
[production] |
| 07:40 |
<elukey@deploy1001> |
Finished deploy [eventlogging/analytics@0f1ad6d]: Move codebase to Python3 - second attempt (duration: 00m 05s) |
[production] |
| 07:40 |
<elukey@deploy1001> |
Started deploy [eventlogging/analytics@0f1ad6d]: Move codebase to Python3 - second attempt |
[production] |
| 07:37 |
<elukey> |
upload archiva 2.2.4-1 to wikimedia-stretch (fix to avoid overriding archiva.xml upon install) |
[production] |
| 07:27 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@c500d7a]: Add the Parsoid proxy for JS/PHP variants, add top mediarequests end point and add mnwwiki and ge.wm.org - T230791 T235744 T236389 |
[production] |
| 07:25 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@c500d7a] (dev-cluster): Add the Parsoid proxy for JS/PHP variants, add top mediarequests end point and add mnwwiki and ge.wm.org (duration: 02m 37s) |
[production] |
| 07:22 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@c500d7a] (dev-cluster): Add the Parsoid proxy for JS/PHP variants, add top mediarequests end point and add mnwwiki and ge.wm.org |
[production] |
| 03:35 |
<bd808> |
Replaced scholarships-02 with scholarships-03 running Debian Buster (T236579) |
[wikimania-support] |
| 02:08 |
<bd808> |
Deleted mwv-builder-02 after copying wiki content to new mwv-builder-03 Buster instance (T236530) |
[mediawiki-vagrant] |