2019-09-16
§
|
10:45 |
<vgutierrez> |
Enabling OCSP prefetched responses for the non-canonical redirect service - T232988 |
[production] |
10:29 |
<_joe_> |
installing a patched php-memcached on mw1347 T232613 |
[production] |
10:16 |
<vgutierrez> |
upgrade acme-chief production servers to acme-chief 0.21 - T219765 |
[production] |
10:16 |
<moritzm> |
upload libtrapperkeeper-webserver-jetty9-clojure 1.7.0-2+wmf1 to buster-wikimedia |
[production] |
10:05 |
<vgutierrez> |
restarting acmechief servers to get latest kernel upgrades |
[production] |
10:04 |
<elukey> |
disable puppet on an-coord1001 and manually forcing python3 for camus - T204735 |
[analytics] |
09:26 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
09:24 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
08:57 |
<vgutierrez> |
replacing nginx with ATS in cp3034 (upload cluster) - T231433 |
[production] |
08:56 |
<mobrovac@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Beta: enable the Parsoid extension - T231569 (duration: 01m 01s) |
[production] |
08:50 |
<marostegui> |
Apply grants for dbproxy1021 on db1133 (m5 master) with replication - T202367 |
[production] |
08:16 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
08:14 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
08:11 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
08:09 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
07:38 |
<moritzm> |
installing faad2 security updates |
[production] |
07:25 |
<joal> |
Delete matomo error with URL http://Wikipedia/screen/Explore |
[analytics] |
07:15 |
<moritzm> |
repooling restbase2009 |
[production] |
06:48 |
<marostegui> |
Stop MySQL on db1114 to upgrade it to 10.3 |
[production] |
06:03 |
<marostegui> |
Stop MySQL on db2054 for decommissioning T232969 |
[production] |
06:01 |
<marostegui> |
Remove db2054 from tendril and zarcillo T232969 |
[production] |
05:59 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Remove db2054 from config T232969 (duration: 01m 03s) |
[production] |
05:58 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Remove db2054 from config T232969 (duration: 01m 05s) |
[production] |
02:35 |
<Zppix> |
removing MacFan4000 as a maintainer due to inactivity and lack of accountability. |
[tools.zppixbot] |
02:07 |
<Zppix> |
upgrade python to 3.5.3 and sopel to 6.9.9 (after some frustration) |
[tools.zppixbot] |
2019-09-13
§
|
23:44 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
23:42 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
23:40 |
<Krinkle> |
deployment-deploy01: cleaning disk: rm /var/cache/hhvm/cli.hhbc.sq3 |
[releng] |
23:06 |
<gehel> |
re-enable puppet on maps - T232817 |
[production] |
21:52 |
<halfak> |
switched ores-lb-03 to point to ores-web-04/05/06 |
[ores] |
21:17 |
<andrewbogott> |
moving ores-redis-02 to cloudvirt1030 |
[ores] |
21:06 |
<halfak> |
restarting redis services on ores-redis-02 |
[ores] |
20:53 |
<halfak> |
ran 'sudo service celery-ores-worker restart' on celery-worker-02 |
[ores] |
20:23 |
<chaomodus> |
restarting netbox1001.wikimedia.org |
[production] |
20:00 |
<twentyafterfour> |
hotfixing T232600 due to severity of the bug and relative safety of the fix (if this breaks, yell at James_F who twisted my arm and made me do it) |
[production] |
19:54 |
<urandom> |
bootstrapping Cassandra, restbase2009-c -- T224553 |
[production] |
17:24 |
<urandom> |
bootstrapping Cassandra, restbase2009-b -- T224553 |
[production] |
16:57 |
<joal> |
Reset ua-parser/uap-java wmf branch to up-to-date master using push force |
[analytics] |
16:19 |
<James_F> |
Zuul: Add initial jobs for mediawiki/tools/api-testing T230340 |
[releng] |
16:10 |
<XioNoX> |
fix bgp group netflow on cr2-codfw |
[production] |
15:47 |
<urandom> |
bootstrapping Cassandra, restbase2009-a -- T224553 |
[production] |
15:43 |
<effie> |
reverting live hacks on mw1348 |
[production] |