|
2020-08-26
ยง
|
| 15:11 |
<oblivian@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'termbox' for release 'production' . |
[production] |
| 14:56 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1134 for MCR change', diff saved to https://phabricator.wikimedia.org/P12371 and previous config saved to /var/cache/conftool/dbconfig/20200826-145612-marostegui.json |
[production] |
| 14:55 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1091 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12370 and previous config saved to /var/cache/conftool/dbconfig/20200826-145531-marostegui.json |
[production] |
| 14:47 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1091 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12369 and previous config saved to /var/cache/conftool/dbconfig/20200826-144750-marostegui.json |
[production] |
| 14:45 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=inactive:weight=0; selector: name=schema1002.eqiad.wmnet |
[production] |
| 14:45 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=inactive:weight=0; selector: name=schema1001.eqiad.wmnet |
[production] |
| 14:45 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=inactive:weight=0; selector: name=schema2001.codfw.wmnet |
[production] |
| 14:44 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=inactive:weight=0; selector: name=schema2002.codfw.wmnet |
[production] |
| 14:36 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1091 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12368 and previous config saved to /var/cache/conftool/dbconfig/20200826-143623-marostegui.json |
[production] |
| 14:34 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=yes:weight=10; selector: name=schema2003.codfw.wmnet |
[production] |
| 14:34 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=yes:weight=10; selector: name=schema2004.codfw.wmnet |
[production] |
| 14:33 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=yes:weight=10; selector: name=schema1004.eqiad.wmnet |
[production] |
| 14:33 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=yes:weight=10; selector: name=schema1003.eqiad.wmnet |
[production] |
| 14:27 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1091 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12367 and previous config saved to /var/cache/conftool/dbconfig/20200826-142746-marostegui.json |
[production] |
| 14:25 |
<jgleeson> |
updated civicrm from 0f195c6cca to d2e80f7522 |
[production] |
| 14:21 |
<pt1979@cumin2001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 14:20 |
<marostegui> |
Upgrade mysql on db1091 after MCR changes |
[production] |
| 14:13 |
<pt1979@cumin2001> |
START - Cookbook sre.dns.netbox |
[production] |
| 13:37 |
<kormat@cumin1001> |
dbctl commit (dc=all): 'Repooling db1110 @ 100% T261276', diff saved to https://phabricator.wikimedia.org/P12366 and previous config saved to /var/cache/conftool/dbconfig/20200826-133753-kormat.json |
[production] |
| 13:18 |
<duesen> |
daniel@mwmaint1002:/srv/mediawiki/php-1.36.0-wmf.5$ mwscript maintenance/findBadBlobs.php dewiki --mark T205936 --revisions - < ~/T205936-dewiki-20050512070000.ids # marking known bad revisions for T205936 |
[production] |
| 13:17 |
<kormat@cumin1001> |
dbctl commit (dc=all): 'Repooling db1110 @ 75% T261276', diff saved to https://phabricator.wikimedia.org/P12365 and previous config saved to /var/cache/conftool/dbconfig/20200826-131732-kormat.json |
[production] |
| 13:16 |
<duesen> |
daniel@mwmaint1002:/srv/mediawiki/php-1.36.0-wmf.5$ mwscript maintenance/findBadBlobs.php oswiki --mark T205936 --revisions - < ~/T205936-oswiki-20090309200000.ids # marking known bad revisions for T205936 |
[production] |
| 13:07 |
<kormat@cumin1001> |
dbctl commit (dc=all): 'Repooling db1110 @ 50% T261276', diff saved to https://phabricator.wikimedia.org/P12364 and previous config saved to /var/cache/conftool/dbconfig/20200826-130735-kormat.json |
[production] |
| 13:06 |
<vgutierrez> |
serve a synthetic warn page to DHE-RSA-AES128-SHA users - T258405 |
[production] |
| 12:47 |
<kormat@cumin1001> |
dbctl commit (dc=all): 'Repooling db1110 @ 30% T261276', diff saved to https://phabricator.wikimedia.org/P12363 and previous config saved to /var/cache/conftool/dbconfig/20200826-124700-kormat.json |
[production] |
| 12:21 |
<kormat@cumin1001> |
dbctl commit (dc=all): 'Repooling db1110 @ 20% T261276', diff saved to https://phabricator.wikimedia.org/P12362 and previous config saved to /var/cache/conftool/dbconfig/20200826-122059-kormat.json |
[production] |
| 12:12 |
<godog> |
upgrade nagios-nrpe-server to 2.15-2 on jessie hosts - T261198 |
[production] |
| 11:58 |
<kormat@cumin1001> |
dbctl commit (dc=all): 'Start repooling db1110 T261276', diff saved to https://phabricator.wikimedia.org/P12361 and previous config saved to /var/cache/conftool/dbconfig/20200826-115850-kormat.json |
[production] |
| 11:56 |
<mlitn@deploy1001> |
Synchronized php-1.36.0-wmf.6/extensions/WikibaseMediaInfo: MediaSearchQueryBuilder should support keyword only queries (duration: 01m 00s) |
[production] |
| 11:55 |
<mlitn@deploy1001> |
Synchronized php-1.36.0-wmf.5/extensions/WikibaseMediaInfo: MediaSearchQueryBuilder should support keyword only queries (duration: 01m 08s) |
[production] |
| 11:53 |
<kart_> |
Finished manual run of ContentTranslation/scripts/purge-unpublished-drafts.php script on mwmaint1002 (T261189) |
[production] |
| 11:39 |
<kart_> |
Started manual run of ContentTranslation/scripts/purge-unpublished-drafts.php script on mwmaint1002 (T261189) |
[production] |
| 11:29 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config/Wikibase.php: Config: [[gerrit:599344|Enable propagateChangeVisibility for testwikidata]], part 2 (duration: 01m 03s) |
[production] |
| 11:26 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:599344|Enable propagateChangeVisibility for testwikidata]], part 1 (duration: 01m 19s) |
[production] |
| 10:30 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:28 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:14 |
<elukey@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 10:14 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:18 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 09:14 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:00 |
<XioNoX> |
re-enable IPv6 BGP to Init7 in knams |
[production] |
| 08:40 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1110 replication broken', diff saved to https://phabricator.wikimedia.org/P12360 and previous config saved to /var/cache/conftool/dbconfig/20200826-084044-marostegui.json |
[production] |
| 08:16 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 08:14 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 05:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1091 for MCR change', diff saved to https://phabricator.wikimedia.org/P12358 and previous config saved to /var/cache/conftool/dbconfig/20200826-054557-marostegui.json |
[production] |
| 05:44 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12357 and previous config saved to /var/cache/conftool/dbconfig/20200826-054409-marostegui.json |
[production] |
| 05:33 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12356 and previous config saved to /var/cache/conftool/dbconfig/20200826-053345-marostegui.json |
[production] |
| 05:23 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12355 and previous config saved to /var/cache/conftool/dbconfig/20200826-052355-marostegui.json |
[production] |
| 05:08 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12354 and previous config saved to /var/cache/conftool/dbconfig/20200826-050849-marostegui.json |
[production] |
| 05:03 |
<marostegui> |
Update db1135 and db1114 after MCR changes |
[production] |