6451-6500 of 10000 results (35ms)
2020-08-26 ยง
17:14 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Documentation-only change; sync for line sanity (duration: 01m 04s) [production]
17:12 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T254349 Set wgVisualEditorEnableBetaFeature true on wikis that need it (duration: 01m 03s) [production]
15:59 <oblivian@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'termbox' for release 'production' . [production]
15:53 <oblivian@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'termbox' for release 'production' . [production]
15:41 <oblivian@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'termbox' for release 'production' . [production]
15:11 <oblivian@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'termbox' for release 'production' . [production]
14:56 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1134 for MCR change', diff saved to https://phabricator.wikimedia.org/P12371 and previous config saved to /var/cache/conftool/dbconfig/20200826-145612-marostegui.json [production]
14:55 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1091 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12370 and previous config saved to /var/cache/conftool/dbconfig/20200826-145531-marostegui.json [production]
14:47 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1091 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12369 and previous config saved to /var/cache/conftool/dbconfig/20200826-144750-marostegui.json [production]
14:45 <elukey@puppetmaster1001> conftool action : set/pooled=inactive:weight=0; selector: name=schema1002.eqiad.wmnet [production]
14:45 <elukey@puppetmaster1001> conftool action : set/pooled=inactive:weight=0; selector: name=schema1001.eqiad.wmnet [production]
14:45 <elukey@puppetmaster1001> conftool action : set/pooled=inactive:weight=0; selector: name=schema2001.codfw.wmnet [production]
14:44 <elukey@puppetmaster1001> conftool action : set/pooled=inactive:weight=0; selector: name=schema2002.codfw.wmnet [production]
14:36 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1091 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12368 and previous config saved to /var/cache/conftool/dbconfig/20200826-143623-marostegui.json [production]
14:34 <elukey@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: name=schema2003.codfw.wmnet [production]
14:34 <elukey@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: name=schema2004.codfw.wmnet [production]
14:33 <elukey@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: name=schema1004.eqiad.wmnet [production]
14:33 <elukey@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: name=schema1003.eqiad.wmnet [production]
14:27 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1091 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12367 and previous config saved to /var/cache/conftool/dbconfig/20200826-142746-marostegui.json [production]
14:25 <jgleeson> updated civicrm from 0f195c6cca to d2e80f7522 [production]
14:21 <pt1979@cumin2001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:20 <marostegui> Upgrade mysql on db1091 after MCR changes [production]
14:13 <pt1979@cumin2001> START - Cookbook sre.dns.netbox [production]
13:37 <kormat@cumin1001> dbctl commit (dc=all): 'Repooling db1110 @ 100% T261276', diff saved to https://phabricator.wikimedia.org/P12366 and previous config saved to /var/cache/conftool/dbconfig/20200826-133753-kormat.json [production]
13:18 <duesen> daniel@mwmaint1002:/srv/mediawiki/php-1.36.0-wmf.5$ mwscript maintenance/findBadBlobs.php dewiki --mark T205936 --revisions - < ~/T205936-dewiki-20050512070000.ids # marking known bad revisions for T205936 [production]
13:17 <kormat@cumin1001> dbctl commit (dc=all): 'Repooling db1110 @ 75% T261276', diff saved to https://phabricator.wikimedia.org/P12365 and previous config saved to /var/cache/conftool/dbconfig/20200826-131732-kormat.json [production]
13:16 <duesen> daniel@mwmaint1002:/srv/mediawiki/php-1.36.0-wmf.5$ mwscript maintenance/findBadBlobs.php oswiki --mark T205936 --revisions - < ~/T205936-oswiki-20090309200000.ids # marking known bad revisions for T205936 [production]
13:07 <kormat@cumin1001> dbctl commit (dc=all): 'Repooling db1110 @ 50% T261276', diff saved to https://phabricator.wikimedia.org/P12364 and previous config saved to /var/cache/conftool/dbconfig/20200826-130735-kormat.json [production]
13:06 <vgutierrez> serve a synthetic warn page to DHE-RSA-AES128-SHA users - T258405 [production]
12:47 <kormat@cumin1001> dbctl commit (dc=all): 'Repooling db1110 @ 30% T261276', diff saved to https://phabricator.wikimedia.org/P12363 and previous config saved to /var/cache/conftool/dbconfig/20200826-124700-kormat.json [production]
12:21 <kormat@cumin1001> dbctl commit (dc=all): 'Repooling db1110 @ 20% T261276', diff saved to https://phabricator.wikimedia.org/P12362 and previous config saved to /var/cache/conftool/dbconfig/20200826-122059-kormat.json [production]
12:12 <godog> upgrade nagios-nrpe-server to 2.15-2 on jessie hosts - T261198 [production]
11:58 <kormat@cumin1001> dbctl commit (dc=all): 'Start repooling db1110 T261276', diff saved to https://phabricator.wikimedia.org/P12361 and previous config saved to /var/cache/conftool/dbconfig/20200826-115850-kormat.json [production]
11:56 <mlitn@deploy1001> Synchronized php-1.36.0-wmf.6/extensions/WikibaseMediaInfo: MediaSearchQueryBuilder should support keyword only queries (duration: 01m 00s) [production]
11:55 <mlitn@deploy1001> Synchronized php-1.36.0-wmf.5/extensions/WikibaseMediaInfo: MediaSearchQueryBuilder should support keyword only queries (duration: 01m 08s) [production]
11:53 <kart_> Finished manual run of ContentTranslation/scripts/purge-unpublished-drafts.php script on mwmaint1002 (T261189) [production]
11:39 <kart_> Started manual run of ContentTranslation/scripts/purge-unpublished-drafts.php script on mwmaint1002 (T261189) [production]
11:29 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:599344|Enable propagateChangeVisibility for testwikidata]], part 2 (duration: 01m 03s) [production]
11:26 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:599344|Enable propagateChangeVisibility for testwikidata]], part 1 (duration: 01m 19s) [production]
10:30 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:28 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:14 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
10:14 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:18 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:14 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:00 <XioNoX> re-enable IPv6 BGP to Init7 in knams [production]
08:40 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1110 replication broken', diff saved to https://phabricator.wikimedia.org/P12360 and previous config saved to /var/cache/conftool/dbconfig/20200826-084044-marostegui.json [production]
08:16 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:14 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
05:45 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1091 for MCR change', diff saved to https://phabricator.wikimedia.org/P12358 and previous config saved to /var/cache/conftool/dbconfig/20200826-054557-marostegui.json [production]