351-400 of 10000 results (20ms)
2020-08-26 §
14:13 <pt1979@cumin2001> START - Cookbook sre.dns.netbox [production]
13:37 <kormat@cumin1001> dbctl commit (dc=all): 'Repooling db1110 @ 100% T261276', diff saved to https://phabricator.wikimedia.org/P12366 and previous config saved to /var/cache/conftool/dbconfig/20200826-133753-kormat.json [production]
13:18 <duesen> daniel@mwmaint1002:/srv/mediawiki/php-1.36.0-wmf.5$ mwscript maintenance/findBadBlobs.php dewiki --mark T205936 --revisions - < ~/T205936-dewiki-20050512070000.ids # marking known bad revisions for T205936 [production]
13:17 <kormat@cumin1001> dbctl commit (dc=all): 'Repooling db1110 @ 75% T261276', diff saved to https://phabricator.wikimedia.org/P12365 and previous config saved to /var/cache/conftool/dbconfig/20200826-131732-kormat.json [production]
13:16 <duesen> daniel@mwmaint1002:/srv/mediawiki/php-1.36.0-wmf.5$ mwscript maintenance/findBadBlobs.php oswiki --mark T205936 --revisions - < ~/T205936-oswiki-20090309200000.ids # marking known bad revisions for T205936 [production]
13:07 <kormat@cumin1001> dbctl commit (dc=all): 'Repooling db1110 @ 50% T261276', diff saved to https://phabricator.wikimedia.org/P12364 and previous config saved to /var/cache/conftool/dbconfig/20200826-130735-kormat.json [production]
13:06 <vgutierrez> serve a synthetic warn page to DHE-RSA-AES128-SHA users - T258405 [production]
12:47 <kormat@cumin1001> dbctl commit (dc=all): 'Repooling db1110 @ 30% T261276', diff saved to https://phabricator.wikimedia.org/P12363 and previous config saved to /var/cache/conftool/dbconfig/20200826-124700-kormat.json [production]
12:21 <kormat@cumin1001> dbctl commit (dc=all): 'Repooling db1110 @ 20% T261276', diff saved to https://phabricator.wikimedia.org/P12362 and previous config saved to /var/cache/conftool/dbconfig/20200826-122059-kormat.json [production]
12:12 <godog> upgrade nagios-nrpe-server to 2.15-2 on jessie hosts - T261198 [production]
11:58 <kormat@cumin1001> dbctl commit (dc=all): 'Start repooling db1110 T261276', diff saved to https://phabricator.wikimedia.org/P12361 and previous config saved to /var/cache/conftool/dbconfig/20200826-115850-kormat.json [production]
11:56 <mlitn@deploy1001> Synchronized php-1.36.0-wmf.6/extensions/WikibaseMediaInfo: MediaSearchQueryBuilder should support keyword only queries (duration: 01m 00s) [production]
11:55 <mlitn@deploy1001> Synchronized php-1.36.0-wmf.5/extensions/WikibaseMediaInfo: MediaSearchQueryBuilder should support keyword only queries (duration: 01m 08s) [production]
11:53 <kart_> Finished manual run of ContentTranslation/scripts/purge-unpublished-drafts.php script on mwmaint1002 (T261189) [production]
11:39 <kart_> Started manual run of ContentTranslation/scripts/purge-unpublished-drafts.php script on mwmaint1002 (T261189) [production]
11:29 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:599344|Enable propagateChangeVisibility for testwikidata]], part 2 (duration: 01m 03s) [production]
11:26 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:599344|Enable propagateChangeVisibility for testwikidata]], part 1 (duration: 01m 19s) [production]
10:30 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:28 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:14 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
10:14 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:18 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:14 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:00 <XioNoX> re-enable IPv6 BGP to Init7 in knams [production]
08:40 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1110 replication broken', diff saved to https://phabricator.wikimedia.org/P12360 and previous config saved to /var/cache/conftool/dbconfig/20200826-084044-marostegui.json [production]
08:16 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:14 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
05:45 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1091 for MCR change', diff saved to https://phabricator.wikimedia.org/P12358 and previous config saved to /var/cache/conftool/dbconfig/20200826-054557-marostegui.json [production]
05:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12357 and previous config saved to /var/cache/conftool/dbconfig/20200826-054409-marostegui.json [production]
05:33 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12356 and previous config saved to /var/cache/conftool/dbconfig/20200826-053345-marostegui.json [production]
05:23 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12355 and previous config saved to /var/cache/conftool/dbconfig/20200826-052355-marostegui.json [production]
05:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12354 and previous config saved to /var/cache/conftool/dbconfig/20200826-050849-marostegui.json [production]
05:03 <marostegui> Update db1135 and db1114 after MCR changes [production]
2020-08-25 §
21:51 <mutante> xhgui1001/xhgui2001 - Unpacking xhgui (0.12.0-2-wmf1) over (0.9.0-1-wmf1) (T260397) [production]
21:50 <mutante> xhgui1001 - Unpacking xhgui (0.12.0-2-wmf1) over (0.9.0-1-wmf1) ... [production]
21:46 <mutante> importing xhgui 0.12.0-2-wmf1 to buster-wikimedia APT repo (T260397) [production]
19:40 <dcausse@deploy1001> Finished deploy [wikimedia/discovery/analytics@125cb6d]: test: Add wikidata ttl import (duration: 00m 54s) [production]
19:39 <dcausse@deploy1001> Started deploy [wikimedia/discovery/analytics@125cb6d]: test: Add wikidata ttl import [production]
19:15 <marxarelli> 1.36.0-wmf.6 promoted to group0 (T257974). no new errors [production]
19:09 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.6 [production]
19:05 <moritzm> installing Java security updates on cloudelastic* hosts [production]
19:02 <moritzm> installing Java security updates on elastic* hosts [production]
18:19 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-reload [production]
17:58 <dduvall@deploy1001> Finished scap: testwikis wikis to 1.36.0-wmf.6 (duration: 41m 58s) [production]
17:30 <dcausse@deploy1001> Finished deploy [wikimedia/discovery/analytics@bc2f7f1]: test: Add wikidata ttl import (duration: 01m 52s) [production]
17:28 <dcausse@deploy1001> Started deploy [wikimedia/discovery/analytics@bc2f7f1]: test: Add wikidata ttl import [production]
17:17 <dduvall@deploy1001> Started scap: testwikis wikis to 1.36.0-wmf.6 [production]
17:08 <dduvall@deploy1001> Pruned MediaWiki: 1.36.0-wmf.4 (duration: 01m 40s) [production]
17:01 <dduvall@deploy1001> Pruned MediaWiki: 1.36.0-wmf.3 (duration: 19m 12s) [production]
17:01 <herron> imported logstash, elasticsearch, and kibana 7.9.0 -oss packages into buster-wikimedia thirdparty/elastic79 [production]