|
2020-08-26
§
|
| 12:21 |
<kormat@cumin1001> |
dbctl commit (dc=all): 'Repooling db1110 @ 20% T261276', diff saved to https://phabricator.wikimedia.org/P12362 and previous config saved to /var/cache/conftool/dbconfig/20200826-122059-kormat.json |
[production] |
| 12:12 |
<godog> |
upgrade nagios-nrpe-server to 2.15-2 on jessie hosts - T261198 |
[production] |
| 11:58 |
<kormat@cumin1001> |
dbctl commit (dc=all): 'Start repooling db1110 T261276', diff saved to https://phabricator.wikimedia.org/P12361 and previous config saved to /var/cache/conftool/dbconfig/20200826-115850-kormat.json |
[production] |
| 11:56 |
<mlitn@deploy1001> |
Synchronized php-1.36.0-wmf.6/extensions/WikibaseMediaInfo: MediaSearchQueryBuilder should support keyword only queries (duration: 01m 00s) |
[production] |
| 11:55 |
<mlitn@deploy1001> |
Synchronized php-1.36.0-wmf.5/extensions/WikibaseMediaInfo: MediaSearchQueryBuilder should support keyword only queries (duration: 01m 08s) |
[production] |
| 11:53 |
<kart_> |
Finished manual run of ContentTranslation/scripts/purge-unpublished-drafts.php script on mwmaint1002 (T261189) |
[production] |
| 11:39 |
<kart_> |
Started manual run of ContentTranslation/scripts/purge-unpublished-drafts.php script on mwmaint1002 (T261189) |
[production] |
| 11:29 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config/Wikibase.php: Config: [[gerrit:599344|Enable propagateChangeVisibility for testwikidata]], part 2 (duration: 01m 03s) |
[production] |
| 11:26 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:599344|Enable propagateChangeVisibility for testwikidata]], part 1 (duration: 01m 19s) |
[production] |
| 10:30 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:28 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:14 |
<elukey@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 10:14 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:18 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 09:14 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:00 |
<XioNoX> |
re-enable IPv6 BGP to Init7 in knams |
[production] |
| 08:40 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1110 replication broken', diff saved to https://phabricator.wikimedia.org/P12360 and previous config saved to /var/cache/conftool/dbconfig/20200826-084044-marostegui.json |
[production] |
| 08:16 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 08:14 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 05:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1091 for MCR change', diff saved to https://phabricator.wikimedia.org/P12358 and previous config saved to /var/cache/conftool/dbconfig/20200826-054557-marostegui.json |
[production] |
| 05:44 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12357 and previous config saved to /var/cache/conftool/dbconfig/20200826-054409-marostegui.json |
[production] |
| 05:33 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12356 and previous config saved to /var/cache/conftool/dbconfig/20200826-053345-marostegui.json |
[production] |
| 05:23 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12355 and previous config saved to /var/cache/conftool/dbconfig/20200826-052355-marostegui.json |
[production] |
| 05:08 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1114, db1135 after MCR changes', diff saved to https://phabricator.wikimedia.org/P12354 and previous config saved to /var/cache/conftool/dbconfig/20200826-050849-marostegui.json |
[production] |
| 05:03 |
<marostegui> |
Update db1135 and db1114 after MCR changes |
[production] |
|
2020-08-25
§
|
| 21:51 |
<mutante> |
xhgui1001/xhgui2001 - Unpacking xhgui (0.12.0-2-wmf1) over (0.9.0-1-wmf1) (T260397) |
[production] |
| 21:50 |
<mutante> |
xhgui1001 - Unpacking xhgui (0.12.0-2-wmf1) over (0.9.0-1-wmf1) ... |
[production] |
| 21:46 |
<mutante> |
importing xhgui 0.12.0-2-wmf1 to buster-wikimedia APT repo (T260397) |
[production] |
| 19:40 |
<dcausse@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@125cb6d]: test: Add wikidata ttl import (duration: 00m 54s) |
[production] |
| 19:39 |
<dcausse@deploy1001> |
Started deploy [wikimedia/discovery/analytics@125cb6d]: test: Add wikidata ttl import |
[production] |
| 19:15 |
<marxarelli> |
1.36.0-wmf.6 promoted to group0 (T257974). no new errors |
[production] |
| 19:09 |
<dduvall@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.6 |
[production] |
| 19:05 |
<moritzm> |
installing Java security updates on cloudelastic* hosts |
[production] |
| 19:02 |
<moritzm> |
installing Java security updates on elastic* hosts |
[production] |
| 18:19 |
<ryankemper@cumin1001> |
START - Cookbook sre.wdqs.data-reload |
[production] |
| 17:58 |
<dduvall@deploy1001> |
Finished scap: testwikis wikis to 1.36.0-wmf.6 (duration: 41m 58s) |
[production] |
| 17:30 |
<dcausse@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@bc2f7f1]: test: Add wikidata ttl import (duration: 01m 52s) |
[production] |
| 17:28 |
<dcausse@deploy1001> |
Started deploy [wikimedia/discovery/analytics@bc2f7f1]: test: Add wikidata ttl import |
[production] |
| 17:17 |
<dduvall@deploy1001> |
Started scap: testwikis wikis to 1.36.0-wmf.6 |
[production] |
| 17:08 |
<dduvall@deploy1001> |
Pruned MediaWiki: 1.36.0-wmf.4 (duration: 01m 40s) |
[production] |
| 17:01 |
<dduvall@deploy1001> |
Pruned MediaWiki: 1.36.0-wmf.3 (duration: 19m 12s) |
[production] |
| 17:01 |
<herron> |
imported logstash, elasticsearch, and kibana 7.9.0 -oss packages into buster-wikimedia thirdparty/elastic79 |
[production] |
| 16:42 |
<dcausse@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@89b4f74]: test: Add wikidata ttl import (duration: 00m 49s) |
[production] |
| 16:41 |
<dcausse@deploy1001> |
Started deploy [wikimedia/discovery/analytics@89b4f74]: test: Add wikidata ttl import |
[production] |
| 16:21 |
<shdubsh> |
restart logstash on logstash1007 -- gc duration outlier |
[production] |
| 16:08 |
<dcausse@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@ae6dd8d]: test: Add wikidata ttl import (duration: 00m 54s) |
[production] |
| 16:07 |
<dcausse@deploy1001> |
Started deploy [wikimedia/discovery/analytics@ae6dd8d]: test: Add wikidata ttl import |
[production] |
| 16:00 |
<gehel> |
repool wdqs1005 - catched up on lag |
[production] |
| 15:47 |
<elukey> |
restart mariadb@analytics_meta on db1108 to apply a replication filter (exclude superset_staging database from replication) |
[production] |
| 15:44 |
<jgleeson> |
fundraising-tools updated from dcad0bfe75 to 3fe3a23114 |
[production] |