|
2020-02-25
ยง
|
| 20:28 |
<tzatziki> |
reset password for ClioCJS |
[production] |
| 20:25 |
<tzatziki> |
changing email address for ClioCJS |
[production] |
| 20:25 |
<mutante> |
apt.wikimedia.org (current install* and new apt* roles) - going ECDSA-only and removing RSA certificate from nginx config - to support buster without having to maintain patched nginx for duplicate ssl_stapling_file directive - at the cost of slightly reduced back-compat on the public repo (T242602) |
[production] |
| 20:24 |
<mutante> |
apt.wikimedia.org (current install* and new apt* roles) - going ECDSA-only and removing RSA certificate from nginx config - to support buster without having to maintain patched nginx for duplicate ssl_stapling_file directive - at the cost of slightly reduced back-compat on the public repo (T224576) |
[production] |
| 20:18 |
<eileen> |
process-control config revision is e17d104c73 |
[production] |
| 20:04 |
<jhuneidi@deploy1001> |
Started scap: testwikis wikis to 1.35.0-wmf.21 refs T233869 |
[production] |
| 20:01 |
<jhuneidi@deploy1001> |
Pruned MediaWiki: 1.35.0-wmf.19 (duration: 14m 35s) |
[production] |
| 19:58 |
<otto@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
| 19:55 |
<otto@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
| 19:54 |
<otto@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
| 19:52 |
<otto@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
| 19:47 |
<otto@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
| 19:47 |
<otto@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
| 19:45 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
| 19:44 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
| 19:39 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
| 19:31 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
| 19:30 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
| 19:26 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
| 19:26 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
| 19:23 |
<longma> |
1.35.0-wmf.21 was branched at ed65726f0dcaf2b163ba44426d5e780bc7f8895d for T233869 |
[production] |
| 19:20 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
| 19:20 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
| 18:03 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Decrease the reads for term store for clients back to Q2Mio (T219123)]], take II (duration: 00m 56s) |
[production] |
| 18:01 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Decrease the reads for term store for clients back to Q2Mio (T219123)]] (duration: 00m 56s) |
[production] |
| 18:00 |
<jynus@cumin1001> |
dbctl commit (dc=all): 'increase s8 special replica weight', diff saved to https://phabricator.wikimedia.org/P10520 and previous config saved to /var/cache/conftool/dbconfig/20200225-180016-jynus.json |
[production] |
| 17:21 |
<jynus@cumin1001> |
dbctl commit (dc=all): 'increase es1019 load to 50% T243963', diff saved to https://phabricator.wikimedia.org/P10519 and previous config saved to /var/cache/conftool/dbconfig/20200225-172133-jynus.json |
[production] |
| 17:15 |
<vgutierrez> |
restart ats-tls on cp1075 - T244538 |
[production] |
| 17:10 |
<ejegg> |
restarted new Ingenico recurring donation charge job |
[production] |
| 17:02 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q6Mio (T219123)]], take II (duration: 00m 55s) |
[production] |
| 17:01 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
| 17:01 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
| 17:01 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
| 17:01 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
| 17:00 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q6Mio (T219123)]] (duration: 00m 56s) |
[production] |
| 16:45 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
| 16:38 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q4Mio (T219123)]], take II (duration: 00m 56s) |
[production] |
| 16:36 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q4Mio (T219123)]] (duration: 00m 56s) |
[production] |
| 16:25 |
<vgutierrez> |
enable BGP in lvs2009 - T196560 T245984 |
[production] |
| 16:17 |
<godog> |
restart debmonitor / puppetboard - T245512 |
[production] |
| 16:17 |
<moritzm> |
installing pillow security updates |
[production] |
| 16:09 |
<vgutierrez> |
update puppet compiler facts |
[production] |
| 16:08 |
<XioNoX> |
add BGP to lvs2009 on cr1/2-codfw |
[production] |
| 16:02 |
<jynus@cumin1001> |
dbctl commit (dc=all): 'repool es1019 with low load after maintenance T243963', diff saved to https://phabricator.wikimedia.org/P10516 and previous config saved to /var/cache/conftool/dbconfig/20200225-160215-jynus.json |
[production] |
| 16:00 |
<ejegg> |
restarted legacy Ingenico recurring donation charge job |
[production] |
| 15:59 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q2Mio (T219123)]], take II (duration: 00m 55s) |
[production] |
| 15:58 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 15:58 |
<ejegg> |
updated Fundraising CiviCRM from 88c72e39ca to bec2d6ad9f |
[production] |
| 15:58 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q2Mio (T219123)]] (duration: 00m 56s) |
[production] |
| 15:56 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |