2020-02-25
ยง
|
19:39 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
19:31 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
19:30 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
19:26 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
19:26 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
19:23 |
<longma> |
1.35.0-wmf.21 was branched at ed65726f0dcaf2b163ba44426d5e780bc7f8895d for T233869 |
[production] |
19:20 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
19:20 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
18:03 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Decrease the reads for term store for clients back to Q2Mio (T219123)]], take II (duration: 00m 56s) |
[production] |
18:01 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Decrease the reads for term store for clients back to Q2Mio (T219123)]] (duration: 00m 56s) |
[production] |
18:00 |
<jynus@cumin1001> |
dbctl commit (dc=all): 'increase s8 special replica weight', diff saved to https://phabricator.wikimedia.org/P10520 and previous config saved to /var/cache/conftool/dbconfig/20200225-180016-jynus.json |
[production] |
17:21 |
<jynus@cumin1001> |
dbctl commit (dc=all): 'increase es1019 load to 50% T243963', diff saved to https://phabricator.wikimedia.org/P10519 and previous config saved to /var/cache/conftool/dbconfig/20200225-172133-jynus.json |
[production] |
17:15 |
<vgutierrez> |
restart ats-tls on cp1075 - T244538 |
[production] |
17:10 |
<ejegg> |
restarted new Ingenico recurring donation charge job |
[production] |
17:02 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q6Mio (T219123)]], take II (duration: 00m 55s) |
[production] |
17:01 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
17:01 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
17:01 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
17:01 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
17:00 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q6Mio (T219123)]] (duration: 00m 56s) |
[production] |
16:45 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
16:38 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q4Mio (T219123)]], take II (duration: 00m 56s) |
[production] |
16:36 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q4Mio (T219123)]] (duration: 00m 56s) |
[production] |
16:25 |
<vgutierrez> |
enable BGP in lvs2009 - T196560 T245984 |
[production] |
16:17 |
<godog> |
restart debmonitor / puppetboard - T245512 |
[production] |
16:17 |
<moritzm> |
installing pillow security updates |
[production] |
16:09 |
<vgutierrez> |
update puppet compiler facts |
[production] |
16:08 |
<XioNoX> |
add BGP to lvs2009 on cr1/2-codfw |
[production] |
16:02 |
<jynus@cumin1001> |
dbctl commit (dc=all): 'repool es1019 with low load after maintenance T243963', diff saved to https://phabricator.wikimedia.org/P10516 and previous config saved to /var/cache/conftool/dbconfig/20200225-160215-jynus.json |
[production] |
16:00 |
<ejegg> |
restarted legacy Ingenico recurring donation charge job |
[production] |
15:59 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q2Mio (T219123)]], take II (duration: 00m 55s) |
[production] |
15:58 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
15:58 |
<ejegg> |
updated Fundraising CiviCRM from 88c72e39ca to bec2d6ad9f |
[production] |
15:58 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q2Mio (T219123)]] (duration: 00m 56s) |
[production] |
15:56 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
15:36 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q1Mio (T219123)]], take II (duration: 00m 55s) |
[production] |
15:34 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q1Mio (T219123)]] (duration: 00m 56s) |
[production] |
15:16 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q512K (T219123)]], take II (duration: 00m 55s) |
[production] |
15:15 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q512K (T219123)]] (duration: 00m 56s) |
[production] |
15:06 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q256K (T219123)]], take II (duration: 00m 55s) |
[production] |
15:02 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q256K (T219123)]] (duration: 00m 56s) |
[production] |
14:46 |
<godog> |
roll restart netbox uwsgi - T245511 |
[production] |
14:40 |
<akosiaris@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . |
[production] |
14:39 |
<bblack@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
14:39 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . |
[production] |
14:39 |
<akosiaris@deploy1001> |
helmfile [CODFW] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . |
[production] |
14:37 |
<bblack@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
14:35 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.20/extensions/Wikibase/lib: [[gerrit:574746|wbterms: only select entity terms that are requested (T246005)]] (duration: 01m 02s) |
[production] |
14:30 |
<vgutierrez> |
restart pybal with BGP enabled on lvs2010 - T245984 T196560 |
[production] |
14:20 |
<vgutierrez> |
update puppet compiler facts |
[production] |