|
2021-10-21
§
|
| 11:55 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 9 hosts with reason: Schema change s5 T278619 |
[production] |
| 11:54 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on 9 hosts with reason: Schema change s5 T278619 |
[production] |
| 11:47 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 9 hosts with reason: Schema change s6 T278619 |
[production] |
| 11:47 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on 9 hosts with reason: Schema change s6 T278619 |
[production] |
| 11:13 |
<Lucas_WMDE> |
UTC morning backport+config window done |
[production] |
| 11:10 |
<Lucas_WMDE> |
lucaswerkmeister-wmde@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/ResubmitChanges.php wikidatawiki --minimum-age $((60*60*12)) # T294008 |
[production] |
| 11:10 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:07 |
<jgiannelos@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:730848|Configure event stream for map tiles state change (T289771)]] (duration: 01m 04s) |
[production] |
| 11:07 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 10:48 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 10:48 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 10:48 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 10:47 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 10:14 |
<jbond> |
mergeing refactor of P:base Gerrit:714975 |
[production] |
| 09:54 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 09:49 |
<ayounsi@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 08:56 |
<urbanecm@deploy1002> |
Synchronized private/PrivateSettings.php: Update T250887 mitigations (duration: 01m 03s) |
[production] |
| 08:33 |
<ema@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=cp3062.esams.wmnet,service=(varnish-fe|ats-tls) |
[production] |
| 08:26 |
<ema@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp3062.esams.wmnet,service=(varnish-fe|ats-tls) |
[production] |
| 08:25 |
<ema> |
cp3062: revert vsl_space experiment T293879 |
[production] |
| 08:24 |
<filippo@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host graphite1004.eqiad.wmnet with OS bullseye |
[production] |
| 08:03 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1118 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P17563 and previous config saved to /var/cache/conftool/dbconfig/20211021-080330-root.json |
[production] |
| 07:56 |
<filippo@cumin1001> |
START - Cookbook sre.hosts.reimage for host graphite1004.eqiad.wmnet with OS bullseye |
[production] |
| 07:48 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1118 (re)pooling @ 75%: After upgrade', diff saved to https://phabricator.wikimedia.org/P17562 and previous config saved to /var/cache/conftool/dbconfig/20211021-074826-root.json |
[production] |
| 07:33 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1118 (re)pooling @ 50%: After upgrade', diff saved to https://phabricator.wikimedia.org/P17561 and previous config saved to /var/cache/conftool/dbconfig/20211021-073323-root.json |
[production] |
| 07:18 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1118 (re)pooling @ 25%: After upgrade', diff saved to https://phabricator.wikimedia.org/P17560 and previous config saved to /var/cache/conftool/dbconfig/20211021-071819-root.json |
[production] |
| 07:03 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1118 (re)pooling @ 10%: After upgrade', diff saved to https://phabricator.wikimedia.org/P17559 and previous config saved to /var/cache/conftool/dbconfig/20211021-070315-root.json |
[production] |
| 06:48 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1118 (re)pooling @ 5%: After upgrade', diff saved to https://phabricator.wikimedia.org/P17558 and previous config saved to /var/cache/conftool/dbconfig/20211021-064812-root.json |
[production] |
| 06:35 |
<elukey> |
`systemctl reload nginx` on cloudelastic100[5,6] to pick up the new TLS certificate and clear alerts - T293826 |
[production] |
| 04:47 |
<marostegui> |
Deploy schema change on s5 codfw - T291719 |
[production] |
| 04:37 |
<marostegui> |
Deploy schema change on s6 codfw - T291719 |
[production] |
| 04:04 |
<legoktm> |
restarted apache on lists1001 so it only uses new TLS cert (T293826) |
[production] |
| 03:29 |
<eileen> |
civicrm revision changed from e889831012 to 733a8fceda, config revision is eed79486d5 |
[production] |
| 00:06 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 00:01 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
|
2021-10-20
§
|
| 23:56 |
<thcipriani@deploy1002> |
Finished scap: Backport: [[gerrit:732336|Restore title to mobile skin without logo (T290525)]] (duration: 11m 41s) |
[production] |
| 23:44 |
<thcipriani@deploy1002> |
Started scap: Backport: [[gerrit:732336|Restore title to mobile skin without logo (T290525)]] |
[production] |
| 23:42 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 23:39 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 23:30 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 23:29 |
<tstarling@deploy1002> |
Synchronized wmf-config/CommonSettings.php: fawiki require login for creation of pages in the draft namespace T291018 (duration: 01m 02s) |
[production] |
| 23:27 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 23:27 |
<tstarling@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: fawiki require login to edit main namespace T291018 (duration: 01m 04s) |
[production] |
| 22:13 |
<dancy@deploy1002> |
Synchronized README: testing (4/4) (duration: 02m 52s) |
[production] |
| 22:00 |
<dancy@deploy1002> |
Synchronized README: testing (3/4) (duration: 02m 57s) |
[production] |
| 21:54 |
<dancy@deploy1002> |
Synchronized README: testing (2) (duration: 01m 02s) |
[production] |
| 21:52 |
<dancy@deploy1002> |
Synchronized README: (no justification provided) (duration: 01m 03s) |
[production] |
| 21:50 |
<dancy> |
Testing a series of one-file scap sync-file runs |
[production] |
| 21:22 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 21:19 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |