|
2020-03-26
§
|
| 12:31 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1096:3315 after schema change', diff saved to https://phabricator.wikimedia.org/P10783 and previous config saved to /var/cache/conftool/dbconfig/20200326-123157-marostegui.json |
[production] |
| 12:25 |
<mutante> |
analytics1028 - performing a puppet change on every run (all other hosts doing this were fixed just recently) |
[production] |
| 12:19 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1096:3315 for schema change', diff saved to https://phabricator.wikimedia.org/P10782 and previous config saved to /var/cache/conftool/dbconfig/20200326-121859-marostegui.json |
[production] |
| 11:38 |
<awight> |
EU SWAT done |
[production] |
| 11:37 |
<awight@deploy1001> |
Synchronized php-1.35.0-wmf.25/extensions/TwoColConflict: SWAT: [[gerrit:583576|Two hotfixes for guided tour (T248465)]] (duration: 01m 07s) |
[production] |
| 11:25 |
<mutante> |
sodium - running ftpsync to get Debian mirror in sync |
[production] |
| 11:23 |
<dcausse@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T231517: [cirrus] force cloudelastic replica count to 1 (duration: 01m 05s) |
[production] |
| 11:21 |
<dcausse@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T231517: [cirrus] force cloudelastic replica count to 1 (duration: 01m 06s) |
[production] |
| 11:12 |
<urbanecm@deploy1001> |
Synchronized php-1.35.0-wmf.25/extensions/ContentTranslation/modules/ui/mw.cx.ui.Categories.js: SWAT: 1ea6bad: Allow publishing to continue even with broken categories (T248302) (duration: 01m 07s) |
[production] |
| 11:06 |
<urbanecm@deploy1001> |
Synchronized wmf-config/throttle.php: SWAT: d1bb0b1: Removed expired throttle.php entries (duration: 01m 09s) |
[production] |
| 11:00 |
<hnowlan@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . |
[production] |
| 10:58 |
<hnowlan@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . |
[production] |
| 10:54 |
<hnowlan@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . |
[production] |
| 10:16 |
<XioNoX> |
esams/knams: advertise 185.15.58.0/23 instead of 185.15.56.0/22 - T207753 |
[production] |
| 09:50 |
<elukey> |
reboot stat1008 - gpu + drivers in a weird state after multiple tests |
[production] |
| 09:00 |
<XioNoX> |
push v4 conditional advertising on cr3-knams - T236785 |
[production] |
| 08:44 |
<marostegui> |
Deploy schema change on s5 codfw, lag will show up on codfw - T248333 |
[production] |
| 08:27 |
<XioNoX> |
troubleshot v6 conditional advertisement from cr3-knams - T236785 |
[production] |
| 07:58 |
<XioNoX> |
remove BGP session to AS8001 in eqiad (down and not replying to email) |
[production] |
| 07:40 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1085 after schema change', diff saved to https://phabricator.wikimedia.org/P10781 and previous config saved to /var/cache/conftool/dbconfig/20200326-074033-marostegui.json |
[production] |
| 07:31 |
<marostegui> |
Deploy schema change on db1085, lag will appear on s6 on labs |
[production] |
| 07:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1085 for schema change', diff saved to https://phabricator.wikimedia.org/P10780 and previous config saved to /var/cache/conftool/dbconfig/20200326-073048-marostegui.json |
[production] |
| 07:07 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1093 after schema change', diff saved to https://phabricator.wikimedia.org/P10779 and previous config saved to /var/cache/conftool/dbconfig/20200326-070746-marostegui.json |
[production] |
| 06:59 |
<marostegui> |
Deploy schema change on db1093 |
[production] |
| 06:59 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1093 for schema change', diff saved to https://phabricator.wikimedia.org/P10778 and previous config saved to /var/cache/conftool/dbconfig/20200326-065929-marostegui.json |
[production] |
| 06:58 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1088 after schema change', diff saved to https://phabricator.wikimedia.org/P10777 and previous config saved to /var/cache/conftool/dbconfig/20200326-065814-marostegui.json |
[production] |
| 06:48 |
<marostegui> |
Deploy schema change on db1088 |
[production] |
| 06:47 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1088 for schema change', diff saved to https://phabricator.wikimedia.org/P10776 and previous config saved to /var/cache/conftool/dbconfig/20200326-064748-marostegui.json |
[production] |
| 06:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1098:3316 after schema change', diff saved to https://phabricator.wikimedia.org/P10775 and previous config saved to /var/cache/conftool/dbconfig/20200326-064648-marostegui.json |
[production] |
| 06:39 |
<marostegui> |
Deploy schema change on db1098:3316 |
[production] |
| 06:38 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1098:3316 for schema change', diff saved to https://phabricator.wikimedia.org/P10774 and previous config saved to /var/cache/conftool/dbconfig/20200326-063844-marostegui.json |
[production] |
| 06:36 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1096:3316 after schema change', diff saved to https://phabricator.wikimedia.org/P10773 and previous config saved to /var/cache/conftool/dbconfig/20200326-063633-marostegui.json |
[production] |
| 06:26 |
<marostegui> |
Deploy schema change on db1096:3316 |
[production] |
| 06:26 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1096:3316 for schema change', diff saved to https://phabricator.wikimedia.org/P10772 and previous config saved to /var/cache/conftool/dbconfig/20200326-062631-marostegui.json |
[production] |
| 06:22 |
<marostegui> |
Rename nova and nova_api tables on db1117:3325 - T248313 |
[production] |
| 00:06 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Enable Special:Investigate on testwiki (T247645) (duration: 03m 14s) |
[production] |
|
2020-03-25
§
|
| 23:49 |
<catrope@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Add investigate to $wgAvailableRights (T247645) (duration: 03m 16s) |
[production] |
| 23:42 |
<catrope@deploy1001> |
Synchronized php-1.35.0-wmf.25/extensions/CheckUser/: Retry because mw1251 timed out, and it is a proxy (duration: 03m 15s) |
[production] |
| 23:38 |
<catrope@deploy1001> |
Synchronized php-1.35.0-wmf.25/extensions/CheckUser/: Add new investigate right (T247645) (duration: 03m 17s) |
[production] |
| 22:21 |
<rzl@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . |
[production] |
| 22:21 |
<rzl@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . |
[production] |
| 22:16 |
<rzl@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . |
[production] |
| 22:16 |
<rzl@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . |
[production] |
| 22:10 |
<rzl@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . |
[production] |
| 22:10 |
<rzl@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . |
[production] |
| 22:05 |
<rzl@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . |
[production] |
| 22:05 |
<rzl@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . |
[production] |
| 22:05 |
<rlazarus> |
updating eventgate-logging-external to envoy 1.13.1 T246868 |
[production] |
| 22:00 |
<rzl@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
| 22:00 |
<rzl@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |