201-250 of 10000 results (54ms)
2020-03-26 §
12:19 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1096:3315 for schema change', diff saved to https://phabricator.wikimedia.org/P10782 and previous config saved to /var/cache/conftool/dbconfig/20200326-121859-marostegui.json [production]
11:38 <awight> EU SWAT done [production]
11:37 <awight@deploy1001> Synchronized php-1.35.0-wmf.25/extensions/TwoColConflict: SWAT: [[gerrit:583576|Two hotfixes for guided tour (T248465)]] (duration: 01m 07s) [production]
11:25 <mutante> sodium - running ftpsync to get Debian mirror in sync [production]
11:23 <dcausse@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T231517: [cirrus] force cloudelastic replica count to 1 (duration: 01m 05s) [production]
11:21 <dcausse@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T231517: [cirrus] force cloudelastic replica count to 1 (duration: 01m 06s) [production]
11:12 <urbanecm@deploy1001> Synchronized php-1.35.0-wmf.25/extensions/ContentTranslation/modules/ui/mw.cx.ui.Categories.js: SWAT: 1ea6bad: Allow publishing to continue even with broken categories (T248302) (duration: 01m 07s) [production]
11:06 <urbanecm@deploy1001> Synchronized wmf-config/throttle.php: SWAT: d1bb0b1: Removed expired throttle.php entries (duration: 01m 09s) [production]
11:00 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
10:58 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
10:54 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
10:16 <XioNoX> esams/knams: advertise 185.15.58.0/23 instead of 185.15.56.0/22 - T207753 [production]
09:50 <elukey> reboot stat1008 - gpu + drivers in a weird state after multiple tests [production]
09:00 <XioNoX> push v4 conditional advertising on cr3-knams - T236785 [production]
08:44 <marostegui> Deploy schema change on s5 codfw, lag will show up on codfw - T248333 [production]
08:27 <XioNoX> troubleshot v6 conditional advertisement from cr3-knams - T236785 [production]
07:58 <XioNoX> remove BGP session to AS8001 in eqiad (down and not replying to email) [production]
07:40 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1085 after schema change', diff saved to https://phabricator.wikimedia.org/P10781 and previous config saved to /var/cache/conftool/dbconfig/20200326-074033-marostegui.json [production]
07:31 <marostegui> Deploy schema change on db1085, lag will appear on s6 on labs [production]
07:30 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1085 for schema change', diff saved to https://phabricator.wikimedia.org/P10780 and previous config saved to /var/cache/conftool/dbconfig/20200326-073048-marostegui.json [production]
07:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1093 after schema change', diff saved to https://phabricator.wikimedia.org/P10779 and previous config saved to /var/cache/conftool/dbconfig/20200326-070746-marostegui.json [production]
06:59 <marostegui> Deploy schema change on db1093 [production]
06:59 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1093 for schema change', diff saved to https://phabricator.wikimedia.org/P10778 and previous config saved to /var/cache/conftool/dbconfig/20200326-065929-marostegui.json [production]
06:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1088 after schema change', diff saved to https://phabricator.wikimedia.org/P10777 and previous config saved to /var/cache/conftool/dbconfig/20200326-065814-marostegui.json [production]
06:48 <marostegui> Deploy schema change on db1088 [production]
06:47 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1088 for schema change', diff saved to https://phabricator.wikimedia.org/P10776 and previous config saved to /var/cache/conftool/dbconfig/20200326-064748-marostegui.json [production]
06:46 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1098:3316 after schema change', diff saved to https://phabricator.wikimedia.org/P10775 and previous config saved to /var/cache/conftool/dbconfig/20200326-064648-marostegui.json [production]
06:39 <marostegui> Deploy schema change on db1098:3316 [production]
06:38 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1098:3316 for schema change', diff saved to https://phabricator.wikimedia.org/P10774 and previous config saved to /var/cache/conftool/dbconfig/20200326-063844-marostegui.json [production]
06:36 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1096:3316 after schema change', diff saved to https://phabricator.wikimedia.org/P10773 and previous config saved to /var/cache/conftool/dbconfig/20200326-063633-marostegui.json [production]
06:26 <marostegui> Deploy schema change on db1096:3316 [production]
06:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1096:3316 for schema change', diff saved to https://phabricator.wikimedia.org/P10772 and previous config saved to /var/cache/conftool/dbconfig/20200326-062631-marostegui.json [production]
06:22 <marostegui> Rename nova and nova_api tables on db1117:3325 - T248313 [production]
00:06 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable Special:Investigate on testwiki (T247645) (duration: 03m 14s) [production]
2020-03-25 §
23:49 <catrope@deploy1001> Synchronized wmf-config/CommonSettings.php: Add investigate to $wgAvailableRights (T247645) (duration: 03m 16s) [production]
23:42 <catrope@deploy1001> Synchronized php-1.35.0-wmf.25/extensions/CheckUser/: Retry because mw1251 timed out, and it is a proxy (duration: 03m 15s) [production]
23:38 <catrope@deploy1001> Synchronized php-1.35.0-wmf.25/extensions/CheckUser/: Add new investigate right (T247645) (duration: 03m 17s) [production]
22:21 <rzl@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
22:21 <rzl@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . [production]
22:16 <rzl@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
22:16 <rzl@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . [production]
22:10 <rzl@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
22:10 <rzl@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . [production]
22:05 <rzl@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
22:05 <rzl@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . [production]
22:05 <rlazarus> updating eventgate-logging-external to envoy 1.13.1 T246868 [production]
22:00 <rzl@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
22:00 <rzl@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
21:59 <ppchelko@deploy1001> Finished deploy [restbase/deploy@a1c3be4] (dev-cluster): Remove experimental PCS endpoints (duration: 02m 57s) [production]
21:56 <ppchelko@deploy1001> Started deploy [restbase/deploy@a1c3be4] (dev-cluster): Remove experimental PCS endpoints [production]