|
2019-05-29
ยง
|
| 17:44 |
<XioNoX> |
enable cr1-codfw:et-0/0/1 - T224511 |
[production] |
| 17:13 |
<XioNoX> |
enable cr1-codfw:et-0/0/0 - T224511 |
[production] |
| 17:02 |
<urbanecm@deploy1001> |
Synchronized wmf-config/CommonSettings.php: [[:gerrit:501926|Change arwiki default user preferences]], part 3/3 (T220186) (duration: 00m 56s) |
[production] |
| 17:00 |
<urbanecm@deploy1001> |
Synchronized wmf-config/flaggedrevs.php: [[:gerrit:501926|Change arwiki default user preferences]], part 2/3 (T220186) (duration: 00m 56s) |
[production] |
| 16:59 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:501926|Change arwiki default user preferences]], part 1/3 (T220186) (duration: 00m 56s) |
[production] |
| 16:48 |
<sbisson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:512942]] Revert: Hardcode korean help desk config (duration: 00m 56s) |
[production] |
| 16:45 |
<sbisson@deploy1001> |
Synchronized php-1.34.0-wmf.7/extensions/GrowthExperiments/includes/HelpPanel.php: SWAT: [[gerrit:512941]] Prevent parsing of GEHelpPanelHelpDeskTitle from accessing the session (duration: 00m 56s) |
[production] |
| 16:42 |
<sbisson@deploy1001> |
Synchronized php-1.34.0-wmf.6/extensions/GrowthExperiments/includes/HelpPanel.php: SWAT: [[gerrit:512940]] Prevent parsing of GEHelpPanelHelpDeskTitle from accessing the session (duration: 01m 00s) |
[production] |
| 16:32 |
<sbisson@deploy1001> |
Synchronized php-1.34.0-wmf.6/extensions/GrowthExperiments/includes/HelpPanel/QuestionRecord.php: SWAT: [[gerrit:512950]] Revert: Fix phan job: ignore line using JsonSerializable (duration: 00m 57s) |
[production] |
| 16:08 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=0) |
[production] |
| 15:55 |
<jynus> |
upgrade and restart db2087 |
[production] |
| 15:11 |
<moritzm> |
draining ganeti2008 for eventual reboot to pick up MDS-enabled kernel |
[production] |
| 15:06 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 15:06 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:06 |
<anomie@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Setting actor migration to write-new/read-new on group 1 (T188327) (duration: 00m 57s) |
[production] |
| 14:54 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:54 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:54 |
<moritzm> |
draining ganeti2007 for eventual reboot to pick up MDS-enabled kernel |
[production] |
| 14:51 |
<XioNoX> |
`request chassis fpc online slot 0` on cr1-codfw - T224511 |
[production] |
| 14:48 |
<XioNoX> |
`request chassis fpc offline slot 0` on cr1-codfw - T224511 |
[production] |
| 14:47 |
<XioNoX> |
disable et- interfaces on cr1-codfw - T224511 |
[production] |
| 14:45 |
<andrewbogott> |
reimaging cloudcontrol1003 T221770 |
[production] |
| 14:34 |
<moritzm> |
draining ganeti2006 for eventual reboot to pick up MDS-enabled kernel |
[production] |
| 14:34 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:34 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:32 |
<andrewbogott> |
powering off cloudcontrol1003 as one last check to see what explodes before I reimage it |
[production] |
| 14:30 |
<_joe_> |
installing the new service checker on restbase in eqiad |
[production] |
| 14:29 |
<_joe_> |
installing new service checker version on restbase in codfw |
[production] |
| 14:20 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:20 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:09 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:09 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:01 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:01 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:58 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.rolling-reboot |
[production] |
| 13:58 |
<gehel@cumin1001> |
END (ERROR) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=97) |
[production] |
| 13:54 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:54 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:48 |
<urandom> |
decommissioning restbase1015-c -- T223976 |
[production] |
| 13:35 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:35 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:19 |
<zfilipin@deploy1001> |
Synchronized php: group1 wikis to 1.34.0-wmf.7 (duration: 00m 58s) |
[production] |
| 13:18 |
<zfilipin@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.34.0-wmf.7 |
[production] |
| 13:16 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:16 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:12 |
<Urbanecm> |
mwscript emptyUserGroup.php --wiki=fawiki 'uploader' finished (T221441) |
[production] |
| 13:06 |
<andrewbogott> |
stopping openstack services on cloudcontrol1003 in anticipation of a re-image |
[production] |
| 13:03 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.rolling-reboot |
[production] |
| 13:02 |
<gehel@cumin1001> |
END (ERROR) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=97) |
[production] |
| 13:02 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.force-shard-allocation (exit_code=0) |
[production] |