|
2020-03-31
§
|
| 06:47 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1103:3314 for schema change', diff saved to https://phabricator.wikimedia.org/P10825 and previous config saved to /var/cache/conftool/dbconfig/20200331-064707-marostegui.json |
[production] |
| 06:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1097:3314 after schema change', diff saved to https://phabricator.wikimedia.org/P10824 and previous config saved to /var/cache/conftool/dbconfig/20200331-064627-marostegui.json |
[production] |
| 05:55 |
<marostegui> |
Drop nova and nova_api from m5 master (db1133) - T248313 |
[production] |
| 05:55 |
<kart_> |
Updated cxserver to 2020-03-30-145349-production (T248578) |
[production] |
| 05:55 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 05:54 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 05:53 |
<vgutierrez> |
depool && decommission cp2007 - T248941 |
[production] |
| 05:51 |
<kartik@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . |
[production] |
| 05:48 |
<kartik@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . |
[production] |
| 05:46 |
<vgutierrez@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 05:46 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 05:46 |
<kartik@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . |
[production] |
| 05:26 |
<marostegui> |
Deploy schema change on db1097:3314 |
[production] |
| 05:13 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1097:3314 for schema change', diff saved to https://phabricator.wikimedia.org/P10822 and previous config saved to /var/cache/conftool/dbconfig/20200331-051354-marostegui.json |
[production] |
| 00:26 |
<eileen> |
civicrm revision changed from cf2e2c11c3 to 524b162174, config revision is 708198a154 |
[production] |
|
2020-03-30
§
|
| 23:30 |
<cdanis> |
cr3-esams: commit flex-flow-sizing T248394 |
[production] |
| 23:20 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 00m 58s) |
[production] |
| 23:19 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Alphabetize wikis in each GrowthExperiments settings (duration: 00m 58s) |
[production] |
| 23:16 |
<cdanis> |
cr2-esams: commit flex-flow-sizing T248394 |
[production] |
| 23:08 |
<cdanis> |
cdanis@cr3-knams# commit comment "sensible flow table sizes T248394" |
[production] |
| 22:56 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 00m 58s) |
[production] |
| 22:53 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Provide wmgSiteLogoIcon (duration: 00m 57s) |
[production] |
| 22:52 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Set wmgSiteLogoIcon for each project family and four special wikis (duration: 00m 58s) |
[production] |
| 22:50 |
<jforrester@deploy1001> |
Synchronized wmf-config/mobile.php: Set wgMobileFrontendLogo from wgLogos['icon'] if set (duration: 00m 59s) |
[production] |
| 22:37 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 00m 57s) |
[production] |
| 22:36 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Split wgLogos setting into wmgSiteLogo1x etc. (duration: 00m 59s) |
[production] |
| 22:33 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Construct wgLogos in CommonSettings so that projects can inherit values (duration: 01m 02s) |
[production] |
| 19:55 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 19:55 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:36 |
<ejegg> |
updated payments listener (standalone SmashPig) from dc0c6b208b to d80e4c5abd |
[production] |
| 15:32 |
<vgutierrez> |
pool cp2033 - T248816 |
[production] |
| 15:25 |
<jeh> |
add icinga 2h downtime and soft reset iDRAC on labstore1005.mgmt.eqiad.wmnet T247965 |
[production] |
| 14:58 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:57 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 14:57 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 14:55 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:53 |
<vgutierrez> |
depool & decommission cp2008 - T248864 |
[production] |
| 14:23 |
<vgutierrez> |
pool cp2032 - T248816 |
[production] |
| 14:17 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 14:17 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 14:01 |
<vgutierrez> |
depool & decommission cp2006 - T248856 |
[production] |
| 13:57 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:45 |
<vgutierrez> |
pool cp2031 - T248816 |
[production] |
| 13:09 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:07 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) |
[production] |
| 13:07 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 13:06 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:56 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 12:56 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 12:53 |
<vgutierrez> |
depool & decommission cp2005 - T248848 |
[production] |