|
2019-09-19
ยง
|
| 16:15 |
<papaul> |
shutting down scs-a1-codfw for replacement |
[production] |
| 15:26 |
<moritzm> |
repooling restbase2012 after completed Cassandra bootstrap T224553 |
[production] |
| 15:25 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=no; selector: cluster=restbase,service=cassandra,dc=codfw,name=restbase2012.codfw.wmnet |
[production] |
| 15:25 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=yes; selector: cluster=restbase,service=restbase-backend,dc=codfw,name=restbase2012.codfw.wmnet |
[production] |
| 15:25 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=yes; selector: cluster=restbase,service=restbase-ssl,dc=codfw,name=restbase2012.codfw.wmnet |
[production] |
| 15:25 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=yes; selector: cluster=restbase,service=restbase,dc=codfw,name=restbase2012.codfw.wmnet |
[production] |
| 15:06 |
<jmm@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
| 15:05 |
<jmm@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 14:56 |
<mholloway-shell@deploy1001> |
Finished deploy [mobileapps/deploy@16a6af1]: Increase num_workers to (ncpu * 1.5) (T229286) (duration: 05m 39s) |
[production] |
| 14:51 |
<mholloway-shell@deploy1001> |
Started deploy [mobileapps/deploy@16a6af1]: Increase num_workers to (ncpu * 1.5) (T229286) |
[production] |
| 14:47 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #3 (duration: 10m 42s) |
[production] |
| 14:37 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #3 |
[production] |
| 14:36 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #2 (duration: 08m 24s) |
[production] |
| 14:31 |
<mobrovac> |
bootstrap restbase2012-c -- T224553 |
[production] |
| 14:28 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #2 |
[production] |
| 14:28 |
<mobrovac@deploy1001> |
deploy aborted: Remove the TID suffix in the ETag, if present - T230272 (duration: 11m 20s) |
[production] |
| 14:28 |
<sbassett> |
Deployed security patch for T224203 (php-1.34.0-wmf.23) |
[production] |
| 14:19 |
<sbassett> |
Deployed security patch for T224203 |
[production] |
| 14:19 |
<jmm@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
| 14:18 |
<jmm@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 14:16 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present - T230272 |
[production] |
| 13:54 |
<mholloway-shell@deploy1001> |
Finished deploy [recommendation-api/deploy@c8abb0f]: Article recommendation API: replace WDQS with MW API (T216750) (duration: 03m 06s) |
[production] |
| 13:51 |
<mholloway-shell@deploy1001> |
Started deploy [recommendation-api/deploy@c8abb0f]: Article recommendation API: replace WDQS with MW API (T216750) |
[production] |
| 13:43 |
<reedy@deploy1001> |
Synchronized php-1.34.0-wmf.23/extensions/Translate: T233308 (duration: 01m 07s) |
[production] |
| 13:14 |
<moritzm> |
powercycling mw1300 |
[production] |
| 13:12 |
<mobrovac> |
bootstrap restbase2012-b -- T224553 |
[production] |
| 13:08 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Pool db1089 into contributions service T223151', diff saved to https://phabricator.wikimedia.org/P9133 and previous config saved to /var/cache/conftool/dbconfig/20190919-130848-marostegui.json |
[production] |
| 13:01 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@7f4b7f7]: Start using RESTBase built on Stretch - T224553 (duration: 21m 38s) |
[production] |
| 12:39 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@7f4b7f7]: Start using RESTBase built on Stretch - T224553 |
[production] |
| 12:36 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 11:48 |
<mobrovac> |
bootstrap restbase2012-a -- T224553 |
[production] |
| 11:32 |
<Urbanecm> |
EU SWAT done |
[production] |
| 11:26 |
<urbanecm@deploy1001> |
Synchronized wmf-config/throttle.php: SWAT: 199a05c: Add new throttle rule for Czech wiki course (T233199) (duration: 01m 01s) |
[production] |
| 11:23 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: eab7c6a: c80f026: GrowthExperiments: GrowthExperiments: Enable Special:Homepage for euwiki, GrowthExperiments: Enable help panel for euwiki (T233066, T233065) (duration: 01m 05s) |
[production] |
| 09:54 |
<urbanecm@deploy1001> |
Synchronized php-1.34.0-wmf.22/extensions/CheckUser: security T207094 (duration: 01m 02s) |
[production] |
| 09:53 |
<urbanecm@deploy1001> |
sync-file aborted: security T207094 (duration: 00m 28s) |
[production] |
| 09:51 |
<urbanecm@deploy1001> |
Synchronized php-1.34.0-wmf.23/extensions/CheckUser: security T207094 (duration: 01m 05s) |
[production] |
| 09:22 |
<godog> |
power back on ms-be1027, found with power off |
[production] |
| 08:31 |
<urbanecm@deploy1001> |
Synchronized wmf-config/abusefilter.php: 393441b: Change configuration of AbuseFilter extension for enwikisource (T231750) (duration: 01m 04s) |
[production] |
| 08:22 |
<jynus@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 08:21 |
<urbanecm@deploy1001> |
Synchronized php-1.34.0-wmf.23/extensions/CheckUser/: revert T207094 (duration: 01m 04s) |
[production] |
| 08:20 |
<jynus@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 08:14 |
<urbanecm@deploy1001> |
Synchronized php-1.34.0-wmf.23/extensions/CheckUser/: security T207094 (duration: 01m 06s) |
[production] |
| 08:11 |
<marostegui> |
Rename tables on db1133:labspuppet T233281 |
[production] |
| 07:48 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 07:48 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 07:40 |
<moritzm> |
rebooting failoid1001 for kernel update |
[production] |
| 07:39 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 07:39 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 07:29 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |