101-150 of 10000 results (34ms)
2019-09-19 ยง
15:25 <jmm@puppetmaster1001> conftool action : set/pooled=yes; selector: cluster=restbase,service=restbase,dc=codfw,name=restbase2012.codfw.wmnet [production]
15:06 <jmm@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) [production]
15:05 <jmm@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:56 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@16a6af1]: Increase num_workers to (ncpu * 1.5) (T229286) (duration: 05m 39s) [production]
14:51 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@16a6af1]: Increase num_workers to (ncpu * 1.5) (T229286) [production]
14:47 <mobrovac@deploy1001> Finished deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #3 (duration: 10m 42s) [production]
14:37 <mobrovac@deploy1001> Started deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #3 [production]
14:36 <mobrovac@deploy1001> Finished deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #2 (duration: 08m 24s) [production]
14:31 <mobrovac> bootstrap restbase2012-c -- T224553 [production]
14:28 <mobrovac@deploy1001> Started deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #2 [production]
14:28 <mobrovac@deploy1001> deploy aborted: Remove the TID suffix in the ETag, if present - T230272 (duration: 11m 20s) [production]
14:28 <sbassett> Deployed security patch for T224203 (php-1.34.0-wmf.23) [production]
14:19 <sbassett> Deployed security patch for T224203 [production]
14:19 <jmm@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) [production]
14:18 <jmm@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:16 <mobrovac@deploy1001> Started deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present - T230272 [production]
13:54 <mholloway-shell@deploy1001> Finished deploy [recommendation-api/deploy@c8abb0f]: Article recommendation API: replace WDQS with MW API (T216750) (duration: 03m 06s) [production]
13:51 <mholloway-shell@deploy1001> Started deploy [recommendation-api/deploy@c8abb0f]: Article recommendation API: replace WDQS with MW API (T216750) [production]
13:43 <reedy@deploy1001> Synchronized php-1.34.0-wmf.23/extensions/Translate: T233308 (duration: 01m 07s) [production]
13:14 <moritzm> powercycling mw1300 [production]
13:12 <mobrovac> bootstrap restbase2012-b -- T224553 [production]
13:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1089 into contributions service T223151', diff saved to https://phabricator.wikimedia.org/P9133 and previous config saved to /var/cache/conftool/dbconfig/20190919-130848-marostegui.json [production]
13:01 <mobrovac@deploy1001> Finished deploy [restbase/deploy@7f4b7f7]: Start using RESTBase built on Stretch - T224553 (duration: 21m 38s) [production]
12:39 <mobrovac@deploy1001> Started deploy [restbase/deploy@7f4b7f7]: Start using RESTBase built on Stretch - T224553 [production]
12:36 <@> helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . [production]
11:48 <mobrovac> bootstrap restbase2012-a -- T224553 [production]
11:32 <Urbanecm> EU SWAT done [production]
11:26 <urbanecm@deploy1001> Synchronized wmf-config/throttle.php: SWAT: 199a05c: Add new throttle rule for Czech wiki course (T233199) (duration: 01m 01s) [production]
11:23 <urbanecm@deploy1001> Synchronized wmf-config/VariantSettings.php: SWAT: eab7c6a: c80f026: GrowthExperiments: GrowthExperiments: Enable Special:Homepage for euwiki, GrowthExperiments: Enable help panel for euwiki (T233066, T233065) (duration: 01m 05s) [production]
09:54 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.22/extensions/CheckUser: security T207094 (duration: 01m 02s) [production]
09:53 <urbanecm@deploy1001> sync-file aborted: security T207094 (duration: 00m 28s) [production]
09:51 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.23/extensions/CheckUser: security T207094 (duration: 01m 05s) [production]
09:22 <godog> power back on ms-be1027, found with power off [production]
08:31 <urbanecm@deploy1001> Synchronized wmf-config/abusefilter.php: 393441b: Change configuration of AbuseFilter extension for enwikisource (T231750) (duration: 01m 04s) [production]
08:22 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:21 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.23/extensions/CheckUser/: revert T207094 (duration: 01m 04s) [production]
08:20 <jynus@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:14 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.23/extensions/CheckUser/: security T207094 (duration: 01m 06s) [production]
08:11 <marostegui> Rename tables on db1133:labspuppet T233281 [production]
07:48 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:48 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
07:40 <moritzm> rebooting failoid1001 for kernel update [production]
07:39 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:39 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
07:29 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:27 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
07:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Give more logpager weight to db1089 T223151', diff saved to https://phabricator.wikimedia.org/P9131 and previous config saved to /var/cache/conftool/dbconfig/20190919-072234-marostegui.json [production]
07:01 <moritzm> reimaging restbase2012 to stretch T224553 [production]
06:18 <marostegui> Sanitize hiwikisource on db1124:3313 and db2094:3313 T219374 [production]
06:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Temporarily pool db1089 into enwiki logpager T223151', diff saved to https://phabricator.wikimedia.org/P9130 and previous config saved to /var/cache/conftool/dbconfig/20190919-060440-marostegui.json [production]