251-300 of 10000 results (52ms)
2019-09-19 ยง
17:55 <mutante> puppetmaster1001 - add mcrouter cert for mw1298.eqiad.wmnet (T192457) [production]
17:52 <@> helmfile [STAGING] Ran 'apply' command on namespace 'wikifeeds' for release 'staging' . [production]
17:48 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.23/extensions/AbuseFilter/includes/: T156095, 32cf50453cd (duration: 01m 04s) [production]
17:47 <arlolra@deploy1001> Finished deploy [parsoid/deploy@77630c5]: Updating Parsoid to 6bf23c2 (duration: 08m 52s) [production]
17:43 <Krinkle> Move whisper/MediaWiki/wanobjectcache/revision_row_1/29 to whisper/MediaWiki/wanobjectcache/revision_row_1_29 on graphite1004 and graphite2003 (T232907) [production]
17:38 <arlolra@deploy1001> Started deploy [parsoid/deploy@77630c5]: Updating Parsoid to 6bf23c2 [production]
17:27 <bblack> lvs2006 - restart pybal for deploy/test of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/536324/ [production]
17:27 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.23/includes/libs/objectcache/wancache: 2e910c9d3f8c04f7db, T232907 (duration: 01m 03s) [production]
17:23 <bblack> lvs2005 - restart pybal for deploy/test of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/536324/ [production]
17:19 <bblack> lvs2006 - restart pybal for deploy/test of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/536324/ [production]
17:16 <bblack> lvs200[456] - puppet disabled for https://gerrit.wikimedia.org/r/536324 deploy/test [production]
17:14 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@69b3737]: Update mobileapps to cfc3062 (duration: 05m 42s) [production]
17:08 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@69b3737]: Update mobileapps to cfc3062 [production]
16:31 <_joe_> removed manually the purge_checkuser cron from mwmaint1002, to have puppet recreate it [production]
16:20 <ejegg> updated fundraising CiviCRM from 90db6cb5a1 to 5def62ab05 [production]
16:15 <papaul> shutting down scs-a1-codfw for replacement [production]
15:26 <moritzm> repooling restbase2012 after completed Cassandra bootstrap T224553 [production]
15:25 <jmm@puppetmaster1001> conftool action : set/pooled=no; selector: cluster=restbase,service=cassandra,dc=codfw,name=restbase2012.codfw.wmnet [production]
15:25 <jmm@puppetmaster1001> conftool action : set/pooled=yes; selector: cluster=restbase,service=restbase-backend,dc=codfw,name=restbase2012.codfw.wmnet [production]
15:25 <jmm@puppetmaster1001> conftool action : set/pooled=yes; selector: cluster=restbase,service=restbase-ssl,dc=codfw,name=restbase2012.codfw.wmnet [production]
15:25 <jmm@puppetmaster1001> conftool action : set/pooled=yes; selector: cluster=restbase,service=restbase,dc=codfw,name=restbase2012.codfw.wmnet [production]
15:06 <jmm@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) [production]
15:05 <jmm@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:56 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@16a6af1]: Increase num_workers to (ncpu * 1.5) (T229286) (duration: 05m 39s) [production]
14:51 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@16a6af1]: Increase num_workers to (ncpu * 1.5) (T229286) [production]
14:47 <mobrovac@deploy1001> Finished deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #3 (duration: 10m 42s) [production]
14:37 <mobrovac@deploy1001> Started deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #3 [production]
14:36 <mobrovac@deploy1001> Finished deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #2 (duration: 08m 24s) [production]
14:31 <mobrovac> bootstrap restbase2012-c -- T224553 [production]
14:28 <mobrovac@deploy1001> Started deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #2 [production]
14:28 <mobrovac@deploy1001> deploy aborted: Remove the TID suffix in the ETag, if present - T230272 (duration: 11m 20s) [production]
14:28 <sbassett> Deployed security patch for T224203 (php-1.34.0-wmf.23) [production]
14:19 <sbassett> Deployed security patch for T224203 [production]
14:19 <jmm@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) [production]
14:18 <jmm@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:16 <mobrovac@deploy1001> Started deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present - T230272 [production]
13:54 <mholloway-shell@deploy1001> Finished deploy [recommendation-api/deploy@c8abb0f]: Article recommendation API: replace WDQS with MW API (T216750) (duration: 03m 06s) [production]
13:51 <mholloway-shell@deploy1001> Started deploy [recommendation-api/deploy@c8abb0f]: Article recommendation API: replace WDQS with MW API (T216750) [production]
13:43 <reedy@deploy1001> Synchronized php-1.34.0-wmf.23/extensions/Translate: T233308 (duration: 01m 07s) [production]
13:14 <moritzm> powercycling mw1300 [production]
13:12 <mobrovac> bootstrap restbase2012-b -- T224553 [production]
13:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1089 into contributions service T223151', diff saved to https://phabricator.wikimedia.org/P9133 and previous config saved to /var/cache/conftool/dbconfig/20190919-130848-marostegui.json [production]
13:01 <mobrovac@deploy1001> Finished deploy [restbase/deploy@7f4b7f7]: Start using RESTBase built on Stretch - T224553 (duration: 21m 38s) [production]
12:39 <mobrovac@deploy1001> Started deploy [restbase/deploy@7f4b7f7]: Start using RESTBase built on Stretch - T224553 [production]
12:36 <@> helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . [production]
11:48 <mobrovac> bootstrap restbase2012-a -- T224553 [production]
11:32 <Urbanecm> EU SWAT done [production]
11:26 <urbanecm@deploy1001> Synchronized wmf-config/throttle.php: SWAT: 199a05c: Add new throttle rule for Czech wiki course (T233199) (duration: 01m 01s) [production]
11:23 <urbanecm@deploy1001> Synchronized wmf-config/VariantSettings.php: SWAT: eab7c6a: c80f026: GrowthExperiments: GrowthExperiments: Enable Special:Homepage for euwiki, GrowthExperiments: Enable help panel for euwiki (T233066, T233065) (duration: 01m 05s) [production]
09:54 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.22/extensions/CheckUser: security T207094 (duration: 01m 02s) [production]