3551-3600 of 10000 results (36ms)
2020-05-22 §
13:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1144:331[45] and db1097:331[45]', diff saved to https://phabricator.wikimedia.org/P11286 and previous config saved to /var/cache/conftool/dbconfig/20200522-131452-marostegui.json [production]
13:10 <jayme@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'termbox' for release 'production' . [production]
13:10 <jayme@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'termbox' for release 'production' . [production]
13:09 <jayme@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'staging' . [production]
13:08 <jayme@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'test' . [production]
13:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1144:3314 and db1144:3315 to the list of hosts', diff saved to https://phabricator.wikimedia.org/P11284 and previous config saved to /var/cache/conftool/dbconfig/20200522-130707-marostegui.json [production]
12:56 <vgutierrez> depool cp4032 for some ats tests [production]
12:13 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
12:12 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
12:06 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
12:04 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
12:03 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
12:03 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
10:48 <marostegui> Stop MySQL on db1097:3314, db1097:3315 to clone db1144 - T252512 [production]
10:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1097:3314, db1097:3315 - T252512', diff saved to https://phabricator.wikimedia.org/P11281 and previous config saved to /var/cache/conftool/dbconfig/20200522-104437-marostegui.json [production]
10:37 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
10:35 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
10:34 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
10:32 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
10:10 <marostegui> Stop event_scheduler on db1115 - T252331 [production]
10:09 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
10:05 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
10:05 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
10:05 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
10:00 <jbond42> update pdns-recursor on dns recursors [production]
09:43 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
09:41 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
09:22 <jayme@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'mathoid' for release 'production' . [production]
09:09 <elukey@deploy1001> Finished deploy [analytics/superset/deploy@be203c8]: Rollback superset to 0.35.2 (duration: 00m 43s) [production]
09:09 <elukey@deploy1001> Started deploy [analytics/superset/deploy@be203c8]: Rollback superset to 0.35.2 [production]
08:41 <vgutierrez> reverting hugepages experiment on cp2041 [production]
08:27 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1149 and db1081', diff saved to https://phabricator.wikimedia.org/P11278 and previous config saved to /var/cache/conftool/dbconfig/20200522-082700-marostegui.json [production]
08:18 <elukey@deploy1001> Finished deploy [analytics/superset/deploy@59ba01d]: Upgrade Superset to 0.36 (duration: 01m 01s) [production]
08:17 <elukey@deploy1001> Started deploy [analytics/superset/deploy@59ba01d]: Upgrade Superset to 0.36 [production]
08:13 <vgutierrez> test hugepages allocator on ATS in cp2041 [production]
08:06 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1149 and db1081', diff saved to https://phabricator.wikimedia.org/P11277 and previous config saved to /var/cache/conftool/dbconfig/20200522-080629-marostegui.json [production]
07:48 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1149 and db1081', diff saved to https://phabricator.wikimedia.org/P11276 and previous config saved to /var/cache/conftool/dbconfig/20200522-074853-marostegui.json [production]
07:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1149 and db1081', diff saved to https://phabricator.wikimedia.org/P11275 and previous config saved to /var/cache/conftool/dbconfig/20200522-072000-marostegui.json [production]
07:07 <elukey@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: name=druid1008.eqiad.wmnet [production]
07:04 <elukey@puppetmaster1001> conftool action : set/pooled=yes; selector: name=druid1007.eqiad.wmnet [production]
07:04 <elukey@puppetmaster1001> conftool action : set/pooled=yes; selector: name=druid1007.eqiad.wmnet [production]
04:34 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1081 - T252512', diff saved to https://phabricator.wikimedia.org/P11272 and previous config saved to /var/cache/conftool/dbconfig/20200522-043418-marostegui.json [production]
2020-05-21 §
23:58 <ejegg> updated civicrm from b658fd8233 to 6b1d5902dd [production]
23:54 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.32/includes/content/ContentHandlerFactory.php: If578893f5689 (duration: 01m 06s) [production]
23:47 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.32/extensions/LiquidThreads/classes/Thread.php: If3418cba06e (duration: 01m 07s) [production]
23:41 <krinkle@deploy1001> Synchronized wmf-config/mc.php: I222457729a5b (duration: 01m 08s) [production]
21:46 <eileen> civicrm revision changed from ed4c9522ac to b658fd8233, config revision is 9babae3954 [production]
21:10 <foks> removing two files for legal compliance [production]
20:44 <bstorm_> labstore1005 is now running stretch and drbd devices are resyncing after several reboots and some significant effort T224582 [production]
18:24 <twentyafterfour> restarting phabricator on phab1001 to deploy https://phabricator.wikimedia.org/rPHEX2687d08786a9dadcbaa96709de991f471f239830 [production]