51-100 of 10000 results (48ms)
2019-11-29 §
12:35 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
12:34 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:33 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:24 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
12:22 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:58 <effie> reimage mw1305.eqiad.wmnet mw1265.eqiad.wmnet mw1270.eqiad.wmnet [production]
11:51 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:49 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:39 <jynus> disabling puppet on dbprov2001 to test recoveries [production]
11:34 <effie> reimage mw1268.eqiad.wmnet mw1280.eqiad.wmnet mw1281.eqiad.wmnet [production]
11:24 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:22 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:20 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:20 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:03 <Lucas_WMDE> <effie> 10:58:17 log reimage mw1268.eqiad.wmnet mw1280.eqiad.wmnet mw1281.eqiad.wmne [production]
11:01 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:58 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:48 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:47 <elukey@deploy1001> Finished deploy [analytics/refinery@97015e4] (thin): Deploy thin Analytics Refinery (no jars/git-fat-obj) to notebook and labstore hosts (duration: 00m 08s) [production]
10:47 <elukey@deploy1001> Started deploy [analytics/refinery@97015e4] (thin): Deploy thin Analytics Refinery (no jars/git-fat-obj) to notebook and labstore hosts [production]
10:46 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:22 <effie> reimage mw1306.eqiad.wmnet mw1264.eqiad.wmnet mw1279.eqiad.wmnet [production]
09:56 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:53 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:53 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:51 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:49 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:46 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:33 <marostegui> Remove triggers from db2094:3313 - T234704 [production]
09:33 <marostegui> Stop replication on db2105 (s3 codfw) for schema change [production]
09:23 <effie> reimage mw1263.eqiad.wmnet mw1307.eqiad.wmnet [production]
09:03 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:01 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:01 <volans> temporary disabling puppet on 'R:keyholder::agent' to merge gerrit:operations/puppet/+/553460 - T239386 [production]
09:00 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:59 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:45 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:43 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:18 <effie> reimage mw2223.codfw.wmnet mw2222.codfw.wmnet mw2221.codfw.wmnet mw2220.codfw.wmnet [production]
07:50 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:48 <jiji@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
07:48 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:48 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:25 <effie> reimage mw1312.eqiad.wmnet mw1308.eqiad.wmnet mw1261.eqiad.wmnet [production]
06:15 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
06:15 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
05:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1134 after schema change', diff saved to https://phabricator.wikimedia.org/P9781 and previous config saved to /var/cache/conftool/dbconfig/20191129-055845-marostegui.json [production]
05:08 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.5/includes/exception/MWExceptionHandler.php: 532f4aba96d85 (duration: 01m 03s) [production]
2019-11-28 §
23:46 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
23:43 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]