1201-1250 of 10000 results (61ms)
2019-10-25 §
04:51 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
04:51 <bblack@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
04:50 <bblack@cumin1001> START - Cookbook sre.hosts.decommission [production]
04:49 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
04:49 <bblack@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
04:49 <bblack@cumin1001> START - Cookbook sre.hosts.decommission [production]
03:24 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=dns300.* [production]
03:24 <bblack@cumin1001> conftool action : set/weight=1; selector: name=dns300.* [production]
03:24 <bblack@cumin1001> conftool action : set/weight=1; selector: name=dns3001.* [production]
03:08 <bblack> cr2-esams + cr3-esams : remove nescio and maerlant from anycast4 neighbor list [production]
03:06 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
03:05 <bblack@cumin1001> START - Cookbook sre.hosts.decommission [production]
02:45 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp3065.esams.wmnet [production]
02:45 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp3049.esams.wmnet [production]
02:45 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp3064.esams.wmnet [production]
02:44 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp3043.esams.wmnet [production]
02:11 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
02:09 <bblack@cumin1001> START - Cookbook sre.hosts.decommission [production]
01:52 <bblack> mr1-esams: switch ntp peers list to use dns300[12] instead of nescio/maerlant [production]
01:50 <bblack> asw2-esams: switch ntp peers list to use dns300[12] instead of nescio/maerlant [production]
01:46 <bblack> cr2-esams + cr3-esams: switch ntp peers list to use dns300[12] instead of nescio/maerlant [production]
01:40 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp3062.esams.wmnet [production]
01:40 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp3042.esams.wmnet [production]
01:40 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp3063.esams.wmnet [production]
01:39 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp3047.esams.wmnet [production]
01:28 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp3052.esams.wmnet [production]
01:28 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp3041.esams.wmnet [production]
01:27 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp3061.esams.wmnet [production]
01:27 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp3046.esams.wmnet [production]
01:27 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp3045.esams.wmnet [production]
01:13 <mutante> puppetmaster1001 - revoking parsoid.svc.eqiad / parsoid.svc.codfw / parsoid.discovery.wmnet certificates and creating new ones including parsoid-php.discovery.wmnet (T233654) [production]
00:52 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.3/extensions/LiquidThreads/classes/View.php: (no justification provided) (duration: 00m 54s) [production]
2019-10-24 §
23:46 <mutante> bast3002 - rsyncing /home, /srv/tfptboot and /srv/prometheus to /srv/bast3002/ on bast3004 (T236394 T236329) [production]
23:24 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.3/includes/specials/pagers/BlockListPager.php: T236425, fc99c5a7c0de2 (duration: 00m 54s) [production]
22:16 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
22:14 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
22:13 <mutante> gerrit1001 - starting gerrit [production]
22:13 <bblack@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:12 <bblack@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
22:12 <bblack@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:12 <bblack@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:11 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
22:10 <thcipriani> stopping gerrit briefly for script run for T236344 [production]
22:09 <bblack@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:01 <mutante> mw1270 - was alerting in Icinga as degraded systemd state - reason was 'hhvm.service not-found". systemctl reset-failed cleared it. could cause monitoring spam on more servers (T229792) [production]
21:56 <eileen> civicrm revision changed from 47e0800001 to a55c2d2787, config revision is 63a67f32a1 [production]
21:16 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp3040.esams.wmnet [production]
21:16 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp3050.esams.wmnet [production]
21:13 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp3051.esams.wmnet [production]
21:13 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp3044.esams.wmnet [production]