4651-4700 of 10000 results (32ms)
2020-08-17 §
10:14 <jayme@cumin1001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) [production]
10:13 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
10:13 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
10:10 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
10:07 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
10:06 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
09:58 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:58 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:56 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:55 <jayme@cumin1001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) [production]
09:52 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:48 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
09:45 <jayme@cumin1001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) [production]
09:42 <jynus> updating compiler facts for cloud puppet compiler project to include new host dbprov2003 [production]
09:39 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
09:38 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:38 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:36 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
09:36 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
09:29 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:28 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:27 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:23 <jayme@cumin1001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) [production]
09:22 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:21 <jayme@cumin1001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) [production]
09:18 <_joe_> running a full apt-get upgrade on mw1379-1380 [production]
09:18 <_joe_> re-upgrading imagemagick on mw1378 [production]
09:16 <_joe_> upgrading packages on mw1377 [production]
09:14 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
09:06 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:06 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:05 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
08:25 <jayme> forcing a puppet run on all mw-api servers in eqiad - T260329 [production]
07:52 <_joe_> repooling mw1382 [production]
07:37 <_joe_> running the same test on mw1382 T260329 [production]
07:34 <_joe_> repooling mw1381 [production]
07:15 <_joe_> running the same test on mw1381 T260329 [production]
07:15 <_joe_> repooled mw1281 [production]
06:26 <_joe_> stop testing on mw1281, T260329 [production]
05:45 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
05:43 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
05:28 <marostegui> Stop mysql on db1099:3311, db1099:3318 for reimage [production]
05:28 <_joe_> depooling mw1281 for testing for T260329 [production]
05:25 <marostegui> Deploy schema change on db1139:3311 [production]
05:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1099:3311, db1099:3318 for reimage and MCR change', diff saved to https://phabricator.wikimedia.org/P12263 and previous config saved to /var/cache/conftool/dbconfig/20200817-052147-marostegui.json [production]
2020-08-16 §
11:12 <gehel> repooling wdqs1004 - catched up on lag [production]
2020-08-15 §
21:18 <gehel> depooling wdqs1004 and restarting services, will wait to catch up on lag before repooling [production]
2020-08-14 §
19:41 <effie> restart mwdebug1002 [production]
16:58 <cdanis> done deploying 'allow nameservers of Jio AS55836 to skip RPKI validation I9fcff8' to all routers T260449 [production]
16:44 <cdanis> ❌cdanis@cumin1001.eqiad.wmnet ~ 🕧☕ homer 'cr2-esams*' commit 'allow nameservers of Jio AS55836 to skip RPKI validation I9fcff8' [production]