1851-1900 of 10000 results (79ms)
2023-01-24 §
02:16 <eevans@cumin1001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host restbase2019.codfw.wmnet [production]
02:04 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase2019.codfw.wmnet [production]
02:03 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase2014.codfw.wmnet [production]
01:55 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase2014.codfw.wmnet [production]
01:51 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase2013.codfw.wmnet [production]
01:44 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase2013.codfw.wmnet [production]
01:36 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1033.eqiad.wmnet [production]
01:26 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1033.eqiad.wmnet [production]
01:26 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1032.eqiad.wmnet [production]
01:18 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1032.eqiad.wmnet [production]
01:16 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1031.eqiad.wmnet [production]
01:06 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1031.eqiad.wmnet [production]
01:03 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1030.eqiad.wmnet [production]
00:55 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1030.eqiad.wmnet [production]
00:55 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1027.eqiad.wmnet [production]
00:47 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1027.eqiad.wmnet [production]
00:45 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1026.eqiad.wmnet [production]
00:38 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1026.eqiad.wmnet [production]
00:36 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1025.eqiad.wmnet [production]
00:28 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1025.eqiad.wmnet [production]
00:27 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1018.eqiad.wmnet [production]
00:18 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1018.eqiad.wmnet [production]
00:14 <zabe@deploy1002> Finished scap: Backport for [[gerrit:881466|Use core's PoolCounterClient (T327336)]] (duration: 12m 47s) [production]
00:02 <zabe@deploy1002> zabe: Backport for [[gerrit:881466|Use core's PoolCounterClient (T327336)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
00:01 <zabe@deploy1002> Started scap: Backport for [[gerrit:881466|Use core's PoolCounterClient (T327336)]] [production]
2023-01-23 §
23:31 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1029.eqiad.wmnet [production]
23:24 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1029.eqiad.wmnet [production]
23:24 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1024.eqiad.wmnet [production]
23:17 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1024.eqiad.wmnet [production]
23:16 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1023.eqiad.wmnet [production]
23:07 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1023.eqiad.wmnet [production]
22:59 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1022.eqiad.wmnet [production]
22:57 <ryankemper> [WDQS Deploy] Restarting `wdqs-categories` across lvs-managed hosts, one node at a time: `sudo -E cumin -b 1 'A:wdqs-all and not A:wdqs-test' 'depool && sleep 45 && systemctl restart wdqs-categories && sleep 45 && pool'` [production]
22:57 <ryankemper> [WDQS Deploy] Restarted `wdqs-categories` across all test hosts simultaneously: `sudo -E cumin 'A:wdqs-test' 'systemctl restart wdqs-categories'` [production]
22:57 <ryankemper> [WDQS Deploy] Restarted `wdqs-updater` across all hosts, 4 hosts at a time: `sudo -E cumin -b 4 'A:wdqs-all' 'systemctl restart wdqs-updater'` [production]
22:56 <ryankemper@deploy1002> Finished deploy [wdqs/wdqs@544f5f3]: 0.3.119 (duration: 07m 30s) [production]
22:52 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1022.eqiad.wmnet [production]
22:49 <ryankemper> [WDQS Deploy] Tests passing following deploy of `0.3.119` on canary `wdqs1003`; proceeding to rest of fleet [production]
22:48 <ryankemper@deploy1002> Started deploy [wdqs/wdqs@544f5f3]: 0.3.119 [production]
22:46 <ryankemper> [WDQS Deploy] Gearing up for deploy of wdqs `0.3.119`. Pre-deploy tests passing on canary `wdqs1003` [production]
22:45 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1017.eqiad.wmnet [production]
22:37 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1017.eqiad.wmnet [production]
22:31 <maryum> Deployed patch for T285159 [production]
21:42 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1028.eqiad.wmnet [production]
21:40 <zabe@deploy1002> Finished scap: Backport for [[gerrit:882746|throttle: Remove expired rule]] (duration: 07m 45s) [production]
21:35 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1028.eqiad.wmnet [production]
21:34 <zabe@deploy1002> zabe: Backport for [[gerrit:882746|throttle: Remove expired rule]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
21:32 <zabe@deploy1002> Started scap: Backport for [[gerrit:882746|throttle: Remove expired rule]] [production]
21:29 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1021.eqiad.wmnet [production]
21:22 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1021.eqiad.wmnet [production]