251-300 of 10000 results (93ms)
2024-08-02 §
00:40 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1255.eqiad.wmnet with OS bullseye [production]
00:39 <zabe@deploy1003> zabe: Continuing with sync [production]
00:38 <zabe@deploy1003> zabe: Backport for [[gerrit:1059178|Further configurations for u4cwiki (T371452)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
00:38 <zabe> zabe@mwmaint1002:~$ mwscript extensions/WikimediaMaintenance/createExtensionTables.php u4cwiki translate # T371452 [production]
00:36 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1252.eqiad.wmnet with reason: host reimage [production]
00:36 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1059178|Further configurations for u4cwiki (T371452)]] [production]
00:34 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1256.eqiad.wmnet with OS bullseye [production]
00:33 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1259.eqiad.wmnet with reason: host reimage [production]
00:31 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1253.eqiad.wmnet with reason: host reimage [production]
00:30 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1250.eqiad.wmnet with OS bullseye [production]
00:29 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host alert2002.wikimedia.org with OS bookworm [production]
00:28 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1251.eqiad.wmnet with OS bullseye [production]
00:27 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1258.eqiad.wmnet with reason: host reimage [production]
00:24 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1254.eqiad.wmnet with reason: host reimage [production]
00:22 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1255.eqiad.wmnet with reason: host reimage [production]
00:19 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on alert2002.wikimedia.org with reason: host reimage [production]
00:17 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1256.eqiad.wmnet with reason: host reimage [production]
00:15 <pt1979@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on alert2002.wikimedia.org with reason: host reimage [production]
00:14 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1250.eqiad.wmnet with reason: host reimage [production]
00:13 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host alert2002.wikimedia.org with OS bookworm [production]
00:11 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1255.eqiad.wmnet with reason: host reimage [production]
00:11 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1251.eqiad.wmnet with reason: host reimage [production]
00:11 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1256.eqiad.wmnet with reason: host reimage [production]
00:10 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1258.eqiad.wmnet with reason: host reimage [production]
00:10 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1259.eqiad.wmnet with reason: host reimage [production]
00:09 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1257.eqiad.wmnet with reason: host reimage [production]
00:09 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1254.eqiad.wmnet with reason: host reimage [production]
00:09 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1252.eqiad.wmnet with reason: host reimage [production]
00:08 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1253.eqiad.wmnet with reason: host reimage [production]
00:08 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1250.eqiad.wmnet with reason: host reimage [production]
00:08 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1251.eqiad.wmnet with reason: host reimage [production]
2024-08-01 §
23:55 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1255.eqiad.wmnet with OS bullseye [production]
23:54 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1256.eqiad.wmnet with OS bullseye [production]
23:53 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1259.eqiad.wmnet with OS bullseye [production]
23:53 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1258.eqiad.wmnet with OS bullseye [production]
23:53 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1257.eqiad.wmnet with OS bullseye [production]
23:52 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1254.eqiad.wmnet with OS bullseye [production]
23:52 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1253.eqiad.wmnet with OS bullseye [production]
23:52 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1252.eqiad.wmnet with OS bullseye [production]
23:52 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1251.eqiad.wmnet with OS bullseye [production]
23:51 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1250.eqiad.wmnet with OS bullseye [production]
23:37 <jclark@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
23:36 <zabe@deploy1003> Finished scap: Backport for [[gerrit:1057037|Automatically set db section to s5 for new wiki]] (duration: 07m 20s) [production]
23:34 <jclark@cumin1002> START - Cookbook sre.dns.netbox [production]
23:31 <zabe@deploy1003> zabe: Continuing with sync [production]
23:31 <zabe@deploy1003> zabe: Backport for [[gerrit:1057037|Automatically set db section to s5 for new wiki]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
23:28 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1057037|Automatically set db section to s5 for new wiki]] [production]
22:37 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
22:37 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
22:37 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1249 (T367856)', diff saved to https://phabricator.wikimedia.org/P67198 and previous config saved to /var/cache/conftool/dbconfig/20240801-223711-marostegui.json [production]