3651-3700 of 10000 results (107ms)
2024-04-18 ยง
11:08 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2333.codfw.wmnet with reason: host reimage [production]
11:05 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2304.codfw.wmnet with reason: host reimage [production]
11:03 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host es1020.eqiad.wmnet [production]
11:02 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2334.codfw.wmnet with reason: host reimage [production]
11:01 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host es2022.codfw.wmnet [production]
11:00 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2332.codfw.wmnet with reason: host reimage [production]
10:57 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2303.codfw.wmnet with reason: host reimage [production]
10:56 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1183', diff saved to https://phabricator.wikimedia.org/P60907 and previous config saved to /var/cache/conftool/dbconfig/20240418-105624-marostegui.json [production]
10:56 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2334.codfw.wmnet with reason: host reimage [production]
10:55 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2333.codfw.wmnet with reason: host reimage [production]
10:55 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2304.codfw.wmnet with reason: host reimage [production]
10:54 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2332.codfw.wmnet with reason: host reimage [production]
10:54 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1224', diff saved to https://phabricator.wikimedia.org/P60906 and previous config saved to /var/cache/conftool/dbconfig/20240418-105441-marostegui.json [production]
10:54 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2302.codfw.wmnet with reason: host reimage [production]
10:54 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2303.codfw.wmnet with reason: host reimage [production]
10:52 <cgoubert@deploy1002> Started scap: Redeploy mw-on-k8s with full rebuild - Fix setting php.timeout - T358308 [production]
10:52 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host es2022.codfw.wmnet [production]
10:48 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host es2021.codfw.wmnet [production]
10:45 <claime> Rebuild php7.4-fpm production images - T358308 [production]
10:41 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1183', diff saved to https://phabricator.wikimedia.org/P60905 and previous config saved to /var/cache/conftool/dbconfig/20240418-104117-marostegui.json [production]
10:40 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host es2021.codfw.wmnet [production]
10:39 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw2334.codfw.wmnet with OS bullseye [production]
10:39 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1224 (T361627)', diff saved to https://phabricator.wikimedia.org/P60904 and previous config saved to /var/cache/conftool/dbconfig/20240418-103933-marostegui.json [production]
10:39 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host es2020.codfw.wmnet [production]
10:39 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw2333.codfw.wmnet with OS bullseye [production]
10:38 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw2332.codfw.wmnet with OS bullseye [production]
10:38 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw2304.codfw.wmnet with OS bullseye [production]
10:38 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw2303.codfw.wmnet with OS bullseye [production]
10:37 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw2302.codfw.wmnet with OS bullseye [production]
10:34 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1224 (T361627)', diff saved to https://phabricator.wikimedia.org/P60903 and previous config saved to /var/cache/conftool/dbconfig/20240418-103422-marostegui.json [production]
10:34 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1224.eqiad.wmnet with reason: Maintenance [production]
10:34 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1224.eqiad.wmnet with reason: Maintenance [production]
10:34 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201 (T361627)', diff saved to https://phabricator.wikimedia.org/P60902 and previous config saved to /var/cache/conftool/dbconfig/20240418-103359-marostegui.json [production]
10:30 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host es2020.codfw.wmnet [production]
10:26 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1183 (T355609)', diff saved to https://phabricator.wikimedia.org/P60901 and previous config saved to /var/cache/conftool/dbconfig/20240418-102609-marostegui.json [production]
10:25 <claime> Depooling mw2302.codfw.wmnet,mw2303.codfw.wmnet,mw2304.codfw.wmnet,mw2332.codfw.wmnet,mw2333.codfw.wmnet,mw2334.codfw.wmnet for reimage - T351074 [production]
10:18 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201', diff saved to https://phabricator.wikimedia.org/P60900 and previous config saved to /var/cache/conftool/dbconfig/20240418-101852-marostegui.json [production]
10:18 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1183 (T355609)', diff saved to https://phabricator.wikimedia.org/P60899 and previous config saved to /var/cache/conftool/dbconfig/20240418-101841-marostegui.json [production]
10:18 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1183.eqiad.wmnet with reason: Maintenance [production]
10:18 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db1183.eqiad.wmnet with reason: Maintenance [production]
10:08 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host contint1002.wikimedia.org [production]
10:03 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201', diff saved to https://phabricator.wikimedia.org/P60898 and previous config saved to /var/cache/conftool/dbconfig/20240418-100338-marostegui.json [production]
09:57 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host contint1002.wikimedia.org [production]
09:54 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1087.eqiad.wmnet [production]
09:53 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1228 (T352010)', diff saved to https://phabricator.wikimedia.org/P60897 and previous config saved to /var/cache/conftool/dbconfig/20240418-095331-ladsgroup.json [production]
09:53 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1228.eqiad.wmnet with reason: Maintenance [production]
09:53 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1228.eqiad.wmnet with reason: Maintenance [production]
09:53 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1219 (T352010)', diff saved to https://phabricator.wikimedia.org/P60896 and previous config saved to /var/cache/conftool/dbconfig/20240418-095308-ladsgroup.json [production]
09:48 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201 (T361627)', diff saved to https://phabricator.wikimedia.org/P60895 and previous config saved to /var/cache/conftool/dbconfig/20240418-094830-marostegui.json [production]
09:46 <btullis@cumin1002> START - Cookbook sre.hosts.reboot-single for host an-worker1087.eqiad.wmnet [production]