301-350 of 10000 results (82ms)
2024-04-18 ยง
10:45 <claime> Rebuild php7.4-fpm production images - T358308 [production]
10:41 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1183', diff saved to https://phabricator.wikimedia.org/P60905 and previous config saved to /var/cache/conftool/dbconfig/20240418-104117-marostegui.json [production]
10:40 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host es2021.codfw.wmnet [production]
10:39 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw2334.codfw.wmnet with OS bullseye [production]
10:39 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1224 (T361627)', diff saved to https://phabricator.wikimedia.org/P60904 and previous config saved to /var/cache/conftool/dbconfig/20240418-103933-marostegui.json [production]
10:39 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host es2020.codfw.wmnet [production]
10:39 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw2333.codfw.wmnet with OS bullseye [production]
10:38 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw2332.codfw.wmnet with OS bullseye [production]
10:38 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw2304.codfw.wmnet with OS bullseye [production]
10:38 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw2303.codfw.wmnet with OS bullseye [production]
10:37 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw2302.codfw.wmnet with OS bullseye [production]
10:34 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1224 (T361627)', diff saved to https://phabricator.wikimedia.org/P60903 and previous config saved to /var/cache/conftool/dbconfig/20240418-103422-marostegui.json [production]
10:34 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1224.eqiad.wmnet with reason: Maintenance [production]
10:34 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1224.eqiad.wmnet with reason: Maintenance [production]
10:34 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201 (T361627)', diff saved to https://phabricator.wikimedia.org/P60902 and previous config saved to /var/cache/conftool/dbconfig/20240418-103359-marostegui.json [production]
10:30 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host es2020.codfw.wmnet [production]
10:26 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1183 (T355609)', diff saved to https://phabricator.wikimedia.org/P60901 and previous config saved to /var/cache/conftool/dbconfig/20240418-102609-marostegui.json [production]
10:25 <claime> Depooling mw2302.codfw.wmnet,mw2303.codfw.wmnet,mw2304.codfw.wmnet,mw2332.codfw.wmnet,mw2333.codfw.wmnet,mw2334.codfw.wmnet for reimage - T351074 [production]
10:18 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201', diff saved to https://phabricator.wikimedia.org/P60900 and previous config saved to /var/cache/conftool/dbconfig/20240418-101852-marostegui.json [production]
10:18 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1183 (T355609)', diff saved to https://phabricator.wikimedia.org/P60899 and previous config saved to /var/cache/conftool/dbconfig/20240418-101841-marostegui.json [production]
10:18 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1183.eqiad.wmnet with reason: Maintenance [production]
10:18 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db1183.eqiad.wmnet with reason: Maintenance [production]
10:08 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host contint1002.wikimedia.org [production]
10:03 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201', diff saved to https://phabricator.wikimedia.org/P60898 and previous config saved to /var/cache/conftool/dbconfig/20240418-100338-marostegui.json [production]
09:57 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host contint1002.wikimedia.org [production]
09:54 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1087.eqiad.wmnet [production]
09:53 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1228 (T352010)', diff saved to https://phabricator.wikimedia.org/P60897 and previous config saved to /var/cache/conftool/dbconfig/20240418-095331-ladsgroup.json [production]
09:53 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1228.eqiad.wmnet with reason: Maintenance [production]
09:53 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1228.eqiad.wmnet with reason: Maintenance [production]
09:53 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1219 (T352010)', diff saved to https://phabricator.wikimedia.org/P60896 and previous config saved to /var/cache/conftool/dbconfig/20240418-095308-ladsgroup.json [production]
09:48 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201 (T361627)', diff saved to https://phabricator.wikimedia.org/P60895 and previous config saved to /var/cache/conftool/dbconfig/20240418-094830-marostegui.json [production]
09:46 <btullis@cumin1002> START - Cookbook sre.hosts.reboot-single for host an-worker1087.eqiad.wmnet [production]
09:46 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1201 (T361627)', diff saved to https://phabricator.wikimedia.org/P60894 and previous config saved to /var/cache/conftool/dbconfig/20240418-094619-marostegui.json [production]
09:46 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1201.eqiad.wmnet with reason: Maintenance [production]
09:46 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1201.eqiad.wmnet with reason: Maintenance [production]
09:45 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1187 (T361627)', diff saved to https://phabricator.wikimedia.org/P60893 and previous config saved to /var/cache/conftool/dbconfig/20240418-094556-marostegui.json [production]
09:42 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1183 (T356166)', diff saved to https://phabricator.wikimedia.org/P60892 and previous config saved to /var/cache/conftool/dbconfig/20240418-094235-marostegui.json [production]
09:39 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host es1034.eqiad.wmnet [production]
09:38 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1219', diff saved to https://phabricator.wikimedia.org/P60891 and previous config saved to /var/cache/conftool/dbconfig/20240418-093759-ladsgroup.json [production]
09:35 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2108.codfw.wmnet [production]
09:35 <arnaudb@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
09:35 <arnaudb@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2108.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" [production]
09:34 <arnaudb@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2108.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" [production]
09:32 <arnaudb@cumin1002> START - Cookbook sre.dns.netbox [production]
09:30 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P60890 and previous config saved to /var/cache/conftool/dbconfig/20240418-093049-marostegui.json [production]
09:27 <arnaudb@cumin1002> START - Cookbook sre.hosts.decommission for hosts db2108.codfw.wmnet [production]
09:27 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1183', diff saved to https://phabricator.wikimedia.org/P60889 and previous config saved to /var/cache/conftool/dbconfig/20240418-092728-marostegui.json [production]
09:27 <arnaudb@cumin1002> dbctl commit (dc=all): 'Depool db2108', diff saved to https://phabricator.wikimedia.org/P60888 and previous config saved to /var/cache/conftool/dbconfig/20240418-092718-arnaudb.json [production]
09:25 <mforns@deploy1002> Finished deploy [analytics/refinery@be07da9]: Regular analytics weekly train [analytics/refinery@be07da9e] (duration: 00m 20s) [production]
09:25 <mforns@deploy1002> Started deploy [analytics/refinery@be07da9]: Regular analytics weekly train [analytics/refinery@be07da9e] [production]