2551-2600 of 10000 results (64ms)
2024-01-17 ยง
18:39 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db1229.eqiad.wmnet with reason: Maintenance [production]
18:39 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1225.eqiad.wmnet with reason: Maintenance [production]
18:39 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db1225.eqiad.wmnet with reason: Maintenance [production]
18:38 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1222 (T354336)', diff saved to https://phabricator.wikimedia.org/P54850 and previous config saved to /var/cache/conftool/dbconfig/20240117-183857-marostegui.json [production]
18:23 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1222', diff saved to https://phabricator.wikimedia.org/P54849 and previous config saved to /var/cache/conftool/dbconfig/20240117-182351-marostegui.json [production]
18:08 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1222', diff saved to https://phabricator.wikimedia.org/P54848 and previous config saved to /var/cache/conftool/dbconfig/20240117-180844-marostegui.json [production]
17:53 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1222 (T354336)', diff saved to https://phabricator.wikimedia.org/P54847 and previous config saved to /var/cache/conftool/dbconfig/20240117-175338-marostegui.json [production]
17:51 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1222 (T354336)', diff saved to https://phabricator.wikimedia.org/P54846 and previous config saved to /var/cache/conftool/dbconfig/20240117-175120-marostegui.json [production]
17:51 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1222.eqiad.wmnet with reason: Maintenance [production]
17:51 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db1222.eqiad.wmnet with reason: Maintenance [production]
17:50 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1197 (T354336)', diff saved to https://phabricator.wikimedia.org/P54845 and previous config saved to /var/cache/conftool/dbconfig/20240117-175059-marostegui.json [production]
17:39 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2395.codfw.wmnet with OS bullseye [production]
17:35 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1197', diff saved to https://phabricator.wikimedia.org/P54844 and previous config saved to /var/cache/conftool/dbconfig/20240117-173552-marostegui.json [production]
17:29 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2357.codfw.wmnet with OS bullseye [production]
17:20 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1197', diff saved to https://phabricator.wikimedia.org/P54843 and previous config saved to /var/cache/conftool/dbconfig/20240117-172045-marostegui.json [production]
17:19 <kamila@deploy2002> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]
17:19 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2395.codfw.wmnet with reason: host reimage [production]
17:19 <denisse@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host grafana2001.codfw.wmnet with OS bookworm [production]
17:18 <kamila@deploy2002> helmfile [codfw] START helmfile.d/services/mobileapps: apply [production]
17:16 <hnowlan@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2395.codfw.wmnet with reason: host reimage [production]
17:13 <kamila@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
17:11 <kamila@deploy2002> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
17:08 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2357.codfw.wmnet with reason: host reimage [production]
17:05 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1197 (T354336)', diff saved to https://phabricator.wikimedia.org/P54842 and previous config saved to /var/cache/conftool/dbconfig/20240117-170539-marostegui.json [production]
17:05 <hnowlan@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2357.codfw.wmnet with reason: host reimage [production]
17:03 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1197 (T354336)', diff saved to https://phabricator.wikimedia.org/P54841 and previous config saved to /var/cache/conftool/dbconfig/20240117-170327-marostegui.json [production]
17:03 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1197.eqiad.wmnet with reason: Maintenance [production]
17:03 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db1197.eqiad.wmnet with reason: Maintenance [production]
17:03 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1188 (T354336)', diff saved to https://phabricator.wikimedia.org/P54840 and previous config saved to /var/cache/conftool/dbconfig/20240117-170305-marostegui.json [production]
17:02 <denisse@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on grafana2001.codfw.wmnet with reason: host reimage [production]
17:00 <hnowlan@cumin2002> START - Cookbook sre.hosts.reimage for host mw2395.codfw.wmnet with OS bullseye [production]
16:57 <denisse@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on grafana2001.codfw.wmnet with reason: host reimage [production]
16:48 <hnowlan@cumin2002> START - Cookbook sre.hosts.reimage for host mw2357.codfw.wmnet with OS bullseye [production]
16:48 <hnowlan@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host mw2282.codfw.wmnet with OS bullseye [production]
16:47 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1188', diff saved to https://phabricator.wikimedia.org/P54839 and previous config saved to /var/cache/conftool/dbconfig/20240117-164759-marostegui.json [production]
16:42 <denisse@cumin2002> START - Cookbook sre.hosts.reimage for host grafana2001.codfw.wmnet with OS bookworm [production]
16:41 <jforrester@deploy2002> Finished deploy [integration/docroot@f08a107]: I74613426e76b9d1a92482d024fcd326463496d88 for T354310 (duration: 00m 07s) [production]
16:40 <jforrester@deploy2002> Started deploy [integration/docroot@f08a107]: I74613426e76b9d1a92482d024fcd326463496d88 for T354310 [production]
16:39 <hnowlan@cumin2002> START - Cookbook sre.hosts.reimage for host mw2282.codfw.wmnet with OS bullseye [production]
16:39 <hnowlan@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host mw2282.codfw.wmnet with OS bullseye [production]
16:32 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1188', diff saved to https://phabricator.wikimedia.org/P54838 and previous config saved to /var/cache/conftool/dbconfig/20240117-163252-marostegui.json [production]
16:29 <damilare> civicrm upgraded from 5ef5362f to d8b0c977 [production]
16:25 <kamila@deploy2002> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
16:23 <hnowlan@cumin2002> START - Cookbook sre.hosts.reimage for host mw2282.codfw.wmnet with OS bullseye [production]
16:23 <hnowlan@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host mw2282.codfw.wmnet with OS bullseye [production]
16:22 <kamila@deploy2002> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
16:17 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1188 (T354336)', diff saved to https://phabricator.wikimedia.org/P54837 and previous config saved to /var/cache/conftool/dbconfig/20240117-161746-marostegui.json [production]
16:15 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1188 (T354336)', diff saved to https://phabricator.wikimedia.org/P54836 and previous config saved to /var/cache/conftool/dbconfig/20240117-161534-marostegui.json [production]
16:15 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1188.eqiad.wmnet with reason: Maintenance [production]
16:15 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db1188.eqiad.wmnet with reason: Maintenance [production]