1551-1600 of 10000 results (102ms)
2024-06-27 ยง
12:42 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host deploy1003.eqiad.wmnet with OS bullseye [production]
12:38 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance [production]
12:38 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance [production]
12:38 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226 (T364069)', diff saved to https://phabricator.wikimedia.org/P65527 and previous config saved to /var/cache/conftool/dbconfig/20240627-123805-marostegui.json [production]
12:22 <jclark@cumin1002> START - Cookbook sre.dns.netbox [production]
12:19 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2175', diff saved to https://phabricator.wikimedia.org/P65524 and previous config saved to /var/cache/conftool/dbconfig/20240627-121942-marostegui.json [production]
12:17 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
12:15 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
12:14 <cmooney@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:12 <cmooney@cumin1002> START - Cookbook sre.dns.netbox [production]
12:12 <cmooney@cumin1002> END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) [production]
12:12 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
12:12 <cgoubert@deploy1002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
12:11 <cmooney@cumin1002> START - Cookbook sre.dns.netbox [production]
12:10 <cmooney@cumin1002> END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) [production]
12:10 <cmooney@cumin1002> START - Cookbook sre.dns.netbox [production]
12:10 <cgoubert@deploy1002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
12:07 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply [production]
12:07 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P65523 and previous config saved to /var/cache/conftool/dbconfig/20240627-120751-marostegui.json [production]
12:07 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/machinetranslation: apply [production]
12:07 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply [production]
12:07 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/machinetranslation: apply [production]
12:07 <cgoubert@deploy1002> helmfile [staging] DONE helmfile.d/services/machinetranslation: apply [production]
12:07 <cgoubert@deploy1002> helmfile [staging] START helmfile.d/services/machinetranslation: apply [production]
12:04 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2175 (T367856)', diff saved to https://phabricator.wikimedia.org/P65522 and previous config saved to /var/cache/conftool/dbconfig/20240627-120435-marostegui.json [production]
12:00 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/toolhub: apply [production]
12:00 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/toolhub: apply [production]
11:59 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/toolhub: apply [production]
11:59 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/toolhub: apply [production]
11:59 <cgoubert@deploy1002> helmfile [staging] DONE helmfile.d/services/toolhub: apply [production]
11:58 <cgoubert@deploy1002> helmfile [staging] START helmfile.d/services/toolhub: apply [production]
11:53 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
11:52 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226 (T364069)', diff saved to https://phabricator.wikimedia.org/P65521 and previous config saved to /var/cache/conftool/dbconfig/20240627-115244-marostegui.json [production]
11:51 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
11:51 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
11:49 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
11:49 <cgoubert@deploy1002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
11:48 <cgoubert@deploy1002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
11:47 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply [production]
11:47 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/developer-portal: apply [production]
11:46 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/developer-portal: apply [production]
11:46 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/developer-portal: apply [production]
11:46 <cgoubert@deploy1002> helmfile [staging] DONE helmfile.d/services/developer-portal: apply [production]
11:46 <cgoubert@deploy1002> helmfile [staging] START helmfile.d/services/developer-portal: apply [production]
11:42 <jgiannelos@deploy1002> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
11:42 <jgiannelos@deploy1002> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
11:41 <jgiannelos@deploy1002> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
11:41 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply [production]
11:41 <jgiannelos@deploy1002> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
11:40 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/shellbox-video: apply [production]