3951-4000 of 10000 results (122ms)
2024-05-31 ยง
07:16 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
07:14 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
07:14 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
07:12 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
07:12 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
07:05 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
07:05 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
07:01 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
07:01 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
06:59 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
06:59 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
06:58 <jiji@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc2043.codfw.wmnet with OS bookworm [production]
06:54 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
06:54 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
06:52 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1043.eqiad.wmnet with OS bookworm [production]
06:52 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
06:52 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
06:46 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
06:46 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
06:44 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
06:44 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
06:42 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
06:42 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
06:41 <jiji@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc2043.codfw.wmnet with reason: host reimage [production]
06:40 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
06:40 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
06:38 <jiji@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mc2043.codfw.wmnet with reason: host reimage [production]
06:36 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1043.eqiad.wmnet with reason: host reimage [production]
06:33 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
06:33 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
06:33 <ayounsi@cumin1002> START - Cookbook sre.network.peering with action 'configure' for AS: 13335 [production]
06:33 <jiji@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mc1043.eqiad.wmnet with reason: host reimage [production]
06:25 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
06:25 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
06:23 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
06:23 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
06:20 <jiji@cumin1002> START - Cookbook sre.hosts.reimage for host mc1043.eqiad.wmnet with OS bookworm [production]
06:20 <jiji@cumin2002> START - Cookbook sre.hosts.reimage for host mc2043.codfw.wmnet with OS bookworm [production]
06:12 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1207 (T364299)', diff saved to https://phabricator.wikimedia.org/P63750 and previous config saved to /var/cache/conftool/dbconfig/20240531-061219-marostegui.json [production]
06:12 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1207.eqiad.wmnet with reason: Maintenance [production]
06:12 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db1207.eqiad.wmnet with reason: Maintenance [production]
06:11 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1206 (T364299)', diff saved to https://phabricator.wikimedia.org/P63749 and previous config saved to /var/cache/conftool/dbconfig/20240531-061156-marostegui.json [production]
06:00 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
06:00 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
05:58 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
05:58 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
05:56 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1206', diff saved to https://phabricator.wikimedia.org/P63748 and previous config saved to /var/cache/conftool/dbconfig/20240531-055647-marostegui.json [production]
05:49 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
05:49 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
05:47 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]