6301-6350 of 10000 results (101ms)
2024-03-14 ยง
12:29 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
12:29 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
12:21 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
12:21 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
12:06 <Dreamy_Jazz> Stopped MediaModeration scanning script on group2 wikis [production]
11:31 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
11:31 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
11:10 <mvolz@deploy2002> helmfile [eqiad] DONE helmfile.d/services/citoid: apply [production]
11:09 <mvolz@deploy2002> helmfile [eqiad] START helmfile.d/services/citoid: apply [production]
11:09 <mvolz@deploy2002> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
11:08 <mvolz@deploy2002> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
11:07 <mvolz@deploy2002> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
11:07 <mvolz@deploy2002> helmfile [staging] START helmfile.d/services/citoid: apply [production]
10:01 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
10:01 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:53 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:53 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:39 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:38 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:36 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on 37 hosts with reason: Enabling circular replication [production]
09:36 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on 37 hosts with reason: Enabling circular replication [production]
09:35 <marostegui> enable eqiad -> codfw replication on s1 T358199 [production]
09:34 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:34 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:26 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on 29 hosts with reason: Enabling circular replication [production]
09:26 <marostegui> enable eqiad -> codfw replication on s2 T358199 [production]
09:26 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on 29 hosts with reason: Enabling circular replication [production]
09:24 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:24 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:23 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group2 wikis to 1.42.0-wmf.22 refs T354440 [production]
09:21 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on 26 hosts with reason: Enabling circular replication [production]
09:21 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on 26 hosts with reason: Enabling circular replication [production]
09:21 <marostegui> enable eqiad -> codfw replication on s3 T358199 [production]
09:16 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on 36 hosts with reason: Enabling circular replication [production]
09:16 <marostegui> enable eqiad -> codfw replication on s4 T358199 [production]
09:16 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on 36 hosts with reason: Enabling circular replication [production]
09:09 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on 27 hosts with reason: Enabling circular replication [production]
09:09 <marostegui> enable eqiad -> codfw replication on s5 T358199 [production]
09:09 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on 27 hosts with reason: Enabling circular replication [production]
09:06 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on 27 hosts with reason: Enabling circular replication [production]
09:06 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on 27 hosts with reason: Enabling circular replication [production]
09:06 <marostegui> enable eqiad -> codfw replication on s6 T358199 [production]
09:04 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:04 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
08:55 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2115 (re)pooling @ 100%: Post reimage', diff saved to https://phabricator.wikimedia.org/P58794 and previous config saved to /var/cache/conftool/dbconfig/20240314-085530-arnaudb.json [production]
08:55 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on 31 hosts with reason: Enabling circular replication [production]
08:54 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on 31 hosts with reason: Enabling circular replication [production]
08:54 <marostegui> enable eqiad -> codfw replication on s7 T358199 [production]
08:51 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on 34 hosts with reason: Enabling circular replication [production]
08:51 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on 34 hosts with reason: Enabling circular replication [production]