6001-6050 of 10000 results (99ms)
2023-06-13 ยง
15:15 <akosiaris@deploy1002> helmfile [staging] START helmfile.d/services/recommendation-api: sync [production]
15:14 <SandraEbele> deploying refinery source [production]
15:14 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2177.codfw.wmnet with reason: Maintenance [production]
15:14 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on db2177.codfw.wmnet with reason: Maintenance [production]
15:14 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host dbproxy1022.eqiad.wmnet with OS bullseye [production]
15:02 <otto@deploy1002> helmfile [eqiad] DONE helmfile.d/services/eventgate-main: apply [production]
15:01 <otto@deploy1002> helmfile [eqiad] START helmfile.d/services/eventgate-main: apply [production]
15:00 <elukey> run kafka re-assign partitions for eqiad.change-prop.transcludes.resource-change on kafka-main1001 - T338357 [production]
14:59 <otto@deploy1002> helmfile [codfw] DONE helmfile.d/services/eventgate-main: apply [production]
14:58 <otto@deploy1002> helmfile [codfw] START helmfile.d/services/eventgate-main: apply [production]
14:58 <otto@deploy1002> helmfile [staging] DONE helmfile.d/services/eventgate-main: apply [production]
14:57 <otto@deploy1002> helmfile [staging] START helmfile.d/services/eventgate-main: apply [production]
14:57 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host snapshot1016.eqiad.wmnet with OS buster [production]
14:54 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
14:54 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
14:54 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2156.codfw.wmnet with reason: Maintenance [production]
14:54 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on db2156.codfw.wmnet with reason: Maintenance [production]
14:47 <aikochou@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
14:33 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2149.codfw.wmnet with reason: Maintenance [production]
14:33 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on db2149.codfw.wmnet with reason: Maintenance [production]
14:16 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp4052.ulsfo.wmnet [production]
14:16 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp4044.ulsfo.wmnet [production]
14:12 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2139.codfw.wmnet with reason: Maintenance [production]
14:12 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on db2139.codfw.wmnet with reason: Maintenance [production]
14:05 <fabfur> reboot cp4044 and cp4052 for kernel upgrade (T335835) [production]
14:05 <fabfur@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp4044.ulsfo.wmnet [production]
14:05 <fabfur@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp4052.ulsfo.wmnet [production]
14:03 <claime> Revert noc.wikimedia.org to eqiad, running authdns-update - T331634 [production]
13:56 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host snapshot1016.eqiad.wmnet with OS buster [production]
13:52 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2112.codfw.wmnet with reason: Maintenance [production]
13:52 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2112.codfw.wmnet with reason: Maintenance [production]
13:52 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2127.codfw.wmnet with reason: Maintenance [production]
13:51 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on db2127.codfw.wmnet with reason: Maintenance [production]
13:47 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1160.eqiad.wmnet with reason: Maintenance [production]
13:47 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db1160.eqiad.wmnet with reason: Maintenance [production]
13:47 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2140.codfw.wmnet with reason: Maintenance [production]
13:46 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2140.codfw.wmnet with reason: Maintenance [production]
13:45 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2109.codfw.wmnet with reason: Maintenance [production]
13:45 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on db2109.codfw.wmnet with reason: Maintenance [production]
13:42 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:929464|Section images: Fix image placeholder alignment for RTL content (T338837)]] (duration: 10m 29s) [production]
13:41 <sukhe> disable puppet on R:Class bird::anycast_healthchecker to merge CR 928804 [production]
13:35 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2165.codfw.wmnet with reason: Maintenance [production]
13:35 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp4051.ulsfo.wmnet [production]
13:35 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp4043.ulsfo.wmnet [production]
13:35 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2165.codfw.wmnet with reason: Maintenance [production]
13:34 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
13:34 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
13:34 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1131.eqiad.wmnet with reason: Maintenance [production]
13:34 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db1131.eqiad.wmnet with reason: Maintenance [production]
13:33 <urbanecm@deploy1002> kharlan and urbanecm: Backport for [[gerrit:929464|Section images: Fix image placeholder alignment for RTL content (T338837)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]