1401-1450 of 10000 results (39ms)
2024-12-16 ยง
10:57 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-videoscaler: apply [production]
10:57 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-videoscaler: apply [production]
10:56 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2102.codfw.wmnet [production]
10:56 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2102.codfw.wmnet [production]
10:56 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2107.codfw.wmnet [production]
10:56 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2107.codfw.wmnet [production]
10:50 <moritzm> installing postgresql-15 security updates [production]
09:41 <joal> Replace pageview_actor data by backfilled correction [analytics]
09:38 <hashar> UTC morning backport window has been completed [production]
09:32 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2102.codfw.wmnet with OS bookworm [production]
09:29 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2107.codfw.wmnet with OS bookworm [production]
09:22 <hashar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1104392|[arwikisource] Enable the SandboxLink extension (T382218)]] (duration: 10m 23s) [production]
09:16 <hashar@deploy2002> hashar, hubaishan: Continuing with sync [production]
09:16 <hashar@deploy2002> hashar, hubaishan: Backport for [[gerrit:1104392|[arwikisource] Enable the SandboxLink extension (T382218)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
09:13 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2102.codfw.wmnet with reason: host reimage [production]
09:11 <hashar@deploy2002> Started scap sync-world: Backport for [[gerrit:1104392|[arwikisource] Enable the SandboxLink extension (T382218)]] [production]
09:09 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2107.codfw.wmnet with reason: host reimage [production]
09:07 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2102.codfw.wmnet with reason: host reimage [production]
09:06 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2107.codfw.wmnet with reason: host reimage [production]
09:04 <hashar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1104593|Update interwiki cache (T381379)]] (duration: 10m 36s) [production]
08:58 <hashar@deploy2002> hashar: Continuing with sync [production]
08:57 <hashar@deploy2002> hashar: Backport for [[gerrit:1104593|Update interwiki cache (T381379)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:53 <hashar@deploy2002> Started scap sync-world: Backport for [[gerrit:1104593|Update interwiki cache (T381379)]] [production]
08:48 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2102 [production]
08:48 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2102 [production]
08:48 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2107 [production]
08:48 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2107 [production]
08:48 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2107.codfw.wmnet with OS bookworm [production]
08:48 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2102.codfw.wmnet with OS bookworm [production]
08:47 <hashar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1103240|tigwiki: add logos (T381379)]], [[gerrit:1103159|tigwiki: add SITENAME, timezone and projectnamespace (T381379)]] (duration: 11m 37s) [production]
08:45 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2102.codfw.wmnet [production]
08:45 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2102.codfw.wmnet [production]
08:44 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2107.codfw.wmnet [production]
08:44 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2107.codfw.wmnet [production]
08:41 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2109.codfw.wmnet [production]
08:41 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2109.codfw.wmnet [production]
08:40 <hashar@deploy2002> anzx, hashar: Continuing with sync [production]
08:40 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2108.codfw.wmnet [production]
08:40 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2108.codfw.wmnet [production]
08:39 <hashar@deploy2002> anzx, hashar: Backport for [[gerrit:1103240|tigwiki: add logos (T381379)]], [[gerrit:1103159|tigwiki: add SITENAME, timezone and projectnamespace (T381379)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:35 <hashar@deploy2002> Started scap sync-world: Backport for [[gerrit:1103240|tigwiki: add logos (T381379)]], [[gerrit:1103159|tigwiki: add SITENAME, timezone and projectnamespace (T381379)]] [production]
08:34 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2108.codfw.wmnet with OS bookworm [production]
08:32 <hashar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1101867|[enwikinews] & [hewikinews] & [plwikinews]: Upgrade license to CC BY 4.0 (T381421)]] (duration: 23m 51s) [production]
08:28 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2109.codfw.wmnet with OS bookworm [production]
08:28 <dcausse> restarting blazegraph on wdqs2017 (BlazegraphFreeAllocatorsDecreasingRapidly) [production]
08:22 <hashar@deploy2002> hashar, anwon: Continuing with sync [production]
08:21 <hashar@deploy2002> hashar, anwon: Backport for [[gerrit:1101867|[enwikinews] & [hewikinews] & [plwikinews]: Upgrade license to CC BY 4.0 (T381421)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:12 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2108.codfw.wmnet with reason: host reimage [production]
08:09 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2109.codfw.wmnet with reason: host reimage [production]
08:08 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2108.codfw.wmnet with reason: host reimage [production]