4751-4800 of 10000 results (139ms)
2025-03-18 ยง
13:58 <tgr@deploy2002> tgr: Continuing with sync [production]
13:57 <tgr@deploy2002> tgr: Backport for [[gerrit:1128873|Revert^2 "Add Portal namespace to kaawiki"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:51 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1128873|Revert^2 "Add Portal namespace to kaawiki"]] [production]
13:50 <godog> bounce mtail on centrallog2002 [production]
13:46 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/mediawiki-dumps-legacy: apply [production]
13:46 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/services/mediawiki-dumps-legacy: apply [production]
13:43 <Lucas_WMDE> pulled d2fa9d6821 / Ieab79b7eb1 to /src/mediawiki-staging on deploy2002 to bring config back in sync with deployed state (due to failed deployment, T389203) [production]
13:43 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/mediawiki-dumps-legacy: apply [production]
13:43 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/services/mediawiki-dumps-legacy: apply [production]
13:15 <lucaswerkmeister-wmde@deploy2002> hashar, lucaswerkmeister-wmde: Continuing with sync [production]
13:12 <lucaswerkmeister-wmde@deploy2002> hashar, lucaswerkmeister-wmde: Backport for [[gerrit:1128781|Add Portal namespace to kaawiki (T388158)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:05 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1128781|Add Portal namespace to kaawiki (T388158)]] [production]
12:40 <elukey@deploy2002> helmfile [eqiad] DONE helmfile.d/admin 'sync'. [production]
12:39 <moritzm> installing freetype2 security updates [production]
12:39 <elukey@deploy2002> helmfile [eqiad] START helmfile.d/admin 'sync'. [production]
12:38 <elukey@deploy2002> helmfile [codfw] DONE helmfile.d/admin 'sync'. [production]
12:38 <elukey@deploy2002> helmfile [codfw] START helmfile.d/admin 'sync'. [production]
12:35 <moritzm> rebalance ganeti eqiad/A following reimages T382507 [production]
12:34 <ladsgroup@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
12:33 <ladsgroup@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply [production]
12:33 <ladsgroup@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
12:32 <ladsgroup@deploy2002> helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply [production]
12:31 <ladsgroup@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
12:31 <ladsgroup@deploy2002> helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply [production]
12:30 <ladsgroup@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop: apply [production]
12:30 <ladsgroup@deploy2002> helmfile [staging] START helmfile.d/services/changeprop: apply [production]
12:30 <ladsgroup@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop: apply [production]
12:30 <ladsgroup@deploy2002> helmfile [staging] START helmfile.d/services/changeprop: apply [production]
12:29 <ladsgroup@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop: apply [production]
12:28 <ladsgroup@deploy2002> helmfile [staging] START helmfile.d/services/changeprop: apply [production]
12:27 <dbrant@deploy2002> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]
12:26 <dbrant@deploy2002> helmfile [codfw] START helmfile.d/services/mobileapps: apply [production]
12:26 <dbrant@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
12:26 <hnowlan@deploy2002> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
12:25 <dbrant@deploy2002> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
12:24 <dbrant@deploy2002> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
12:24 <dbrant@deploy2002> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
12:16 <hnowlan@deploy2002> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
11:47 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.addnode (exit_code=99) for new host ganeti1029.eqiad.wmnet to cluster eqiad and group A [production]
11:46 <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1128819|Bump thumbnail steps to 20% (T360589)]] (duration: 17m 41s) [production]
11:43 <jmm@cumin2002> START - Cookbook sre.ganeti.addnode for new host ganeti1029.eqiad.wmnet to cluster eqiad and group A [production]
11:35 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
11:35 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:1128819|Bump thumbnail steps to 20% (T360589)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
11:34 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1029.eqiad.wmnet [production]
11:28 <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1128819|Bump thumbnail steps to 20% (T360589)]] [production]
11:26 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1029.eqiad.wmnet [production]
11:04 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
11:01 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:1128819|Bump thumbnail steps to 20% (T360589)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
10:54 <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1128819|Bump thumbnail steps to 20% (T360589)]] [production]
10:36 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti1029.eqiad.wmnet with OS bookworm [production]