551-600 of 10000 results (28ms)
2025-11-04 ยง
19:06 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-jobrunner: apply [production]
19:06 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P84788 and previous config saved to /var/cache/conftool/dbconfig/20251104-190634-marostegui.json [production]
19:06 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-jobrunner: apply [production]
19:06 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-jobrunner: apply [production]
19:05 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-jobrunner: apply [production]
19:05 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-jobrunner: apply [production]
19:04 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
19:04 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
19:03 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
19:03 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
18:55 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
18:55 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
18:52 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
18:51 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
18:51 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P84785 and previous config saved to /var/cache/conftool/dbconfig/20251104-185126-marostegui.json [production]
18:51 <dancy@deploy2002> Installation of scap version "4.222.0" completed for 2 hosts [production]
18:51 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
18:50 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
18:49 <dancy@deploy2002> Installing scap version "4.222.0" for 2 host(s) [production]
18:48 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
18:48 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
18:40 <swfrench@deploy2002> Finished scap sync-world: Fully migrate mw-(api-int|jobrunner) to 8.3 - T405955 (duration: 07m 49s) [production]
18:36 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2182 (T407997)', diff saved to https://phabricator.wikimedia.org/P84784 and previous config saved to /var/cache/conftool/dbconfig/20251104-183619-marostegui.json [production]
18:32 <swfrench@deploy2002> Started scap sync-world: Fully migrate mw-(api-int|jobrunner) to 8.3 - T405955 [production]
18:21 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudweb2002-dev.wikimedia.org with OS trixie [production]
18:16 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2182 (T407997)', diff saved to https://phabricator.wikimedia.org/P84783 and previous config saved to /var/cache/conftool/dbconfig/20251104-181648-marostegui.json [production]
18:16 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2182.codfw.wmnet with reason: Maintenance [production]
18:16 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2168 (T407997)', diff saved to https://phabricator.wikimedia.org/P84782 and previous config saved to /var/cache/conftool/dbconfig/20251104-181623-marostegui.json [production]
18:12 <fnegri@cumin1003> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database thwikimedia (T409201) [production]
18:09 <jhuneidi@deploy2002> sync-world aborted: testwikis to 1.46.0-wmf.1 refs T408271 (duration: 03m 00s) [production]
18:06 <jhuneidi@deploy2002> Started scap sync-world: testwikis to 1.46.0-wmf.1 refs T408271 [production]
18:01 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P84781 and previous config saved to /var/cache/conftool/dbconfig/20251104-180116-marostegui.json [production]
17:58 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers [tools]
17:46 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P84780 and previous config saved to /var/cache/conftool/dbconfig/20251104-174608-marostegui.json [production]
17:39 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers [tools]
17:38 <dcaro> removed tools and toolsbeta redis from the scrapes targets (moved to tools/toolsbeta prometheus) [metricsinfra]
17:31 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2168 (T407997)', diff saved to https://phabricator.wikimedia.org/P84779 and previous config saved to /var/cache/conftool/dbconfig/20251104-173100-marostegui.json [production]
17:26 <fnegri@cumin1003> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database tokwiki (T404570) [production]
17:26 <fnegri@cumin1003> START - Cookbook sre.wikireplicas.add-wiki for database tokwiki (T404570) [production]
17:26 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component maintain-kubeusers [tools]
17:24 <fnegri@cumin1003> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database tokwiki (T404566) [production]
17:24 <fnegri@cumin1003> START - Cookbook sre.wikireplicas.add-wiki for database tokwiki (T404566) [production]
17:24 <fnegri@cumin1003> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database tokwiki (T404703) [production]
17:23 <fnegri@cumin1003> START - Cookbook sre.wikireplicas.add-wiki for database tokwiki (T404703) [production]
17:23 <fnegri@cumin1003> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database mswikiquote (T404703) [production]
17:23 <Krinkle> Delete https://en.wikipedia.beta.wmcloud.org/wiki/MediaWiki:Robots.txt so that https://en.wikipedia.beta.wmcloud.org/robots.txt goes back to labs-default of Disallow all. [releng]
17:23 <fnegri@cumin1003> START - Cookbook sre.wikireplicas.add-wiki for database mswikiquote (T404703) [production]
17:16 <wfan> donorwiki upgraded from 09caf170 to 8fe00530 [production]
17:15 <wfan> payments-wiki upgraded from 0132998e to 8fe00530 [production]
17:15 <fnegri@cumin1003> START - Cookbook sre.wikireplicas.add-wiki for database thwikimedia (T409201) [production]