201-250 of 10000 results (36ms)
2026-01-26 ยง
21:06 <arlolra@deploy2002> arlolra: Continuing with sync [production]
21:04 <arlolra@deploy2002> arlolra: Backport for [[gerrit:1230974|Deploy PRV to 21 wikis + bump 3 top50 to 100% (T415386)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:02 <arlolra@deploy2002> Started scap sync-world: Backport for [[gerrit:1230974|Deploy PRV to 21 wikis + bump 3 top50 to 100% (T415386)]] [production]
20:49 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1203 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87946 and previous config saved to /var/cache/conftool/dbconfig/20260126-204925-marostegui.json [production]
20:49 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1203.eqiad.wmnet with reason: Maintenance [production]
20:49 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1193 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87945 and previous config saved to /var/cache/conftool/dbconfig/20260126-204900-marostegui.json [production]
20:38 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1193', diff saved to https://phabricator.wikimedia.org/P87944 and previous config saved to /var/cache/conftool/dbconfig/20260126-203851-marostegui.json [production]
20:28 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1193', diff saved to https://phabricator.wikimedia.org/P87943 and previous config saved to /var/cache/conftool/dbconfig/20260126-202843-marostegui.json [production]
20:18 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1193 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87942 and previous config saved to /var/cache/conftool/dbconfig/20260126-201834-marostegui.json [production]
18:56 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db1224.eqiad.wmnet onto db1264.eqiad.wmnet [production]
18:56 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1264 gradually with 4 steps - Pool db1264.eqiad.wmnet in after cloning [production]
18:11 <marostegui@cumin1003> START - Cookbook sre.mysql.pool db1264 gradually with 4 steps - Pool db1264.eqiad.wmnet in after cloning [production]
18:09 <dreamyjazz@deploy2002> Finished scap sync-world: Backport for [[gerrit:1233228|Add CheckUser Suggested Investigations stream to ext-EventLogging]] (duration: 13m 12s) [production]
18:02 <dreamyjazz@deploy2002> dreamyjazz: Continuing with sync [production]
17:57 <dreamyjazz@deploy2002> dreamyjazz: Backport for [[gerrit:1233228|Add CheckUser Suggested Investigations stream to ext-EventLogging]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
17:56 <dreamyjazz@deploy2002> Started scap sync-world: Backport for [[gerrit:1233228|Add CheckUser Suggested Investigations stream to ext-EventLogging]] [production]
17:15 <damilare> smashpig upgraded from 8b4ebf34 to 96a6224d [fundraising]
16:57 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1224 gradually with 4 steps - Pool db1224.eqiad.wmnet in after cloning [production]
16:56 <komla@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) by 26 cores, 2000 gigabytes, 4 instances, 69632 ram (T414983) [wikiqlever]
16:56 <komla@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase by 26 cores, 2000 gigabytes, 4 instances, 69632 ram (T414983) [wikiqlever]
16:50 <jgiannelos@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
16:49 <jgiannelos@deploy2002> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
16:48 <jgiannelos@deploy2002> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]
16:47 <jgiannelos@deploy2002> helmfile [codfw] START helmfile.d/services/mobileapps: apply [production]
16:47 <jdrewniak@deploy2002> Finished scap sync-world: Backport for [[gerrit:1230961|Bumping portals submodule to master (T128546)]] (duration: 08m 57s) [production]
16:46 <jgiannelos@deploy2002> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
16:46 <jgiannelos@deploy2002> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
16:44 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.sanitize-wiki (exit_code=0) Checking sanitization for wikis kajwiki in section s5 [production]
16:43 <jdrewniak@deploy2002> jdrewniak: Continuing with sync [production]
16:41 <marostegui@cumin1003> START - Cookbook sre.mysql.sanitize-wiki Checking sanitization for wikis kajwiki in section s5 [production]
16:41 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.sanitize-wiki (exit_code=0) Managing sanitization for wikis kajwiki in section s5 [production]
16:40 <jdrewniak@deploy2002> jdrewniak: Backport for [[gerrit:1230961|Bumping portals submodule to master (T128546)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
16:38 <jdrewniak@deploy2002> Started scap sync-world: Backport for [[gerrit:1230961|Bumping portals submodule to master (T128546)]] [production]
16:35 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1233210|kajwiki: Update logos and timezone (T413283)]] (duration: 06m 32s) [production]
16:34 <marostegui@cumin1003> START - Cookbook sre.mysql.sanitize-wiki Managing sanitization for wikis kajwiki in section s5 [production]
16:32 <larssandergreen> tools upgraded from c75f7625 to 84323460 [fundraising]
16:31 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
16:31 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1233210|kajwiki: Update logos and timezone (T413283)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
16:29 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1233210|kajwiki: Update logos and timezone (T413283)]] [production]
16:19 <dancy@deploy2002> Installation of scap version "4.236.0" completed for 2 hosts [production]
16:17 <dancy@deploy2002> Installing scap version "4.236.0" for 2 host(s) [production]
16:12 <marostegui@cumin1003> START - Cookbook sre.mysql.pool db1224 gradually with 4 steps - Pool db1224.eqiad.wmnet in after cloning [production]
16:06 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1233206|kajwiki: Enable GrowthExperiments (T415027)]] (duration: 10m 04s) [production]
16:01 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
15:57 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1233206|kajwiki: Enable GrowthExperiments (T415027)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
15:56 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1233206|kajwiki: Enable GrowthExperiments (T415027)]] [production]
15:49 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1233205|Activate kajwiki (T413283)]] (duration: 07m 03s) [production]
15:45 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
15:44 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1233205|Activate kajwiki (T413283)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
15:42 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1233205|Activate kajwiki (T413283)]] [production]