3951-4000 of 10000 results (68ms)
2022-05-23 ยง
21:00 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:49 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:49 <cjming> end of UTC late backport window [production]
20:48 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:48 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@2f7ddb1]: increase driver memory_overhead for convert_to_esbulk (duration: 02m 20s) [production]
20:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:47 <cjming@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:797424|Deploy TOC A/B test to frwiki, ptwiki at 50% (T306607)]] (duration: 00m 52s) [production]
20:46 <ebernhardson@deploy1002> Started deploy [wikimedia/discovery/analytics@2f7ddb1]: increase driver memory_overhead for convert_to_esbulk [production]
20:42 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:41 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:41 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:40 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:40 <jforrester@deploy1002> Synchronized wmf-config/extension-list: Config: [[gerrit:593352|Drop CodeReview, Part III: Drop from i18n build step (T116948)]] (duration: 00m 51s) [production]
20:37 <jforrester@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:593351|Drop CodeReview, Part II: Stop configuring it anywhere (T116948)]] (duration: 00m 51s) [production]
20:35 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:35 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:34 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:34 <jforrester@deploy1002> Synchronized wmf-config/CommonSettings.php: Config: [[gerrit:593350|Drop CodeReview, Part I: Stop loading it anywhere (T116948)]] (duration: 00m 51s) [production]
20:34 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:28 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:28 <cjming@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:789613|Add localized wordmark for plwiktionary (T307683)]] (duration: 00m 51s) [production]
20:28 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:27 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:27 <cjming@deploy1002> Synchronized static/images/mobile/copyright/wiktionary-wordmark-pl.svg: Config: [[gerrit:789613|Add localized wordmark for plwiktionary (T307683)]] (duration: 00m 50s) [production]
20:24 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@aa49833]: increase memory_overhead for convert_to_esbulk (duration: 02m 24s) [production]
20:23 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:22 <ebernhardson@deploy1002> Started deploy [wikimedia/discovery/analytics@aa49833]: increase memory_overhead for convert_to_esbulk [production]
20:21 <cjming@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:797312|Start writing to cuc_actor in test wikis (T233004)]] (duration: 00m 50s) [production]
20:18 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:17 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:16 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:13 <cjming@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:793766|commonswiki: Enable wgCopyUploadAllowOnWikiDomainConfig (T300407)]] (duration: 00m 52s) [production]
20:11 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:11 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:10 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 20:00:00 on 8 hosts with reason: Maintenance [production]
20:10 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 20:00:00 on 8 hosts with reason: Maintenance [production]
20:10 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10:00:00 on db2104.codfw.wmnet with reason: Maintenance [production]
20:10 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 10:00:00 on db2104.codfw.wmnet with reason: Maintenance [production]
20:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
19:47 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1113:3315 (T298560)', diff saved to https://phabricator.wikimedia.org/P28366 and previous config saved to /var/cache/conftool/dbconfig/20220523-194659-ladsgroup.json [production]
19:46 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1113.eqiad.wmnet with reason: Maintenance [production]
19:46 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1113.eqiad.wmnet with reason: Maintenance [production]
19:41 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 20:00:00 on 6 hosts with reason: Maintenance [production]
19:40 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 20:00:00 on 6 hosts with reason: Maintenance [production]
19:40 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10:00:00 on db2105.codfw.wmnet with reason: Maintenance [production]
19:40 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 10:00:00 on db2105.codfw.wmnet with reason: Maintenance [production]
19:29 <kharlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/linkrecommendation: apply [production]