1701-1750 of 10000 results (57ms)
2022-05-31 ยง
20:46 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:43 <urbanecm@deploy1002> Synchronized wmf-config/CommonSettings.php: 51f314f49e2df6ec7784b5200535bb45d8bec154: Assign similareditors right to the checkuser group (T307205) (duration: 03m 06s) [production]
20:41 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:40 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1178 (T60674)', diff saved to https://phabricator.wikimedia.org/P29266 and previous config saved to /var/cache/conftool/dbconfig/20220531-204054-ladsgroup.json [production]
20:40 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:40 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:39 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1101:3317', diff saved to https://phabricator.wikimedia.org/P29265 and previous config saved to /var/cache/conftool/dbconfig/20220531-203603-ladsgroup.json [production]
20:23 <urbanecm@deploy1002> Synchronized wmf-config/CommonSettings.php: 660afb14144db36d94deccae59d4ead096e10e5f: Add SimilarEditors extension โ€“ III: Add to CommonSettings (T306909) (duration: 03m 09s) [production]
20:20 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1101:3317 (T309311)', diff saved to https://phabricator.wikimedia.org/P29264 and previous config saved to /var/cache/conftool/dbconfig/20220531-202058-ladsgroup.json [production]
20:19 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 97551748271963ea59bd4f28b2fb1a1b48dd0c29: Add SimilarEditors extension โ€“ II: Add to InitialiseSettings, default off (T306909) (duration: 03m 06s) [production]
20:18 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:18 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:17 <bking@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge plugin upgrade - bking@cumin1001 - T309648 [production]
20:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:14 <urbanecm@deploy1002> Synchronized wmf-config/extension-list: b88690ee8ccbc50a51c6ef9dcdcbe3faecc3170f: Add SimilarEditors extension โ€“ I: Add to i18n (T306909) (duration: 03m 07s) [production]
20:11 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1178 (T60674)', diff saved to https://phabricator.wikimedia.org/P29263 and previous config saved to /var/cache/conftool/dbconfig/20220531-201059-ladsgroup.json [production]
20:11 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1178.eqiad.wmnet with reason: Maintenance [production]
20:10 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1178.eqiad.wmnet with reason: Maintenance [production]
20:10 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1126 (T60674)', diff saved to https://phabricator.wikimedia.org/P29262 and previous config saved to /var/cache/conftool/dbconfig/20220531-201051-ladsgroup.json [production]
20:08 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge plugin upgrade - bking@cumin1001 - T309648 [production]
19:55 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1126', diff saved to https://phabricator.wikimedia.org/P29261 and previous config saved to /var/cache/conftool/dbconfig/20220531-195546-ladsgroup.json [production]
19:41 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
19:40 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1126', diff saved to https://phabricator.wikimedia.org/P29259 and previous config saved to /var/cache/conftool/dbconfig/20220531-194040-ladsgroup.json [production]
19:40 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
19:40 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
19:36 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
19:33 <ladsgroup@deploy1002> Synchronized php-1.39.0-wmf.13/includes/: Backport: [[gerrit:801752|Allow sharding in site_stats update (T306589)]] (duration: 03m 20s) [production]
19:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1101:3317 (T309311)', diff saved to https://phabricator.wikimedia.org/P29258 and previous config saved to /var/cache/conftool/dbconfig/20220531-192623-ladsgroup.json [production]
19:26 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1101.eqiad.wmnet with reason: Maintenance [production]
19:26 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1101.eqiad.wmnet with reason: Maintenance [production]
19:25 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1126 (T60674)', diff saved to https://phabricator.wikimedia.org/P29257 and previous config saved to /var/cache/conftool/dbconfig/20220531-192535-ladsgroup.json [production]
19:16 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
19:15 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
19:15 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
19:12 <ladsgroup@deploy1002> Synchronized php-1.39.0-wmf.14/includes/: Backport: [[gerrit:801751|Allow sharding in site_stats update (T306589)]] (duration: 03m 25s) [production]
19:11 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
19:07 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:801801|Enable MultiShardSiteStats in several large wikis and testwiki (T306589)]] (duration: 03m 09s) [production]
19:06 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
18:59 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
18:59 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
18:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1126 (T60674)', diff saved to https://phabricator.wikimedia.org/P29256 and previous config saved to /var/cache/conftool/dbconfig/20220531-185917-ladsgroup.json [production]
18:59 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1126.eqiad.wmnet with reason: Maintenance [production]
18:59 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1126.eqiad.wmnet with reason: Maintenance [production]
18:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1114 (T60674)', diff saved to https://phabricator.wikimedia.org/P29255 and previous config saved to /var/cache/conftool/dbconfig/20220531-185909-ladsgroup.json [production]
18:53 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
18:48 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
18:46 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance [production]
18:46 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance [production]