2401-2450 of 10000 results (78ms)
2022-06-30 ยง
21:53 <thcipriani@deploy1002> Synchronized portals/wikipedia.org/assets: Config: [[gerrit:810077|Bumping portals to master (T128546)]] (duration: 03m 24s) [production]
21:48 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:47 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:46 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:41 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:40 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:40 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:39 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:34 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:33 <thcipriani@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:810060|tawikisource: Add English alias for Author/Author_talk namespace (T165813)]] (duration: 03m 42s) [production]
21:33 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:33 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:32 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:25 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169 (T309311)', diff saved to https://phabricator.wikimedia.org/P30696 and previous config saved to /var/cache/conftool/dbconfig/20220630-212558-ladsgroup.json [production]
21:10 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169', diff saved to https://phabricator.wikimedia.org/P30695 and previous config saved to /var/cache/conftool/dbconfig/20220630-211053-ladsgroup.json [production]
21:07 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:06 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:06 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:05 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:59 <thcipriani@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:809165|Enable Wikistories on idwiki (T311143)]] (duration: 03m 31s) [production]
20:55 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169', diff saved to https://phabricator.wikimedia.org/P30694 and previous config saved to /var/cache/conftool/dbconfig/20220630-205548-ladsgroup.json [production]
20:50 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:49 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:49 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:40 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169 (T309311)', diff saved to https://phabricator.wikimedia.org/P30693 and previous config saved to /var/cache/conftool/dbconfig/20220630-204043-ladsgroup.json [production]
20:38 <thcipriani@deploy1002> Finished scap: Backport for [[gerrit:806960]] QuickSurveys: Deploy research-incentive to jawiki (duration: 23m 53s) [production]
20:38 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:37 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:37 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:33 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:26 <bd808> Rebuilding Toolhub search indices [production]
20:24 <bd808@deploy1002> helmfile [eqiad] DONE helmfile.d/services/toolhub: apply [production]
20:23 <bd808@deploy1002> helmfile [eqiad] START helmfile.d/services/toolhub: apply [production]
20:23 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:22 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:21 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:19 <bd808@deploy1002> helmfile [codfw] DONE helmfile.d/services/toolhub: apply [production]
20:18 <bd808@deploy1002> helmfile [codfw] START helmfile.d/services/toolhub: apply [production]
20:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:17 <bd808@deploy1002> helmfile [staging] DONE helmfile.d/services/toolhub: apply [production]
20:16 <bd808@deploy1002> helmfile [staging] START helmfile.d/services/toolhub: apply [production]
20:14 <thcipriani@deploy1002> Started scap: Backport for [[gerrit:806960]] QuickSurveys: Deploy research-incentive to jawiki [production]
19:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1169 (T309311)', diff saved to https://phabricator.wikimedia.org/P30692 and previous config saved to /var/cache/conftool/dbconfig/20220630-193254-ladsgroup.json [production]
19:32 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1169.eqiad.wmnet with reason: Maintenance [production]
19:32 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1169.eqiad.wmnet with reason: Maintenance [production]
19:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1132 (T309311)', diff saved to https://phabricator.wikimedia.org/P30691 and previous config saved to /var/cache/conftool/dbconfig/20220630-193223-ladsgroup.json [production]
19:17 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1132', diff saved to https://phabricator.wikimedia.org/P30690 and previous config saved to /var/cache/conftool/dbconfig/20220630-191718-ladsgroup.json [production]
19:02 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1132', diff saved to https://phabricator.wikimedia.org/P30689 and previous config saved to /var/cache/conftool/dbconfig/20220630-190213-ladsgroup.json [production]