2901-2950 of 10000 results (69ms)
2022-09-12 ยง
20:51 <samtar@deploy1002> Started scap: Backport for [[gerrit:831549|Set track_total_hits to true]] [production]
20:49 <samtar@deploy1002> Finished scap: Backport for [[gerrit:831117|Enable Nearby on Hebrew and French Wikipedia (T246493)]] (duration: 07m 27s) [production]
20:49 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:48 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:46 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2176', diff saved to https://phabricator.wikimedia.org/P34548 and previous config saved to /var/cache/conftool/dbconfig/20220912-204617-ladsgroup.json [production]
20:42 <samtar@deploy1002> samtar and jdlrobson: Backport for [[gerrit:831117|Enable Nearby on Hebrew and French Wikipedia (T246493)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
20:42 <samtar@deploy1002> Started scap: Backport for [[gerrit:831117|Enable Nearby on Hebrew and French Wikipedia (T246493)]] [production]
20:42 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:41 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:41 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:40 <samtar@deploy1002> Finished scap: Backport for [[gerrit:830917|Deploy Research Incentive Survey to idwiki (T316466)]] (duration: 06m 25s) [production]
20:39 <jhathaway> testing exim config change on mx1001.wikimedia.org [production]
20:38 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:38 <herron@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host dispatch-be1001.eqiad.wmnet [production]
20:34 <samtar@deploy1002> samtar and dani: Backport for [[gerrit:830917|Deploy Research Incentive Survey to idwiki (T316466)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
20:34 <samtar@deploy1002> Started scap: Backport for [[gerrit:830917|Deploy Research Incentive Survey to idwiki (T316466)]] [production]
20:33 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:32 <samtar@deploy1002> Finished scap: Backport for [[gerrit:831548|Re-enable track_total_hits for elastic7 (T317374)]] (duration: 06m 12s) [production]
20:32 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:32 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:31 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2176', diff saved to https://phabricator.wikimedia.org/P34547 and previous config saved to /var/cache/conftool/dbconfig/20220912-203110-ladsgroup.json [production]
20:29 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:26 <samtar@deploy1002> samtar and ebernhardson: Backport for [[gerrit:831548|Re-enable track_total_hits for elastic7 (T317374)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet [production]
20:26 <samtar@deploy1002> Started scap: Backport for [[gerrit:831548|Re-enable track_total_hits for elastic7 (T317374)]] [production]
20:24 <samtar@deploy1002> Finished scap: Backport for [[gerrit:830982|Create six more namespaces (three content namespaces and their corresponding three discussion namespaces) on the bn.wiktionary (T317424)]] (duration: 08m 14s) [production]
20:24 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:24 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1147 (T314041)', diff saved to https://phabricator.wikimedia.org/P34546 and previous config saved to /var/cache/conftool/dbconfig/20220912-202359-ladsgroup.json [production]
20:23 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1147.eqiad.wmnet with reason: Maintenance [production]
20:23 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1147.eqiad.wmnet with reason: Maintenance [production]
20:23 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:23 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:22 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:17 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:16 <samtar@deploy1002> samtar and aishik: Backport for [[gerrit:830982|Create six more namespaces (three content namespaces and their corresponding three discussion namespaces) on the bn.wiktionary (T317424)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet [production]
20:16 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:16 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:16 <samtar@deploy1002> Started scap: Backport for [[gerrit:830982|Create six more namespaces (three content namespaces and their corresponding three discussion namespaces) on the bn.wiktionary (T317424)]] [production]
20:16 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2176 (T312863)', diff saved to https://phabricator.wikimedia.org/P34545 and previous config saved to /var/cache/conftool/dbconfig/20220912-201604-ladsgroup.json [production]
20:15 <herron@cumin1001> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dispatch-be1001.eqiad.wmnet on all recursors [production]
20:14 <herron@cumin1001> START - Cookbook sre.dns.wipe-cache dispatch-be1001.eqiad.wmnet on all recursors [production]
20:14 <herron@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:14 <samtar@deploy1002> Finished scap: Backport for [[gerrit:831167|Mark spcomwiki and searchcomwiki as closed (T285685)]] (duration: 05m 40s) [production]
20:13 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:13 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:12 <herron@cumin1001> START - Cookbook sre.dns.netbox [production]
20:12 <herron@cumin1001> START - Cookbook sre.ganeti.makevm for new host dispatch-be1001.eqiad.wmnet [production]
20:11 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
20:09 <samtar@deploy1002> samtar and zabe: Backport for [[gerrit:831167|Mark spcomwiki and searchcomwiki as closed (T285685)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]