1351-1400 of 10000 results (71ms)
2022-10-17 ยง
14:20 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
14:20 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/eventgate-analytics-external: apply [production]
14:20 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
14:20 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/eventgate-analytics-external: apply [production]
14:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2109 (T318955)', diff saved to https://phabricator.wikimedia.org/P35514 and previous config saved to /var/cache/conftool/dbconfig/20221017-141921-ladsgroup.json [production]
14:16 <cgoubert@cumin1001> conftool action : set/pooled=false; selector: dnsdisc=eventgate-analytics-external,name=eqiad [production]
14:16 <claime> Depooling eventgate-analytics-external in eqiad - T303543 [production]
14:14 <cgoubert@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=eventgate-analytics-external,name=codfw [production]
14:14 <claime> Repooling eventgate-analytics-external in codfw - T303543 [production]
14:13 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
14:13 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/eventgate-analytics-external: apply [production]
14:09 <cgoubert@cumin1001> conftool action : set/pooled=false; selector: dnsdisc=eventgate-analytics-external,name=codfw [production]
14:09 <claime> Depooling eventgate-analytics-external in codfw - T303543 [production]
14:07 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2168:3317', diff saved to https://phabricator.wikimedia.org/P35513 and previous config saved to /var/cache/conftool/dbconfig/20221017-140717-ladsgroup.json [production]
14:05 <cgoubert@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=eventgate-analytics,name=eqiad [production]
14:05 <claime> Repooling eventgate-analytics in eqiad - T303543 [production]
14:04 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics: apply [production]
14:04 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2109 (T318955)', diff saved to https://phabricator.wikimedia.org/P35512 and previous config saved to /var/cache/conftool/dbconfig/20221017-140452-ladsgroup.json [production]
14:04 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2109.codfw.wmnet with reason: Maintenance [production]
14:04 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 8:00:00 on db2109.codfw.wmnet with reason: Maintenance [production]
14:04 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2105 (T318955)', diff saved to https://phabricator.wikimedia.org/P35511 and previous config saved to /var/cache/conftool/dbconfig/20221017-140430-ladsgroup.json [production]
14:04 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/eventgate-analytics: apply [production]
14:00 <cgoubert@cumin1001> conftool action : set/pooled=false; selector: dnsdisc=eventgate-analytics,name=eqiad [production]
14:00 <claime> Depooling eventgate-analytics in eqiad - T303543 [production]
13:57 <cgoubert@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=eventgate-analytics,name=codfw [production]
13:56 <claime> Repooling eventgate-analytics in codfw - T303543 [production]
13:56 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/eventgate-analytics: apply [production]
13:56 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/eventgate-analytics: apply [production]
13:52 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2168:3317 (T318950)', diff saved to https://phabricator.wikimedia.org/P35510 and previous config saved to /var/cache/conftool/dbconfig/20221017-135211-ladsgroup.json [production]
13:51 <cgoubert@cumin1001> conftool action : set/pooled=false; selector: dnsdisc=eventgate-analytics,name=codfw [production]
13:50 <claime> Depooling eventgate-analytics in codfw - T303543 [production]
13:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2168:3317 (T318950)', diff saved to https://phabricator.wikimedia.org/P35509 and previous config saved to /var/cache/conftool/dbconfig/20221017-134953-ladsgroup.json [production]
13:49 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2168.codfw.wmnet with reason: Maintenance [production]
13:49 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db2168.codfw.wmnet with reason: Maintenance [production]
13:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2159 (T318950)', diff saved to https://phabricator.wikimedia.org/P35508 and previous config saved to /var/cache/conftool/dbconfig/20221017-134931-ladsgroup.json [production]
13:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2105', diff saved to https://phabricator.wikimedia.org/P35507 and previous config saved to /var/cache/conftool/dbconfig/20221017-134924-ladsgroup.json [production]
13:49 <jclark@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:48 <claime> Repooled eventgate-logging-external in equiad - T303543 [production]
13:47 <cgoubert@deploy1002> helmfile [staging] DONE helmfile.d/services/eventgate-logging-external: apply [production]
13:47 <jclark@cumin1001> START - Cookbook sre.dns.netbox [production]
13:46 <cgoubert@deploy1002> helmfile [staging] START helmfile.d/services/eventgate-logging-external: apply [production]
13:29 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:843481|GrowthExperiments: enable the vue version of mentee overview in all wikis (T300532)]] (duration: 06m 24s) [production]
13:28 <cgoubert@cumin1001> conftool action : set/pooled=false; selector: dnsdisc=eventgate-logging-external,name=codfw [production]
13:27 <claime> Depooling eventgate-logging-external in codfw - T303543 [production]
13:23 <urbanecm@deploy1002> urbanecm and sgimeno: Backport for [[gerrit:843481|GrowthExperiments: enable the vue version of mentee overview in all wikis (T300532)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
13:23 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:843481|GrowthExperiments: enable the vue version of mentee overview in all wikis (T300532)]] [production]
13:22 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:842967|Enable Sandbox Extension at Bengali Wikiquote (T320903)]] (duration: 04m 54s) [production]
13:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P35504 and previous config saved to /var/cache/conftool/dbconfig/20221017-131918-ladsgroup.json [production]
13:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2105 (T318955)', diff saved to https://phabricator.wikimedia.org/P35503 and previous config saved to /var/cache/conftool/dbconfig/20221017-131911-ladsgroup.json [production]
13:18 <urbanecm@deploy1002> urbanecm and mdsshakil: Backport for [[gerrit:842967|Enable Sandbox Extension at Bengali Wikiquote (T320903)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]