8501-8550 of 10000 results (87ms)
2022-11-29 ยง
21:38 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-debug: apply [production]
21:37 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2146', diff saved to https://phabricator.wikimedia.org/P41803 and previous config saved to /var/cache/conftool/dbconfig/20221129-213710-marostegui.json [production]
21:36 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mw-debug: apply [production]
21:36 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply [production]
21:36 <urbanecm@deploy1002> urbanecm and matmarex: Backport for [[gerrit:856551|Use new DiscussionTools heading markup on plwiki (T314714)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
21:35 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-debug: apply [production]
21:34 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:856551|Use new DiscussionTools heading markup on plwiki (T314714)]] [production]
21:30 <jhathaway@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw1498.eqiad.wmnet [production]
21:30 <jhathaway@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw1497.eqiad.wmnet [production]
21:30 <jhathaway@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw1496.eqiad.wmnet [production]
21:30 <jhathaway@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw1495.eqiad.wmnet [production]
21:30 <jhathaway@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw1494.eqiad.wmnet [production]
21:29 <jhathaway@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw1493.eqiad.wmnet [production]
21:29 <jhathaway@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw1492.eqiad.wmnet [production]
21:29 <jhathaway@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw1491.eqiad.wmnet [production]
21:29 <jhathaway@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw1490.eqiad.wmnet [production]
21:29 <jhathaway@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw1489.eqiad.wmnet [production]
21:25 <jhathaway@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw1489.eqiad.wmnet [production]
21:24 <robh@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cp5021 [production]
21:23 <robh@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cp5021 [production]
21:23 <jhathaway@puppetmaster1001> conftool action : set/pooled=no; selector: name=mw1489.eqiad.wmnet [production]
21:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2146 (T321126)', diff saved to https://phabricator.wikimedia.org/P41802 and previous config saved to /var/cache/conftool/dbconfig/20221129-212203-marostegui.json [production]
21:20 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-debug: apply [production]
21:19 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db2146 (T321126)', diff saved to https://phabricator.wikimedia.org/P41801 and previous config saved to /var/cache/conftool/dbconfig/20221129-211940-marostegui.json [production]
21:19 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2146.codfw.wmnet with reason: Maintenance [production]
21:19 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mw-debug: apply [production]
21:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply [production]
21:19 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 5:00:00 on db2146.codfw.wmnet with reason: Maintenance [production]
21:19 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2145 (T321126)', diff saved to https://phabricator.wikimedia.org/P41800 and previous config saved to /var/cache/conftool/dbconfig/20221129-211918-marostegui.json [production]
21:18 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-debug: apply [production]
21:18 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:851714|Deploy Research Incentive survey on frwiki (T321930)]] (duration: 15m 15s) [production]
21:13 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-debug: apply [production]
21:12 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mw-debug: apply [production]
21:12 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply [production]
21:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-debug: apply [production]
21:05 <urbanecm@deploy1002> urbanecm and dani: Backport for [[gerrit:851714|Deploy Research Incentive survey on frwiki (T321930)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet [production]
21:05 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-debug: apply [production]
21:04 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mw-debug: apply [production]
21:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply [production]
21:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P41799 and previous config saved to /var/cache/conftool/dbconfig/20221129-210412-marostegui.json [production]
21:03 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-debug: apply [production]
21:02 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:851714|Deploy Research Incentive survey on frwiki (T321930)]] [production]
20:49 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P41798 and previous config saved to /var/cache/conftool/dbconfig/20221129-204905-marostegui.json [production]
20:47 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2182 (T323907)', diff saved to https://phabricator.wikimedia.org/P41797 and previous config saved to /var/cache/conftool/dbconfig/20221129-204752-ladsgroup.json [production]
20:33 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2145 (T321126)', diff saved to https://phabricator.wikimedia.org/P41796 and previous config saved to /var/cache/conftool/dbconfig/20221129-203359-marostegui.json [production]
20:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P41795 and previous config saved to /var/cache/conftool/dbconfig/20221129-203246-ladsgroup.json [production]
20:31 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db2145 (T321126)', diff saved to https://phabricator.wikimedia.org/P41794 and previous config saved to /var/cache/conftool/dbconfig/20221129-203135-marostegui.json [production]
20:31 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2145.codfw.wmnet with reason: Maintenance [production]
20:31 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 5:00:00 on db2145.codfw.wmnet with reason: Maintenance [production]
20:30 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2141.codfw.wmnet with reason: Maintenance [production]