2151-2200 of 10000 results (86ms)
2023-03-13 §
07:58 <zabe@deploy2002> Finished scap: Backport for [[gerrit:897188|use core Renameuser classes (T27482)]], [[gerrit:897187|UserRenameHandler: Use core RenameUser classes (T27482)]] (duration: 07m 02s) [production]
07:53 <zabe@deploy2002> zabe: Backport for [[gerrit:897188|use core Renameuser classes (T27482)]], [[gerrit:897187|UserRenameHandler: Use core RenameUser classes (T27482)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
07:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2120', diff saved to https://phabricator.wikimedia.org/P45740 and previous config saved to /var/cache/conftool/dbconfig/20230313-075232-marostegui.json [production]
07:51 <zabe@deploy2002> Started scap: Backport for [[gerrit:897188|use core Renameuser classes (T27482)]], [[gerrit:897187|UserRenameHandler: Use core RenameUser classes (T27482)]] [production]
07:37 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2120', diff saved to https://phabricator.wikimedia.org/P45739 and previous config saved to /var/cache/conftool/dbconfig/20230313-073725-marostegui.json [production]
07:37 <marostegui> Remove pagetriage_log from enwiki T328309 [production]
07:32 <kartik@deploy2002> Finished scap: Backport for [[gerrit:897404|testwiki: Enable Section Translation on 11 Wikipedias (T327102 T326541)]] (duration: 17m 04s) [production]
07:25 <kartik@deploy2002> kartik: Backport for [[gerrit:897404|testwiki: Enable Section Translation on 11 Wikipedias (T327102 T326541)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
07:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2120 (T329260)', diff saved to https://phabricator.wikimedia.org/P45738 and previous config saved to /var/cache/conftool/dbconfig/20230313-072219-marostegui.json [production]
07:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db2120 (T329260)', diff saved to https://phabricator.wikimedia.org/P45737 and previous config saved to /var/cache/conftool/dbconfig/20230313-071522-marostegui.json [production]
07:15 <kartik@deploy2002> Started scap: Backport for [[gerrit:897404|testwiki: Enable Section Translation on 11 Wikipedias (T327102 T326541)]] [production]
07:15 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2120.codfw.wmnet with reason: Maintenance [production]
07:15 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2120.codfw.wmnet with reason: Maintenance [production]
07:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2108 (T329260)', diff saved to https://phabricator.wikimedia.org/P45736 and previous config saved to /var/cache/conftool/dbconfig/20230313-071501-marostegui.json [production]
06:59 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2108', diff saved to https://phabricator.wikimedia.org/P45735 and previous config saved to /var/cache/conftool/dbconfig/20230313-065954-marostegui.json [production]
06:52 <marostegui_> Remove pagetriage_log from testwiki and test2wiki T328309 [production]
06:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2108', diff saved to https://phabricator.wikimedia.org/P45734 and previous config saved to /var/cache/conftool/dbconfig/20230313-064448-marostegui.json [production]
06:35 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 9873 [production]
06:35 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 9873 [production]
06:34 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 9507 [production]
06:34 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 9507 [production]
06:33 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 15830 [production]
06:33 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 15830 [production]
06:31 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 9902 [production]
06:31 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 9902 [production]
06:29 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 8966 [production]
06:29 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2108 (T329260)', diff saved to https://phabricator.wikimedia.org/P45733 and previous config saved to /var/cache/conftool/dbconfig/20230313-062942-marostegui.json [production]
06:29 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 8966 [production]
06:27 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 34549 [production]
06:27 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 34549 [production]
06:25 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 29357 [production]
06:25 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 29357 [production]
06:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db2108 (T329260)', diff saved to https://phabricator.wikimedia.org/P45732 and previous config saved to /var/cache/conftool/dbconfig/20230313-062244-marostegui.json [production]
06:22 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2108.codfw.wmnet with reason: Maintenance [production]
06:22 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2108.codfw.wmnet with reason: Maintenance [production]
06:21 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 138886 [production]
06:19 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 138886 [production]
06:18 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2100.codfw.wmnet with reason: Maintenance [production]
06:18 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2100.codfw.wmnet with reason: Maintenance [production]
06:16 <marostegui_> Deploy schema change on s3 codfw dbmaint T329684 [production]
06:13 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2098.codfw.wmnet with reason: Maintenance [production]
06:13 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2098.codfw.wmnet with reason: Maintenance [production]
04:37 <kart_> Updated cxserver to 2023-03-09-061555-production (T331097, T327102, T326541) [production]
04:19 <kartik@deploy2002> helmfile [codfw] DONE helmfile.d/services/cxserver: apply [production]
04:19 <kartik@deploy2002> helmfile [codfw] START helmfile.d/services/cxserver: apply [production]
04:18 <kartik@deploy2002> helmfile [eqiad] DONE helmfile.d/services/cxserver: apply [production]
04:17 <kartik@deploy2002> helmfile [eqiad] START helmfile.d/services/cxserver: apply [production]
04:12 <kartik@deploy2002> helmfile [staging] DONE helmfile.d/services/cxserver: apply [production]
04:12 <kartik@deploy2002> helmfile [staging] START helmfile.d/services/cxserver: apply [production]
2023-03-12 §
10:47 <elukey> reset offsets on kafka jumbo for benthos webrequest live (as indicated in https://phabricator.wikimedia.org/T331801#8685569) [production]