2251-2300 of 10000 results (75ms)
2023-02-08 ยง
14:42 <jforrester@deploy1002> Started scap: Backport for [[gerrit:887751|Replace trwiki temporary legacy logo with one including the wordmark (T329047)]] [production]
14:41 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1201', diff saved to https://phabricator.wikimedia.org/P43823 and previous config saved to /var/cache/conftool/dbconfig/20230208-144119-marostegui.json [production]
14:41 <jforrester@deploy1002> Finished scap: Backport for [[gerrit:833771|Move non-variant wgMFUseWikibase to CommonSettings]] (duration: 07m 37s) [production]
14:37 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db2125 (T328817)', diff saved to https://phabricator.wikimedia.org/P43822 and previous config saved to /var/cache/conftool/dbconfig/20230208-143756-marostegui.json [production]
14:37 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2125.codfw.wmnet with reason: Maintenance [production]
14:37 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2125.codfw.wmnet with reason: Maintenance [production]
14:37 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2104 (T328817)', diff saved to https://phabricator.wikimedia.org/P43821 and previous config saved to /var/cache/conftool/dbconfig/20230208-143735-marostegui.json [production]
14:35 <jforrester@deploy1002> jforrester: Backport for [[gerrit:833771|Move non-variant wgMFUseWikibase to CommonSettings]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
14:33 <jforrester@deploy1002> Started scap: Backport for [[gerrit:833771|Move non-variant wgMFUseWikibase to CommonSettings]] [production]
14:31 <jforrester@deploy1002> Finished scap: Backport for [[gerrit:833770|Move non-variant wgMFNearby to CommonSettings]] (duration: 08m 52s) [production]
14:29 <moritzm> test install of testvm6001 T327867 [production]
14:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1201', diff saved to https://phabricator.wikimedia.org/P43820 and previous config saved to /var/cache/conftool/dbconfig/20230208-142613-marostegui.json [production]
14:24 <jforrester@deploy1002> jforrester: Backport for [[gerrit:833770|Move non-variant wgMFNearby to CommonSettings]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
14:22 <jforrester@deploy1002> Started scap: Backport for [[gerrit:833770|Move non-variant wgMFNearby to CommonSettings]] [production]
14:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2104', diff saved to https://phabricator.wikimedia.org/P43819 and previous config saved to /var/cache/conftool/dbconfig/20230208-142229-marostegui.json [production]
14:20 <jforrester@deploy1002> Finished scap: Backport for [[gerrit:882706|Replace wgBetaFeaturesWhitelist with wgBetaFeaturesAllowList, Part II]] (duration: 07m 48s) [production]
14:14 <jforrester@deploy1002> jforrester: Backport for [[gerrit:882706|Replace wgBetaFeaturesWhitelist with wgBetaFeaturesAllowList, Part II]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet [production]
14:12 <jforrester@deploy1002> Started scap: Backport for [[gerrit:882706|Replace wgBetaFeaturesWhitelist with wgBetaFeaturesAllowList, Part II]] [production]
14:11 <jforrester@deploy1002> Finished scap: Backport for [[gerrit:882705|Replace wgBetaFeaturesWhitelist with wgBetaFeaturesAllowList, Part I]] (duration: 08m 12s) [production]
14:11 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1201 (T328817)', diff saved to https://phabricator.wikimedia.org/P43818 and previous config saved to /var/cache/conftool/dbconfig/20230208-141106-marostegui.json [production]
14:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1201 (T328817)', diff saved to https://phabricator.wikimedia.org/P43817 and previous config saved to /var/cache/conftool/dbconfig/20230208-140859-marostegui.json [production]
14:08 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1201.eqiad.wmnet with reason: Maintenance [production]
14:08 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db1201.eqiad.wmnet with reason: Maintenance [production]
14:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1187 (T328817)', diff saved to https://phabricator.wikimedia.org/P43816 and previous config saved to /var/cache/conftool/dbconfig/20230208-140837-marostegui.json [production]
14:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2104', diff saved to https://phabricator.wikimedia.org/P43815 and previous config saved to /var/cache/conftool/dbconfig/20230208-140722-marostegui.json [production]
14:05 <jforrester@deploy1002> jforrester: Backport for [[gerrit:882705|Replace wgBetaFeaturesWhitelist with wgBetaFeaturesAllowList, Part I]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet [production]
14:03 <jforrester@deploy1002> Started scap: Backport for [[gerrit:882705|Replace wgBetaFeaturesWhitelist with wgBetaFeaturesAllowList, Part I]] [production]
13:53 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P43813 and previous config saved to /var/cache/conftool/dbconfig/20230208-135331-marostegui.json [production]
13:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2104 (T328817)', diff saved to https://phabricator.wikimedia.org/P43812 and previous config saved to /var/cache/conftool/dbconfig/20230208-135216-marostegui.json [production]
13:49 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db2104 (T328817)', diff saved to https://phabricator.wikimedia.org/P43811 and previous config saved to /var/cache/conftool/dbconfig/20230208-134950-marostegui.json [production]
13:49 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2104.codfw.wmnet with reason: Maintenance [production]
13:49 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2104.codfw.wmnet with reason: Maintenance [production]
13:45 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2097.codfw.wmnet with reason: Maintenance [production]
13:44 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2097.codfw.wmnet with reason: Maintenance [production]
13:38 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P43810 and previous config saved to /var/cache/conftool/dbconfig/20230208-133825-marostegui.json [production]
13:33 <jbond> (correction) send puppet.esams.wmnet to eqiad and puppet.esqin.wmnet to codfw [production]
13:33 <jbond> send puppet.esams.wmnet to eqiad and puppet.esams.wmnet to codfw [production]
13:23 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1187 (T328817)', diff saved to https://phabricator.wikimedia.org/P43809 and previous config saved to /var/cache/conftool/dbconfig/20230208-132318-marostegui.json [production]
13:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1187 (T328817)', diff saved to https://phabricator.wikimedia.org/P43808 and previous config saved to /var/cache/conftool/dbconfig/20230208-131409-marostegui.json [production]
13:14 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1187.eqiad.wmnet with reason: Maintenance [production]
13:13 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db1187.eqiad.wmnet with reason: Maintenance [production]
13:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180 (T328817)', diff saved to https://phabricator.wikimedia.org/P43807 and previous config saved to /var/cache/conftool/dbconfig/20230208-131348-marostegui.json [production]
13:03 <eoghan@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host gitlab-runner1002.eqiad.wmnet with OS bullseye [production]
13:00 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 13150 [production]
12:59 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 13150 [production]
12:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P43805 and previous config saved to /var/cache/conftool/dbconfig/20230208-125841-marostegui.json [production]
12:43 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P43804 and previous config saved to /var/cache/conftool/dbconfig/20230208-124335-marostegui.json [production]
12:37 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db1096.eqiad.wmnet [production]
12:37 <marostegui@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:37 <marostegui@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db1096.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - marostegui@cumin1001" [production]