151-200 of 10000 results (68ms)
2024-02-05 ยง
17:21 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2123', diff saved to https://phabricator.wikimedia.org/P56248 and previous config saved to /var/cache/conftool/dbconfig/20240205-172133-marostegui.json [production]
17:19 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint2002:~$ mwscript namespaceDupes enwikiquote --add-prefix='Wikiquote:T355195/' --fix [production]
17:11 <arnaudb@cumin1002> END (PASS) - Cookbook sre.mysql.clone (exit_code=0) Will create a clone of db1135.eqiad.wmnet onto db1235.eqiad.wmnet [production]
17:07 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1244:3314 (re)pooling @ 100%: 10', diff saved to https://phabricator.wikimedia.org/P56247 and previous config saved to /var/cache/conftool/dbconfig/20240205-170737-arnaudb.json [production]
17:07 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1246:3312 (re)pooling @ 100%: 10', diff saved to https://phabricator.wikimedia.org/P56246 and previous config saved to /var/cache/conftool/dbconfig/20240205-170735-arnaudb.json [production]
17:06 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2123', diff saved to https://phabricator.wikimedia.org/P56245 and previous config saved to /var/cache/conftool/dbconfig/20240205-170627-marostegui.json [production]
16:52 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1244:3314 (re)pooling @ 75%: 10', diff saved to https://phabricator.wikimedia.org/P56244 and previous config saved to /var/cache/conftool/dbconfig/20240205-165232-arnaudb.json [production]
16:52 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1246:3312 (re)pooling @ 75%: 10', diff saved to https://phabricator.wikimedia.org/P56243 and previous config saved to /var/cache/conftool/dbconfig/20240205-165230-arnaudb.json [production]
16:51 <moritzm> pruning unneeded openjdk-17-jre-headless packages on cassandra-dev* hosts [production]
16:51 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2123 (T355609)', diff saved to https://phabricator.wikimedia.org/P56242 and previous config saved to /var/cache/conftool/dbconfig/20240205-165120-marostegui.json [production]
16:49 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host sretest2003.codfw.wmnet with OS bullseye [production]
16:48 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2123 (T355609)', diff saved to https://phabricator.wikimedia.org/P56241 and previous config saved to /var/cache/conftool/dbconfig/20240205-164859-marostegui.json [production]
16:48 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2123.codfw.wmnet with reason: Maintenance [production]
16:48 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2123.codfw.wmnet with reason: Maintenance [production]
16:48 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2111 (T355609)', diff saved to https://phabricator.wikimedia.org/P56240 and previous config saved to /var/cache/conftool/dbconfig/20240205-164836-marostegui.json [production]
16:42 <moritzm> pruning unneeded openjdk-17-jre-headless packages on sessionstore* hosts [production]
16:42 <sukhe> adding cdobbins to cn=wmf and cn=ops [production]
16:37 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1244:3314 (re)pooling @ 50%: 10', diff saved to https://phabricator.wikimedia.org/P56239 and previous config saved to /var/cache/conftool/dbconfig/20240205-163727-arnaudb.json [production]
16:37 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1246:3312 (re)pooling @ 50%: 10', diff saved to https://phabricator.wikimedia.org/P56238 and previous config saved to /var/cache/conftool/dbconfig/20240205-163725-arnaudb.json [production]
16:33 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2111', diff saved to https://phabricator.wikimedia.org/P56237 and previous config saved to /var/cache/conftool/dbconfig/20240205-163329-marostegui.json [production]
16:23 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts debmonitor1002.eqiad.wmnet [production]
16:23 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:23 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: debmonitor1002.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
16:22 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1244:3314 (re)pooling @ 40%: 10', diff saved to https://phabricator.wikimedia.org/P56236 and previous config saved to /var/cache/conftool/dbconfig/20240205-162222-arnaudb.json [production]
16:22 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1246:3312 (re)pooling @ 40%: 10', diff saved to https://phabricator.wikimedia.org/P56235 and previous config saved to /var/cache/conftool/dbconfig/20240205-162220-arnaudb.json [production]
16:20 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: debmonitor1002.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
16:18 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2111', diff saved to https://phabricator.wikimedia.org/P56234 and previous config saved to /var/cache/conftool/dbconfig/20240205-161822-marostegui.json [production]
16:18 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
16:11 <jmm@cumin2002> START - Cookbook sre.hosts.decommission for hosts debmonitor1002.eqiad.wmnet [production]
16:10 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts debmonitor2002.codfw.wmnet [production]
16:10 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:10 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: debmonitor2002.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
16:09 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: debmonitor2002.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
16:07 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1244:3314 (re)pooling @ 30%: 10', diff saved to https://phabricator.wikimedia.org/P56233 and previous config saved to /var/cache/conftool/dbconfig/20240205-160717-arnaudb.json [production]
16:07 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1246:3312 (re)pooling @ 30%: 10', diff saved to https://phabricator.wikimedia.org/P56232 and previous config saved to /var/cache/conftool/dbconfig/20240205-160715-arnaudb.json [production]
16:07 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
16:03 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2111 (T355609)', diff saved to https://phabricator.wikimedia.org/P56231 and previous config saved to /var/cache/conftool/dbconfig/20240205-160316-marostegui.json [production]
16:02 <jmm@cumin2002> START - Cookbook sre.hosts.decommission for hosts debmonitor2002.codfw.wmnet [production]
16:01 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2111 (T355609)', diff saved to https://phabricator.wikimedia.org/P56230 and previous config saved to /var/cache/conftool/dbconfig/20240205-160055-marostegui.json [production]
16:00 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2111.codfw.wmnet with reason: Maintenance [production]
16:00 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2111.codfw.wmnet with reason: Maintenance [production]
16:00 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2101.codfw.wmnet with reason: Maintenance [production]
16:00 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2101.codfw.wmnet with reason: Maintenance [production]
15:52 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1244:3314 (re)pooling @ 20%: 10', diff saved to https://phabricator.wikimedia.org/P56229 and previous config saved to /var/cache/conftool/dbconfig/20240205-155212-arnaudb.json [production]
15:52 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1246:3312 (re)pooling @ 20%: 10', diff saved to https://phabricator.wikimedia.org/P56228 and previous config saved to /var/cache/conftool/dbconfig/20240205-155210-arnaudb.json [production]
15:49 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: elasticsearch::cloudelastic [production]
15:38 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: elasticsearch::cloudelastic [production]
15:35 <claime> Building production images for 987443 - T283861 [production]
15:04 <slyngshede@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for debmonitor2003.codfw.wmnet [production]
15:04 <slyngshede@cumin1002> START - Cookbook sre.hosts.remove-downtime for debmonitor2003.codfw.wmnet [production]