3101-3150 of 10000 results (98ms)
2023-12-13 §
09:06 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1229 (re)pooling @ 60%: Post reboot repooling', diff saved to https://phabricator.wikimedia.org/P54362 and previous config saved to /var/cache/conftool/dbconfig/20231213-090648-arnaudb.json [production]
09:06 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1228 (re)pooling @ 60%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54361 and previous config saved to /var/cache/conftool/dbconfig/20231213-090631-arnaudb.json [production]
09:05 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1247 (re)pooling @ 60%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54360 and previous config saved to /var/cache/conftool/dbconfig/20231213-090534-arnaudb.json [production]
08:55 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 202120 [production]
08:55 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 202120 [production]
08:51 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1229 (re)pooling @ 50%: Post reboot repooling', diff saved to https://phabricator.wikimedia.org/P54359 and previous config saved to /var/cache/conftool/dbconfig/20231213-085143-arnaudb.json [production]
08:51 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1228 (re)pooling @ 50%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54358 and previous config saved to /var/cache/conftool/dbconfig/20231213-085125-arnaudb.json [production]
08:50 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1247 (re)pooling @ 50%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54357 and previous config saved to /var/cache/conftool/dbconfig/20231213-085027-arnaudb.json [production]
08:48 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5007.eqsin.wmnet [production]
08:48 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 3856 [production]
08:48 <XioNoX> delete bgp group Confed_drmrs from cr1-esams - T347892 [production]
08:46 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 3856 [production]
08:45 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5007.eqsin.wmnet [production]
08:44 <ayounsi@cumin1001> END (FAIL) - Cookbook sre.network.peering (exit_code=99) with action 'email' for AS: 46997 [production]
08:43 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 46997 [production]
08:36 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1229 (re)pooling @ 40%: Post reboot repooling', diff saved to https://phabricator.wikimedia.org/P54356 and previous config saved to /var/cache/conftool/dbconfig/20231213-083638-arnaudb.json [production]
08:36 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1228 (re)pooling @ 40%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54355 and previous config saved to /var/cache/conftool/dbconfig/20231213-083620-arnaudb.json [production]
08:35 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1247 (re)pooling @ 40%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54354 and previous config saved to /var/cache/conftool/dbconfig/20231213-083522-arnaudb.json [production]
08:30 <XioNoX> delete bgp group Confed_esams from cr2-drmrs - T347892 [production]
08:25 <mlitn@deploy2002> Finished scap: Backport for [[gerrit:979113|No custom UW licensing config]] (duration: 09m 43s) [production]
08:21 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1229 (re)pooling @ 30%: Post reboot repooling', diff saved to https://phabricator.wikimedia.org/P54353 and previous config saved to /var/cache/conftool/dbconfig/20231213-082133-arnaudb.json [production]
08:21 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1228 (re)pooling @ 30%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54352 and previous config saved to /var/cache/conftool/dbconfig/20231213-082115-arnaudb.json [production]
08:20 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1247 (re)pooling @ 30%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54351 and previous config saved to /var/cache/conftool/dbconfig/20231213-082017-arnaudb.json [production]
08:18 <mlitn@deploy2002> mlitn: Continuing with sync [production]
08:17 <mlitn@deploy2002> mlitn: Backport for [[gerrit:979113|No custom UW licensing config]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:16 <mlitn@deploy2002> Started scap: Backport for [[gerrit:979113|No custom UW licensing config]] [production]
08:15 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy1020.eqiad.wmnet with OS bookworm [production]
08:06 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1229 (re)pooling @ 20%: Post reboot repooling', diff saved to https://phabricator.wikimedia.org/P54350 and previous config saved to /var/cache/conftool/dbconfig/20231213-080628-arnaudb.json [production]
08:06 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1228 (re)pooling @ 20%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54349 and previous config saved to /var/cache/conftool/dbconfig/20231213-080610-arnaudb.json [production]
08:06 <moritzm> installing openssh security updates [production]
08:05 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1247 (re)pooling @ 20%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54348 and previous config saved to /var/cache/conftool/dbconfig/20231213-080512-arnaudb.json [production]
07:56 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbproxy1020.eqiad.wmnet with reason: host reimage [production]
07:53 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on dbproxy1020.eqiad.wmnet with reason: host reimage [production]
07:51 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1229 (re)pooling @ 10%: Post reboot repooling', diff saved to https://phabricator.wikimedia.org/P54347 and previous config saved to /var/cache/conftool/dbconfig/20231213-075123-arnaudb.json [production]
07:51 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1228 (re)pooling @ 10%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54346 and previous config saved to /var/cache/conftool/dbconfig/20231213-075105-arnaudb.json [production]
07:50 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1247 (re)pooling @ 10%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54345 and previous config saved to /var/cache/conftool/dbconfig/20231213-075006-arnaudb.json [production]
07:43 <arnaudb@cumin1001> END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db1211.eqiad.wmnet onto db1226.eqiad.wmnet [production]
07:40 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host dbproxy1020.eqiad.wmnet with OS bookworm [production]
06:30 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy1021.eqiad.wmnet with OS bookworm [production]
06:10 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbproxy1021.eqiad.wmnet with reason: host reimage [production]
06:06 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on dbproxy1021.eqiad.wmnet with reason: host reimage [production]
05:54 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host dbproxy1021.eqiad.wmnet with OS bookworm [production]
03:41 <hashar@deploy2002> Finished deploy [gerrit/gerrit@9bf8914]: Add a banner for the 2023 developer survey - T351109 (duration: 00m 08s) [production]
03:41 <hashar@deploy2002> Started deploy [gerrit/gerrit@9bf8914]: Add a banner for the 2023 developer survey - T351109 [production]
2023-12-12 §
23:56 <ejegg> donorwiki upgraded from f7407053 to bc49e5a6 [production]
23:26 <tzatziki> removing 2 files for legal compliance [production]
23:05 <tzatziki> removing 2 files for legal compliance [production]
22:57 <mutante> planet - switched to eqiad and bookworm backend (T348392 T345617) - https://meta.wikimedia.org/wiki/Planet_Wikimedia [production]
22:43 <mutante> planet2003 -manually upgrade rawdog package to 3.0.2 T348392 [production]
21:33 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on planet1003.eqiad.wmnet with reason: debugging [production]