2001-2050 of 10000 results (66ms)
2022-10-03 ยง
08:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2157', diff saved to https://phabricator.wikimedia.org/P35297 and previous config saved to /var/cache/conftool/dbconfig/20221003-085840-root.json [production]
08:55 <marostegui@cumin1001> dbctl commit (dc=all): 'db1200 (re)pooling @ 50%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35296 and previous config saved to /var/cache/conftool/dbconfig/20221003-085509-root.json [production]
08:54 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 12975 [production]
08:53 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 12975 [production]
08:50 <marostegui@cumin1001> dbctl commit (dc=all): 'db2175 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35295 and previous config saved to /var/cache/conftool/dbconfig/20221003-085007-root.json [production]
08:40 <vgutierrez@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts cp5001.eqsin.wmnet [production]
08:40 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
08:40 <marostegui@cumin1001> dbctl commit (dc=all): 'db1200 (re)pooling @ 25%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35294 and previous config saved to /var/cache/conftool/dbconfig/20221003-084004-root.json [production]
08:39 <ayounsi@cumin1001> END (FAIL) - Cookbook sre.network.peering (exit_code=99) with action 'email' for AS: 3303 [production]
08:38 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 3303 [production]
08:37 <marostegui@cumin1001> dbctl commit (dc=all): 'db1182 (re)pooling @ 100%: After upgrade to 10.6', diff saved to https://phabricator.wikimedia.org/P35293 and previous config saved to /var/cache/conftool/dbconfig/20221003-083729-root.json [production]
08:36 <vgutierrez@cumin1001> START - Cookbook sre.dns.netbox [production]
08:35 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 12956 [production]
08:35 <marostegui@cumin1001> dbctl commit (dc=all): 'db2175 (re)pooling @ 75%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35292 and previous config saved to /var/cache/conftool/dbconfig/20221003-083502-root.json [production]
08:34 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 12956 [production]
08:30 <vgutierrez@cumin1001> START - Cookbook sre.hosts.decommission for hosts cp5001.eqsin.wmnet [production]
08:29 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 15557 [production]
08:28 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 15557 [production]
08:26 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 12975 [production]
08:26 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 12975 [production]
08:25 <marostegui@cumin1001> dbctl commit (dc=all): 'db1200 (re)pooling @ 10%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35291 and previous config saved to /var/cache/conftool/dbconfig/20221003-082459-root.json [production]
08:24 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 30781 [production]
08:23 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 30781 [production]
08:22 <marostegui@cumin1001> dbctl commit (dc=all): 'db1182 (re)pooling @ 75%: After upgrade to 10.6', diff saved to https://phabricator.wikimedia.org/P35290 and previous config saved to /var/cache/conftool/dbconfig/20221003-082224-root.json [production]
08:21 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 39386 [production]
08:19 <marostegui@cumin1001> dbctl commit (dc=all): 'db2175 (re)pooling @ 50%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35289 and previous config saved to /var/cache/conftool/dbconfig/20221003-081955-root.json [production]
08:16 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 39386 [production]
08:09 <marostegui@cumin1001> dbctl commit (dc=all): 'db1200 (re)pooling @ 5%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35288 and previous config saved to /var/cache/conftool/dbconfig/20221003-080954-root.json [production]
08:07 <marostegui@cumin1001> dbctl commit (dc=all): 'db1182 (re)pooling @ 50%: After upgrade to 10.6', diff saved to https://phabricator.wikimedia.org/P35287 and previous config saved to /var/cache/conftool/dbconfig/20221003-080719-root.json [production]
08:06 <ayounsi@cumin1001> END (ERROR) - Cookbook sre.network.peering (exit_code=97) with action 'email' for AS: 16509 [production]
08:05 <marostegui@cumin1001> dbctl commit (dc=all): 'db1158 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35286 and previous config saved to /var/cache/conftool/dbconfig/20221003-080556-root.json [production]
08:05 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 16509 [production]
08:05 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2178.codfw.wmnet with reason: Upgrade to 10.6 [production]
08:05 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on db2178.codfw.wmnet with reason: Upgrade to 10.6 [production]
08:04 <marostegui@cumin1001> dbctl commit (dc=all): 'db2175 (re)pooling @ 25%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35285 and previous config saved to /var/cache/conftool/dbconfig/20221003-080451-root.json [production]
07:57 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2178.codfw.wmnet with reason: Upgrade to 10.6 [production]
07:57 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on db2178.codfw.wmnet with reason: Upgrade to 10.6 [production]
07:56 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2178', diff saved to https://phabricator.wikimedia.org/P35284 and previous config saved to /var/cache/conftool/dbconfig/20221003-075643-root.json [production]
07:54 <marostegui@cumin1001> dbctl commit (dc=all): 'db1200 (re)pooling @ 3%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35283 and previous config saved to /var/cache/conftool/dbconfig/20221003-075449-root.json [production]
07:52 <marostegui@cumin1001> dbctl commit (dc=all): 'db1182 (re)pooling @ 25%: After upgrade to 10.6', diff saved to https://phabricator.wikimedia.org/P35282 and previous config saved to /var/cache/conftool/dbconfig/20221003-075214-root.json [production]
07:50 <marostegui@cumin1001> dbctl commit (dc=all): 'db1158 (re)pooling @ 75%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35281 and previous config saved to /var/cache/conftool/dbconfig/20221003-075051-root.json [production]
07:49 <marostegui@cumin1001> dbctl commit (dc=all): 'db2175 (re)pooling @ 10%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35280 and previous config saved to /var/cache/conftool/dbconfig/20221003-074946-root.json [production]
07:42 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 16637 [production]
07:42 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 16637 [production]
07:39 <marostegui@cumin1001> dbctl commit (dc=all): 'db1200 (re)pooling @ 1%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35279 and previous config saved to /var/cache/conftool/dbconfig/20221003-073944-root.json [production]
07:37 <marostegui@cumin1001> dbctl commit (dc=all): 'db1182 (re)pooling @ 10%: After upgrade to 10.6', diff saved to https://phabricator.wikimedia.org/P35278 and previous config saved to /var/cache/conftool/dbconfig/20221003-073709-root.json [production]
07:36 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1200.eqiad.wmnet with reason: Upgrade to 10.6 [production]
07:36 <XioNoX> cr2-drmrs# set chassis fpc 0 sampling-instance pmacct [production]
07:36 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on db1200.eqiad.wmnet with reason: Upgrade to 10.6 [production]
07:36 <marostegui@cumin1001> dbctl commit (dc=all): 'db1167 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35277 and previous config saved to /var/cache/conftool/dbconfig/20221003-073627-root.json [production]