1801-1850 of 10000 results (66ms)
2022-09-28 ยง
14:01 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 5650 [production]
14:00 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 5650 [production]
14:00 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 5400 [production]
14:00 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 5400 [production]
14:00 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 4922 [production]
13:59 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 4922 [production]
13:59 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 4826 [production]
13:59 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 4826 [production]
13:59 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 4775 [production]
13:57 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 4775 [production]
13:57 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 4637 [production]
13:56 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 4637 [production]
13:56 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 4230 [production]
13:56 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 4230 [production]
13:55 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 4181 [production]
13:55 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 4181 [production]
13:55 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 3856 [production]
13:55 <marostegui@cumin1001> dbctl commit (dc=all): 'es2022 (re)pooling @ 75%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35083 and previous config saved to /var/cache/conftool/dbconfig/20220928-135502-root.json [production]
13:54 <marostegui@cumin1001> dbctl commit (dc=all): 'db2122 (re)pooling @ 75%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35082 and previous config saved to /var/cache/conftool/dbconfig/20220928-135456-root.json [production]
13:54 <marostegui@cumin1001> dbctl commit (dc=all): 'db2146 (re)pooling @ 75%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35081 and previous config saved to /var/cache/conftool/dbconfig/20220928-135451-root.json [production]
13:54 <marostegui@cumin1001> dbctl commit (dc=all): 'db2180 (re)pooling @ 75%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35080 and previous config saved to /var/cache/conftool/dbconfig/20220928-135445-root.json [production]
13:53 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 3856 [production]
13:53 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 3300 [production]
13:53 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:52 <elukey@cumin1001> START - Cookbook sre.ores.roll-restart-workers for ORES eqiad cluster: Roll restart of ORES's daemons. [production]
13:51 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
13:50 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 3300 [production]
13:50 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 3292 [production]
13:50 <elukey@cumin1001> END (PASS) - Cookbook sre.ores.roll-restart-workers (exit_code=0) for ORES codfw cluster: Roll restart of ORES's daemons. [production]
13:50 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 3292 [production]
13:50 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 2906 [production]
13:49 <andrew@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudrabbit1003.wikimedia.org [production]
13:48 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 2906 [production]
13:48 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 2647 [production]
13:47 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 2647 [production]
13:47 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 2635 [production]
13:46 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 2635 [production]
13:46 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 2603 [production]
13:46 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 2603 [production]
13:45 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 1273 [production]
13:45 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 1273 [production]
13:45 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 812 [production]
13:44 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 812 [production]
13:44 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 714 [production]
13:42 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 714 [production]
13:39 <marostegui@cumin1001> dbctl commit (dc=all): 'es2022 (re)pooling @ 50%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35079 and previous config saved to /var/cache/conftool/dbconfig/20220928-133957-root.json [production]
13:39 <marostegui@cumin1001> dbctl commit (dc=all): 'db2122 (re)pooling @ 50%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35078 and previous config saved to /var/cache/conftool/dbconfig/20220928-133951-root.json [production]
13:39 <marostegui@cumin1001> dbctl commit (dc=all): 'db2146 (re)pooling @ 50%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35077 and previous config saved to /var/cache/conftool/dbconfig/20220928-133946-root.json [production]
13:39 <marostegui@cumin1001> dbctl commit (dc=all): 'db2180 (re)pooling @ 50%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35076 and previous config saved to /var/cache/conftool/dbconfig/20220928-133940-root.json [production]
13:34 <jmm@cumin2002> END (FAIL) - Cookbook sre.o11y.roll-restart-reboot-thanos-fe (exit_code=1) rolling restart_daemons on A:thanos-fe-codfw [production]