2251-2300 of 10000 results (76ms)
2022-09-28 ยง
14:20 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 15133 [production]
14:20 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 14630 [production]
14:19 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 14630 [production]
14:19 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 14361 [production]
14:18 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 14361 [production]
14:18 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 13760 [production]
14:18 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 13760 [production]
14:18 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 13489 [production]
14:18 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 13489 [production]
14:18 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 13335 [production]
14:16 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2153 (T314041)', diff saved to https://phabricator.wikimedia.org/P35088 and previous config saved to /var/cache/conftool/dbconfig/20220928-141638-ladsgroup.json [production]
14:16 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host graphite1005.mgmt.eqiad.wmnet with reboot policy FORCED [production]
14:15 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 13335 [production]
14:15 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 12200 [production]
14:15 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 12200 [production]
14:15 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 12041 [production]
14:15 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 12041 [production]
14:14 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 11164 [production]
14:14 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 11164 [production]
14:14 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 11039 [production]
14:14 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 11039 [production]
14:14 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 10310 [production]
14:12 <volans> added python3-gjson v0.0.5 to apt.w.o (bullseye only) [production]
14:12 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 10310 [production]
14:11 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 8966 [production]
14:11 <elukey@cumin1001> END (PASS) - Cookbook sre.ores.roll-restart-workers (exit_code=0) for ORES eqiad cluster: Roll restart of ORES's daemons. [production]
14:11 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 8966 [production]
14:11 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 8781 [production]
14:10 <marostegui@cumin1001> dbctl commit (dc=all): 'es2022 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35087 and previous config saved to /var/cache/conftool/dbconfig/20220928-141007-root.json [production]
14:10 <marostegui@cumin1001> dbctl commit (dc=all): 'db2122 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35086 and previous config saved to /var/cache/conftool/dbconfig/20220928-141001-root.json [production]
14:09 <marostegui@cumin1001> dbctl commit (dc=all): 'db2146 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35085 and previous config saved to /var/cache/conftool/dbconfig/20220928-140956-root.json [production]
14:09 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 8781 [production]
14:09 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 8674 [production]
14:09 <marostegui@cumin1001> dbctl commit (dc=all): 'db2180 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P35084 and previous config saved to /var/cache/conftool/dbconfig/20220928-140950-root.json [production]
14:09 <jmm@cumin2002> END (PASS) - Cookbook sre.o11y.roll-restart-reboot-thanos-fe (exit_code=0) rolling restart_daemons on A:thanos-fe-eqiad [production]
14:09 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudrabbit1003.wikimedia.org with OS bullseye [production]
14:08 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 8674 [production]
14:08 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 8359 [production]
14:08 <andrew@cumin1001> END (ERROR) - Cookbook sre.hosts.reboot-single (exit_code=97) for host cloudrabbit1003.wikimedia.org [production]
14:08 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 8359 [production]
14:08 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 8075 [production]
14:08 <jmm@cumin2002> START - Cookbook sre.o11y.roll-restart-reboot-thanos-fe rolling restart_daemons on A:thanos-fe-eqiad [production]
14:06 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 8075 [production]
14:06 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 7843 [production]
14:06 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 7843 [production]
14:06 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 7795 [production]
14:06 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 7795 [production]
14:06 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 7784 [production]
14:05 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 7784 [production]
14:05 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 7713 [production]