5951-6000 of 10000 results (102ms)
2023-04-28 §
12:06 <jclark@cumin1001> START - Cookbook sre.dns.netbox [production]
10:43 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-cache2003.codfw.wmnet with OS bullseye [production]
10:28 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-cache2003.codfw.wmnet with reason: host reimage [production]
10:25 <elukey@deploy1002> helmfile [ml-staging-codfw] 'sync' command on namespace 'ores-legacy' for release 'main' . [production]
10:25 <klausman@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-cache2003.codfw.wmnet with reason: host reimage [production]
10:13 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-cache2002.codfw.wmnet with OS bullseye [production]
10:11 <klausman@cumin2002> START - Cookbook sre.hosts.reimage for host ml-cache2003.codfw.wmnet with OS bullseye [production]
10:01 <vgutierrez> restarting varnish on cp5017 and cp5025 to drop port 80 - T322774 [production]
09:58 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-cache2002.codfw.wmnet with reason: host reimage [production]
09:55 <klausman@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-cache2002.codfw.wmnet with reason: host reimage [production]
09:42 <klausman@cumin2002> START - Cookbook sre.hosts.reimage for host ml-cache2002.codfw.wmnet with OS bullseye [production]
09:31 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-cache2001.codfw.wmnet with OS bullseye [production]
09:24 <elukey@deploy1002> helmfile [ml-staging-codfw] 'sync' command on namespace 'ores-legacy' for release 'main' . [production]
09:13 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-cache2001.codfw.wmnet with reason: host reimage [production]
09:11 <klausman@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-cache2001.codfw.wmnet with reason: host reimage [production]
08:57 <klausman@cumin2002> START - Cookbook sre.hosts.reimage for host ml-cache2001.codfw.wmnet with OS bullseye [production]
08:47 <jnuche@deploy1002> Installing scap version "4.51.0" for 593 hosts [production]
08:29 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-cache2003.codfw.wmnet with OS buster [production]
08:23 <jmm@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest1002.eqiad.wmnet with OS bookworm [production]
08:14 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-cache2003.codfw.wmnet with reason: host reimage [production]
08:11 <klausman@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-cache2003.codfw.wmnet with reason: host reimage [production]
07:57 <klausman@cumin2002> START - Cookbook sre.hosts.reimage for host ml-cache2003.codfw.wmnet with OS buster [production]
07:55 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-cache2002.codfw.wmnet with OS buster [production]
07:47 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest1002.eqiad.wmnet with reason: host reimage [production]
07:44 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on sretest1002.eqiad.wmnet with reason: host reimage [production]
07:41 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-cache2002.codfw.wmnet with reason: host reimage [production]
07:37 <klausman@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-cache2002.codfw.wmnet with reason: host reimage [production]
07:30 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host sretest1002.eqiad.wmnet with OS bookworm [production]
07:23 <klausman@cumin2002> START - Cookbook sre.hosts.reimage for host ml-cache2002.codfw.wmnet with OS buster [production]
07:22 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-cache2001.codfw.wmnet with OS buster [production]
07:04 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-cache2001.codfw.wmnet with reason: host reimage [production]
07:00 <klausman@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-cache2001.codfw.wmnet with reason: host reimage [production]
06:46 <klausman@cumin2002> START - Cookbook sre.hosts.reimage for host ml-cache2001.codfw.wmnet with OS buster [production]
05:57 <XioNoX> push pfw policies - T335554 [production]
05:30 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.debug (exit_code=0) for Netbox circuit ID 112 [production]
05:29 <ayounsi@cumin1001> START - Cookbook sre.network.debug for Netbox circuit ID 112 [production]
05:28 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 393731 [production]
05:27 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 393731 [production]
04:08 <eileen> config revision changed from b33fa934 to 2eef4039 [production]
03:16 <ejegg> SmashPig upgraded from db9fa965 to a9fa7a2c [production]
03:08 <ejegg> payments-wiki upgraded from 91582d93 to 61951572 [production]
03:05 <eileen> config revision changed from 98f2afbb to b33fa934 [production]
02:55 <eileen> civicrm upgraded from b4a05476 to e7904ea6 [production]
02:13 <eileen> civicrm upgraded from 601d223e to b4a05476 [production]
2023-04-27 §
22:17 <zabe@deploy1002> Finished scap: T334295 (duration: 06m 58s) [production]
22:10 <zabe@deploy1002> Started scap: T334295 [production]
20:29 <TheresNoTime> close UTC late backport window [production]
20:27 <samtar@deploy1002> Finished scap: Backport for [[gerrit:912884|[cawikisource] Add a wordmark (Vector 2022) (T331823)]], [[gerrit:912888|[cawiktionary] Add a wordmark (Vector 2022) (T331823)]] (duration: 07m 19s) [production]
20:21 <samtar@deploy1002> superpes and samtar: Backport for [[gerrit:912884|[cawikisource] Add a wordmark (Vector 2022) (T331823)]], [[gerrit:912888|[cawiktionary] Add a wordmark (Vector 2022) (T331823)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet [production]
20:20 <samtar@deploy1002> Started scap: Backport for [[gerrit:912884|[cawikisource] Add a wordmark (Vector 2022) (T331823)]], [[gerrit:912888|[cawiktionary] Add a wordmark (Vector 2022) (T331823)]] [production]