251-300 of 10000 results (26ms)
2024-12-19 ยง
09:20 <jmm@cumin2002> START - Cookbook sre.swift.roll-restart-reboot-swift-thanos-proxies rolling restart_daemons on A:thanos-fe [production]
09:17 <kartik@deploy2002> Finished scap sync-world: Backport for [[gerrit:1105283|Event logging: update schemaId (T364460)]] (duration: 25m 20s) [production]
09:12 <moritzm> upgrading mwdebug* to PHP 1:7.4.33-1+0~20221108.73+debian10~1.gbpa00350a+wmf10u2+icu67u4 T382077 [production]
09:09 <jmm@cumin2002> END (PASS) - Cookbook sre.ldap.roll-restart-reboot-replica (exit_code=0) rolling restart_daemons on A:ldap-replicas-eqiad [production]
09:09 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2059 [production]
09:09 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2059 [production]
09:09 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2060 [production]
09:09 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2060 [production]
09:09 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2059.codfw.wmnet with OS bookworm [production]
09:09 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2060.codfw.wmnet with OS bookworm [production]
09:08 <jmm@cumin2002> START - Cookbook sre.ldap.roll-restart-reboot-replica rolling restart_daemons on A:ldap-replicas-eqiad [production]
09:07 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2059-2060].codfw.wmnet [production]
09:07 <kartik@deploy2002> kartik, wangombe: Continuing with sync [production]
09:06 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2059-2060].codfw.wmnet [production]
09:03 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2061-2062].codfw.wmnet [production]
09:02 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2061-2062].codfw.wmnet [production]
08:57 <kartik@deploy2002> kartik, wangombe: Backport for [[gerrit:1105283|Event logging: update schemaId (T364460)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:56 <jmm@cumin2002> END (PASS) - Cookbook sre.ldap.roll-restart-reboot-replica (exit_code=0) rolling restart_daemons on A:ldap-replicas-codfw [production]
08:55 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2062.codfw.wmnet with OS bookworm [production]
08:55 <jmm@cumin2002> START - Cookbook sre.ldap.roll-restart-reboot-replica rolling restart_daemons on A:ldap-replicas-codfw [production]
08:52 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2061.codfw.wmnet with OS bookworm [production]
08:51 <kartik@deploy2002> Started scap sync-world: Backport for [[gerrit:1105283|Event logging: update schemaId (T364460)]] [production]
08:37 <kartik@deploy2002> Finished scap sync-world: Backport for [[gerrit:1105341|Event logging: pass empty object to translation property (T364460)]] (duration: 21m 52s) [production]
08:36 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2062.codfw.wmnet with reason: host reimage [production]
08:32 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2061.codfw.wmnet with reason: host reimage [production]
08:31 <kartik@deploy2002> wangombe, kartik: Continuing with sync [production]
08:28 <kartik@deploy2002> wangombe, kartik: Backport for [[gerrit:1105341|Event logging: pass empty object to translation property (T364460)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:27 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2062.codfw.wmnet with reason: host reimage [production]
08:27 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2061.codfw.wmnet with reason: host reimage [production]
08:15 <kartik@deploy2002> Started scap sync-world: Backport for [[gerrit:1105341|Event logging: pass empty object to translation property (T364460)]] [production]
08:09 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2062 [production]
08:09 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2062 [production]
08:09 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2061 [production]
08:09 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2061 [production]
08:08 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2062.codfw.wmnet with OS bookworm [production]
08:08 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2061.codfw.wmnet with OS bookworm [production]
08:07 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2061-2062].codfw.wmnet [production]
08:03 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2061-2062].codfw.wmnet [production]
08:01 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2190.codfw.wmnet [production]
08:01 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2190.codfw.wmnet [production]
08:00 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2190.codfw.wmnet with OS bookworm [production]
07:40 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2190.codfw.wmnet with reason: host reimage [production]
07:37 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2190.codfw.wmnet with reason: host reimage [production]
07:18 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2190 [production]
07:18 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2190 [production]
07:18 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2190.codfw.wmnet with OS bookworm [production]
02:28 <krinkle@deploy2002> Finished deploy [statsv/statsv@2ee86ea]: Add dogstatsd support (duration: 00m 18s) [production]
02:28 <krinkle@deploy2002> Started deploy [statsv/statsv@2ee86ea]: Add dogstatsd support [production]
01:48 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host es1043.eqiad.wmnet with OS bookworm [production]
01:05 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host es1043.eqiad.wmnet with OS bookworm [production]