201-250 of 10000 results (93ms)
2026-02-10 ยง
17:25 <jasmine@cumin2002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2116-2123,2216-2241].codfw.wmnet [production]
16:40 <moritzm> uploaded dnsmasq 2.92-1~wmf12 to trixie-wikimedia/main T396864 [production]
16:21 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 20940 [production]
16:09 <moritzm> installing Django security updates [production]
16:09 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: pool site drmrs [reason: work done, T416441] [production]
16:09 <sukhe@cumin1003> START - Cookbook sre.dns.admin DNS admin: pool site drmrs [reason: work done, T416441] [production]
16:07 <dzahn@dns1004> END - running authdns-update [production]
16:06 <mutante> switching gerrit to behind CDN [production]
16:05 <dzahn@dns1004> START - running authdns-update [production]
16:04 <sukhe@dns1004> END - running authdns-update [production]
16:03 <sukhe@dns1004> START - running authdns-update [production]
16:03 <sukhe@puppetserver1001> conftool action : set/pooled=yes; selector: cluster=dnsbox,dc=drmrs [reason: drmrs maintenance] [production]
16:01 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for 39 hosts [production]
16:00 <sukhe@cumin1003> START - Cookbook sre.hosts.remove-downtime for 39 hosts [production]
15:58 <cmooney@cumin1003> START - Cookbook sre.network.peering with action 'configure' for AS: 20940 [production]
15:57 <cmooney@cumin1003> END (FAIL) - Cookbook sre.network.peering (exit_code=99) with action 'configure' for AS: 20940 [production]
15:55 <topranks> remove ACL entry permitting Cloud VPS private IP addresses direct access to gerrit.wikimedia.org T411895 [production]
15:53 <cmooney@cumin1003> START - Cookbook sre.network.peering with action 'configure' for AS: 20940 [production]
15:46 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:46 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:44 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:44 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:44 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:44 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:41 <XioNoX> mr1-drmrs> request system reboot - T416441 [production]
15:41 <ayounsi@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mr1-drmrs,mr1-drmrs IPv6,mr1-drmrs.oob with reason: router upgrade [production]
15:39 <ayounsi@cumin1003> DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 1:00:00 on mr1-drmrs,mr1-drmrs IPv6,mr1-drmrs.mgmt with reason: router upgrade [production]
15:37 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:37 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:37 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:37 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:36 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:36 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:35 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:35 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:35 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:35 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:34 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:34 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:33 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:33 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:33 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:33 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:33 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:33 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:32 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:32 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:30 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) [production]
15:30 <fceratto@cumin1003> START - Cookbook sre.mysql.update-replication [production]
15:30 <dpogorzelski@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-staging-etcd2003.codfw.wmnet with OS bookworm [production]