1-50 of 10000 results (102ms)
2026-05-29 ยง
16:13 <cjming@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen-next: apply [production]
16:12 <cjming@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply [production]
15:28 <dancy@deploy1003> Installation of scap version "4.267.0" completed for 2 hosts [production]
15:26 <dancy@deploy1003> Installing scap version "4.267.0" for 2 host(s) [production]
14:21 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/webrequest-page-view-next: apply [production]
14:21 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/webrequest-page-view-next: apply [production]
14:15 <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1295466|GlobalPreferencesHandler: Cast auto-reveal expiry to int (T427625)]] (duration: 07m 58s) [production]
14:11 <kharlan@deploy1003> kharlan: Continuing with deployment [production]
14:09 <kharlan@deploy1003> kharlan: Backport for [[gerrit:1295466|GlobalPreferencesHandler: Cast auto-reveal expiry to int (T427625)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:07 <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1295466|GlobalPreferencesHandler: Cast auto-reveal expiry to int (T427625)]] [production]
13:53 <moritzm> imported OpenJDK 21 21.0.11+10-1~deb12u1 to component/jdk21 (backport of latest Java 21 security release for Bookworm) [production]
12:09 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host urldownloader1006.wikimedia.org [production]
12:09 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host urldownloader1006.wikimedia.org with OS trixie [production]
11:54 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on urldownloader1006.wikimedia.org with reason: host reimage [production]
11:47 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on urldownloader1006.wikimedia.org with reason: host reimage [production]
11:36 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host urldownloader1006.wikimedia.org with OS trixie [production]
11:15 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM urldownloader1006.wikimedia.org - jmm@cumin2002" [production]
11:15 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM urldownloader1006.wikimedia.org - jmm@cumin2002" [production]
11:13 <jelto@cumin1003> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1004.wikimedia.org with reason: Upgrade GitLab [production]
11:12 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) urldownloader1006.wikimedia.org on all recursors [production]
11:12 <jmm@cumin2002> START - Cookbook sre.dns.wipe-cache urldownloader1006.wikimedia.org on all recursors [production]
11:12 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:12 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM urldownloader1006.wikimedia.org - jmm@cumin2002" [production]
11:06 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM urldownloader1006.wikimedia.org - jmm@cumin2002" [production]
11:00 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
11:00 <jmm@cumin2002> START - Cookbook sre.ganeti.makevm for new host urldownloader1006.wikimedia.org [production]
10:59 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host urldownloader1005.wikimedia.org [production]
10:59 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host urldownloader1005.wikimedia.org with OS trixie [production]
10:43 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on urldownloader1005.wikimedia.org with reason: host reimage [production]
10:40 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2212: Pooling [production]
10:37 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on urldownloader1005.wikimedia.org with reason: host reimage [production]
10:27 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host urldownloader1005.wikimedia.org with OS trixie [production]
10:12 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host kafka-logging1008.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
10:01 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host kafka-logging1008.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
09:59 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host kafka-logging1006.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
09:55 <fceratto@cumin1003> START - Cookbook sre.mysql.pool pool db2212: Pooling [production]
09:50 <jelto@cumin1003> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1004.wikimedia.org with reason: Upgrade GitLab [production]
09:49 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host kafka-logging1006.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
09:45 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
09:44 <jynus@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup2014.codfw.wmnet with OS bookworm [production]
09:33 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
09:20 <jynus@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup2014.codfw.wmnet with reason: host reimage [production]
09:12 <jynus@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on backup2014.codfw.wmnet with reason: host reimage [production]
09:10 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM urldownloader1005.wikimedia.org - jmm@cumin2002" [production]
09:10 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM urldownloader1005.wikimedia.org - jmm@cumin2002" [production]
09:03 <jelto@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM etherpad2002.codfw.wmnet [production]
08:59 <jelto@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM etherpad2002.codfw.wmnet [production]
08:59 <jelto> gnt-instance modify -B memory=4g,vcpus=1 etherpad2002.codfw.wmnet - T427588 [production]
08:54 <jynus@cumin2002> START - Cookbook sre.hosts.reimage for host backup2014.codfw.wmnet with OS bookworm [production]
08:51 <jelto@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM etherpad1004.eqiad.wmnet [production]