1001-1050 of 10000 results (172ms)
2024-09-12 ยง
13:44 <akosiaris@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2112 [production]
13:44 <akosiaris@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2112 [production]
13:44 <akosiaris@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker2112.codfw.wmnet 62.0.192.10.in-addr.arpa 2.6.0.0.0.0.0.0.2.9.1.0.0.1.0.0.1.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
13:44 <akosiaris@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-worker2112.codfw.wmnet 62.0.192.10.in-addr.arpa 2.6.0.0.0.0.0.0.2.9.1.0.0.1.0.0.1.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
13:44 <akosiaris@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:44 <akosiaris@cumin1002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw2399 to wikikube-worker2113 [production]
13:43 <akosiaris@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2113 [production]
13:43 <cscott> mwscript namespaceDupes enwiki --source-pseudo-namespace MOS --dest-namespace 126 --move-talk --add-prefix=T363538/ --fix | tee ~/T363538-enwiki-namespaceDupes [production]
13:42 <hashar> Afternoon backport deployments are completed . NamespaceDupe is being run on enwiki for T363538#10140642 [production]
13:42 <akosiaris@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2109.codfw.wmnet with reason: host reimage [production]
13:42 <akosiaris@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2113 [production]
13:42 <akosiaris@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:42 <akosiaris@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2399 to wikikube-worker2113 - akosiaris@cumin1002" [production]
13:42 <akosiaris@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2399 to wikikube-worker2113 - akosiaris@cumin1002" [production]
13:42 <akosiaris@cumin1002> START - Cookbook sre.dns.netbox [production]
13:40 <akosiaris@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2109.codfw.wmnet with reason: host reimage [production]
13:38 <hashar@deploy1003> Finished scap sync-world: Backport for [[gerrit:1071067|Elevate pseudo-namespace MOS to a real namespace on enwiki (T363538)]] (duration: 06m 39s) [production]
13:37 <elukey@cumin1002> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host poolcounter2006.codfw.wmnet [production]
13:37 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host poolcounter2006.codfw.wmnet with OS bookworm [production]
13:36 <akosiaris@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2112 [production]
13:36 <akosiaris@cumin1002> START - Cookbook sre.dns.netbox [production]
13:36 <akosiaris@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2111 [production]
13:36 <akosiaris@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2111 [production]
13:36 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1192', diff saved to https://phabricator.wikimedia.org/P69052 and previous config saved to /var/cache/conftool/dbconfig/20240912-133623-arnaudb.json [production]
13:36 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp4037.ulsfo.wmnet [production]
13:36 <akosiaris@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2111 [production]
13:36 <akosiaris@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker2111.codfw.wmnet 61.0.192.10.in-addr.arpa 1.6.0.0.0.0.0.0.2.9.1.0.0.1.0.0.1.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
13:36 <akosiaris@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-worker2111.codfw.wmnet 61.0.192.10.in-addr.arpa 1.6.0.0.0.0.0.0.2.9.1.0.0.1.0.0.1.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
13:36 <akosiaris@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:36 <akosiaris@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2111 - akosiaris@cumin1002" [production]
13:35 <akosiaris@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2111 - akosiaris@cumin1002" [production]
13:35 <akosiaris@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2108.codfw.wmnet with reason: host reimage [production]
13:35 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp4037.ulsfo.wmnet [production]
13:34 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2209', diff saved to https://phabricator.wikimedia.org/P69051 and previous config saved to /var/cache/conftool/dbconfig/20240912-133456-ladsgroup.json [production]
13:34 <akosiaris@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2112.codfw.wmnet with OS bullseye [production]
13:34 <akosiaris@cumin1002> START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker2112.codfw.wmnet [production]
13:33 <akosiaris@cumin1002> START - Cookbook sre.hosts.rename from mw2399 to wikikube-worker2113 [production]
13:33 <hashar@deploy1003> cscott, hashar: Continuing with sync [production]
13:33 <akosiaris@cumin1002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw2398 to wikikube-worker2112 [production]
13:33 <hashar@deploy1003> cscott, hashar: Backport for [[gerrit:1071067|Elevate pseudo-namespace MOS to a real namespace on enwiki (T363538)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:32 <akosiaris@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2112 [production]
13:32 <akosiaris@cumin1002> START - Cookbook sre.dns.netbox [production]
13:32 <akosiaris@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2112 [production]
13:32 <akosiaris@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:32 <akosiaris@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2108.codfw.wmnet with reason: host reimage [production]
13:31 <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1071067|Elevate pseudo-namespace MOS to a real namespace on enwiki (T363538)]] [production]
13:30 <akosiaris@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2111 [production]
13:30 <cmooney@cumin1002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2025.codfw.wmnet [production]
13:30 <akosiaris@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2110 [production]
13:30 <akosiaris@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2110 [production]