5301-5350 of 10000 results (100ms)
2024-04-30 ยง
12:50 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti7002.magru.wmnet with OS bookworm [production]
12:49 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jmm@cumin2002" [production]
12:46 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jmm@cumin2002" [production]
12:45 <brouberol@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mpic-next: apply [production]
12:25 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti7002.magru.wmnet with reason: host reimage [production]
12:24 <jforrester@deploy1002> Finished deploy [integration/docroot@b88f9e1]: Update VisualEditor links, post-JSDoc (b88f9e1674) (duration: 00m 06s) [production]
12:24 <jforrester@deploy1002> Started deploy [integration/docroot@b88f9e1]: Update VisualEditor links, post-JSDoc (b88f9e1674) [production]
12:23 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti7002.magru.wmnet with reason: host reimage [production]
12:20 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db1182.eqiad.wmnet [production]
12:11 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db1162.eqiad.wmnet [production]
12:09 <brouberol@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
12:09 <brouberol@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
12:01 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db1162.eqiad.wmnet [production]
11:50 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti7002.magru.wmnet with OS bookworm [production]
11:47 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti7001.magru.wmnet with OS bookworm [production]
11:47 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jmm@cumin2002" [production]
11:43 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cephosd1001.eqiad.wmnet [production]
11:39 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jmm@cumin2002" [production]
11:37 <btullis@cumin1002> START - Cookbook sre.hosts.reboot-single for host cephosd1001.eqiad.wmnet [production]
11:36 <marostegui@cumin1002> dbctl commit (dc=all): 'db1158 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P61495 and previous config saved to /var/cache/conftool/dbconfig/20240430-113640-root.json [production]
11:21 <marostegui@cumin1002> dbctl commit (dc=all): 'db1158 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P61494 and previous config saved to /var/cache/conftool/dbconfig/20240430-112135-root.json [production]
11:19 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db2207.codfw.wmnet [production]
11:19 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti7001.magru.wmnet with reason: host reimage [production]
11:16 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti7001.magru.wmnet with reason: host reimage [production]
11:08 <jiji@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
11:07 <jiji@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
11:07 <jiji@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
11:06 <jiji@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
11:06 <jiji@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
11:06 <marostegui@cumin1002> dbctl commit (dc=all): 'db1158 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P61493 and previous config saved to /var/cache/conftool/dbconfig/20240430-110629-root.json [production]
11:06 <jiji@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
11:04 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db2207.codfw.wmnet [production]
11:03 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db2204.codfw.wmnet [production]
10:54 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db2204.codfw.wmnet [production]
10:54 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cephosd1001.eqiad.wmnet with OS bullseye [production]
10:53 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db2189.codfw.wmnet [production]
10:51 <marostegui@cumin1002> dbctl commit (dc=all): 'db1158 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P61492 and previous config saved to /var/cache/conftool/dbconfig/20240430-105124-root.json [production]
10:48 <Dreamy_Jazz> Security deploy finished [production]
10:47 <logmsgbot> dreamyjazz Deployed security patch for T338419 [production]
10:45 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db2189.codfw.wmnet [production]
10:43 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti7001.magru.wmnet with OS bookworm [production]
10:39 <aokoth@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts lists1004.eqiad.wmnet [production]
10:39 <aokoth@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:39 <aokoth@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lists1004.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - aokoth@cumin1002" [production]
10:38 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db2175.codfw.wmnet [production]
10:38 <aokoth@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lists1004.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - aokoth@cumin1002" [production]
10:37 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cephosd1001.eqiad.wmnet with reason: host reimage [production]
10:36 <marostegui@cumin1002> dbctl commit (dc=all): 'db1158 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P61491 and previous config saved to /var/cache/conftool/dbconfig/20240430-103618-root.json [production]
10:35 <btullis@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cephosd1001.eqiad.wmnet with reason: host reimage [production]
10:33 <logmsgbot> dreamyjazz Deployed security patch for T338419 [production]