2151-2200 of 10000 results (83ms)
2023-06-26 ยง
13:29 <sukhe> sudo cumin 'A:dns-auth' 'enable-puppet "merging CR 932248"' [production]
13:26 <daniel@deploy1002> Finished scap: Backport for [[gerrit:932175|Parsoid: Disable PC writes on frwiki (T339867)]] (duration: 10m 20s) [production]
13:25 <tchin@deploy1002> helmfile [staging] START helmfile.d/services/eventstreams-internal: apply [production]
13:22 <sukhe> sudo cumin 'A:dns-auth' 'disable-puppet "merging CR 932248"' [production]
13:18 <mfossati@deploy1002> Finished deploy [airflow-dags/platform_eng@b3751e6]: (no justification provided) (duration: 00m 09s) [production]
13:18 <mfossati@deploy1002> Started deploy [airflow-dags/platform_eng@b3751e6]: (no justification provided) [production]
13:17 <daniel@deploy1002> daniel: Backport for [[gerrit:932175|Parsoid: Disable PC writes on frwiki (T339867)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
13:17 <tchin@deploy1002> helmfile [staging] START helmfile.d/services/eventstreams-internal: apply [production]
13:15 <daniel@deploy1002> Started scap: Backport for [[gerrit:932175|Parsoid: Disable PC writes on frwiki (T339867)]] [production]
13:05 <claime> parse1012 pooled inactive for flapping investigation [production]
13:03 <cgoubert@cumin1001> conftool action : set/pooled=inactive; selector: name=parse1012.eqiad.wmnet [production]
11:59 <aborrero@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudservices2005-dev [production]
11:59 <aborrero@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cloudservices2005-dev [production]
11:00 <moritzm> installing libfastjson security updates [production]
10:33 <aborrero@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "cloudservices2005-dev - aborrero@cumin2002" [production]
10:32 <aborrero@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "cloudservices2005-dev - aborrero@cumin2002" [production]
10:26 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts krb2001.codfw.wmnet [production]
10:26 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:26 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: krb2001.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
10:25 <aborrero@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudservices2005-dev.codfw.wmnet with OS bullseye [production]
10:25 <aborrero@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - aborrero@cumin2002" [production]
10:25 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: krb2001.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
10:24 <aborrero@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - aborrero@cumin2002" [production]
10:21 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
10:19 <claime> mw-on-k8s: Redirect www.mediawiki.org to mw-on-k8s - T337490 [production]
10:16 <jmm@cumin2002> START - Cookbook sre.hosts.decommission for hosts krb2001.codfw.wmnet [production]
10:01 <claime> mw-on-k8s: Redirect closed wikis to mw-on-k8s - T337490 [production]
09:40 <aborrero@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudservices2005-dev.codfw.wmnet with reason: host reimage [production]
09:37 <aborrero@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudservices2005-dev.codfw.wmnet with reason: host reimage [production]
09:29 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on debmonitor2003.codfw.wmnet with reason: Setup in progress [production]
09:29 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on debmonitor2003.codfw.wmnet with reason: Setup in progress [production]
09:18 <aborrero@cumin2002> START - Cookbook sre.hosts.reimage for host cloudservices2005-dev.codfw.wmnet with OS bullseye [production]
09:17 <aborrero@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudservices2005-dev.codfw.wmnet with OS bullseye [production]
09:17 <aborrero@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudservices2005-dev [production]
09:17 <aborrero@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cloudservices2005-dev [production]
09:11 <aborrero@cumin2002> START - Cookbook sre.hosts.reimage for host cloudservices2005-dev.codfw.wmnet with OS bullseye [production]
09:10 <aborrero@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cloudservices2005-dev.codfw.wmnet on all recursors [production]
09:10 <aborrero@cumin2002> START - Cookbook sre.dns.wipe-cache cloudservices2005-dev.codfw.wmnet on all recursors [production]
09:10 <aborrero@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cloudservices2005-dev.mgmt.codfw.wmnet on all recursors [production]
09:10 <aborrero@cumin2002> START - Cookbook sre.dns.wipe-cache cloudservices2005-dev.mgmt.codfw.wmnet on all recursors [production]
09:09 <aborrero@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
09:09 <aborrero@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudservices2005-dev - aborrero@cumin2002" [production]
09:08 <aborrero@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudservices2005-dev - aborrero@cumin2002" [production]
09:06 <aborrero@cumin2002> START - Cookbook sre.dns.netbox [production]
08:19 <root@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Paramita Das out of all services on: 19 hosts [production]
08:18 <root@cumin2002> START - Cookbook sre.idm.logout Logging Paramita Das out of all services on: 19 hosts [production]
08:18 <root@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Paramita Das out of all services on: 771 hosts [production]
08:17 <root@cumin2002> START - Cookbook sre.idm.logout Logging Paramita Das out of all services on: 771 hosts [production]
08:15 <root@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Paramita Das out of all services on: 1261 hosts [production]
08:14 <root@cumin2002> START - Cookbook sre.idm.logout Logging Paramita Das out of all services on: 1261 hosts [production]