1301-1350 of 10000 results (105ms)
2023-06-26 ยง
11:59 <aborrero@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudservices2005-dev [production]
11:59 <aborrero@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cloudservices2005-dev [production]
11:00 <moritzm> installing libfastjson security updates [production]
10:33 <aborrero@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "cloudservices2005-dev - aborrero@cumin2002" [production]
10:32 <aborrero@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "cloudservices2005-dev - aborrero@cumin2002" [production]
10:26 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts krb2001.codfw.wmnet [production]
10:26 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:26 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: krb2001.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
10:25 <aborrero@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudservices2005-dev.codfw.wmnet with OS bullseye [production]
10:25 <aborrero@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - aborrero@cumin2002" [production]
10:25 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: krb2001.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
10:24 <aborrero@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - aborrero@cumin2002" [production]
10:21 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
10:19 <claime> mw-on-k8s: Redirect www.mediawiki.org to mw-on-k8s - T337490 [production]
10:16 <jmm@cumin2002> START - Cookbook sre.hosts.decommission for hosts krb2001.codfw.wmnet [production]
10:01 <claime> mw-on-k8s: Redirect closed wikis to mw-on-k8s - T337490 [production]
09:40 <aborrero@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudservices2005-dev.codfw.wmnet with reason: host reimage [production]
09:37 <aborrero@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudservices2005-dev.codfw.wmnet with reason: host reimage [production]
09:29 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on debmonitor2003.codfw.wmnet with reason: Setup in progress [production]
09:29 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on debmonitor2003.codfw.wmnet with reason: Setup in progress [production]
09:18 <aborrero@cumin2002> START - Cookbook sre.hosts.reimage for host cloudservices2005-dev.codfw.wmnet with OS bullseye [production]
09:17 <aborrero@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudservices2005-dev.codfw.wmnet with OS bullseye [production]
09:17 <aborrero@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudservices2005-dev [production]
09:17 <aborrero@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cloudservices2005-dev [production]
09:11 <aborrero@cumin2002> START - Cookbook sre.hosts.reimage for host cloudservices2005-dev.codfw.wmnet with OS bullseye [production]
09:10 <aborrero@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cloudservices2005-dev.codfw.wmnet on all recursors [production]
09:10 <aborrero@cumin2002> START - Cookbook sre.dns.wipe-cache cloudservices2005-dev.codfw.wmnet on all recursors [production]
09:10 <aborrero@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cloudservices2005-dev.mgmt.codfw.wmnet on all recursors [production]
09:10 <aborrero@cumin2002> START - Cookbook sre.dns.wipe-cache cloudservices2005-dev.mgmt.codfw.wmnet on all recursors [production]
09:09 <aborrero@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
09:09 <aborrero@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudservices2005-dev - aborrero@cumin2002" [production]
09:08 <aborrero@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudservices2005-dev - aborrero@cumin2002" [production]
09:06 <aborrero@cumin2002> START - Cookbook sre.dns.netbox [production]
08:19 <root@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Paramita Das out of all services on: 19 hosts [production]
08:18 <root@cumin2002> START - Cookbook sre.idm.logout Logging Paramita Das out of all services on: 19 hosts [production]
08:18 <root@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Paramita Das out of all services on: 771 hosts [production]
08:17 <root@cumin2002> START - Cookbook sre.idm.logout Logging Paramita Das out of all services on: 771 hosts [production]
08:15 <root@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Paramita Das out of all services on: 1261 hosts [production]
08:14 <root@cumin2002> START - Cookbook sre.idm.logout Logging Paramita Das out of all services on: 1261 hosts [production]
08:07 <aborrero@cumin1001> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox [production]
08:07 <aborrero@cumin1001> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox [production]
08:07 <aborrero@cumin1001> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary [production]
08:06 <aborrero@cumin1001> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary [production]
07:48 <taavi@deploy1002> Finished scap: Backport for [[gerrit:932789|extwiki: Add an alias for old NS_PROJECT name]] (duration: 08m 49s) [production]
07:41 <taavi@deploy1002> taavi: Backport for [[gerrit:932789|extwiki: Add an alias for old NS_PROJECT name]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet [production]
07:39 <taavi@deploy1002> Started scap: Backport for [[gerrit:932789|extwiki: Add an alias for old NS_PROJECT name]] [production]
07:37 <taavi@deploy1002> Sync cancelled. [production]
07:36 <taavi@deploy1002> taavi: Backport for [[gerrit:932788|extwiki: Update project namespace name (T337696)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
07:34 <taavi@deploy1002> Started scap: Backport for [[gerrit:932788|extwiki: Update project namespace name (T337696)]] [production]
07:31 <taavi@deploy1002> Sync cancelled. [production]