4501-4550 of 10000 results (89ms)
2023-09-26 ยง
02:20 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1230.eqiad.wmnet with reason: host reimage [production]
02:20 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on db1233.eqiad.wmnet with reason: host reimage [production]
02:19 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on db1232.eqiad.wmnet with reason: host reimage [production]
02:18 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on db1231.eqiad.wmnet with reason: host reimage [production]
02:17 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on db1230.eqiad.wmnet with reason: host reimage [production]
02:14 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1226.eqiad.wmnet with reason: host reimage [production]
02:11 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on db1226.eqiad.wmnet with reason: host reimage [production]
02:07 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host db1233.eqiad.wmnet with OS bullseye [production]
02:06 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host db1232.eqiad.wmnet with OS bullseye [production]
02:05 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host db1231.eqiad.wmnet with OS bullseye [production]
02:04 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host db1230.eqiad.wmnet with OS bullseye [production]
02:03 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host db1229.eqiad.wmnet with OS bullseye [production]
02:02 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host db1228.eqiad.wmnet with OS bullseye [production]
02:01 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host db1227.eqiad.wmnet with OS bullseye [production]
01:59 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host db1226.eqiad.wmnet with OS bullseye [production]
01:33 <ejegg|food> payments-wiki upgraded from 5596c7fd to 358e616e [production]
01:21 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1021.eqiad.wmnet with OS bullseye [production]
01:20 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host wdqs1021.eqiad.wmnet with OS bullseye [production]
01:20 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1017.eqiad.wmnet with OS bullseye [production]
01:19 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host wdqs1017.eqiad.wmnet with OS bullseye [production]
01:19 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1021.eqiad.wmnet with OS bullseye [production]
01:19 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host wdqs1021.eqiad.wmnet with OS bullseye [production]
01:18 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1017.eqiad.wmnet with OS bullseye [production]
01:18 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host wdqs1017.eqiad.wmnet with OS bullseye [production]
01:17 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db2159 (T343198)', diff saved to https://phabricator.wikimedia.org/P52628 and previous config saved to /var/cache/conftool/dbconfig/20230926-011707-arnaudb.json [production]
01:17 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
01:16 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
01:16 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2159.codfw.wmnet with reason: Maintenance [production]
01:16 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2159.codfw.wmnet with reason: Maintenance [production]
01:16 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2150 (T343198)', diff saved to https://phabricator.wikimedia.org/P52627 and previous config saved to /var/cache/conftool/dbconfig/20230926-011629-arnaudb.json [production]
01:01 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P52626 and previous config saved to /var/cache/conftool/dbconfig/20230926-010123-arnaudb.json [production]
00:46 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P52625 and previous config saved to /var/cache/conftool/dbconfig/20230926-004616-arnaudb.json [production]
00:40 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1017.eqiad.wmnet with OS bullseye [production]
00:40 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host wdqs1017.eqiad.wmnet with OS bullseye [production]
00:35 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2150 (T343198)', diff saved to https://phabricator.wikimedia.org/P52624 and previous config saved to /var/cache/conftool/dbconfig/20230926-003109-arnaudb.json [production]
00:35 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1024.eqiad.wmnet with OS bullseye [production]
00:30 <jclark@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
00:29 <jclark@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
00:28 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1022.eqiad.wmnet with OS bullseye [production]
00:28 <jclark@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
00:27 <jclark@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
00:26 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1019.eqiad.wmnet with OS bullseye [production]
00:26 <jclark@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
00:25 <jclark@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
00:24 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1018.eqiad.wmnet with OS bullseye [production]
00:24 <jclark@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
00:23 <jclark@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
00:09 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1019.eqiad.wmnet with reason: host reimage [production]
00:09 <jclark@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1022.eqiad.wmnet with reason: host reimage [production]
00:07 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1018.eqiad.wmnet with reason: host reimage [production]