3951-4000 of 10000 results (94ms)
2023-10-14 §
02:22 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2141.codfw.wmnet with reason: Maintenance [production]
02:22 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2130 (T343198)', diff saved to https://phabricator.wikimedia.org/P52942 and previous config saved to /var/cache/conftool/dbconfig/20231014-022208-arnaudb.json [production]
02:07 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2130', diff saved to https://phabricator.wikimedia.org/P52941 and previous config saved to /var/cache/conftool/dbconfig/20231014-020701-arnaudb.json [production]
01:51 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2130', diff saved to https://phabricator.wikimedia.org/P52940 and previous config saved to /var/cache/conftool/dbconfig/20231014-015154-arnaudb.json [production]
01:36 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2130 (T343198)', diff saved to https://phabricator.wikimedia.org/P52939 and previous config saved to /var/cache/conftool/dbconfig/20231014-013648-arnaudb.json [production]
00:04 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
2023-10-13 §
23:56 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
22:21 <ejegg> fundraising civicrm upgraded from c5f54d97 to e71ccffb [production]
21:32 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp1107.eqiad.wmnet with OS bullseye [production]
21:32 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp1106.eqiad.wmnet with OS bullseye [production]
21:29 <hashar@deploy2002> Finished deploy [integration/docroot@096f637]: Expand Purtle doc card (duration: 00m 05s) [production]
21:29 <hashar@deploy2002> Started deploy [integration/docroot@096f637]: Expand Purtle doc card [production]
21:29 <hashar@deploy2002> Finished deploy [integration/docroot@504d455]: Fix php-session-serializer tagline (duration: 00m 06s) [production]
21:28 <hashar@deploy2002> Started deploy [integration/docroot@504d455]: Fix php-session-serializer tagline [production]
20:49 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp1111.eqiad.wmnet with OS bullseye [production]
20:41 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp1114.eqiad.wmnet with OS bullseye [production]
20:29 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp1113.eqiad.wmnet with OS bullseye [production]
20:29 <jclark@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
20:26 <jclark@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
20:24 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp1108'] [production]
20:23 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp1108'] [production]
20:22 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp1108.eqiad.wmnet with OS bullseye [production]
20:15 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp1107.eqiad.wmnet with OS bullseye [production]
20:12 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp1107.eqiad.wmnet with reason: host reimage [production]
20:12 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host cp1107.eqiad.wmnet with OS bullseye [production]
20:12 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host cp1106.eqiad.wmnet with OS bullseye [production]
20:11 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp1112.eqiad.wmnet with OS bullseye [production]
20:11 <jclark@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
20:10 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp1113.eqiad.wmnet with reason: host reimage [production]
20:07 <jclark@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp1107.eqiad.wmnet with reason: host reimage [production]
20:07 <jclark@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
20:06 <jclark@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp1113.eqiad.wmnet with reason: host reimage [production]
20:04 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp1109.eqiad.wmnet with OS bullseye [production]
20:04 <jclark@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
20:03 <jclark@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
19:57 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host cp1111.eqiad.wmnet with OS bullseye [production]
19:56 <vriley@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp1102'] [production]
19:56 <vriley@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp1102'] [production]
19:55 <vriley@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cp1102 [production]
19:54 <vriley@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cp1102 [production]
19:53 <vriley@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp1102'] [production]
19:53 <vriley@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp1102'] [production]
19:52 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host cp1107.eqiad.wmnet with OS bullseye [production]
19:49 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp1112.eqiad.wmnet with reason: host reimage [production]
19:48 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host cp1113.eqiad.wmnet with OS bullseye [production]
19:47 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp1109.eqiad.wmnet with reason: host reimage [production]
19:43 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp1102'] [production]
19:43 <jclark@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['cp1102'] [production]
19:43 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp1102'] [production]
19:39 <jclark@cumin1001> END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts ['cp1113'] [production]