401-450 of 10000 results (114ms)
2025-08-12 §
04:04 <mwpresync@deploy1003> Pruned MediaWiki: 1.45.0-wmf.11 (duration: 04m 19s) [production]
03:59 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1209', diff saved to https://phabricator.wikimedia.org/P81026 and previous config saved to /var/cache/conftool/dbconfig/20250812-035900-ladsgroup.json [production]
03:41 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1209 (T400854)', diff saved to https://phabricator.wikimedia.org/P81024 and previous config saved to /var/cache/conftool/dbconfig/20250812-034107-ladsgroup.json [production]
03:41 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1209.eqiad.wmnet with reason: Maintenance [production]
03:40 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1203 (T400854)', diff saved to https://phabricator.wikimedia.org/P81023 and previous config saved to /var/cache/conftool/dbconfig/20250812-034045-ladsgroup.json [production]
03:25 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1203', diff saved to https://phabricator.wikimedia.org/P81022 and previous config saved to /var/cache/conftool/dbconfig/20250812-032537-ladsgroup.json [production]
03:10 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1203', diff saved to https://phabricator.wikimedia.org/P81021 and previous config saved to /var/cache/conftool/dbconfig/20250812-031029-ladsgroup.json [production]
02:55 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1203 (T400854)', diff saved to https://phabricator.wikimedia.org/P81020 and previous config saved to /var/cache/conftool/dbconfig/20250812-025522-ladsgroup.json [production]
02:52 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1203 (T400854)', diff saved to https://phabricator.wikimedia.org/P81019 and previous config saved to /var/cache/conftool/dbconfig/20250812-025239-ladsgroup.json [production]
02:52 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1203.eqiad.wmnet with reason: Maintenance [production]
02:52 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1192 (T400854)', diff saved to https://phabricator.wikimedia.org/P81018 and previous config saved to /var/cache/conftool/dbconfig/20250812-025216-ladsgroup.json [production]
02:37 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1192', diff saved to https://phabricator.wikimedia.org/P81017 and previous config saved to /var/cache/conftool/dbconfig/20250812-023709-ladsgroup.json [production]
02:22 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1192', diff saved to https://phabricator.wikimedia.org/P81016 and previous config saved to /var/cache/conftool/dbconfig/20250812-022201-ladsgroup.json [production]
02:06 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1192 (T400854)', diff saved to https://phabricator.wikimedia.org/P81015 and previous config saved to /var/cache/conftool/dbconfig/20250812-020653-ladsgroup.json [production]
02:04 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1192 (T400854)', diff saved to https://phabricator.wikimedia.org/P81014 and previous config saved to /var/cache/conftool/dbconfig/20250812-020403-ladsgroup.json [production]
02:03 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1192.eqiad.wmnet with reason: Maintenance [production]
02:03 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1178 (T400854)', diff saved to https://phabricator.wikimedia.org/P81013 and previous config saved to /var/cache/conftool/dbconfig/20250812-020341-ladsgroup.json [production]
01:48 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1178', diff saved to https://phabricator.wikimedia.org/P81012 and previous config saved to /var/cache/conftool/dbconfig/20250812-014833-ladsgroup.json [production]
01:33 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1178', diff saved to https://phabricator.wikimedia.org/P81011 and previous config saved to /var/cache/conftool/dbconfig/20250812-013325-ladsgroup.json [production]
01:30 <ejegg> payments-wiki upgraded from 0a1084a8 to cd876775 [production]
01:26 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudcephosd1044.eqiad.wmnet with OS bookworm [production]
01:18 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1178 (T400854)', diff saved to https://phabricator.wikimedia.org/P81010 and previous config saved to /var/cache/conftool/dbconfig/20250812-011817-ladsgroup.json [production]
01:14 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1178 (T400854)', diff saved to https://phabricator.wikimedia.org/P81009 and previous config saved to /var/cache/conftool/dbconfig/20250812-011427-ladsgroup.json [production]
01:14 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1178.eqiad.wmnet with reason: Maintenance [production]
01:14 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1177 (T400854)', diff saved to https://phabricator.wikimedia.org/P81008 and previous config saved to /var/cache/conftool/dbconfig/20250812-011403-ladsgroup.json [production]
01:01 <eileen> civicrm upgraded from ebb98a9e to 13fb0ba8 [production]
00:58 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1177', diff saved to https://phabricator.wikimedia.org/P81007 and previous config saved to /var/cache/conftool/dbconfig/20250812-005856-ladsgroup.json [production]
00:43 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1177', diff saved to https://phabricator.wikimedia.org/P81006 and previous config saved to /var/cache/conftool/dbconfig/20250812-004349-ladsgroup.json [production]
00:28 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1177 (T400854)', diff saved to https://phabricator.wikimedia.org/P81005 and previous config saved to /var/cache/conftool/dbconfig/20250812-002841-ladsgroup.json [production]
00:25 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1177 (T400854)', diff saved to https://phabricator.wikimedia.org/P81004 and previous config saved to /var/cache/conftool/dbconfig/20250812-002553-ladsgroup.json [production]
00:25 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1177.eqiad.wmnet with reason: Maintenance [production]
00:25 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1172 (T400854)', diff saved to https://phabricator.wikimedia.org/P81003 and previous config saved to /var/cache/conftool/dbconfig/20250812-002530-ladsgroup.json [production]
00:12 <dzahn@dns1004> END - running authdns-update [production]
00:11 <dzahn@dns1004> START - running authdns-update [production]
00:10 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1172', diff saved to https://phabricator.wikimedia.org/P81002 and previous config saved to /var/cache/conftool/dbconfig/20250812-001022-ladsgroup.json [production]
2025-08-11 §
23:56 <vriley@cumin1002> START - Cookbook sre.hosts.reimage for host cloudcephosd1044.eqiad.wmnet with OS bookworm [production]
23:55 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1172', diff saved to https://phabricator.wikimedia.org/P81001 and previous config saved to /var/cache/conftool/dbconfig/20250811-235515-ladsgroup.json [production]
23:44 <vriley@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1046.eqiad.wmnet with OS bookworm [production]
23:44 <vriley@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1002" [production]
23:43 <vriley@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1068.eqiad.wmnet with OS bookworm [production]
23:43 <vriley@cumin1002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1002" [production]
23:40 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1172 (T400854)', diff saved to https://phabricator.wikimedia.org/P81000 and previous config saved to /var/cache/conftool/dbconfig/20250811-234007-ladsgroup.json [production]
23:37 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1172 (T400854)', diff saved to https://phabricator.wikimedia.org/P80999 and previous config saved to /var/cache/conftool/dbconfig/20250811-233712-ladsgroup.json [production]
23:37 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1172.eqiad.wmnet with reason: Maintenance [production]
23:36 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1171.eqiad.wmnet with reason: Maintenance [production]
23:35 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1167 (T400854)', diff saved to https://phabricator.wikimedia.org/P80998 and previous config saved to /var/cache/conftool/dbconfig/20250811-233545-ladsgroup.json [production]
23:20 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1167', diff saved to https://phabricator.wikimedia.org/P80997 and previous config saved to /var/cache/conftool/dbconfig/20250811-232038-ladsgroup.json [production]
23:19 <vriley@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1002" [production]
23:11 <vriley@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudcephosd1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
23:05 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1167', diff saved to https://phabricator.wikimedia.org/P80996 and previous config saved to /var/cache/conftool/dbconfig/20250811-230530-ladsgroup.json [production]