|
2025-04-29
§
|
| 06:25 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1246.eqiad.wmnet with reason: host reimage |
[production] |
| 06:22 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host ganeti7002.magru.wmnet |
[production] |
| 06:21 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on db1246.eqiad.wmnet with reason: host reimage |
[production] |
| 06:20 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti7002.magru.wmnet |
[production] |
| 06:03 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.reimage for host db1246.eqiad.wmnet with OS bookworm |
[production] |
| 06:01 |
<marostegui@cumin1002> |
END (FAIL) - Cookbook sre.hosts.ipmi-password-reset (exit_code=99) |
[production] |
| 06:00 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.ipmi-password-reset |
[production] |
| 06:00 |
<marostegui@cumin1002> |
END (FAIL) - Cookbook sre.hosts.ipmi-password-reset (exit_code=99) |
[production] |
| 06:00 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.ipmi-password-reset |
[production] |
| 04:04 |
<mwpresync@deploy1003> |
Finished scap sync-world: testwikis to 1.44.0-wmf.27 refs T386222 (duration: 61m 23s) |
[production] |
| 03:03 |
<mwpresync@deploy1003> |
Started scap sync-world: testwikis to 1.44.0-wmf.27 refs T386222 |
[production] |
| 02:19 |
<ejegg> |
civicrm upgraded from a82ee0f8 to 6c4c4016 |
[production] |
| 01:25 |
<fceratto@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db[1256-1257].eqiad.wmnet with reason: Maintenance |
[production] |
| 01:25 |
<fceratto@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1255.eqiad.wmnet with reason: Maintenance |
[production] |
| 01:25 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1226 (T392806)', diff saved to https://phabricator.wikimedia.org/P75579 and previous config saved to /var/cache/conftool/dbconfig/20250429-012509-fceratto.json |
[production] |
| 01:10 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P75578 and previous config saved to /var/cache/conftool/dbconfig/20250429-011002-fceratto.json |
[production] |
| 00:54 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P75577 and previous config saved to /var/cache/conftool/dbconfig/20250429-005455-fceratto.json |
[production] |
| 00:39 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1226 (T392806)', diff saved to https://phabricator.wikimedia.org/P75576 and previous config saved to /var/cache/conftool/dbconfig/20250429-003948-fceratto.json |
[production] |
| 00:31 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Depooling db1226 (T392806)', diff saved to https://phabricator.wikimedia.org/P75575 and previous config saved to /var/cache/conftool/dbconfig/20250429-003131-fceratto.json |
[production] |
| 00:31 |
<fceratto@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1226.eqiad.wmnet with reason: Maintenance |
[production] |
| 00:31 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1214 (T392806)', diff saved to https://phabricator.wikimedia.org/P75574 and previous config saved to /var/cache/conftool/dbconfig/20250429-003104-fceratto.json |
[production] |
| 00:21 |
<eileen> |
civicrm upgraded from 3ca2db06 to a82ee0f8 |
[production] |
| 00:15 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1214', diff saved to https://phabricator.wikimedia.org/P75573 and previous config saved to /var/cache/conftool/dbconfig/20250429-001557-fceratto.json |
[production] |
| 00:00 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1214', diff saved to https://phabricator.wikimedia.org/P75572 and previous config saved to /var/cache/conftool/dbconfig/20250429-000049-fceratto.json |
[production] |
|
2025-04-28
§
|
| 23:54 |
<zabe> |
zabe@mwmaint1002:~$ mwscript extensions/AbuseFilter/maintenance/MigrateESRefToAflTable.php enwiki --deletedump /home/zabe/afl_text_table_deletedump/enwiki --dump /home/zabe/afl_text_table_dump/enwiki --sleep 0.5 # T381599 |
[production] |
| 23:47 |
<jhancock@cumin2002> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ganeti2047.codfw.wmnet with OS bookworm |
[production] |
| 23:45 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1214 (T392806)', diff saved to https://phabricator.wikimedia.org/P75571 and previous config saved to /var/cache/conftool/dbconfig/20250428-234542-fceratto.json |
[production] |
| 23:15 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Depooling db1214 (T392806)', diff saved to https://phabricator.wikimedia.org/P75570 and previous config saved to /var/cache/conftool/dbconfig/20250428-231534-fceratto.json |
[production] |
| 23:15 |
<fceratto@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1214.eqiad.wmnet with reason: Maintenance |
[production] |
| 23:15 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1211 (T392806)', diff saved to https://phabricator.wikimedia.org/P75569 and previous config saved to /var/cache/conftool/dbconfig/20250428-231508-fceratto.json |
[production] |
| 23:04 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host ganeti2047.codfw.wmnet with OS bookworm |
[production] |
| 23:00 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1211', diff saved to https://phabricator.wikimedia.org/P75568 and previous config saved to /var/cache/conftool/dbconfig/20250428-230001-fceratto.json |
[production] |
| 22:44 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1211', diff saved to https://phabricator.wikimedia.org/P75567 and previous config saved to /var/cache/conftool/dbconfig/20250428-224453-fceratto.json |
[production] |
| 22:29 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1211 (T392806)', diff saved to https://phabricator.wikimedia.org/P75566 and previous config saved to /var/cache/conftool/dbconfig/20250428-222946-fceratto.json |
[production] |
| 22:21 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Depooling db1211 (T392806)', diff saved to https://phabricator.wikimedia.org/P75564 and previous config saved to /var/cache/conftool/dbconfig/20250428-222148-fceratto.json |
[production] |
| 22:21 |
<fceratto@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1211.eqiad.wmnet with reason: Maintenance |
[production] |
| 22:21 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1209 (T392806)', diff saved to https://phabricator.wikimedia.org/P75563 and previous config saved to /var/cache/conftool/dbconfig/20250428-222122-fceratto.json |
[production] |
| 22:19 |
<sbassett> |
Deployed security fix for T391343 |
[production] |
| 22:06 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1209', diff saved to https://phabricator.wikimedia.org/P75562 and previous config saved to /var/cache/conftool/dbconfig/20250428-220615-fceratto.json |
[production] |
| 22:03 |
<sbassett> |
Deployed security fix for T392276 |
[production] |
| 21:51 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1209', diff saved to https://phabricator.wikimedia.org/P75561 and previous config saved to /var/cache/conftool/dbconfig/20250428-215107-fceratto.json |
[production] |
| 21:47 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti2048.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 21:47 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti2047.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 21:46 |
<sbassett> |
Deployed security fix for T385792 |
[production] |
| 21:42 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host ganeti2048.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 21:42 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host ganeti2047.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 21:36 |
<sukhe@cumin1002> |
END (PASS) - Cookbook sre.dns.roll-reboot (exit_code=0) rolling reboot on P{dns2006*} and A:dnsbox |
[production] |
| 21:36 |
<sukhe@cumin1002> |
cookbooks.sre.dns.roll-reboot finished rebooting dns2006.wikimedia.org |
[production] |
| 21:36 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1209 (T392806)', diff saved to https://phabricator.wikimedia.org/P75560 and previous config saved to /var/cache/conftool/dbconfig/20250428-213601-fceratto.json |
[production] |
| 21:28 |
<jhancock@cumin2002> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ganeti2045.codfw.wmnet with OS bookworm |
[production] |