|
2025-01-29
§
|
| 04:56 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2208 (T384592)', diff saved to https://phabricator.wikimedia.org/P72686 and previous config saved to /var/cache/conftool/dbconfig/20250129-045600-marostegui.json |
[production] |
| 04:08 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2208 (T384592)', diff saved to https://phabricator.wikimedia.org/P72685 and previous config saved to /var/cache/conftool/dbconfig/20250129-040822-marostegui.json |
[production] |
| 04:08 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2208.codfw.wmnet with reason: Maintenance |
[production] |
| 03:06 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2200.codfw.wmnet with reason: Maintenance |
[production] |
| 02:56 |
<denisse@deploy2002> |
Finished deploy [librenms/librenms@f049593]: Upgrade LibreNMS to 25.1.0 - T384258 (duration: 00m 13s) |
[production] |
| 02:56 |
<denisse@deploy2002> |
Started deploy [librenms/librenms@f049593]: Upgrade LibreNMS to 25.1.0 - T384258 |
[production] |
| 01:57 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2198.codfw.wmnet with reason: Maintenance |
[production] |
| 01:57 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2182 (T384592)', diff saved to https://phabricator.wikimedia.org/P72683 and previous config saved to /var/cache/conftool/dbconfig/20250129-015717-marostegui.json |
[production] |
| 01:42 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P72682 and previous config saved to /var/cache/conftool/dbconfig/20250129-014210-marostegui.json |
[production] |
| 01:27 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P72681 and previous config saved to /var/cache/conftool/dbconfig/20250129-012703-marostegui.json |
[production] |
| 01:11 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2182 (T384592)', diff saved to https://phabricator.wikimedia.org/P72680 and previous config saved to /var/cache/conftool/dbconfig/20250129-011157-marostegui.json |
[production] |
| 00:17 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2182 (T384592)', diff saved to https://phabricator.wikimedia.org/P72679 and previous config saved to /var/cache/conftool/dbconfig/20250129-001702-marostegui.json |
[production] |
| 00:16 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2182.codfw.wmnet with reason: Maintenance |
[production] |
| 00:16 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168 (T384592)', diff saved to https://phabricator.wikimedia.org/P72678 and previous config saved to /var/cache/conftool/dbconfig/20250129-001651-marostegui.json |
[production] |
| 00:01 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P72677 and previous config saved to /var/cache/conftool/dbconfig/20250129-000144-marostegui.json |
[production] |
|
2025-01-28
§
|
| 23:46 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P72676 and previous config saved to /var/cache/conftool/dbconfig/20250128-234637-marostegui.json |
[production] |
| 23:31 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168 (T384592)', diff saved to https://phabricator.wikimedia.org/P72675 and previous config saved to /var/cache/conftool/dbconfig/20250128-233130-marostegui.json |
[production] |
| 22:36 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2168 (T384592)', diff saved to https://phabricator.wikimedia.org/P72673 and previous config saved to /var/cache/conftool/dbconfig/20250128-223652-marostegui.json |
[production] |
| 22:36 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2168.codfw.wmnet with reason: Maintenance |
[production] |
| 22:36 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T384592)', diff saved to https://phabricator.wikimedia.org/P72672 and previous config saved to /var/cache/conftool/dbconfig/20250128-223630-marostegui.json |
[production] |
| 22:30 |
<jhuneidi@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1114804|Move VE EditCheck testwiki enabling into the correct file (T384658)]], [[gerrit:1114425|Condense wikivoyage configuration options for Parsoid Read Views (T365367)]] (duration: 13m 48s) |
[production] |
| 22:23 |
<jhuneidi@deploy2002> |
jhuneidi, cscott, kemayo: Continuing with sync |
[production] |
| 22:21 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P72670 and previous config saved to /var/cache/conftool/dbconfig/20250128-222123-marostegui.json |
[production] |
| 22:06 |
<jhuneidi@deploy2002> |
jhuneidi, matmarex: Continuing with sync |
[production] |
| 22:06 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P72667 and previous config saved to /var/cache/conftool/dbconfig/20250128-220616-marostegui.json |
[production] |
| 22:06 |
<jhuneidi@deploy2002> |
jhuneidi, matmarex: Backport for [[gerrit:1114799|Fix PHP 7.4 issue (T384905)]], [[gerrit:1114800|wikimedia/request-timeout: 2.0.1 -> 2.0.2 (T384905)]], [[gerrit:1114802|composer: wikimedia/request-timeout 2.0.1 -> 2.0.2 (T384905)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 22:03 |
<aqu@deploy2002> |
Finished deploy [analytics/refinery@3959b36] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@3959b36b] (duration: 00m 34s) |
[production] |
| 22:02 |
<aqu@deploy2002> |
Started deploy [analytics/refinery@3959b36] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@3959b36b] |
[production] |
| 22:02 |
<aqu@deploy2002> |
Finished deploy [analytics/refinery@3959b36] (thin): Regular analytics weekly train THIN [analytics/refinery@3959b36b] (duration: 01m 08s) |
[production] |
| 22:01 |
<jhuneidi@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1114799|Fix PHP 7.4 issue (T384905)]], [[gerrit:1114800|wikimedia/request-timeout: 2.0.1 -> 2.0.2 (T384905)]], [[gerrit:1114802|composer: wikimedia/request-timeout 2.0.1 -> 2.0.2 (T384905)]] |
[production] |
| 22:00 |
<aqu@deploy2002> |
Started deploy [analytics/refinery@3959b36] (thin): Regular analytics weekly train THIN [analytics/refinery@3959b36b] |
[production] |
| 22:00 |
<aqu@deploy2002> |
Finished deploy [analytics/refinery@3959b36]: Regular analytics weekly train [analytics/refinery@3959b36b] (duration: 02m 03s) |
[production] |
| 21:58 |
<aqu@deploy2002> |
Started deploy [analytics/refinery@3959b36]: Regular analytics weekly train [analytics/refinery@3959b36b] |
[production] |
| 21:57 |
<aqu> |
About to deploy analytics/refinery |
[production] |
| 21:56 |
<aqu> |
Deployed refinery-source using jenkins |
[production] |
| 21:51 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T384592)', diff saved to https://phabricator.wikimedia.org/P72666 and previous config saved to /var/cache/conftool/dbconfig/20250128-215109-marostegui.json |
[production] |
| 20:49 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2159 (T384592)', diff saved to https://phabricator.wikimedia.org/P72665 and previous config saved to /var/cache/conftool/dbconfig/20250128-204933-marostegui.json |
[production] |
| 20:49 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2187.codfw.wmnet with reason: Maintenance |
[production] |
| 20:49 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2159.codfw.wmnet with reason: Maintenance |
[production] |
| 20:49 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150 (T384592)', diff saved to https://phabricator.wikimedia.org/P72664 and previous config saved to /var/cache/conftool/dbconfig/20250128-204907-marostegui.json |
[production] |
| 20:47 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P72663 and previous config saved to /var/cache/conftool/dbconfig/20250128-204712-root.json |
[production] |
| 20:34 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P72662 and previous config saved to /var/cache/conftool/dbconfig/20250128-203400-marostegui.json |
[production] |
| 20:32 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P72661 and previous config saved to /var/cache/conftool/dbconfig/20250128-203207-root.json |
[production] |
| 20:18 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P72660 and previous config saved to /var/cache/conftool/dbconfig/20250128-201853-marostegui.json |
[production] |
| 20:17 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P72659 and previous config saved to /var/cache/conftool/dbconfig/20250128-201702-root.json |
[production] |
| 20:03 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150 (T384592)', diff saved to https://phabricator.wikimedia.org/P72656 and previous config saved to /var/cache/conftool/dbconfig/20250128-200346-marostegui.json |
[production] |
| 20:01 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P72655 and previous config saved to /var/cache/conftool/dbconfig/20250128-200157-root.json |
[production] |
| 19:46 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P72654 and previous config saved to /var/cache/conftool/dbconfig/20250128-194651-root.json |
[production] |
| 19:36 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2028.codfw.wmnet |
[production] |
| 19:20 |
<jhuneidi@deploy2002> |
rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.14 refs T382365 |
[production] |