|
2025-01-28
ยง
|
| 22:36 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T384592)', diff saved to https://phabricator.wikimedia.org/P72672 and previous config saved to /var/cache/conftool/dbconfig/20250128-223630-marostegui.json |
[production] |
| 22:30 |
<jhuneidi@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1114804|Move VE EditCheck testwiki enabling into the correct file (T384658)]], [[gerrit:1114425|Condense wikivoyage configuration options for Parsoid Read Views (T365367)]] (duration: 13m 48s) |
[production] |
| 22:23 |
<jhuneidi@deploy2002> |
jhuneidi, cscott, kemayo: Continuing with sync |
[production] |
| 22:21 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P72670 and previous config saved to /var/cache/conftool/dbconfig/20250128-222123-marostegui.json |
[production] |
| 22:06 |
<jhuneidi@deploy2002> |
jhuneidi, matmarex: Continuing with sync |
[production] |
| 22:06 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P72667 and previous config saved to /var/cache/conftool/dbconfig/20250128-220616-marostegui.json |
[production] |
| 22:06 |
<jhuneidi@deploy2002> |
jhuneidi, matmarex: Backport for [[gerrit:1114799|Fix PHP 7.4 issue (T384905)]], [[gerrit:1114800|wikimedia/request-timeout: 2.0.1 -> 2.0.2 (T384905)]], [[gerrit:1114802|composer: wikimedia/request-timeout 2.0.1 -> 2.0.2 (T384905)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 22:03 |
<aqu@deploy2002> |
Finished deploy [analytics/refinery@3959b36] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@3959b36b] (duration: 00m 34s) |
[production] |
| 22:02 |
<aqu@deploy2002> |
Started deploy [analytics/refinery@3959b36] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@3959b36b] |
[production] |
| 22:02 |
<aqu@deploy2002> |
Finished deploy [analytics/refinery@3959b36] (thin): Regular analytics weekly train THIN [analytics/refinery@3959b36b] (duration: 01m 08s) |
[production] |
| 22:01 |
<jhuneidi@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1114799|Fix PHP 7.4 issue (T384905)]], [[gerrit:1114800|wikimedia/request-timeout: 2.0.1 -> 2.0.2 (T384905)]], [[gerrit:1114802|composer: wikimedia/request-timeout 2.0.1 -> 2.0.2 (T384905)]] |
[production] |
| 22:00 |
<aqu@deploy2002> |
Started deploy [analytics/refinery@3959b36] (thin): Regular analytics weekly train THIN [analytics/refinery@3959b36b] |
[production] |
| 22:00 |
<aqu@deploy2002> |
Finished deploy [analytics/refinery@3959b36]: Regular analytics weekly train [analytics/refinery@3959b36b] (duration: 02m 03s) |
[production] |
| 21:58 |
<aqu@deploy2002> |
Started deploy [analytics/refinery@3959b36]: Regular analytics weekly train [analytics/refinery@3959b36b] |
[production] |
| 21:57 |
<aqu> |
About to deploy analytics/refinery |
[production] |
| 21:56 |
<aqu> |
Deployed refinery-source using jenkins |
[production] |
| 21:51 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T384592)', diff saved to https://phabricator.wikimedia.org/P72666 and previous config saved to /var/cache/conftool/dbconfig/20250128-215109-marostegui.json |
[production] |
| 20:49 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2159 (T384592)', diff saved to https://phabricator.wikimedia.org/P72665 and previous config saved to /var/cache/conftool/dbconfig/20250128-204933-marostegui.json |
[production] |
| 20:49 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2187.codfw.wmnet with reason: Maintenance |
[production] |
| 20:49 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2159.codfw.wmnet with reason: Maintenance |
[production] |
| 20:49 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150 (T384592)', diff saved to https://phabricator.wikimedia.org/P72664 and previous config saved to /var/cache/conftool/dbconfig/20250128-204907-marostegui.json |
[production] |
| 20:47 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P72663 and previous config saved to /var/cache/conftool/dbconfig/20250128-204712-root.json |
[production] |
| 20:34 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P72662 and previous config saved to /var/cache/conftool/dbconfig/20250128-203400-marostegui.json |
[production] |
| 20:32 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P72661 and previous config saved to /var/cache/conftool/dbconfig/20250128-203207-root.json |
[production] |
| 20:18 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P72660 and previous config saved to /var/cache/conftool/dbconfig/20250128-201853-marostegui.json |
[production] |
| 20:17 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P72659 and previous config saved to /var/cache/conftool/dbconfig/20250128-201702-root.json |
[production] |
| 20:03 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150 (T384592)', diff saved to https://phabricator.wikimedia.org/P72656 and previous config saved to /var/cache/conftool/dbconfig/20250128-200346-marostegui.json |
[production] |
| 20:01 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P72655 and previous config saved to /var/cache/conftool/dbconfig/20250128-200157-root.json |
[production] |
| 19:46 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P72654 and previous config saved to /var/cache/conftool/dbconfig/20250128-194651-root.json |
[production] |
| 19:36 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2028.codfw.wmnet |
[production] |
| 19:20 |
<jhuneidi@deploy2002> |
rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.14 refs T382365 |
[production] |
| 18:21 |
<swfrench@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/shellbox-video: apply |
[production] |
| 18:18 |
<swfrench@deploy2002> |
helmfile [codfw] START helmfile.d/services/shellbox-video: apply |
[production] |
| 18:18 |
<swfrench-wmf> |
starting shellbox-video pilot on PHP 8.1 (3 replicas, codfw only) - T377038 |
[production] |
| 18:17 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2150 (T384592)', diff saved to https://phabricator.wikimedia.org/P72653 and previous config saved to /var/cache/conftool/dbconfig/20250128-181729-marostegui.json |
[production] |
| 18:17 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2150.codfw.wmnet with reason: Maintenance |
[production] |
| 18:05 |
<swfrench@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply |
[production] |
| 18:04 |
<swfrench@deploy2002> |
helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply |
[production] |
| 18:04 |
<swfrench-wmf> |
starting shellbox-constraints pilot on PHP 8.1 (1 replica, eqiad only) - T377038 |
[production] |
| 18:03 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:03 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1236 (T384592)', diff saved to https://phabricator.wikimedia.org/P72652 and previous config saved to /var/cache/conftool/dbconfig/20250128-180335-marostegui.json |
[production] |
| 17:48 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1236', diff saved to https://phabricator.wikimedia.org/P72651 and previous config saved to /var/cache/conftool/dbconfig/20250128-174828-marostegui.json |
[production] |
| 17:33 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1236', diff saved to https://phabricator.wikimedia.org/P72650 and previous config saved to /var/cache/conftool/dbconfig/20250128-173321-marostegui.json |
[production] |
| 17:18 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1236 (T384592)', diff saved to https://phabricator.wikimedia.org/P72649 and previous config saved to /var/cache/conftool/dbconfig/20250128-171814-marostegui.json |
[production] |
| 17:12 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P72648 and previous config saved to /var/cache/conftool/dbconfig/20250128-171205-root.json |
[production] |
| 17:10 |
<vgutierrez@cumin1002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs4010.ulsfo.wmnet with OS bookworm |
[production] |
| 17:06 |
<rzl> |
stopping puppet on A:cp-text |
[production] |
| 17:05 |
<cmooney@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on netflow3003.esams.wmnet with reason: disabling alerts as I'm running gnmic manually rather than with systemd |
[production] |
| 17:04 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1236 (T384592)', diff saved to https://phabricator.wikimedia.org/P72647 and previous config saved to /var/cache/conftool/dbconfig/20250128-170412-marostegui.json |
[production] |
| 17:04 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1236.eqiad.wmnet with reason: Maintenance |
[production] |