|
2025-01-29
§
|
| 01:01 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli |
[tools] |
| 01:01 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli |
[toolsbeta] |
| 00:54 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli |
[toolsbeta] |
| 00:53 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli |
[toolsbeta] |
| 00:46 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli |
[toolsbeta] |
| 00:17 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2182 (T384592)', diff saved to https://phabricator.wikimedia.org/P72679 and previous config saved to /var/cache/conftool/dbconfig/20250129-001702-marostegui.json |
[production] |
| 00:16 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2182.codfw.wmnet with reason: Maintenance |
[production] |
| 00:16 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168 (T384592)', diff saved to https://phabricator.wikimedia.org/P72678 and previous config saved to /var/cache/conftool/dbconfig/20250129-001651-marostegui.json |
[production] |
| 00:01 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P72677 and previous config saved to /var/cache/conftool/dbconfig/20250129-000144-marostegui.json |
[production] |
|
2025-01-28
§
|
| 23:46 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P72676 and previous config saved to /var/cache/conftool/dbconfig/20250128-234637-marostegui.json |
[production] |
| 23:31 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168 (T384592)', diff saved to https://phabricator.wikimedia.org/P72675 and previous config saved to /var/cache/conftool/dbconfig/20250128-233130-marostegui.json |
[production] |
| 22:36 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2168 (T384592)', diff saved to https://phabricator.wikimedia.org/P72673 and previous config saved to /var/cache/conftool/dbconfig/20250128-223652-marostegui.json |
[production] |
| 22:36 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2168.codfw.wmnet with reason: Maintenance |
[production] |
| 22:36 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T384592)', diff saved to https://phabricator.wikimedia.org/P72672 and previous config saved to /var/cache/conftool/dbconfig/20250128-223630-marostegui.json |
[production] |
| 22:30 |
<jhuneidi@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1114804|Move VE EditCheck testwiki enabling into the correct file (T384658)]], [[gerrit:1114425|Condense wikivoyage configuration options for Parsoid Read Views (T365367)]] (duration: 13m 48s) |
[production] |
| 22:23 |
<jhuneidi@deploy2002> |
jhuneidi, cscott, kemayo: Continuing with sync |
[production] |
| 22:21 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P72670 and previous config saved to /var/cache/conftool/dbconfig/20250128-222123-marostegui.json |
[production] |
| 22:06 |
<jhuneidi@deploy2002> |
jhuneidi, matmarex: Continuing with sync |
[production] |
| 22:06 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P72667 and previous config saved to /var/cache/conftool/dbconfig/20250128-220616-marostegui.json |
[production] |
| 22:06 |
<jhuneidi@deploy2002> |
jhuneidi, matmarex: Backport for [[gerrit:1114799|Fix PHP 7.4 issue (T384905)]], [[gerrit:1114800|wikimedia/request-timeout: 2.0.1 -> 2.0.2 (T384905)]], [[gerrit:1114802|composer: wikimedia/request-timeout 2.0.1 -> 2.0.2 (T384905)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 22:03 |
<aqu@deploy2002> |
Finished deploy [analytics/refinery@3959b36] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@3959b36b] (duration: 00m 34s) |
[production] |
| 22:02 |
<aqu@deploy2002> |
Started deploy [analytics/refinery@3959b36] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@3959b36b] |
[production] |
| 22:02 |
<aqu@deploy2002> |
Finished deploy [analytics/refinery@3959b36] (thin): Regular analytics weekly train THIN [analytics/refinery@3959b36b] (duration: 01m 08s) |
[production] |
| 22:01 |
<jhuneidi@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1114799|Fix PHP 7.4 issue (T384905)]], [[gerrit:1114800|wikimedia/request-timeout: 2.0.1 -> 2.0.2 (T384905)]], [[gerrit:1114802|composer: wikimedia/request-timeout 2.0.1 -> 2.0.2 (T384905)]] |
[production] |
| 22:00 |
<aqu@deploy2002> |
Started deploy [analytics/refinery@3959b36] (thin): Regular analytics weekly train THIN [analytics/refinery@3959b36b] |
[production] |
| 22:00 |
<aqu@deploy2002> |
Finished deploy [analytics/refinery@3959b36]: Regular analytics weekly train [analytics/refinery@3959b36b] (duration: 02m 03s) |
[production] |
| 21:58 |
<aqu@deploy2002> |
Started deploy [analytics/refinery@3959b36]: Regular analytics weekly train [analytics/refinery@3959b36b] |
[production] |
| 21:57 |
<aqu> |
About to deploy analytics/refinery |
[production] |
| 21:56 |
<aqu> |
About to deploy analytics/refinery |
[analytics] |
| 21:56 |
<aqu> |
Deployed refinery-source using jenkins |
[analytics] |
| 21:56 |
<aqu> |
Deployed refinery-source using jenkins |
[production] |
| 21:51 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T384592)', diff saved to https://phabricator.wikimedia.org/P72666 and previous config saved to /var/cache/conftool/dbconfig/20250128-215109-marostegui.json |
[production] |
| 21:32 |
<xcollazo> |
Running `sudo systemctl restart airflow-scheduler@analytics` to try and clear an SSL error. |
[analytics] |
| 21:04 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=0) |
[admin] |
| 21:04 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.ceph.osd.depool_and_destroy |
[admin] |
| 21:04 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=0) |
[admin] |
| 21:03 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.ceph.osd.depool_and_destroy |
[admin] |
| 20:51 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.ceph.osd.bootstrap_and_add |
[admin] |
| 20:50 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=0) |
[admin] |
| 20:49 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2159 (T384592)', diff saved to https://phabricator.wikimedia.org/P72665 and previous config saved to /var/cache/conftool/dbconfig/20250128-204933-marostegui.json |
[production] |
| 20:49 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2187.codfw.wmnet with reason: Maintenance |
[production] |
| 20:49 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2159.codfw.wmnet with reason: Maintenance |
[production] |
| 20:49 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150 (T384592)', diff saved to https://phabricator.wikimedia.org/P72664 and previous config saved to /var/cache/conftool/dbconfig/20250128-204907-marostegui.json |
[production] |
| 20:48 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.ceph.osd.depool_and_destroy |
[admin] |
| 20:47 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P72663 and previous config saved to /var/cache/conftool/dbconfig/20250128-204712-root.json |
[production] |
| 20:34 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P72662 and previous config saved to /var/cache/conftool/dbconfig/20250128-203400-marostegui.json |
[production] |
| 20:32 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P72661 and previous config saved to /var/cache/conftool/dbconfig/20250128-203207-root.json |
[production] |
| 20:18 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P72660 and previous config saved to /var/cache/conftool/dbconfig/20250128-201853-marostegui.json |
[production] |
| 20:17 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2177 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P72659 and previous config saved to /var/cache/conftool/dbconfig/20250128-201702-root.json |
[production] |
| 20:03 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150 (T384592)', diff saved to https://phabricator.wikimedia.org/P72656 and previous config saved to /var/cache/conftool/dbconfig/20250128-200346-marostegui.json |
[production] |