|
2025-01-29
§
|
| 04:56 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2208 (T384592)', diff saved to https://phabricator.wikimedia.org/P72686 and previous config saved to /var/cache/conftool/dbconfig/20250129-045600-marostegui.json |
[production] |
| 04:08 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2208 (T384592)', diff saved to https://phabricator.wikimedia.org/P72685 and previous config saved to /var/cache/conftool/dbconfig/20250129-040822-marostegui.json |
[production] |
| 04:08 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2208.codfw.wmnet with reason: Maintenance |
[production] |
| 03:06 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2200.codfw.wmnet with reason: Maintenance |
[production] |
| 02:56 |
<denisse@deploy2002> |
Finished deploy [librenms/librenms@f049593]: Upgrade LibreNMS to 25.1.0 - T384258 (duration: 00m 13s) |
[production] |
| 02:56 |
<denisse@deploy2002> |
Started deploy [librenms/librenms@f049593]: Upgrade LibreNMS to 25.1.0 - T384258 |
[production] |
| 01:57 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2198.codfw.wmnet with reason: Maintenance |
[production] |
| 01:57 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2182 (T384592)', diff saved to https://phabricator.wikimedia.org/P72683 and previous config saved to /var/cache/conftool/dbconfig/20250129-015717-marostegui.json |
[production] |
| 01:42 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P72682 and previous config saved to /var/cache/conftool/dbconfig/20250129-014210-marostegui.json |
[production] |
| 01:27 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P72681 and previous config saved to /var/cache/conftool/dbconfig/20250129-012703-marostegui.json |
[production] |
| 01:11 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2182 (T384592)', diff saved to https://phabricator.wikimedia.org/P72680 and previous config saved to /var/cache/conftool/dbconfig/20250129-011157-marostegui.json |
[production] |
| 01:10 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli |
[tools] |
| 01:01 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli |
[tools] |
| 01:01 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli |
[toolsbeta] |
| 00:54 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli |
[toolsbeta] |
| 00:53 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli |
[toolsbeta] |
| 00:46 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli |
[toolsbeta] |
| 00:17 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2182 (T384592)', diff saved to https://phabricator.wikimedia.org/P72679 and previous config saved to /var/cache/conftool/dbconfig/20250129-001702-marostegui.json |
[production] |
| 00:16 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2182.codfw.wmnet with reason: Maintenance |
[production] |
| 00:16 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168 (T384592)', diff saved to https://phabricator.wikimedia.org/P72678 and previous config saved to /var/cache/conftool/dbconfig/20250129-001651-marostegui.json |
[production] |
| 00:01 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P72677 and previous config saved to /var/cache/conftool/dbconfig/20250129-000144-marostegui.json |
[production] |
|
2025-01-28
§
|
| 23:46 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P72676 and previous config saved to /var/cache/conftool/dbconfig/20250128-234637-marostegui.json |
[production] |
| 23:31 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168 (T384592)', diff saved to https://phabricator.wikimedia.org/P72675 and previous config saved to /var/cache/conftool/dbconfig/20250128-233130-marostegui.json |
[production] |
| 22:36 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2168 (T384592)', diff saved to https://phabricator.wikimedia.org/P72673 and previous config saved to /var/cache/conftool/dbconfig/20250128-223652-marostegui.json |
[production] |
| 22:36 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2168.codfw.wmnet with reason: Maintenance |
[production] |
| 22:36 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T384592)', diff saved to https://phabricator.wikimedia.org/P72672 and previous config saved to /var/cache/conftool/dbconfig/20250128-223630-marostegui.json |
[production] |
| 22:30 |
<jhuneidi@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1114804|Move VE EditCheck testwiki enabling into the correct file (T384658)]], [[gerrit:1114425|Condense wikivoyage configuration options for Parsoid Read Views (T365367)]] (duration: 13m 48s) |
[production] |
| 22:23 |
<jhuneidi@deploy2002> |
jhuneidi, cscott, kemayo: Continuing with sync |
[production] |
| 22:21 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P72670 and previous config saved to /var/cache/conftool/dbconfig/20250128-222123-marostegui.json |
[production] |
| 22:06 |
<jhuneidi@deploy2002> |
jhuneidi, matmarex: Continuing with sync |
[production] |
| 22:06 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P72667 and previous config saved to /var/cache/conftool/dbconfig/20250128-220616-marostegui.json |
[production] |
| 22:06 |
<jhuneidi@deploy2002> |
jhuneidi, matmarex: Backport for [[gerrit:1114799|Fix PHP 7.4 issue (T384905)]], [[gerrit:1114800|wikimedia/request-timeout: 2.0.1 -> 2.0.2 (T384905)]], [[gerrit:1114802|composer: wikimedia/request-timeout 2.0.1 -> 2.0.2 (T384905)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 22:03 |
<aqu@deploy2002> |
Finished deploy [analytics/refinery@3959b36] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@3959b36b] (duration: 00m 34s) |
[production] |
| 22:02 |
<aqu@deploy2002> |
Started deploy [analytics/refinery@3959b36] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@3959b36b] |
[production] |
| 22:02 |
<aqu@deploy2002> |
Finished deploy [analytics/refinery@3959b36] (thin): Regular analytics weekly train THIN [analytics/refinery@3959b36b] (duration: 01m 08s) |
[production] |
| 22:01 |
<jhuneidi@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1114799|Fix PHP 7.4 issue (T384905)]], [[gerrit:1114800|wikimedia/request-timeout: 2.0.1 -> 2.0.2 (T384905)]], [[gerrit:1114802|composer: wikimedia/request-timeout 2.0.1 -> 2.0.2 (T384905)]] |
[production] |
| 22:00 |
<aqu@deploy2002> |
Started deploy [analytics/refinery@3959b36] (thin): Regular analytics weekly train THIN [analytics/refinery@3959b36b] |
[production] |
| 22:00 |
<aqu@deploy2002> |
Finished deploy [analytics/refinery@3959b36]: Regular analytics weekly train [analytics/refinery@3959b36b] (duration: 02m 03s) |
[production] |
| 21:58 |
<aqu@deploy2002> |
Started deploy [analytics/refinery@3959b36]: Regular analytics weekly train [analytics/refinery@3959b36b] |
[production] |
| 21:57 |
<aqu> |
About to deploy analytics/refinery |
[production] |
| 21:56 |
<aqu> |
About to deploy analytics/refinery |
[analytics] |
| 21:56 |
<aqu> |
Deployed refinery-source using jenkins |
[analytics] |
| 21:56 |
<aqu> |
Deployed refinery-source using jenkins |
[production] |
| 21:51 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T384592)', diff saved to https://phabricator.wikimedia.org/P72666 and previous config saved to /var/cache/conftool/dbconfig/20250128-215109-marostegui.json |
[production] |
| 21:32 |
<xcollazo> |
Running `sudo systemctl restart airflow-scheduler@analytics` to try and clear an SSL error. |
[analytics] |
| 21:04 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=0) |
[admin] |
| 21:04 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.ceph.osd.depool_and_destroy |
[admin] |
| 21:04 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=0) |
[admin] |
| 21:03 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.ceph.osd.depool_and_destroy |
[admin] |
| 20:51 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.ceph.osd.bootstrap_and_add |
[admin] |