|
2023-01-04
ยง
|
| 21:45 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 4:00:00 on db1198.eqiad.wmnet with reason: Maintenance |
[production] |
| 21:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1189 (T326011)', diff saved to https://phabricator.wikimedia.org/P42824 and previous config saved to /var/cache/conftool/dbconfig/20230104-214555-marostegui.json |
[production] |
| 21:44 |
<kindrobot@deploy1002> |
Finished scap: Backport for [[gerrit:875386|Add namespace to gorwiktionary (T326253)]] (duration: 11m 26s) |
[production] |
| 21:35 |
<kindrobot@deploy1002> |
kindrobot and jhsoby: Backport for [[gerrit:875386|Add namespace to gorwiktionary (T326253)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet |
[production] |
| 21:33 |
<kindrobot@deploy1002> |
Started scap: Backport for [[gerrit:875386|Add namespace to gorwiktionary (T326253)]] |
[production] |
| 21:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1189', diff saved to https://phabricator.wikimedia.org/P42823 and previous config saved to /var/cache/conftool/dbconfig/20230104-213049-marostegui.json |
[production] |
| 21:28 |
<kindrobot@deploy1002> |
Finished scap: Backport for [[gerrit:874957|Start writing to cuc_comment_id on group0 and group1 wikis (T233004)]] (duration: 17m 28s) |
[production] |
| 21:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1189', diff saved to https://phabricator.wikimedia.org/P42820 and previous config saved to /var/cache/conftool/dbconfig/20230104-211542-marostegui.json |
[production] |
| 21:12 |
<kindrobot@deploy1002> |
kindrobot and zabe: Backport for [[gerrit:874957|Start writing to cuc_comment_id on group0 and group1 wikis (T233004)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet |
[production] |
| 21:10 |
<kindrobot@deploy1002> |
Started scap: Backport for [[gerrit:874957|Start writing to cuc_comment_id on group0 and group1 wikis (T233004)]] |
[production] |
| 21:05 |
<kindrobot> |
starting UTC late backport window |
[production] |
| 21:00 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1189 (T326011)', diff saved to https://phabricator.wikimedia.org/P42819 and previous config saved to /var/cache/conftool/dbconfig/20230104-210036-marostegui.json |
[production] |
| 20:58 |
<Amir1> |
running refreshGlobalimagelinks.php on all wikis (T322588) |
[production] |
| 20:56 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depooling db1189 (T326011)', diff saved to https://phabricator.wikimedia.org/P42818 and previous config saved to /var/cache/conftool/dbconfig/20230104-205628-marostegui.json |
[production] |
| 20:56 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1189.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:56 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 4:00:00 on db1189.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:56 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1179 (T326011)', diff saved to https://phabricator.wikimedia.org/P42817 and previous config saved to /var/cache/conftool/dbconfig/20230104-205607-marostegui.json |
[production] |
| 20:41 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1179', diff saved to https://phabricator.wikimedia.org/P42816 and previous config saved to /var/cache/conftool/dbconfig/20230104-204100-marostegui.json |
[production] |
| 20:25 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1179', diff saved to https://phabricator.wikimedia.org/P42815 and previous config saved to /var/cache/conftool/dbconfig/20230104-202554-marostegui.json |
[production] |
| 20:14 |
<cstone> |
payments-wiki upgraded from ede93d62 to f075991f |
[production] |
| 20:10 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1179 (T326011)', diff saved to https://phabricator.wikimedia.org/P42814 and previous config saved to /var/cache/conftool/dbconfig/20230104-201047-marostegui.json |
[production] |
| 20:06 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depooling db1179 (T326011)', diff saved to https://phabricator.wikimedia.org/P42813 and previous config saved to /var/cache/conftool/dbconfig/20230104-200638-marostegui.json |
[production] |
| 20:06 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1179.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:06 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 4:00:00 on db1179.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:06 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1175 (T326011)', diff saved to https://phabricator.wikimedia.org/P42812 and previous config saved to /var/cache/conftool/dbconfig/20230104-200617-marostegui.json |
[production] |
| 19:51 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P42811 and previous config saved to /var/cache/conftool/dbconfig/20230104-195110-marostegui.json |
[production] |
| 19:36 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P42810 and previous config saved to /var/cache/conftool/dbconfig/20230104-193604-marostegui.json |
[production] |
| 19:32 |
<dduvall@deploy1002> |
Synchronized php: group1 wikis to 1.40.0-wmf.17 refs T325580 (duration: 06m 58s) |
[production] |
| 19:25 |
<dduvall@deploy1002> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.40.0-wmf.17 refs T325580 |
[production] |
| 19:20 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1175 (T326011)', diff saved to https://phabricator.wikimedia.org/P42809 and previous config saved to /var/cache/conftool/dbconfig/20230104-192057-marostegui.json |
[production] |
| 19:16 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depooling db1175 (T326011)', diff saved to https://phabricator.wikimedia.org/P42808 and previous config saved to /var/cache/conftool/dbconfig/20230104-191648-marostegui.json |
[production] |
| 19:16 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1175.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:16 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 4:00:00 on db1175.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:16 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1166 (T326011)', diff saved to https://phabricator.wikimedia.org/P42807 and previous config saved to /var/cache/conftool/dbconfig/20230104-191627-marostegui.json |
[production] |
| 19:07 |
<dancy@deploy1002> |
Installing scap version "4.32.0" for 560 hosts |
[production] |
| 19:01 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P42806 and previous config saved to /var/cache/conftool/dbconfig/20230104-190121-marostegui.json |
[production] |
| 18:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P42805 and previous config saved to /var/cache/conftool/dbconfig/20230104-184614-marostegui.json |
[production] |
| 18:40 |
<mfossati@deploy1002> |
Finished deploy [airflow-dags/platform_eng@84f5f50]: (no justification provided) (duration: 00m 05s) |
[production] |
| 18:40 |
<mfossati@deploy1002> |
Started deploy [airflow-dags/platform_eng@84f5f50]: (no justification provided) |
[production] |
| 18:31 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1166 (T326011)', diff saved to https://phabricator.wikimedia.org/P42804 and previous config saved to /var/cache/conftool/dbconfig/20230104-183108-marostegui.json |
[production] |
| 18:27 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depooling db1166 (T326011)', diff saved to https://phabricator.wikimedia.org/P42803 and previous config saved to /var/cache/conftool/dbconfig/20230104-182700-marostegui.json |
[production] |
| 18:26 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1166.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:26 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 4:00:00 on db1166.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:24 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1145.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:24 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 4:00:00 on db1145.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:24 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1123 (T326011)', diff saved to https://phabricator.wikimedia.org/P42802 and previous config saved to /var/cache/conftool/dbconfig/20230104-182425-marostegui.json |
[production] |
| 18:15 |
<taavi@deploy1002> |
Finished deploy [horizon/deploy@9d02cd6]: pushing wmf-puppet-dashboard updates for enc git handling (after remembering to update the submodules) (duration: 00m 54s) |
[production] |
| 18:14 |
<taavi@deploy1002> |
Started deploy [horizon/deploy@9d02cd6]: pushing wmf-puppet-dashboard updates for enc git handling (after remembering to update the submodules) |
[production] |
| 18:13 |
<taavi@deploy1002> |
Finished deploy [horizon/deploy@9d02cd6]: pushing wmf-puppet-dashboard updates for enc git handling (duration: 03m 54s) |
[production] |
| 18:09 |
<taavi@deploy1002> |
Started deploy [horizon/deploy@9d02cd6]: pushing wmf-puppet-dashboard updates for enc git handling |
[production] |