|
2026-01-28
ยง
|
| 22:38 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance |
[production] |
| 22:37 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2197.codfw.wmnet with reason: Maintenance |
[production] |
| 22:37 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2193 (T415786)', diff saved to https://phabricator.wikimedia.org/P88054 and previous config saved to /var/cache/conftool/dbconfig/20260128-223659-marostegui.json |
[production] |
| 22:36 |
<reedy@deploy2002> |
sfaci, jhsoby, reedy: Backport for [[gerrit:1234484|Enable VE in Project namespace on mswiktionary (T415823)]], [[gerrit:1233670|Removed `mpic` as local service (T407805)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 22:34 |
<reedy@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1234484|Enable VE in Project namespace on mswiktionary (T415823)]], [[gerrit:1233670|Removed `mpic` as local service (T407805)]] |
[production] |
| 22:28 |
<brennen@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1234517|Upgrade symfony/* (T415834)]], [[gerrit:1234516|Upgrade symfony/* (T415834)]] (duration: 12m 15s) |
[production] |
| 22:22 |
<brennen@deploy2002> |
brennen, reedy: Continuing with sync |
[production] |
| 22:21 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P88053 and previous config saved to /var/cache/conftool/dbconfig/20260128-222150-marostegui.json |
[production] |
| 22:20 |
<brennen@deploy2002> |
brennen, reedy: Backport for [[gerrit:1234517|Upgrade symfony/* (T415834)]], [[gerrit:1234516|Upgrade symfony/* (T415834)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 22:16 |
<brennen@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1234517|Upgrade symfony/* (T415834)]], [[gerrit:1234516|Upgrade symfony/* (T415834)]] |
[production] |
| 22:12 |
<elukey> |
roll restart druid middle managers on an-druid*, daemons stuck since the 21st (probably due to the upgrade) - T415799 |
[production] |
| 22:10 |
<brennen@deploy2002> |
Finished scap sync-world: Syncing with --force-l10n-update to see if it clears out T415725 (duration: 36m 46s) |
[production] |
| 22:06 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P88052 and previous config saved to /var/cache/conftool/dbconfig/20260128-220642-marostegui.json |
[production] |
| 21:51 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2193 (T415786)', diff saved to https://phabricator.wikimedia.org/P88051 and previous config saved to /var/cache/conftool/dbconfig/20260128-215133-marostegui.json |
[production] |
| 21:35 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1225.eqiad.wmnet with reason: Maintenance |
[production] |
| 21:34 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1187 (T415786)', diff saved to https://phabricator.wikimedia.org/P88050 and previous config saved to /var/cache/conftool/dbconfig/20260128-213443-marostegui.json |
[production] |
| 21:34 |
<brennen@deploy2002> |
Started scap sync-world: Syncing with --force-l10n-update to see if it clears out T415725 |
[production] |
| 21:26 |
<James_F> |
jforrester@doc1004:~$ sudo -u doc-uploader rm -rf /srv/doc/cover-extensions/WebAuthn # T415832 |
[releng] |
| 21:22 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2193 (T415786)', diff saved to https://phabricator.wikimedia.org/P88049 and previous config saved to /var/cache/conftool/dbconfig/20260128-212213-marostegui.json |
[production] |
| 21:22 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2193.codfw.wmnet with reason: Maintenance |
[production] |
| 21:21 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2180 (T415786)', diff saved to https://phabricator.wikimedia.org/P88048 and previous config saved to /var/cache/conftool/dbconfig/20260128-212148-marostegui.json |
[production] |
| 21:19 |
<dancy@deploy2002> |
Installation of scap version "4.239.0" completed for 2 hosts |
[production] |
| 21:19 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P88047 and previous config saved to /var/cache/conftool/dbconfig/20260128-211934-marostegui.json |
[production] |
| 21:17 |
<dancy@deploy2002> |
Installing scap version "4.239.0" for 2 host(s) |
[production] |
| 21:11 |
<bd808> |
Unblock 181.160.0.0/15 & 186.40.128.0/17 (T415820) |
[releng] |
| 21:06 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2180', diff saved to https://phabricator.wikimedia.org/P88046 and previous config saved to /var/cache/conftool/dbconfig/20260128-210639-marostegui.json |
[production] |
| 21:04 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P88045 and previous config saved to /var/cache/conftool/dbconfig/20260128-210426-marostegui.json |
[production] |
| 20:51 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2180', diff saved to https://phabricator.wikimedia.org/P88044 and previous config saved to /var/cache/conftool/dbconfig/20260128-205130-marostegui.json |
[production] |
| 20:49 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1187 (T415786)', diff saved to https://phabricator.wikimedia.org/P88043 and previous config saved to /var/cache/conftool/dbconfig/20260128-204917-marostegui.json |
[production] |
| 20:36 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2180 (T415786)', diff saved to https://phabricator.wikimedia.org/P88042 and previous config saved to /var/cache/conftool/dbconfig/20260128-203623-marostegui.json |
[production] |
| 20:14 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1187 (T415786)', diff saved to https://phabricator.wikimedia.org/P88041 and previous config saved to /var/cache/conftool/dbconfig/20260128-201416-marostegui.json |
[production] |
| 20:14 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1187.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:13 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180 (T415786)', diff saved to https://phabricator.wikimedia.org/P88040 and previous config saved to /var/cache/conftool/dbconfig/20260128-201351-marostegui.json |
[production] |
| 20:00 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2180 (T415786)', diff saved to https://phabricator.wikimedia.org/P88039 and previous config saved to /var/cache/conftool/dbconfig/20260128-200042-marostegui.json |
[production] |
| 20:00 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2180.codfw.wmnet with reason: Maintenance |
[production] |
| 20:00 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2169 (T415786)', diff saved to https://phabricator.wikimedia.org/P88038 and previous config saved to /var/cache/conftool/dbconfig/20260128-200018-marostegui.json |
[production] |
| 19:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P88037 and previous config saved to /var/cache/conftool/dbconfig/20260128-195842-marostegui.json |
[production] |
| 19:45 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2169', diff saved to https://phabricator.wikimedia.org/P88036 and previous config saved to /var/cache/conftool/dbconfig/20260128-194511-marostegui.json |
[production] |
| 19:43 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P88035 and previous config saved to /var/cache/conftool/dbconfig/20260128-194333-marostegui.json |
[production] |
| 19:36 |
<jgleeson> |
SmashPig upgraded from 96a6224d to b42f2de4 |
[fundraising] |
| 19:30 |
<dreamyjazz@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1234481|Set wgCheckUserSuggestedInvestigationsUseGlobalContributionsLink]] (duration: 09m 52s) |
[production] |
| 19:30 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2169', diff saved to https://phabricator.wikimedia.org/P88034 and previous config saved to /var/cache/conftool/dbconfig/20260128-193002-marostegui.json |
[production] |
| 19:28 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180 (T415786)', diff saved to https://phabricator.wikimedia.org/P88033 and previous config saved to /var/cache/conftool/dbconfig/20260128-192825-marostegui.json |
[production] |
| 19:25 |
<dreamyjazz@deploy2002> |
dreamyjazz: Continuing with sync |
[production] |
| 19:22 |
<dreamyjazz@deploy2002> |
dreamyjazz: Backport for [[gerrit:1234481|Set wgCheckUserSuggestedInvestigationsUseGlobalContributionsLink]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 19:20 |
<dreamyjazz@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1234481|Set wgCheckUserSuggestedInvestigationsUseGlobalContributionsLink]] |
[production] |
| 19:14 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2169 (T415786)', diff saved to https://phabricator.wikimedia.org/P88032 and previous config saved to /var/cache/conftool/dbconfig/20260128-191454-marostegui.json |
[production] |
| 18:53 |
<jgleeson> |
civicrm upgraded from 56c222da to 5c065c4e |
[fundraising] |
| 18:53 |
<jgleeson> |
SmashPig upgraded from 96a6224d to b42f2de4 |
[fundraising] |
| 18:52 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1180 (T415786)', diff saved to https://phabricator.wikimedia.org/P88031 and previous config saved to /var/cache/conftool/dbconfig/20260128-185245-marostegui.json |
[production] |