|
2025-07-16
§
|
| 06:36 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2149 (re)pooling @ 25%: 10', diff saved to https://phabricator.wikimedia.org/P79165 and previous config saved to /var/cache/conftool/dbconfig/20250716-063646-root.json |
[production] |
| 06:32 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1256 (re)pooling @ 75%: 10', diff saved to https://phabricator.wikimedia.org/P79164 and previous config saved to /var/cache/conftool/dbconfig/20250716-063159-root.json |
[production] |
| 06:30 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1159', diff saved to https://phabricator.wikimedia.org/P79163 and previous config saved to /var/cache/conftool/dbconfig/20250716-063046-marostegui.json |
[production] |
| 06:25 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db2149 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P79162 and previous config saved to /var/cache/conftool/dbconfig/20250716-062537-marostegui.json |
[production] |
| 06:25 |
<root@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2149.codfw.wmnet with reason: Maintenance |
[production] |
| 06:19 |
<marostegui> |
Poweroff pc2015 for 10G migration T378715 |
[production] |
| 06:16 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1256 (re)pooling @ 50%: 10', diff saved to https://phabricator.wikimedia.org/P79161 and previous config saved to /var/cache/conftool/dbconfig/20250716-061653-root.json |
[production] |
| 06:15 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1159 (T399249)', diff saved to https://phabricator.wikimedia.org/P79160 and previous config saved to /var/cache/conftool/dbconfig/20250716-061539-marostegui.json |
[production] |
| 06:09 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 6:00:00 on pc2015.codfw.wmnet,pc1015.eqiad.wmnet with reason: maintenance |
[production] |
| 06:03 |
<marostegui> |
Restart mariadb on pc5 T399540 |
[production] |
| 06:01 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1256 (re)pooling @ 25%: 10', diff saved to https://phabricator.wikimedia.org/P79159 and previous config saved to /var/cache/conftool/dbconfig/20250716-060148-root.json |
[production] |
| 06:00 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) |
[production] |
| 05:59 |
<marostegui@cumin1002> |
START - Cookbook sre.mysql.parsercache |
[production] |
| 05:54 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db1256 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P79157 and previous config saved to /var/cache/conftool/dbconfig/20250716-055408-marostegui.json |
[production] |
| 05:54 |
<root@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1256.eqiad.wmnet with reason: Maintenance |
[production] |
| 05:46 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1159 (T399249)', diff saved to Unable to send diff to phaste and previous config saved to /var/cache/conftool/dbconfig/20250716-054645-marostegui.json |
[production] |
| 05:46 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db1159.eqiad.wmnet with reason: Maintenance |
[production] |
| 03:31 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2228 (T399249)', diff saved to https://phabricator.wikimedia.org/P79156 and previous config saved to /var/cache/conftool/dbconfig/20250716-033133-marostegui.json |
[production] |
| 03:16 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2228', diff saved to https://phabricator.wikimedia.org/P79155 and previous config saved to /var/cache/conftool/dbconfig/20250716-031626-marostegui.json |
[production] |
| 03:01 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2228', diff saved to https://phabricator.wikimedia.org/P79154 and previous config saved to /var/cache/conftool/dbconfig/20250716-030119-marostegui.json |
[production] |
| 02:46 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2228 (T399249)', diff saved to https://phabricator.wikimedia.org/P79153 and previous config saved to /var/cache/conftool/dbconfig/20250716-024611-marostegui.json |
[production] |
| 02:19 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2228 (T399249)', diff saved to https://phabricator.wikimedia.org/P79152 and previous config saved to /var/cache/conftool/dbconfig/20250716-021956-marostegui.json |
[production] |
| 02:19 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2228.codfw.wmnet with reason: Maintenance |
[production] |
| 02:19 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2223 (T399249)', diff saved to https://phabricator.wikimedia.org/P79151 and previous config saved to /var/cache/conftool/dbconfig/20250716-021933-marostegui.json |
[production] |
| 02:04 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2223', diff saved to https://phabricator.wikimedia.org/P79150 and previous config saved to /var/cache/conftool/dbconfig/20250716-020426-marostegui.json |
[production] |
| 01:49 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2223', diff saved to https://phabricator.wikimedia.org/P79149 and previous config saved to /var/cache/conftool/dbconfig/20250716-014918-marostegui.json |
[production] |
| 01:34 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2223 (T399249)', diff saved to https://phabricator.wikimedia.org/P79148 and previous config saved to /var/cache/conftool/dbconfig/20250716-013410-marostegui.json |
[production] |
| 01:06 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2223 (T399249)', diff saved to https://phabricator.wikimedia.org/P79147 and previous config saved to /var/cache/conftool/dbconfig/20250716-010617-marostegui.json |
[production] |
| 01:06 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2223.codfw.wmnet with reason: Maintenance |
[production] |
| 01:05 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2211 (T399249)', diff saved to https://phabricator.wikimedia.org/P79146 and previous config saved to /var/cache/conftool/dbconfig/20250716-010554-marostegui.json |
[production] |
| 00:50 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2211', diff saved to https://phabricator.wikimedia.org/P79145 and previous config saved to /var/cache/conftool/dbconfig/20250716-005047-marostegui.json |
[production] |
| 00:35 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2211', diff saved to https://phabricator.wikimedia.org/P79144 and previous config saved to /var/cache/conftool/dbconfig/20250716-003539-marostegui.json |
[production] |
| 00:20 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2211 (T399249)', diff saved to https://phabricator.wikimedia.org/P79143 and previous config saved to /var/cache/conftool/dbconfig/20250716-002031-marostegui.json |
[production] |
|
2025-07-15
§
|
| 23:52 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2211 (T399249)', diff saved to https://phabricator.wikimedia.org/P79142 and previous config saved to /var/cache/conftool/dbconfig/20250715-235236-marostegui.json |
[production] |
| 23:52 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2211.codfw.wmnet with reason: Maintenance |
[production] |
| 23:26 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2201.codfw.wmnet with reason: Maintenance |
[production] |
| 23:26 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2192 (T399249)', diff saved to https://phabricator.wikimedia.org/P79141 and previous config saved to /var/cache/conftool/dbconfig/20250715-232640-marostegui.json |
[production] |
| 23:11 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2192', diff saved to https://phabricator.wikimedia.org/P79139 and previous config saved to /var/cache/conftool/dbconfig/20250715-231132-marostegui.json |
[production] |
| 22:56 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2192', diff saved to https://phabricator.wikimedia.org/P79138 and previous config saved to /var/cache/conftool/dbconfig/20250715-225624-marostegui.json |
[production] |
| 22:50 |
<zabe@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply |
[production] |
| 22:49 |
<zabe@deploy1003> |
helmfile [eqiad] START helmfile.d/services/mw-experimental: apply |
[production] |
| 22:41 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2192 (T399249)', diff saved to https://phabricator.wikimedia.org/P79137 and previous config saved to /var/cache/conftool/dbconfig/20250715-224117-marostegui.json |
[production] |
| 22:27 |
<swfrench-wmf> |
reprepro include php-excimer_1.2.5-1+wmf11u1 php-imagick_3.7.0-13+wmf11u1 php-luasandbox_4.1.2-1+wmf11u1 php-memcached_3.3.0-1+wmf11u1 php-pcov_1.0.12-1+wmf11u1 php-redis_6.2.0-1+wmf11u1 php-uuid_1.3.0-1+wmf11u1 php-wmerrors_2.0.0-1+wmf11u1 php-yaml_2.2.4-1+wmf11u1 wikidiff2_1.14.1-2+wmf11u1 xdebug_3.4.4-1+wmf11u1 in component/php83 - T398245 |
[production] |
| 22:20 |
<zabe@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1169777|extension-list: Undeploy Interwiki (step 3) (T399636)]] (duration: 08m 17s) |
[production] |
| 22:16 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2192 (T399249)', diff saved to https://phabricator.wikimedia.org/P79136 and previous config saved to /var/cache/conftool/dbconfig/20250715-221606-marostegui.json |
[production] |
| 22:15 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2192.codfw.wmnet with reason: Maintenance |
[production] |
| 22:15 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2178 (T399249)', diff saved to https://phabricator.wikimedia.org/P79135 and previous config saved to /var/cache/conftool/dbconfig/20250715-221543-marostegui.json |
[production] |
| 22:15 |
<zabe@deploy1003> |
zabe: Continuing with sync |
[production] |
| 22:14 |
<zabe@deploy1003> |
zabe: Backport for [[gerrit:1169777|extension-list: Undeploy Interwiki (step 3) (T399636)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 22:12 |
<zabe@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1169777|extension-list: Undeploy Interwiki (step 3) (T399636)]] |
[production] |