|
2025-11-12
§
|
| 10:49 |
<aklapper@deploy2002> |
rebuilt and synchronized wikiversions files: group1 to 1.46.0-wmf.2 refs T408272 |
[production] |
| 09:44 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'es1033 (re)pooling @ 4%: Moved it to es7', diff saved to https://phabricator.wikimedia.org/P85267 and previous config saved to /var/cache/conftool/dbconfig/20251112-094458-root.json |
[production] |
| 07:51 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2203 gradually with 4 steps - Repooling after upgrade |
[production] |
| 07:41 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es1039 gradually with 4 steps - Pool es1039.eqiad.wmnet in after cloning |
[production] |
| 07:05 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.pool db2203 gradually with 4 steps - Repooling after upgrade |
[production] |
| 07:03 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2179.codfw.wmnet with reason: Maintenance |
[production] |
| 06:56 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.pool es1039 gradually with 4 steps - Pool es1039.eqiad.wmnet in after cloning |
[production] |
| 06:55 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1160.eqiad.wmnet with reason: Maintenance |
[production] |
| 01:54 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance |
[production] |
| 01:15 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 14m 14s) |
[production] |
| 01:01 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1263.eqiad.wmnet with reason: Maintenance |
[production] |
| 01:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
| 00:09 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1261.eqiad.wmnet with reason: Maintenance |
[production] |
|
2025-11-11
§
|
| 23:16 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1260.eqiad.wmnet with reason: Maintenance |
[production] |
| 22:24 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1252.eqiad.wmnet with reason: Maintenance |
[production] |
| 21:31 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1249.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:39 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1248.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:47 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1247.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:42 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1245.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:49 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1244.eqiad.wmnet with reason: Maintenance |
[production] |
| 17:57 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1243.eqiad.wmnet with reason: Maintenance |
[production] |
| 17:04 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1242.eqiad.wmnet with reason: Maintenance |
[production] |
| 16:09 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1221.eqiad.wmnet with reason: Maintenance |
[production] |
| 15:39 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2246.codfw.wmnet with reason: Maintenance |
[production] |
| 14:47 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2245.codfw.wmnet with reason: Maintenance |
[production] |
| 14:05 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1220 gradually with 4 steps - Pool db1220.eqiad.wmnet in after cloning |
[production] |
| 13:54 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2240.codfw.wmnet with reason: Maintenance |
[production] |
| 13:49 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2239.codfw.wmnet with reason: Maintenance |
[production] |
| 13:19 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.pool db1220 gradually with 4 steps - Pool db1220.eqiad.wmnet in after cloning |
[production] |
| 12:57 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2237.codfw.wmnet with reason: Maintenance |
[production] |
| 12:04 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2236.codfw.wmnet with reason: Maintenance |
[production] |
| 11:12 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2219.codfw.wmnet with reason: Maintenance |
[production] |
| 10:19 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2210.codfw.wmnet with reason: Maintenance |
[production] |
| 09:36 |
<aklapper@deploy2002> |
rebuilt and synchronized wikiversions files: group0 to 1.46.0-wmf.2 refs T408272 |
[production] |
| 08:29 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2172.codfw.wmnet with reason: Maintenance |
[production] |
| 07:36 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2155.codfw.wmnet with reason: Maintenance |
[production] |
| 06:42 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2147.codfw.wmnet with reason: Maintenance |
[production] |
| 06:21 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2203.codfw.wmnet with reason: Maintenance |
[production] |
| 05:02 |
<mwpresync@deploy2002> |
Pruned MediaWiki: 1.45.0-wmf.24 (duration: 02m 30s) |
[production] |
| 04:49 |
<mwpresync@deploy2002> |
Finished scap sync-world: testwikis to 1.46.0-wmf.2 refs T408272 (duration: 46m 27s) |
[production] |
| 04:03 |
<mwpresync@deploy2002> |
Started scap sync-world: testwikis to 1.46.0-wmf.2 refs T408272 |
[production] |
| 01:01 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 01m 18s) |
[production] |
| 01:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
|
2025-11-10
§
|
| 18:01 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2181 gradually with 4 steps - Migration of db2181.codfw.wmnet completed |
[production] |
| 17:16 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.pool db2181 gradually with 4 steps - Migration of db2181.codfw.wmnet completed |
[production] |
| 16:10 |
<swfrench-wmf> |
begin rolling restart of codfw-associated confds after conf2006 etcd restart - T352245 |
[production] |
| 15:11 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2167 gradually with 4 steps - Migration of db2167.codfw.wmnet completed |
[production] |
| 14:26 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.pool db2167 gradually with 4 steps - Migration of db2167.codfw.wmnet completed |
[production] |
| 13:42 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2166 gradually with 4 steps - Migration of db2166.codfw.wmnet completed |
[production] |
| 12:56 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.pool db2166 gradually with 4 steps - Migration of db2166.codfw.wmnet completed |
[production] |