2025-05-14
§
|
22:10 |
<jhathaway@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on ms-be2088.codfw.wmnet with reason: T381919 |
[production] |
21:47 |
<jhathaway@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on ms-be2088.codfw.wmnet with reason: T381919 |
[production] |
16:11 |
<jhathaway@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on ms-be2088.codfw.wmnet with reason: T381919 |
[production] |
10:28 |
<jnuche@deploy1003> |
rebuilt and synchronized wikiversions files: group1 to 1.45.0-wmf.1 refs T392171 |
[production] |
08:31 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1257 gradually with 4 steps - Pool db1257.eqiad.wmnet in after cloning |
[production] |
08:30 |
<jnuche@deploy1003> |
rebuilt and synchronized wikiversions files: group0 to 1.45.0-wmf.1 refs T392171 |
[production] |
08:01 |
<marostegui@cumin1002> |
START - Cookbook sre.mysql.pool db1257 gradually with 4 steps - Pool db1257.eqiad.wmnet in after cloning |
[production] |
07:26 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1257 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P76089 and previous config saved to /var/cache/conftool/dbconfig/20250514-072622-root.json |
[production] |
2025-05-13
§
|
13:25 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1256 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P76038 and previous config saved to /var/cache/conftool/dbconfig/20250513-132451-root.json |
[production] |
12:55 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1255 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P76031 and previous config saved to /var/cache/conftool/dbconfig/20250513-125535-root.json |
[production] |
12:24 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2241 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P76018 and previous config saved to /var/cache/conftool/dbconfig/20250513-122407-root.json |
[production] |
12:24 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2242 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P76017 and previous config saved to /var/cache/conftool/dbconfig/20250513-122406-root.json |
[production] |
10:14 |
<jnuche@deploy1003> |
rebuilt and synchronized wikiversions files: group0 to 1.45.0-wmf.1 refs T392171 |
[production] |
09:11 |
<jnuche@deploy1003> |
Started scap sync-world: testwikis to 1.45.0-wmf.1 refs T392171 |
[production] |
04:04 |
<mwpresync@deploy1003> |
Pruned MediaWiki: 1.44.0-wmf.25 (duration: 04m 17s) |
[production] |
2025-05-03
§
|
13:53 |
<krinkle@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1140653|multiversion: Remove getMWConfigForCacheing() as identical to getConfigGlobals() (T169821)]], [[gerrit:1140658|tests: Move buildLogoHTML.php to tests/ alongside buildConfigCache.php]], [[gerrit:1140707|multiversion: Separate wmf-config reading from actual Multiversion (T169821)]] (duration: 16m 22s) |
[production] |
13:41 |
<krinkle@deploy1003> |
krinkle: Backport for [[gerrit:1140653|multiversion: Remove getMWConfigForCacheing() as identical to getConfigGlobals() (T169821)]], [[gerrit:1140658|tests: Move buildLogoHTML.php to tests/ alongside buildConfigCache.php]], [[gerrit:1140707|multiversion: Separate wmf-config reading from actual Multiversion (T169821)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
13:36 |
<krinkle@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1140653|multiversion: Remove getMWConfigForCacheing() as identical to getConfigGlobals() (T169821)]], [[gerrit:1140658|tests: Move buildLogoHTML.php to tests/ alongside buildConfigCache.php]], [[gerrit:1140707|multiversion: Separate wmf-config reading from actual Multiversion (T169821)]] |
[production] |
12:19 |
<reedy@deploy1003> |
Synchronized wmf-config/InitialiseSettings-labs.php: Allow all users to use 2FA on beta (duration: 11m 14s) |
[production] |
2025-04-30
§
|
21:40 |
<bking@cumin2002> |
END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.RESTART (1 nodes at a time) for ElasticSearch cluster cloudelastic: apply new wmf-opensearch-search-plugins version 1.3.20-4~bullseye - bking@cumin2002 - T390100 |
[production] |
21:15 |
<bking@cumin2002> |
END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: apply new wmf-opensearch-search-plugins version 1.3.20-4~bullseye - bking@cumin2002 - T390100 |
[production] |
21:15 |
<bking@cumin2002> |
START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: apply new wmf-opensearch-search-plugins version 1.3.20-4~bullseye - bking@cumin2002 - T390100 |
[production] |
21:12 |
<bking@cumin2002> |
START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (1 nodes at a time) for ElasticSearch cluster cloudelastic: apply new wmf-opensearch-search-plugins version 1.3.20-4~bullseye - bking@cumin2002 - T390100 |
[production] |
15:20 |
<Krinkle> |
Removed @nrayio (former staff [[User:NRay (WMF)]]) from https://www.npmjs.com/settings/wikimedia/members |
[production] |
12:42 |
<filippo@cumin1002> |
DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 4:00:00 on alert2002.wikimedia.org with reason: kernel |
[production] |
11:45 |
<kostajh> |
Deployed patches for T392976 to wmf.25 and wmf.27 |
[production] |
08:35 |
<hashar@deploy1003> |
rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.27 refs T386222 |
[production] |
08:17 |
<hashar@deploy1003> |
rebuilt and synchronized wikiversions files: group1 to 1.44.0-wmf.27 refs T386222 |
[production] |