2025-06-16
§
|
15:05 |
<dreamyjazz@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1159477|Revert "Enable temporary accounts onboarding dialog on WMF wikis"]] |
[production] |
13:52 |
<jynus@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on ms-backup2001.codfw.wmnet with reason: Maintenance and reboot |
[production] |
13:10 |
<phuedx@deploy1003> |
phuedx, mvolz, dreamyjazz, tchanders: Backport for [[gerrit:1156872|ext-EventStreamConfig: Update product_metrics.web_base stream (T395692)]], [[gerrit:1127960|Set $wgCentralAuthAutomaticGlobalGroups for global IP reveal group (T376315)]], [[gerrit:1153307|Enable temporary accounts onboarding dialog on WMF wikis (T395933)]], [[gerrit:1139808|Change citoid config for test wiki (T361576)]] synced to t |
[production] |
13:08 |
<phuedx@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1156872|ext-EventStreamConfig: Update product_metrics.web_base stream (T395692)]], [[gerrit:1127960|Set $wgCentralAuthAutomaticGlobalGroups for global IP reveal group (T376315)]], [[gerrit:1153307|Enable temporary accounts onboarding dialog on WMF wikis (T395933)]], [[gerrit:1139808|Change citoid config for test wiki (T361576)]] |
[production] |
11:14 |
<jynus@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on ms-backup2002.codfw.wmnet with reason: Maintenance and reboot |
[production] |
07:36 |
<ryankemper@cumin2002> |
END (PASS) - Cookbook sre.wdqs.data-reload (exit_code=0) reloading wikidata_main on wdqs1022.eqiad.wmnet from DumpsSource.HDFS (hdfs:///wmf/data/discovery/wikidata/munged_n3_dump/wikidata/main/20250526/ using stat1009.eqiad.wmnet) |
[production] |
2025-06-13
§
|
16:10 |
<brennen@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1156860|Revert "group1 to 1.45.0-wmf.5" (T392175 T396790)]] (duration: 14m 56s) |
[production] |
15:59 |
<brennen@deploy1003> |
brennen: Backport for [[gerrit:1156860|Revert "group1 to 1.45.0-wmf.5" (T392175 T396790)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
15:55 |
<brennen@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1156860|Revert "group1 to 1.45.0-wmf.5" (T392175 T396790)]] |
[production] |
09:47 |
<jynus@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on ms-backup1001.eqiad.wmnet with reason: Maintenance and reboot |
[production] |
09:12 |
<jynus@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on ms-backup1002.eqiad.wmnet with reason: Maintenance and reboot |
[production] |
01:17 |
<ladsgroup@cumin2002> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1251 gradually with 4 steps - Firmware update done |
[production] |
00:31 |
<ladsgroup@cumin2002> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1253 gradually with 4 steps - Firmware updated |
[production] |
00:29 |
<ladsgroup@cumin2002> |
START - Cookbook sre.mysql.pool db1251 gradually with 4 steps - Firmware update done |
[production] |
2025-06-12
§
|
23:54 |
<ladsgroup@cumin2002> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1254 gradually with 4 steps - Firmware update done |
[production] |
23:43 |
<ladsgroup@cumin2002> |
START - Cookbook sre.mysql.pool db1253 gradually with 4 steps - Firmware updated |
[production] |
23:06 |
<ladsgroup@cumin2002> |
START - Cookbook sre.mysql.pool db1254 gradually with 4 steps - Firmware update done |
[production] |
18:37 |
<brennen@deploy1003> |
rebuilt and synchronized wikiversions files: group1 to 1.45.0-wmf.5 refs T392175 |
[production] |
18:24 |
<brennen@deploy1003> |
rebuilt and synchronized wikiversions files: group2 to 1.45.0-wmf.5 refs T392175 |
[production] |
15:45 |
<swfrench-wmf> |
removed python3-conftool-dbctl package from puppetmaster[12]001 - T395696 |
[production] |
13:46 |
<moritzm> |
installing mariadb security updates (as shipped in Debian, not the wmf-mariadb packages we use for the main mariadb clusters) |
[production] |
06:42 |
<jynus@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1225.eqiad.wmnet,dbprov1004.eqiad.wmnet with reason: Downtime hosts for MariaDB 10.11 upgrade |
[production] |
2025-06-10
§
|
18:17 |
<brennen@deploy1003> |
rebuilt and synchronized wikiversions files: group0 to 1.45.0-wmf.5 refs T392175 |
[production] |
16:52 |
<mszabo@deploy1003> |
sync-world failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.45.0-wmf.4,1.45.0-wmf.5 --multiversion-image-name docker-registry.discovery.wmnet/restricted/mediawiki-multiversion --multiversion-debug-image-name docker-registry.discovery.w |
[production] |
16:21 |
<dancy@deploy1003> |
Finished scap sync-world: testwikis to 1.45.0-wmf.5 refs T392175 (duration: 44m 02s) |
[production] |
15:37 |
<dancy@deploy1003> |
Started scap sync-world: testwikis to 1.45.0-wmf.5 refs T392175 |
[production] |
09:17 |
<jynus@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2197.codfw.wmnet,dbprov2003.codfw.wmnet with reason: Downtime hosts for MariaDB 10.11 upgrade |
[production] |
04:04 |
<mwpresync@deploy1003> |
Pruned MediaWiki: 1.45.0-wmf.2 (duration: 04m 22s) |
[production] |
2025-06-09
§
|
11:19 |
<fceratto@cumin1002> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2151* gradually with 4 steps - Pooling in |
[production] |
11:18 |
<fceratto@cumin1002> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2158* gradually with 4 steps - Pooling in |
[production] |
10:34 |
<fceratto@cumin1002> |
START - Cookbook sre.mysql.pool db2151* gradually with 4 steps - Pooling in |
[production] |
10:33 |
<fceratto@cumin1002> |
START - Cookbook sre.mysql.pool db2158* gradually with 4 steps - Pooling in |
[production] |
08:08 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2244 gradually with 4 steps - Pool db2244.codfw.wmnet in after cloning |
[production] |
07:23 |
<marostegui@cumin1002> |
START - Cookbook sre.mysql.pool db2244 gradually with 4 steps - Pool db2244.codfw.wmnet in after cloning |
[production] |
06:22 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2243 gradually with 4 steps - Pool db2243.codfw.wmnet in after cloning |
[production] |
05:37 |
<marostegui@cumin1002> |
START - Cookbook sre.mysql.pool db2243 gradually with 4 steps - Pool db2243.codfw.wmnet in after cloning |
[production] |