801-850 of 10000 results (30ms)
2025-04-29 §
08:17 <hashar@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.27 refs T386222 [production]
07:50 <moritzm> copied wmf-certificates 1~20230906-1 from bookworm-wikimedia to trixie-wikimedia T391083 [production]
04:04 <mwpresync@deploy1003> Finished scap sync-world: testwikis to 1.44.0-wmf.27 refs T386222 (duration: 61m 23s) [production]
03:03 <mwpresync@deploy1003> Started scap sync-world: testwikis to 1.44.0-wmf.27 refs T386222 [production]
2025-04-28 §
19:23 <brett@puppetserver1001> conftool action : set/pooled=yes; selector: name=ncredir[4-7]001.* [production]
19:07 <brett@puppetserver1001> conftool action : set/pooled=no; selector: name=ncredir(3|4|5|6|7)001.* [production]
2025-04-24 §
06:52 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
2025-04-23 §
16:27 <dreamyjazz@deploy1003> Finished scap sync-world: Backport for [[gerrit:1138403|Enable temporary-account-viewer group on all WMF production wikis (T390942 T387205)]] (duration: 11m 11s) [production]
16:21 <dreamyjazz@deploy1003> dreamyjazz: Backport for [[gerrit:1138403|Enable temporary-account-viewer group on all WMF production wikis (T390942 T387205)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
16:16 <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1138403|Enable temporary-account-viewer group on all WMF production wikis (T390942 T387205)]] [production]
16:10 <dreamyjazz@deploy1003> dreamyjazz: Backport for [[gerrit:1138403|Enable temporary-account-viewer group on all WMF production wikis (T390942 T387205)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
16:06 <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1138403|Enable temporary-account-viewer group on all WMF production wikis (T390942 T387205)]] [production]
14:48 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1013,1017].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
07:27 <elukey> elukey@ganeti1048:~$ sudo gnt-instance modify -B memory=6g,vcpus=4 ml-serve-ctrl1001.eqiad.wmnet - T392289 [production]
07:27 <elukey> elukey@ganeti1048:~$ sudo gnt-instance modify -B memory=6g,vcpus=4 ml-serve-ctrl1002.eqiad.wmnet - T392289 [production]
07:27 <elukey> elukey@ganeti2032:~$ sudo gnt-instance modify -B memory=6g,vcpus=4 ml-serve-ctrl2002.codfw.wmnet - T392289 [production]
07:26 <elukey> elukey@ganeti2032:~$ sudo gnt-instance modify -B memory=6g,vcpus=4 ml-serve-ctrl2001.codfw.wmnet - T392289 [production]
2025-04-22 §
04:02 <mwpresync@deploy1003> Pruned MediaWiki: 1.44.0-wmf.23 (duration: 02m 48s) [production]
00:25 <reedy@deploy1003> Synchronized wmf-config/InitialiseSettings-labs.php: Fix syntax (duration: 10m 53s) [production]
00:03 <reedy@deploy1003> Synchronized wmf-config/InitialiseSettings-labs.php: Fix syntax (duration: 11m 02s) [production]
2025-04-19 §
16:38 <elukey> `sudo gnt-instance modify -B memory=6g,vcpus=4 aux-k8s-ctrl1002.eqiad.wmnet` - T392289 [production]
16:38 <elukey> `sudo gnt-instance modify -B memory=6g,vcpus=4 aux-k8s-ctrl1003.eqiad.wmnet` - T392289 [production]
16:30 <elukey> `sudo gnt-instance modify -B memory=6g,vcpus=4 aux-k8s-ctrl2002.codfw.wmnet` - T392289 [production]
16:30 <elukey> `sudo gnt-instance modify -B memory=6g,vcpus=4 aux-k8s-ctrl2003.codfw.wmnet` - T392289 [production]
2025-04-17 §
23:32 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
18:13 <dduvall@deploy1003> rebuilt and synchronized wikiversions files: group2 to 1.44.0-wmf.25 refs T386220 [production]
14:22 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
2025-04-16 §
22:43 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
18:42 <dduvall@deploy1003> rebuilt and synchronized wikiversions files: group1 to 1.44.0-wmf.25 refs T386220 [production]
13:51 <jelto> "Imported helm311 3.11.3-4 to bullseye-wikimedia and bookworm-wikimedia - T387548" [production]
10:29 <MichaelG_WMF> migr@mwmaint1002:/srv/mediawiki/php-1.44.0-wmf.24$ time mwscript ./extensions/GrowthExperiments/maintenance/updateMenteeData.php --wiki ruwiki --verbose #T391695 [production]
10:23 <MichaelG_WMF> migr@mwmaint1002:/srv/mediawiki/php-1.44.0-wmf.24$ time mwscript ./extensions/GrowthExperiments/maintenance/updateMenteeData.php --wiki frwiki --verbose #T391695 [production]
10:21 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1014,1018].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
10:17 <MichaelG_WMF> migr@mwmaint1002:/srv/mediawiki/php-1.44.0-wmf.25$ mwscript ./extensions/GrowthExperiments/maintenance/updateMenteeData.php --wiki testwiki --verbose #T391695 [production]
2025-04-15 §
18:49 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
18:29 <dduvall@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.25 refs T386220 [production]
09:54 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1014,1018].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
09:15 <jnuche@deploy1003> sync-world aborted: testwikis to 1.44.0-wmf.25 refs T386220 (duration: 14m 36s) [production]
09:00 <jnuche@deploy1003> Started scap sync-world: testwikis to 1.44.0-wmf.25 refs T386220 [production]
04:10 <mwpresync@deploy1003> Pruned MediaWiki: 1.44.0-wmf.22 (duration: 10m 03s) [production]
03:43 <mwpresync@deploy1003> sync-world failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.44.0-wmf.24,1.44.0-wmf.25 --multiversion-image-name docker-registry.discovery.wmnet/restricted/mediawiki-multiversion --multiversion-debug-image-name docker-registry.discov [production]
03:02 <mwpresync@deploy1003> Started scap sync-world: testwikis to 1.44.0-wmf.25 refs T386220 [production]
2025-04-14 §
18:27 <James_F> Run `mwscript sql --wiki=testwiki /srv/mediawiki-staging/php-1.44.0-wmf.24/extensions/WikiLambda/sql/mysql/table-usage.sql` for T391885 [production]
17:30 <swfrench-wmf> running: cumin -b8 -s60 'A:cp-text' 'run-puppet-agent -e "merging ATS config change - T391421"' [production]
17:25 <swfrench-wmf> running: run-puppet-agent -e "merging ATS config change - T391421" on cp4040 [production]
17:20 <swfrench-wmf> running: cumin 'A:cp-text' 'disable-puppet "merging ATS config change - T391421"' [production]
16:15 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
14:12 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1013,1017].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
09:35 <fceratto@cumin1002> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2220 gradually with 4 steps - Finished upgrading host [production]
08:48 <fceratto@cumin1002> START - Cookbook sre.mysql.pool db2220 gradually with 4 steps - Finished upgrading host [production]