2401-2450 of 10000 results (31ms)
2025-04-23 §
07:27 <elukey> elukey@ganeti2032:~$ sudo gnt-instance modify -B memory=6g,vcpus=4 ml-serve-ctrl2002.codfw.wmnet - T392289 [production]
07:26 <elukey> elukey@ganeti2032:~$ sudo gnt-instance modify -B memory=6g,vcpus=4 ml-serve-ctrl2001.codfw.wmnet - T392289 [production]
2025-04-22 §
04:02 <mwpresync@deploy1003> Pruned MediaWiki: 1.44.0-wmf.23 (duration: 02m 48s) [production]
00:25 <reedy@deploy1003> Synchronized wmf-config/InitialiseSettings-labs.php: Fix syntax (duration: 10m 53s) [production]
00:03 <reedy@deploy1003> Synchronized wmf-config/InitialiseSettings-labs.php: Fix syntax (duration: 11m 02s) [production]
2025-04-19 §
16:38 <elukey> `sudo gnt-instance modify -B memory=6g,vcpus=4 aux-k8s-ctrl1002.eqiad.wmnet` - T392289 [production]
16:38 <elukey> `sudo gnt-instance modify -B memory=6g,vcpus=4 aux-k8s-ctrl1003.eqiad.wmnet` - T392289 [production]
16:30 <elukey> `sudo gnt-instance modify -B memory=6g,vcpus=4 aux-k8s-ctrl2002.codfw.wmnet` - T392289 [production]
16:30 <elukey> `sudo gnt-instance modify -B memory=6g,vcpus=4 aux-k8s-ctrl2003.codfw.wmnet` - T392289 [production]
2025-04-17 §
23:32 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
18:13 <dduvall@deploy1003> rebuilt and synchronized wikiversions files: group2 to 1.44.0-wmf.25 refs T386220 [production]
14:22 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
2025-04-16 §
22:43 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
18:42 <dduvall@deploy1003> rebuilt and synchronized wikiversions files: group1 to 1.44.0-wmf.25 refs T386220 [production]
13:51 <jelto> "Imported helm311 3.11.3-4 to bullseye-wikimedia and bookworm-wikimedia - T387548" [production]
10:29 <MichaelG_WMF> migr@mwmaint1002:/srv/mediawiki/php-1.44.0-wmf.24$ time mwscript ./extensions/GrowthExperiments/maintenance/updateMenteeData.php --wiki ruwiki --verbose #T391695 [production]
10:23 <MichaelG_WMF> migr@mwmaint1002:/srv/mediawiki/php-1.44.0-wmf.24$ time mwscript ./extensions/GrowthExperiments/maintenance/updateMenteeData.php --wiki frwiki --verbose #T391695 [production]
10:21 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1014,1018].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
10:17 <MichaelG_WMF> migr@mwmaint1002:/srv/mediawiki/php-1.44.0-wmf.25$ mwscript ./extensions/GrowthExperiments/maintenance/updateMenteeData.php --wiki testwiki --verbose #T391695 [production]
2025-04-15 §
18:49 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2187.codfw.wmnet with reason: Maintenance [production]
18:29 <dduvall@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.25 refs T386220 [production]
09:54 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1014,1018].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
09:15 <jnuche@deploy1003> sync-world aborted: testwikis to 1.44.0-wmf.25 refs T386220 (duration: 14m 36s) [production]
09:00 <jnuche@deploy1003> Started scap sync-world: testwikis to 1.44.0-wmf.25 refs T386220 [production]
04:10 <mwpresync@deploy1003> Pruned MediaWiki: 1.44.0-wmf.22 (duration: 10m 03s) [production]
03:43 <mwpresync@deploy1003> sync-world failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.44.0-wmf.24,1.44.0-wmf.25 --multiversion-image-name docker-registry.discovery.wmnet/restricted/mediawiki-multiversion --multiversion-debug-image-name docker-registry.discov [production]
03:02 <mwpresync@deploy1003> Started scap sync-world: testwikis to 1.44.0-wmf.25 refs T386220 [production]
2025-04-14 §
18:27 <James_F> Run `mwscript sql --wiki=testwiki /srv/mediawiki-staging/php-1.44.0-wmf.24/extensions/WikiLambda/sql/mysql/table-usage.sql` for T391885 [production]
17:30 <swfrench-wmf> running: cumin -b8 -s60 'A:cp-text' 'run-puppet-agent -e "merging ATS config change - T391421"' [production]
17:25 <swfrench-wmf> running: run-puppet-agent -e "merging ATS config change - T391421" on cp4040 [production]
17:20 <swfrench-wmf> running: cumin 'A:cp-text' 'disable-puppet "merging ATS config change - T391421"' [production]
16:15 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
14:12 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1013,1017].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
09:35 <fceratto@cumin1002> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2220 gradually with 4 steps - Finished upgrading host [production]
08:48 <fceratto@cumin1002> START - Cookbook sre.mysql.pool db2220 gradually with 4 steps - Finished upgrading host [production]
2025-04-11 §
16:27 <bking@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on 15 hosts with reason: reimaging/migrating hosts [production]
14:49 <aokoth@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on releases2003.codfw.wmnet with reason: Bookworm Re-image [production]
2025-04-10 §
21:41 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
18:20 <brennen@deploy1003> rebuilt and synchronized wikiversions files: group2 to 1.44.0-wmf.24 refs T386219 [production]
18:07 <brennen> 1.44.0-wmf.24 train status (T386219): logs quiet, no current blockers, moving to all wikis [production]
12:45 <reedy@deploy1003> Synchronized wmf-config/interwiki-labs.php: Update! (duration: 14m 07s) [production]
12:39 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1016,1020].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
2025-04-09 §
18:20 <brennen@deploy1003> rebuilt and synchronized wikiversions files: group1 to 1.44.0-wmf.24 refs T386219 [production]
18:06 <brennen> 1.44.0-wmf.24 train status (T386219): logs quiet, no current blockers, moving to group1 [production]
14:47 <jforrester@deploy1003> sync-world failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.44.0-wmf.23,1.44.0-wmf.24 --multiversion-image-name docker-registry.discovery.wmnet/restricted/mediawiki-multiversion --multiversion-debug-image-name docker-registry.disco [production]
01:33 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
2025-04-08 §
21:19 <brett> import libvmod-netmapper 1.9-4 to component/varnish6 bullseye-wikimedia (T391334) [production]
20:25 <brett> import varnishkafka 1.1.0-4 to component/varnish6 bullseyw-wikimedia (T391334) [production]
20:22 <brett> import libvmod-re2 1.5.3-4 to component/varnish6 bullseyw-wikimedia (T391334) [production]
18:34 <brennen@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.24 refs T386219 [production]