3151-3200 of 10000 results (41ms)
2024-10-10 §
11:09 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1243.eqiad.wmnet with reason: Maintenance [production]
11:09 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1243.eqiad.wmnet with reason: Maintenance [production]
10:21 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1242.eqiad.wmnet with reason: Maintenance [production]
10:21 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1242.eqiad.wmnet with reason: Maintenance [production]
09:33 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1241.eqiad.wmnet with reason: Maintenance [production]
09:33 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1241.eqiad.wmnet with reason: Maintenance [production]
09:20 <aklapper@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.43.0-wmf.26 refs T375657 [production]
08:45 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1238.eqiad.wmnet with reason: Maintenance [production]
08:45 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1238.eqiad.wmnet with reason: Maintenance [production]
08:39 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1236.eqiad.wmnet with reason: Maintenance [production]
08:39 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1236.eqiad.wmnet with reason: Maintenance [production]
07:59 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1221.eqiad.wmnet with reason: Maintenance [production]
07:59 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1221.eqiad.wmnet with reason: Maintenance [production]
07:12 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1199.eqiad.wmnet with reason: Maintenance [production]
07:12 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1199.eqiad.wmnet with reason: Maintenance [production]
06:24 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1190.eqiad.wmnet with reason: Maintenance [production]
06:24 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1190.eqiad.wmnet with reason: Maintenance [production]
06:24 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1150.eqiad.wmnet with reason: Maintenance [production]
06:24 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1150.eqiad.wmnet with reason: Maintenance [production]
2024-10-09 §
19:55 <swfrench-wmf> removing echostore staging deployment to unblock breaking change - T376766 [production]
15:49 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on lvs[5004-5006].eqsin.wmnet with reason: site is depooled, cr2-eqsin is being replaced [production]
15:49 <sukhe@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on lvs[5004-5006].eqsin.wmnet with reason: site is depooled, cr2-eqsin is being replaced [production]
08:12 <aklapper@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.43.0-wmf.26 refs T375657 [production]
2024-10-08 §
18:54 <swfrench-wmf> ran authdns-update on dns1004 to pick up mwdebug-next record - T372604 [production]
17:34 <swfrench-wmf> ran and enabled puppet-agent on 'A:lvs and A:codfw' - T372604 [production]
17:09 <swfrench-wmf> ran and enabled puppet-agent on 'A:lvs and A:eqiad' - T372604 [production]
17:03 <swfrench-wmf> ran disable-puppet on 'A:lvs and (A:eqiad or A:codfw)' - T372604 [production]
10:36 <jayme> updated kubernetes 1.23.14-3 -> 1.23.14-4 on P:kubernetes::node - T362408 [production]
09:25 <jayme> imported kubernetes 1.23.14-4 to component/kubernetes123 (buster, bullseye, bookworm) - T362408 [production]
08:19 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.26 refs T375657 [production]
04:01 <mwpresync@deploy2002> Pruned MediaWiki: 1.43.0-wmf.23 (duration: 00m 58s) [production]
03:50 <mwpresync@deploy2002> Finished scap sync-world: testwikis to 1.43.0-wmf.26 refs T375657 (duration: 47m 44s) [production]
03:03 <mwpresync@deploy2002> Started scap sync-world: testwikis to 1.43.0-wmf.26 refs T375657 [production]
2024-10-07 §
18:22 <swfrench-wmf> running `git restore helmfile.d/services/thumbor/values.yaml` on deploy1003 to unblock git-pull timer [production]
2024-10-03 §
22:18 <brennen@deploy2002> scap failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.43.0-wmf.25 --multiversion-image-name docker-registry.discovery.wmnet/restricted/mediawiki-multiversion --multiversion-debug-image-name docker-registry.discovery.wmnet/restricted/m [production]
22:15 <brennen@deploy2002> scap failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.43.0-wmf.25 --multiversion-image-name docker-registry.discovery.wmnet/restricted/mediawiki-multiversion --multiversion-debug-image-name docker-registry.discovery.wmnet/restricted/m [production]
19:25 <ryankemper> [WDQS Deploy] Restarted `wdqs-updater` across all hosts, 4 hosts at a time: `sudo -E cumin -b 4 'A:wdqs-all' 'systemctl restart wdqs-updater'` [production]
08:36 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.43.0-wmf.25 refs T375656 [production]
2024-10-02 §
18:10 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.43.0-wmf.25 refs T375656 [production]
09:31 <hashar@deploy2002> rebuilt and synchronized wikiversions files: Revert "group1 wikis to [php-1.43.0-wmf.24]" - T375656 [production]
07:09 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cp[3071-3072].esams.wmnet with reason: HW maintenance [production]
07:09 <vgutierrez@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on cp[3071-3072].esams.wmnet with reason: HW maintenance [production]
2024-10-01 §
20:28 <hashar> mwscript purgeList.php --wiki=tlywiki --namespace=4 # T367009 [production]
08:58 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.25 refs T375656 [production]
04:01 <mwpresync@deploy2002> Pruned MediaWiki: 1.43.0-wmf.22 (duration: 00m 58s) [production]
03:51 <mwpresync@deploy2002> Finished scap sync-world: testwikis to 1.43.0-wmf.25 refs T375656 (duration: 48m 36s) [production]
03:02 <mwpresync@deploy2002> Started scap sync-world: testwikis to 1.43.0-wmf.25 refs T375656 [production]
2024-09-30 §
18:04 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on lvs[4008-4010].ulsfo.wmnet with reason: site is depooled, cr3-ulsfo is being replaced [production]
18:04 <sukhe@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on lvs[4008-4010].ulsfo.wmnet with reason: site is depooled, cr3-ulsfo is being replaced [production]
16:53 <swfrench-wmf> built and published new php8.1 images - T376036 [production]