6651-6700 of 10000 results (112ms)
2023-12-20 ยง
15:05 <dani@deploy2002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
15:04 <dani@deploy2002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
15:02 <bking@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1024.eqiad.wmnet [production]
15:02 <bking@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs1024.eqiad.wmnet [production]
15:01 <bking@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts wdqs1024.eqiad.wmnet [production]
15:01 <bking@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs1024.eqiad.wmnet [production]
14:58 <inflatador> bking@cumin2002 disable/mask wmf_auto_restart_prometheus-blazegraph-exporter-wdqs-categories on wdqs102[24] T352878 [production]
14:57 <lucaswerkmeister-wmde@deploy2002> Finished scap: Backport for [[gerrit:982416|RunSingleJob.php: Fix use of MWExceptionHandler before it's defined (T352265)]] (duration: 10m 30s) [production]
14:51 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde and matmarex: Continuing with sync [production]
14:48 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde and matmarex: Backport for [[gerrit:982416|RunSingleJob.php: Fix use of MWExceptionHandler before it's defined (T352265)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:46 <lucaswerkmeister-wmde@deploy2002> Started scap: Backport for [[gerrit:982416|RunSingleJob.php: Fix use of MWExceptionHandler before it's defined (T352265)]] [production]
14:43 <lucaswerkmeister-wmde@deploy2002> Finished scap: Backport for [[gerrit:976650|Remove BetaFeature code related to ReferencePreviews (T351708)]], [[gerrit:978035|Remove wgPopupsReferencePreviews now that it defaults to true (T351708)]] (duration: 10m 16s) [production]
14:37 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde and awight and wmde-fisch: Continuing with sync [production]
14:35 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde and awight and wmde-fisch: Backport for [[gerrit:976650|Remove BetaFeature code related to ReferencePreviews (T351708)]], [[gerrit:978035|Remove wgPopupsReferencePreviews now that it defaults to true (T351708)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:33 <lucaswerkmeister-wmde@deploy2002> Started scap: Backport for [[gerrit:976650|Remove BetaFeature code related to ReferencePreviews (T351708)]], [[gerrit:978035|Remove wgPopupsReferencePreviews now that it defaults to true (T351708)]] [production]
14:30 <lucaswerkmeister-wmde@deploy2002> Finished scap: Backport for [[gerrit:984324|Check for false from ThumbnailImage::getStoragePath (T353758)]] (duration: 09m 38s) [production]
14:26 <lucaswerkmeister-wmde@deploy2002> kharlan and lucaswerkmeister-wmde: Continuing with sync [production]
14:22 <lucaswerkmeister-wmde@deploy2002> kharlan and lucaswerkmeister-wmde: Backport for [[gerrit:984324|Check for false from ThumbnailImage::getStoragePath (T353758)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:21 <lucaswerkmeister-wmde@deploy2002> Started scap: Backport for [[gerrit:984324|Check for false from ThumbnailImage::getStoragePath (T353758)]] [production]
14:19 <lucaswerkmeister-wmde@deploy2002> Finished scap: Backport for [[gerrit:981636|Make wiktionary and mw.org provide og:site_name (T348203)]] (duration: 15m 54s) [production]
14:16 <moritzm> installing distro-info-data updates from Bookworm point release [production]
14:14 <lucaswerkmeister-wmde@deploy2002> pols12 and lucaswerkmeister-wmde: Continuing with sync [production]
14:12 <moritzm> installing debootstrap bugfix updates from Bookworm point release [production]
14:06 <lucaswerkmeister-wmde@deploy2002> pols12 and lucaswerkmeister-wmde: Backport for [[gerrit:981636|Make wiktionary and mw.org provide og:site_name (T348203)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:04 <moritzm> installing cups updates from bookworm point release [production]
14:04 <lucaswerkmeister-wmde@deploy2002> Started scap: Backport for [[gerrit:981636|Make wiktionary and mw.org provide og:site_name (T348203)]] [production]
13:38 <aqu@deploy2002> Finished deploy [airflow-dags/wmde@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac513] (duration: 00m 05s) [production]
13:38 <aqu@deploy2002> Started deploy [airflow-dags/wmde@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac513] [production]
13:38 <aqu@deploy2002> Finished deploy [airflow-dags/search@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] (duration: 00m 30s) [production]
13:37 <aqu@deploy2002> Started deploy [airflow-dags/search@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] [production]
13:37 <aqu@deploy2002> Finished deploy [airflow-dags/research@90f280e]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@e2ed6162] (duration: 00m 06s) [production]
13:37 <aqu@deploy2002> Started deploy [airflow-dags/research@90f280e]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@e2ed6162] [production]
13:36 <aqu@deploy2002> Finished deploy [airflow-dags/platform_eng@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] (duration: 00m 25s) [production]
13:36 <aqu@deploy2002> Started deploy [airflow-dags/platform_eng@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] [production]
13:35 <aqu@deploy2002> Finished deploy [airflow-dags/analytics_product@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] (duration: 00m 09s) [production]
13:35 <aqu@deploy2002> Started deploy [airflow-dags/analytics_product@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] [production]
13:34 <aqu@deploy2002> Finished deploy [airflow-dags/analytics@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] (duration: 00m 05s) [production]
13:34 <aqu@deploy2002> Started deploy [airflow-dags/analytics@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] [production]
13:34 <aqu@deploy2002> Finished deploy [airflow-dags/analytics_test@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] (duration: 00m 11s) [production]
13:34 <aqu@deploy2002> Started deploy [airflow-dags/analytics_test@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] [production]
13:32 <aqu@deploy2002> Finished deploy [airflow-dags/analytics_test@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] (duration: 00m 01s) [production]
13:32 <aqu@deploy2002> Started deploy [airflow-dags/analytics_test@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] [production]
13:31 <aqu@deploy2002> Finished deploy [airflow-dags/analytics@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] (duration: 00m 01s) [production]
13:31 <aqu@deploy2002> Started deploy [airflow-dags/analytics@d5ac513]: Make sure airflow-dags is up-to-date before activating metrics [airflow-dags@d5ac5131] [production]
12:12 <aikochou@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
11:30 <kostajh> T353703 Manual run: /usr/local/bin/foreachwikiindblist /srv/mediawiki/dblists/mediamoderation.dblist extensions/MediaModeration/maintenance/updateMetrics.php --verbose [production]
10:22 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on mw2448.codfw.wmnet with reason: hw failure [production]
10:22 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on mw2448.codfw.wmnet with reason: hw failure [production]
09:43 <fabfur@cumin1001> END (PASS) - Cookbook sre.dns.roll-restart-reboot-wikimedia-dns (exit_code=0) rolling restart_daemons on A:wikidough and A:wikidough [production]
09:39 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for doh5002.wikimedia.org [production]