1-50 of 10000 results (91ms)
2025-03-25 ยง
09:45 <dcausse> repooling wdqs1013 [production]
09:23 <aklapper@deploy1003> Started scap sync-world: testwikis to 1.44.0-wmf.22 refs T386217 [production]
09:16 <fabfur@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on cp4047.ulsfo.wmnet with reason: HW errors [production]
09:16 <volans> uploaded python3-wmflib_1.3.0 to apt.wikimedia.org buster-wikimedia,bullseye-wikimedia,bookworm-wikimedia [production]
09:15 <hashar@deploy1003> Finished scap sync-world: Backport for [[gerrit:1130147|[kowikiquote] Change the logo and wordmark (T389631)]] (duration: 17m 22s) [production]
09:08 <hashar@deploy1003> superpes, hashar: Continuing with sync [production]
09:03 <hashar@deploy1003> superpes, hashar: Backport for [[gerrit:1130147|[kowikiquote] Change the logo and wordmark (T389631)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:59 <dcausse> repooling wdqs1018 [production]
08:58 <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1130147|[kowikiquote] Change the logo and wordmark (T389631)]] [production]
08:56 <dcausse> depooling & restarting blazegraph on wdqs1013 (deadlocked) [production]
08:54 <kartik@deploy1003> Finished scap sync-world: Backport for [[gerrit:1126617|AX: Add quick survey for MinT for Wikireaders (T381886)]] (duration: 20m 59s) [production]
08:47 <joal@deploy1003> Finished deploy [airflow-dags/analytics@324a662]: Regular analytics weekly train [airflow-dags/analytics@324a6629] (duration: 00m 30s) [production]
08:47 <kartik@deploy1003> abi, kartik: Continuing with sync [production]
08:47 <joal@deploy1003> Started deploy [airflow-dags/analytics@324a662]: Regular analytics weekly train [airflow-dags/analytics@324a6629] [production]
08:38 <kartik@deploy1003> abi, kartik: Backport for [[gerrit:1126617|AX: Add quick survey for MinT for Wikireaders (T381886)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:37 <joal@deploy1003> Finished deploy [airflow-dags/analytics@001332b]: Regular analytics weekly train [airflow-dags/analytics@001332b5] (duration: 00m 33s) [production]
08:37 <joal@deploy1003> Started deploy [airflow-dags/analytics@001332b]: Regular analytics weekly train [airflow-dags/analytics@001332b5] [production]
08:33 <kartik@deploy1003> Started scap sync-world: Backport for [[gerrit:1126617|AX: Add quick survey for MinT for Wikireaders (T381886)]] [production]
08:30 <kartik@deploy1003> Finished scap sync-world: Backport for [[gerrit:1130345|AX: Disable automatic translation entrypoints before release (T389176)]] (duration: 25m 13s) [production]
08:23 <kartik@deploy1003> kartik, abi: Continuing with sync [production]
08:19 <joal@deploy1003> Finished deploy [analytics/refinery@2f09783] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@2f097836] (duration: 00m 39s) [production]
08:18 <joal@deploy1003> Started deploy [analytics/refinery@2f09783] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@2f097836] [production]
08:18 <joal@deploy1003> Finished deploy [analytics/refinery@2f09783] (thin): Regular analytics weekly train THIN [analytics/refinery@2f097836] (duration: 00m 52s) [production]
08:17 <joal@deploy1003> Started deploy [analytics/refinery@2f09783] (thin): Regular analytics weekly train THIN [analytics/refinery@2f097836] [production]
08:14 <joal@deploy1003> Finished deploy [analytics/refinery@2f09783]: Regular analytics weekly train [analytics/refinery@2f097836] (duration: 02m 35s) [production]
08:11 <joal@deploy1003> Started deploy [analytics/refinery@2f09783]: Regular analytics weekly train [analytics/refinery@2f097836] [production]
08:11 <kartik@deploy1003> kartik, abi: Backport for [[gerrit:1130345|AX: Disable automatic translation entrypoints before release (T389176)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:08 <moritzm> installing jinja2 security updates [production]
08:05 <kartik@deploy1003> Started scap sync-world: Backport for [[gerrit:1130345|AX: Disable automatic translation entrypoints before release (T389176)]] [production]
08:05 <hashar> Shifted MediaWiki train UTC-0 version window by one hour to avoid conflict with backport window. [production]
07:00 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
07:00 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
06:32 <kartik@deploy1003> helmfile [staging] DONE helmfile.d/services/machinetranslation: apply [production]
06:32 <kartik@deploy1003> helmfile [staging] START helmfile.d/services/machinetranslation: apply [production]
04:51 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
04:04 <mwpresync@deploy1003> Pruned MediaWiki: 1.43.0-wmf.22, 1.43.0-wmf.23, 1.43.0-wmf.24, 1.43.0-wmf.25, 1.43.0-wmf.26, 1.43.0-wmf.27, 1.43.0-wmf.28, 1.44.0-wmf.1, 1.44.0-wmf.2, 1.44.0-wmf.3, 1.44.0-wmf.4, 1.44.0-wmf.5, 1.44.0-wmf.6, 1.44.0-wmf.8, 1.44.0-wmf.11, 1.44.0-wmf.12, 1.44.0-wmf.13, 1.44.0-wmf.14, 1.44.0-wmf.15, 1.44.0-wmf.16, 1.44.0-wmf.17, 1.44.0-wmf.18, 1.44.0-wmf.19 (duration: 04m 48s) [production]
01:58 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2269.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:52 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2269.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:51 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2269.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:50 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2266.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:50 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2268.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:49 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2265.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:48 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2267.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:41 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2269.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:39 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2268.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:39 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2266.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:38 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker2268.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:38 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker2266.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:38 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2264.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
01:37 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2268.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]