1051-1100 of 10000 results (113ms)
2024-10-28 ยง
19:24 <gmodena@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
19:23 <brett> Removed RSA certificate support from ldap, archiva, durum [production]
19:21 <gmodena@deploy2002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
19:21 <gmodena@deploy2002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
19:18 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich-next: apply [production]
19:17 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich-next: apply [production]
19:15 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich: apply [production]
19:15 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich: apply [production]
19:14 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich-next: apply [production]
19:13 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich-next: apply [production]
17:43 <jiawang@deploy2002> Finished deploy [airflow-dags/analytics_product@a7456f9]: deploy tsp pipelines (duration: 01m 33s) [production]
17:42 <jiawang@deploy2002> Started deploy [airflow-dags/analytics_product@a7456f9]: deploy tsp pipelines [production]
17:04 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on cloudvirt1063.eqiad.wmnet with reason: cloudvirt1063 needs maintenance T375223 [production]
17:03 <fnegri@cumin1002> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on cloudvirt1063.eqiad.wmnet with reason: cloudvirt1063 needs maintenance T375223 [production]
16:55 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs1013.eqiad.wmnet [production]
16:50 <vgutierrez@cumin1002> START - Cookbook sre.hosts.reboot-single for host lvs1013.eqiad.wmnet [production]
16:50 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs1014.eqiad.wmnet [production]
16:44 <vgutierrez@cumin1002> START - Cookbook sre.hosts.reboot-single for host lvs1014.eqiad.wmnet [production]
16:44 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs1015.eqiad.wmnet [production]
16:38 <vgutierrez@cumin1002> START - Cookbook sre.hosts.reboot-single for host lvs1015.eqiad.wmnet [production]
16:38 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs1016.eqiad.wmnet [production]
16:32 <vgutierrez@cumin1002> START - Cookbook sre.hosts.reboot-single for host lvs1016.eqiad.wmnet [production]
16:26 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudcumin1001.eqiad.wmnet [production]
16:20 <fnegri@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudcumin1001.eqiad.wmnet [production]
16:20 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudcumin2001.codfw.wmnet [production]
16:16 <fnegri@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudcumin2001.codfw.wmnet [production]
15:51 <jdrewniak@deploy2002> Synchronized portals: Wikimedia Portals Update: [[gerrit:1046698| Bumping portals to master (T128546)]] (duration: 02m 25s) [production]
15:49 <jdrewniak@deploy2002> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:1046698| Bumping portals to master (T128546)]] (duration: 07m 35s) [production]
15:48 <XioNoX> re-enable IX BGP sessions in eqiad [production]
15:30 <jan_drewniak> starting portals deployment [production]
15:29 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
15:28 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
15:16 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
15:16 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
14:51 <MichaelG_WMF> T372337 - run `mwscript extensions/GrowthExperiments/maintenance/fixLinkRecommendationData.php --wiki=eswiki --search-index` to fix the remaining ca. 10K dangling search index records [production]
14:37 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.addnode (exit_code=99) for new host ganeti2042.codfw.wmnet to cluster codfw and group D [production]
14:36 <jmm@cumin2002> START - Cookbook sre.ganeti.addnode for new host ganeti2042.codfw.wmnet to cluster codfw and group D [production]
14:08 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1083754|knwiktionary: update logo, wordmark (T360022)]], [[gerrit:1083762|hewikisource: add project namespace alias (T378303)]], [[gerrit:1082809|Add config for testing T375264 on beta (T377988)]] (duration: 10m 43s) [production]
14:04 <urbanecm@deploy2002> anzx, cparle, urbanecm: Continuing with sync [production]
14:01 <urbanecm@deploy2002> anzx, cparle, urbanecm: Backport for [[gerrit:1083754|knwiktionary: update logo, wordmark (T360022)]], [[gerrit:1083762|hewikisource: add project namespace alias (T378303)]], [[gerrit:1082809|Add config for testing T375264 on beta (T377988)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:58 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1083754|knwiktionary: update logo, wordmark (T360022)]], [[gerrit:1083762|hewikisource: add project namespace alias (T378303)]], [[gerrit:1082809|Add config for testing T375264 on beta (T377988)]] [production]
13:57 <urbanecm@deploy2002> Sync cancelled. [production]
13:54 <urbanecm@deploy2002> anzx, urbanecm: Backport for [[gerrit:1083754|knwiktionary: update logo, wordmark (T360022)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:52 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1083754|knwiktionary: update logo, wordmark (T360022)]] [production]
13:49 <arnaudb@cumin2002> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2211 quickly with 2 steps - test fast pool [production]
13:41 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1083170|Enable CampaignEvents collaboration list by default (T375141)]], [[gerrit:1077370|beta: Drop $wgCampaignEventsShowEventInvitationSpecialPages (T373442)]], [[gerrit:1077371|prod: Drop $wgCampaignEventsShowEventInvitationSpecialPages (T373442)]] (duration: 13m 43s) [production]
13:38 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.addnode (exit_code=99) for new host ganeti2041.codfw.wmnet to cluster codfw and group D [production]
13:37 <jmm@cumin2002> START - Cookbook sre.ganeti.addnode for new host ganeti2041.codfw.wmnet to cluster codfw and group D [production]
13:36 <urbanecm@deploy2002> urbanecm, daimona: Continuing with sync [production]
13:33 <arnaudb@cumin2002> START - Cookbook sre.mysql.pool db2211 quickly with 2 steps - test fast pool [production]