451-500 of 10000 results (31ms)
2024-11-14 ยง
15:35 <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1091248|Revert "mmv.js: Store comingFromHashChange as a class property" (T379835)]] (duration: 12m 10s) [production]
15:33 <sukhe> reprepro -C main include bullseye-wikimedia trafficserver_9.2.6-1wm1_amd64.changes: T379797 [production]
15:30 <sukhe@cumin1002> START - Cookbook sre.dns.roll-restart-ntp rolling restart_daemons on A:dnsbox [production]
15:29 <jayme@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-ctrl2002.codfw.wmnet with reason: T379719 [production]
15:29 <jayme@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-ctrl2002.codfw.wmnet with reason: T379719 [production]
15:28 <jayme@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-ctrl2002.codfw.wmnet [production]
15:28 <jayme@cumin2002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-ctrl2002.codfw.wmnet [production]
15:27 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
15:27 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:1091248|Revert "mmv.js: Store comingFromHashChange as a class property" (T379835)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
15:24 <elukey@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host thanos-be2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:24 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host thanos-be2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:24 <sukhe@cumin1002> END (PASS) - Cookbook sre.dns.roll-restart (exit_code=0) rolling restart_daemons on A:dnsbox and not A:magru and A:dnsbox [production]
15:23 <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1091248|Revert "mmv.js: Store comingFromHashChange as a class property" (T379835)]] [production]
15:16 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-search: apply [production]
15:15 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-search: apply [production]
15:15 <wmbot~lucaswerkmeister@tools-bastion-13> deployed 4918453fd3 (Codex 1.16.0) [tools.codex-playground]
15:07 <elukey@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host thanos-be2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:07 <sergi0> UTC afternoon deploys done [production]
15:06 <sgimeno@deploy2002> Finished scap sync-world: Backport for [[gerrit:1091231|HomepageHooks: run metrics increment in deferred update (T379682)]] (duration: 11m 15s) [production]
15:02 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host thanos-be2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:02 <sgimeno@deploy2002> sgimeno: Continuing with sync [production]
14:59 <sgimeno@deploy2002> sgimeno: Backport for [[gerrit:1091231|HomepageHooks: run metrics increment in deferred update (T379682)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:55 <sgimeno@deploy2002> Started scap sync-world: Backport for [[gerrit:1091231|HomepageHooks: run metrics increment in deferred update (T379682)]] [production]
14:53 <volans> uploaded spicerack_8.16.1 to apt.wikimedia.org bullseye-wikimedia [production]
14:50 <sgimeno@deploy2002> Finished scap sync-world: Backport for [[gerrit:1090830|GrowthExperiments: set experiment config only in pilot wikis (T379681)]] (duration: 13m 02s) [production]
14:45 <sgimeno@deploy2002> sgimeno: Continuing with sync [production]
14:41 <sgimeno@deploy2002> sgimeno: Backport for [[gerrit:1090830|GrowthExperiments: set experiment config only in pilot wikis (T379681)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:37 <sgimeno@deploy2002> Started scap sync-world: Backport for [[gerrit:1090830|GrowthExperiments: set experiment config only in pilot wikis (T379681)]] [production]
14:33 <sukhe@cumin1002> START - Cookbook sre.dns.roll-restart rolling restart_daemons on A:dnsbox and not A:magru and A:dnsbox [production]
14:30 <sukhe@cumin1002> END (PASS) - Cookbook sre.dns.roll-restart (exit_code=0) rolling restart_daemons on A:dnsbox and A:magru and A:dnsbox [production]
14:27 <kartik@deploy2002> Finished scap sync-world: Backport for [[gerrit:1091227|CX3 Build 0.2.0+20241114]] (duration: 13m 23s) [production]
14:25 <sukhe@cumin1002> START - Cookbook sre.dns.roll-restart rolling restart_daemons on A:dnsbox and A:magru and A:dnsbox [production]
14:22 <kartik@deploy2002> kartik: Continuing with sync [production]
14:18 <sukhe@cumin1002> END (PASS) - Cookbook sre.dns.roll-restart-reboot-wikimedia-dns (exit_code=0) rolling restart_daemons on A:wikidough and A:wikidough [production]
14:17 <kartik@deploy2002> kartik: Backport for [[gerrit:1091227|CX3 Build 0.2.0+20241114]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:13 <kartik@deploy2002> Started scap sync-world: Backport for [[gerrit:1091227|CX3 Build 0.2.0+20241114]] [production]
14:05 <sukhe@cumin1002> START - Cookbook sre.dns.roll-restart-reboot-wikimedia-dns rolling restart_daemons on A:wikidough and A:wikidough [production]
13:50 <aqu@deploy2002> Finished deploy [airflow-dags/analytics@2220747]: Stage Refine parallelization improvment [airflow-dags@2220747d] (duration: 01m 08s) [production]
13:49 <aqu@deploy2002> Started deploy [airflow-dags/analytics@2220747]: Stage Refine parallelization improvment [airflow-dags@2220747d] [production]
13:38 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti7004.magru.wmnet [production]
13:36 <aqu@deploy2002> Finished deploy [airflow-dags/analytics_test@2220747]: Stage Refine parallelization improvment [airflow-dags@2220747d] (duration: 00m 15s) [production]
13:36 <aqu@deploy2002> Started deploy [airflow-dags/analytics_test@2220747]: Stage Refine parallelization improvment [airflow-dags@2220747d] [production]
13:30 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti7004.magru.wmnet [production]
13:21 <kcvelaga@deploy2002> Finished deploy [airflow-dags/analytics_product@c5ab766]: T379546 (duration: 00m 54s) [production]
13:21 <kcvelaga@deploy2002> Started deploy [airflow-dags/analytics_product@c5ab766]: T379546 [production]
13:19 <oblivian@cumin1002> END (PASS) - Cookbook sre.deploy.hiddenparma (exit_code=0) Hiddenparma deployment to the alerting hosts with reason: "Fix search button height - oblivian@cumin1002" [production]
13:18 <oblivian@cumin1002> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: Fix search button height - oblivian@cumin1002 [production]
13:18 <oblivian@cumin1002> START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: Fix search button height - oblivian@cumin1002 [production]
13:18 <oblivian@cumin1002> START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "Fix search button height - oblivian@cumin1002" [production]
13:16 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component tools-webservice [tools]