3951-4000 of 10000 results (65ms)
2022-10-06 ยง
21:08 <thcipriani@deploy1002> Finished scap: Backport for [[gerrit:839577|Skin: Map namespaces to associated pages inside runOnSkinTemplateNavigationHooks (T319396)]] (duration: 06m 08s) [production]
21:02 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts cloudnet1004.eqiad.wmnet [production]
21:02 <andrew@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:02 <thcipriani@deploy1002> thcipriani and jdlrobson: Backport for [[gerrit:839577|Skin: Map namespaces to associated pages inside runOnSkinTemplateNavigationHooks (T319396)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
21:01 <thcipriani@deploy1002> Started scap: Backport for [[gerrit:839577|Skin: Map namespaces to associated pages inside runOnSkinTemplateNavigationHooks (T319396)]] [production]
20:58 <andrew@cumin1001> START - Cookbook sre.dns.netbox [production]
20:48 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:47 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:45 <samtar@deploy1002> Finished scap: Backport for [[gerrit:839575|Replace promise handling when AfD'ing pages (T238025)]], [[gerrit:839576|Replace promise handling when AfD'ing pages (T238025)]] (duration: 07m 56s) [production]
20:40 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:39 <andrew@cumin1001> START - Cookbook sre.hosts.decommission for hosts cloudnet1004.eqiad.wmnet [production]
20:37 <samtar@deploy1002> samtar and samtar: Backport for [[gerrit:839575|Replace promise handling when AfD'ing pages (T238025)]], [[gerrit:839576|Replace promise handling when AfD'ing pages (T238025)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
20:37 <samtar@deploy1002> Started scap: Backport for [[gerrit:839575|Replace promise handling when AfD'ing pages (T238025)]], [[gerrit:839576|Replace promise handling when AfD'ing pages (T238025)]] [production]
20:36 <samtar@deploy1002> Backport cancelled. [production]
20:35 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:34 <thcipriani@deploy1002> Finished scap: Backport for [[gerrit:839572|Skin: Map namespaces to associated pages inside runOnSkinTemplateNavigationHooks (T319396)]] (duration: 09m 51s) [production]
20:33 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts cloudnet1003.eqiad.wmnet [production]
20:33 <andrew@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:32 <andrew@cumin1001> START - Cookbook sre.dns.netbox [production]
20:29 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:28 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:27 <andrew@cumin1001> START - Cookbook sre.hosts.decommission for hosts cloudnet1003.eqiad.wmnet [production]
20:25 <thcipriani@deploy1002> thcipriani and jdlrobson: Backport for [[gerrit:839572|Skin: Map namespaces to associated pages inside runOnSkinTemplateNavigationHooks (T319396)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
20:24 <thcipriani@deploy1002> Started scap: Backport for [[gerrit:839572|Skin: Map namespaces to associated pages inside runOnSkinTemplateNavigationHooks (T319396)]] [production]
20:22 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:16 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:10 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:05 <samtar@deploy1002> backport aborted: (duration: 03m 13s) [production]
20:03 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
19:51 <SandraEbele> Started airflow projectview_hourly_dag [production]
19:50 <SandraEbele> killed Oozie projectview-hourly job [production]
19:41 <SandraEbele> deployed airflow to fix projectview_hourly_dag [production]
19:34 <ebysans@deploy1002> Finished deploy [airflow-dags/analytics@cbdc509]: (no justification provided) (duration: 00m 14s) [production]
19:34 <ebysans@deploy1002> Started deploy [airflow-dags/analytics@cbdc509]: (no justification provided) [production]
19:33 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
19:32 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
19:32 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
19:31 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
19:29 <ryankemper@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on 6 hosts with reason: T313431 [production]
19:28 <ryankemper@cumin1001> START - Cookbook sre.hosts.downtime for 3:00:00 on 6 hosts with reason: T313431 [production]
19:28 <brennen@deploy1002> rebuilt and synchronized wikiversions files: group2 wikis to 1.40.0-wmf.3 refs T314193 [production]
19:26 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
19:25 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
19:25 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
19:24 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
19:20 <brennen@deploy1002> rebuilt and synchronized wikiversions files: all wikis to 1.40.0-wmf.4 refs T314193 [production]
19:15 <brennen> train 1.40.0-wmf.4 (T314193) no current blockers, rolling train to all wikis [production]
19:03 <inflatador> 'bking@elastic restarted elastic2025, 2031, 2061, 2084 T313431 [production]