2951-3000 of 10000 results (94ms)
2023-10-23 ยง
14:41 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudcephosd1021'] [production]
14:30 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
14:26 <jayme@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
14:26 <jayme> switched mw-api-int (mw-on-k8s) to certmanager certificates - T300033 [production]
14:26 <jayme@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
14:25 <jayme@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
14:24 <jayme@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
14:14 <jayme@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
14:13 <jayme> switched mw-api-ext (mw-on-k8s) to certmanager certificates - T300033 [production]
14:13 <jayme@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
14:13 <jayme@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
14:12 <jayme@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
14:06 <jayme@deploy2002> helmfile [codfw] [main] DONE helmfile.d/services/mw-jobrunner : sync [production]
14:06 <jayme@deploy2002> helmfile [codfw] [canary] DONE helmfile.d/services/mw-jobrunner : sync [production]
14:06 <jayme@deploy2002> helmfile [codfw] [main] START helmfile.d/services/mw-jobrunner : sync [production]
14:06 <jayme@deploy2002> helmfile [codfw] [canary] START helmfile.d/services/mw-jobrunner : sync [production]
14:05 <jayme> switched mw-jobrunner (mw-on-k8s) to certmanager certificates - T300033 [production]
14:05 <jayme@deploy2002> helmfile [eqiad] [main] DONE helmfile.d/services/mw-jobrunner : sync [production]
14:05 <jayme@deploy2002> helmfile [eqiad] [canary] DONE helmfile.d/services/mw-jobrunner : sync [production]
14:05 <jayme@deploy2002> helmfile [eqiad] [canary] START helmfile.d/services/mw-jobrunner : sync [production]
14:05 <jayme@deploy2002> helmfile [eqiad] [main] START helmfile.d/services/mw-jobrunner : sync [production]
13:53 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:967302|Stop writing to $wgCentralAuthCookieDomain in 'EnterMobileMode' hook]] (duration: 15m 50s) [production]
13:52 <moritzm> installing batik security updates [production]
13:48 <urbanecm@deploy2002> urbanecm and matmarex: Continuing with sync [production]
13:38 <urbanecm@deploy2002> urbanecm and matmarex: Backport for [[gerrit:967302|Stop writing to $wgCentralAuthCookieDomain in 'EnterMobileMode' hook]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:37 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:967302|Stop writing to $wgCentralAuthCookieDomain in 'EnterMobileMode' hook]] [production]
13:37 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:965610|New stream for Android Patroller tasks feature (T348816)]] (duration: 06m 54s) [production]
13:31 <urbanecm@deploy2002> urbanecm and sharvaniharan: Continuing with sync [production]
13:31 <urbanecm@deploy2002> urbanecm and sharvaniharan: Backport for [[gerrit:965610|New stream for Android Patroller tasks feature (T348816)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:30 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:965610|New stream for Android Patroller tasks feature (T348816)]] [production]
13:29 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:967195|Remove 'currentProto'/'finalProto'/'proto' business (T348852)]], [[gerrit:966915|Remove unused $wgIncludeLegacyJavaScript]], [[gerrit:966919|Remove $wgApiFrameOptions override for enwiki and zhwiki (T131183)]] (duration: 11m 56s) [production]
13:23 <urbanecm@deploy2002> matmarex and urbanecm: Continuing with sync [production]
13:18 <urbanecm@deploy2002> matmarex and urbanecm: Backport for [[gerrit:967195|Remove 'currentProto'/'finalProto'/'proto' business (T348852)]], [[gerrit:966915|Remove unused $wgIncludeLegacyJavaScript]], [[gerrit:966919|Remove $wgApiFrameOptions override for enwiki and zhwiki (T131183)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:17 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:967195|Remove 'currentProto'/'finalProto'/'proto' business (T348852)]], [[gerrit:966915|Remove unused $wgIncludeLegacyJavaScript]], [[gerrit:966919|Remove $wgApiFrameOptions override for enwiki and zhwiki (T131183)]] [production]
13:16 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:967429|wikidatawiki: Switch property for determining Lexeme language code (T348923)]] (duration: 12m 50s) [production]
13:11 <urbanecm@deploy2002> migr and urbanecm: Continuing with sync [production]
13:05 <urbanecm@deploy2002> migr and urbanecm: Backport for [[gerrit:967429|wikidatawiki: Switch property for determining Lexeme language code (T348923)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:04 <moritzm> installing libxpm security updates on buster [production]
13:04 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:967429|wikidatawiki: Switch property for determining Lexeme language code (T348923)]] [production]
12:41 <jayme@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
12:40 <jayme> switched mw-web (mw-on-k8s) to certmanager certificates - T300033 [production]
12:40 <jayme@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
12:40 <jayme@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
12:39 <jayme@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
12:33 <moritzm> installing libx11 security updates [production]
12:16 <arnaudb@cumin1001> END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db1131.eqiad.wmnet onto db1231.eqiad.wmnet [production]
11:49 <jnuche@deploy2002> Finished deploy [releng/jenkins-deploy@054e07d] (releasing): (no justification provided) (duration: 00m 42s) [production]
11:49 <jnuche@deploy2002> Started deploy [releng/jenkins-deploy@054e07d] (releasing): (no justification provided) [production]
11:49 <moritzm> added Balthazar to pwstore [production]
11:33 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on an-airflow1007.eqiad.wmnet with reason: Server not yet in productin use [production]