601-650 of 10000 results (80ms)
2023-12-18 ยง
14:55 <urbanecm@deploy2002> cwhite and urbanecm and chlod: Backport for [[gerrit:983229|Configure and enable StatsLib for production (T343024)]], [[gerrit:983529|Revert "util.main: Don't use mw.Map(), use a native Map() instead" (T353571 T353076)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:53 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:983229|Configure and enable StatsLib for production (T343024)]], [[gerrit:983529|Revert "util.main: Don't use mw.Map(), use a native Map() instead" (T353571 T353076)]] [production]
14:52 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:981714|Enable action blocks for zhwiki (T353120)]] (duration: 08m 58s) [production]
14:47 <urbanecm@deploy2002> milkydefer and urbanecm: Continuing with sync [production]
14:45 <moritzm> installing nagios-plugins-contrib bugfix updates from Bookworm point release [production]
14:45 <moritzm> installing nagios-plugins-contrib bugfix updates [production]
14:44 <urbanecm@deploy2002> milkydefer and urbanecm: Backport for [[gerrit:981714|Enable action blocks for zhwiki (T353120)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:44 <mfossati@deploy2002> Finished deploy [airflow-dags/platform_eng@d275e4f]: (no justification provided) (duration: 00m 32s) [production]
14:44 <mfossati@deploy2002> Started deploy [airflow-dags/platform_eng@d275e4f]: (no justification provided) [production]
14:43 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:981714|Enable action blocks for zhwiki (T353120)]] [production]
14:43 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:982873|Add a testing stream for page-prediction-change events (T349919)]], [[gerrit:983178|CheckUser: Enable read new for event tables migration everywhere (T341829)]] (duration: 19m 00s) [production]
14:37 <urbanecm@deploy2002> dreamyjazz and aikochou and urbanecm: Continuing with sync [production]
14:36 <elukey@deploy2002> helmfile [eqiad] DONE helmfile.d/services/recommendation-api: sync [production]
14:35 <elukey@deploy2002> helmfile [eqiad] START helmfile.d/services/recommendation-api: sync [production]
14:34 <urbanecm@deploy2002> dreamyjazz and aikochou and urbanecm: Backport for [[gerrit:982873|Add a testing stream for page-prediction-change events (T349919)]], [[gerrit:983178|CheckUser: Enable read new for event tables migration everywhere (T341829)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:24 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:982873|Add a testing stream for page-prediction-change events (T349919)]], [[gerrit:983178|CheckUser: Enable read new for event tables migration everywhere (T341829)]] [production]
14:13 <moritzm> installing node-undici security updates [production]
13:15 <moritzm> installing intel-microcode security updates on buster hosts [production]
13:08 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp4037.ulsfo.wmnet with OS bullseye [production]
12:56 <kamila@deploy2002> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]
12:55 <kamila@deploy2002> helmfile [codfw] START helmfile.d/services/mobileapps: apply [production]
12:52 <kamila@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
12:51 <kamila@deploy2002> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
12:50 <kamila@deploy2002> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
12:50 <kamila@deploy2002> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
12:45 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp4037.ulsfo.wmnet with reason: host reimage [production]
12:41 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp4037.ulsfo.wmnet with reason: host reimage [production]
12:27 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe-canary [production]
12:26 <mvernon@cumin2002> START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe-canary [production]
12:26 <kamila@deploy2002> helmfile [ml-serve-codfw] DONE helmfile.d/admin 'apply'. [production]
12:25 <kamila@deploy2002> helmfile [ml-serve-codfw] START helmfile.d/admin 'apply'. [production]
12:24 <kamila@deploy2002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. [production]
12:23 <kamila@deploy2002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. [production]
12:20 <kamila@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'apply'. [production]
12:20 <fabfur@cumin1002> START - Cookbook sre.hosts.reimage for host cp4037.ulsfo.wmnet with OS bullseye [production]
12:20 <kamila@deploy2002> helmfile [ml-staging-codfw] START helmfile.d/admin 'apply'. [production]
12:19 <fabfur@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp4037.ulsfo.wmnet with OS bullseye [production]
12:19 <kamila@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
12:18 <kamila@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
12:14 <kamila@deploy2002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
12:13 <kamila@deploy2002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
12:12 <Emperor> restart swift-proxy and envoyproxy on ms-fe1012 [production]
12:10 <kamila@deploy2002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
12:09 <kamila@deploy2002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
12:04 <kamila@deploy2002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
12:03 <kamila@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
12:01 <moritzm> installing ncurses security updates [production]
11:59 <kamila@deploy2002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
11:58 <kamila@deploy2002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
11:51 <fabfur@cumin1002> START - Cookbook sre.hosts.reimage for host cp4037.ulsfo.wmnet with OS bullseye [production]