1251-1300 of 10000 results (38ms)
2025-01-21 ยง
21:14 <cjming@deploy2002> cjming, jdlrobson: Backport for [[gerrit:1112101|Enable Vector 2022 and dark mode on Azerbaijani wikis (T383942)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:08 <cjming@deploy2002> Started scap sync-world: Backport for [[gerrit:1112101|Enable Vector 2022 and dark mode on Azerbaijani wikis (T383942)]] [production]
20:35 <ecarg@deploy2002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
20:35 <ecarg@deploy2002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
20:14 <herron@cumin1002> dbctl commit (dc=all): 'depool db2175', diff saved to https://phabricator.wikimedia.org/P72208 and previous config saved to /var/cache/conftool/dbconfig/20250121-201444-herron.json [production]
19:43 <cmooney@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on netflow7001.magru.wmnet with reason: disabling alerts as I'm running gnmic manually rather than with systemd [production]
19:32 <jebe@deploy2002> Finished deploy [airflow-dags/analytics_product@0aa9d7c]: (no justification provided) (duration: 00m 35s) [production]
19:31 <jebe@deploy2002> Started deploy [airflow-dags/analytics_product@0aa9d7c]: (no justification provided) [production]
19:26 <brennen@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.13 refs T382364 [production]
19:25 <dcausse@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
19:25 <dcausse@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
19:04 <wmbot~bd808@tools-bastion-12> Built new image from 8e390695 [tools.gitlab-account-approval]
18:49 <swfrench-wmf> finished running puppet on A:cp-text for ATS mapping change - T377042 [production]
18:38 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1126.eqiad.wmnet with OS bookworm [production]
18:35 <cmooney@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on netflow7001.magru.wmnet with reason: disabling alerts as I'm running gnmic manually rather than with systemd [production]
17:12 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1128.eqiad.wmnet with reason: host reimage [production]
17:09 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1125.eqiad.wmnet with reason: host reimage [production]
17:06 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1124.eqiad.wmnet with reason: host reimage [production]
17:05 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics: apply [production]
17:04 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics: apply [production]
17:03 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1123.eqiad.wmnet with reason: host reimage [production]
17:00 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1128.eqiad.wmnet with reason: host reimage [production]
17:00 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1127.eqiad.wmnet with reason: host reimage [production]
17:00 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1124.eqiad.wmnet with reason: host reimage [production]
17:00 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1125.eqiad.wmnet with reason: host reimage [production]
16:59 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1123.eqiad.wmnet with reason: host reimage [production]
16:54 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
16:54 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
16:44 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1128 [production]
16:44 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1128 [production]
16:44 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1128.eqiad.wmnet with OS bookworm [production]
16:44 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1127 [production]
16:44 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1127 [production]
16:44 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1127.eqiad.wmnet with OS bookworm [production]
16:44 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1126 [production]
16:44 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1126 [production]
16:44 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1126.eqiad.wmnet with OS bookworm [production]
16:44 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1125 [production]
16:44 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1125 [production]
16:44 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1125.eqiad.wmnet with OS bookworm [production]
16:44 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1124 [production]
16:44 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1124 [production]
16:44 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1124.eqiad.wmnet with OS bookworm [production]
16:44 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1123 [production]
16:44 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1123 [production]
16:44 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1123.eqiad.wmnet with OS bookworm [production]
16:43 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti2019.codfw.wmnet with OS bookworm [production]
16:35 <kamila@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1123.eqiad.wmnet wikikube-worker1124.eqiad.wmnet wikikube-worker1125.eqiad.wmnet wikikube-worker1126.eqiad.wmnet wikikube-worker1127.eqiad.wmnet wikikube-worker1128.eqiad.wmnet on all recursors [production]
16:35 <kamila@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-worker1123.eqiad.wmnet wikikube-worker1124.eqiad.wmnet wikikube-worker1125.eqiad.wmnet wikikube-worker1126.eqiad.wmnet wikikube-worker1127.eqiad.wmnet wikikube-worker1128.eqiad.wmnet on all recursors [production]
16:34 <eevans@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for restbase2037.codfw.wmnet [production]