1-50 of 10000 results (87ms)
2025-01-07 ยง
23:58 <eileen> civicrm upgraded from d8ec1e91 to 82b02ce5 [production]
23:49 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1108724|[Growth] enwiki: Deploy Add Link to 5% of users (T382382)]] (duration: 13m 34s) [production]
23:42 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
23:42 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1108724|[Growth] enwiki: Deploy Add Link to 5% of users (T382382)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
23:36 <jhathaway@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest2001.codfw.wmnet with OS bookworm [production]
23:36 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1108724|[Growth] enwiki: Deploy Add Link to 5% of users (T382382)]] [production]
23:35 <cdanis@deploy2002> Finished scap sync-world: Backport for [[gerrit:1108850|tracing: Disable tracing in CLI mode (T340552)]] (duration: 14m 23s) [production]
23:27 <cdanis@deploy2002> cdanis: Continuing with sync [production]
23:27 <cdanis@deploy2002> cdanis: Backport for [[gerrit:1108850|tracing: Disable tracing in CLI mode (T340552)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
23:20 <cdanis@deploy2002> Started scap sync-world: Backport for [[gerrit:1108850|tracing: Disable tracing in CLI mode (T340552)]] [production]
23:19 <jhathaway@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest2001.codfw.wmnet with reason: host reimage [production]
23:16 <jhathaway@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on sretest2001.codfw.wmnet with reason: host reimage [production]
23:05 <jhathaway@cumin2002> START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm [production]
22:47 <jhathaway@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest2001.codfw.wmnet with OS bookworm [production]
22:35 <jhathaway@cumin2002> START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm [production]
22:34 <jhathaway@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest2001.codfw.wmnet with OS bookworm [production]
22:22 <jhathaway@cumin2002> START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm [production]
22:22 <jhathaway@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest2001.codfw.wmnet with OS bookworm [production]
22:15 <jhathaway@cumin2002> START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm [production]
22:09 <jhathaway@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest2001.codfw.wmnet with OS bookworm [production]
22:02 <jhathaway@cumin2002> START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm [production]
20:56 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
20:56 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
20:49 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
20:49 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
20:46 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on doc1003.eqiad.wmnet with reason: maintenance [production]
20:45 <dzahn@cumin2002> START - Cookbook sre.hosts.downtime for 1:00:00 on doc1003.eqiad.wmnet with reason: maintenance [production]
20:19 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
20:18 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
20:16 <cdanis@deploy2002> Finished scap sync-world: Backport for [[gerrit:1108802|group0: enable OpenTelemetry exports (T340552)]] (duration: 16m 06s) [production]
20:15 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'sync'. [production]
20:15 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'sync'. [production]
20:08 <cdanis@deploy2002> cdanis: Continuing with sync [production]
20:07 <cdanis@deploy2002> cdanis: Backport for [[gerrit:1108802|group0: enable OpenTelemetry exports (T340552)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:00 <cdanis@deploy2002> Started scap sync-world: Backport for [[gerrit:1108802|group0: enable OpenTelemetry exports (T340552)]] [production]
20:00 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
20:00 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
19:56 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
19:55 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
19:52 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich: apply [production]
19:52 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich: apply [production]
19:36 <dduvall@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.11 refs T382362 [production]
18:41 <xcollazo@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
18:41 <xcollazo@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
18:27 <xcollazo@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: sync [production]
18:27 <xcollazo@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: sync [production]
18:17 <xcollazo@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
18:17 <xcollazo@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
18:12 <mvernon@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8 days, 0:00:00 on ms-be2075.codfw.wmnet with reason: host is awaiting attention from Dell [production]
18:11 <mvernon@cumin1002> START - Cookbook sre.hosts.downtime for 8 days, 0:00:00 on ms-be2075.codfw.wmnet with reason: host is awaiting attention from Dell [production]