| 2024-11-19
      
      § | 
    
  | 22:50 | <ryankemper@deploy2002> | Started deploy [wdqs/wdqs@9927a5a] (wcqs): Deploy 0.3.150 to WCQS | [production] | 
            
  | 22:00 | <urbanecm@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1092341|Enable experimental Parsoid fragment support on labs and test wikis (T374661)]], [[gerrit:1092850|Revert "editcheck: Remove try/catch around transaction squashing" (T333710 T380234)]], [[gerrit:1092851|Revert "editcheck: Remove try/catch around transaction squashing" (T333710 T380234)]] (duration: 20m 39s) | [production] | 
            
  | 21:53 | <urbanecm@deploy2002> | cscott, kemayo, urbanecm: Continuing with sync | [production] | 
            
  | 21:52 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api | [tools] | 
            
  | 21:46 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-api | [tools] | 
            
  | 21:45 | <urbanecm@deploy2002> | cscott, kemayo, urbanecm: Backport for [[gerrit:1092341|Enable experimental Parsoid fragment support on labs and test wikis (T374661)]], [[gerrit:1092850|Revert "editcheck: Remove try/catch around transaction squashing" (T333710 T380234)]], [[gerrit:1092851|Revert "editcheck: Remove try/catch around transaction squashing" (T333710 T380234)]] synced to the testservers (https://wikitech.wikimedia.or | [production] | 
            
  | 21:44 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api | [toolsbeta] | 
            
  | 21:39 | <jhancock@cumin2002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host es2041.codfw.wmnet with OS bookworm | [production] | 
            
  | 21:39 | <urbanecm@deploy2002> | Started scap sync-world: Backport for [[gerrit:1092341|Enable experimental Parsoid fragment support on labs and test wikis (T374661)]], [[gerrit:1092850|Revert "editcheck: Remove try/catch around transaction squashing" (T333710 T380234)]], [[gerrit:1092851|Revert "editcheck: Remove try/catch around transaction squashing" (T333710 T380234)]] | [production] | 
            
  | 21:38 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-api | [toolsbeta] | 
            
  | 21:38 | <urbanecm@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1092296|Promote Vector 2022 as default on 3 wikis (T379765)]], [[gerrit:1092912|Separate cache key space for test & production JsonConfig data (T380320)]] (duration: 14m 38s) | [production] | 
            
  | 21:36 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer | [tools] | 
            
  | 21:31 | <urbanecm@deploy2002> | bvibber, jdlrobson, urbanecm: Continuing with sync | [production] | 
            
  | 21:30 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer | [tools] | 
            
  | 21:29 | <urbanecm@deploy2002> | bvibber, jdlrobson, urbanecm: Backport for [[gerrit:1092296|Promote Vector 2022 as default on 3 wikis (T379765)]], [[gerrit:1092912|Separate cache key space for test & production JsonConfig data (T380320)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:25 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer | [toolsbeta] | 
            
  | 21:23 | <urbanecm@deploy2002> | Started scap sync-world: Backport for [[gerrit:1092296|Promote Vector 2022 as default on 3 wikis (T379765)]], [[gerrit:1092912|Separate cache key space for test & production JsonConfig data (T380320)]] | [production] | 
            
  | 21:19 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer | [toolsbeta] | 
            
  | 21:16 | <eevans@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on restbase2038.codfw.wmnet with reason: Bootstrapping — T380236 | [production] | 
            
  | 21:15 | <eevans@cumin1002> | START - Cookbook sre.hosts.downtime for 30 days, 0:00:00 on restbase2038.codfw.wmnet with reason: Bootstrapping — T380236 | [production] | 
            
  | 21:15 | <eevans@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on restbase2037.codfw.wmnet with reason: Bootstrapping — T380236 | [production] | 
            
  | 21:15 | <eevans@cumin1002> | START - Cookbook sre.hosts.downtime for 30 days, 0:00:00 on restbase2037.codfw.wmnet with reason: Bootstrapping — T380236 | [production] | 
            
  | 21:15 | <eevans@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on restbase2036.codfw.wmnet with reason: Bootstrapping — T380236 | [production] | 
            
  | 21:14 | <eevans@cumin1002> | START - Cookbook sre.hosts.downtime for 30 days, 0:00:00 on restbase2036.codfw.wmnet with reason: Bootstrapping — T380236 | [production] | 
            
  | 21:11 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-api | [tools] | 
            
  | 21:05 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component envvars-api | [tools] | 
            
  | 21:05 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer | [tools] | 
            
  | 20:59 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer | [tools] | 
            
  | 20:56 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host es2041.codfw.wmnet with OS bookworm | [production] | 
            
  | 20:54 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component wmcs-k8s-metrics | [tools] | 
            
  | 20:53 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-emailer | [tools] | 
            
  | 20:53 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer | [tools] | 
            
  | 20:50 | <jhathaway@cumin2002> | END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host thanos-be2005.codfw.wmnet with OS bullseye | [production] | 
            
  | 20:48 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component wmcs-k8s-metrics | [tools] | 
            
  | 20:43 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer | [toolsbeta] | 
            
  | 20:40 | <jhathaway@cumin2002> | START - Cookbook sre.hosts.reimage for host thanos-be2005.codfw.wmnet with OS bullseye | [production] | 
            
  | 20:40 | <jhathaway@cumin2002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host thanos-be2005.codfw.wmnet with OS bullseye | [production] | 
            
  | 20:38 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-api | [tools] | 
            
  | 20:38 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer | [toolsbeta] | 
            
  | 20:36 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-emailer | [toolsbeta] | 
            
  | 20:32 | <sukhe@cumin1002> | END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp7007.magru.wmnet with OS bullseye | [production] | 
            
  | 20:31 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component envvars-api | [tools] | 
            
  | 20:31 | <raymond-ndibe@cloudcumin1001> | END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component envvars-api (T362867) | [tools] | 
            
  | 20:31 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component envvars-api (T362867) | [tools] | 
            
  | 20:30 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer | [toolsbeta] | 
            
  | 20:30 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-api (T362867) | [tools] | 
            
  | 20:29 | <sukhe@cumin1002> | START - Cookbook sre.hosts.reimage for host cp7007.magru.wmnet with OS bullseye | [production] | 
            
  | 20:28 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component envvars-api (T362867) | [tools] | 
            
  | 20:24 | <jhancock@cumin2002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host es2041.codfw.wmnet with OS bookworm | [production] | 
            
  | 20:24 | <jhathaway@cumin2002> | START - Cookbook sre.hosts.reimage for host thanos-be2005.codfw.wmnet with OS bullseye | [production] |