| 
      
        2023-05-02
      
      ยง
     | 
  
    
  | 23:28 | 
  <eileen> | 
  config revision changed from 18acbe1a to 69f60bb9 | 
  [production] | 
            
  | 22:56 | 
  <eileen> | 
  config revision changed from 2eef4039 to 18acbe1a | 
  [production] | 
            
  | 22:53 | 
  <eileen> | 
  civicrm upgraded from a3d84de3 to 8076995a | 
  [production] | 
            
  | 20:36 | 
  <urbanecm@deploy1002> | 
  Finished scap: Backport for [[gerrit:908367|[Growth] Finish Personalized praise variable rename (T334630)]] (duration: 06m 55s) | 
  [production] | 
            
  | 20:30 | 
  <akosiaris@deploy1002> | 
  helmfile [staging] DONE helmfile.d/services/machinetranslation: apply | 
  [production] | 
            
  | 20:30 | 
  <akosiaris@deploy1002> | 
  helmfile [staging] START helmfile.d/services/machinetranslation: apply | 
  [production] | 
            
  | 20:29 | 
  <urbanecm@deploy1002> | 
  Started scap: Backport for [[gerrit:908367|[Growth] Finish Personalized praise variable rename (T334630)]] | 
  [production] | 
            
  | 20:25 | 
  <ebernhardson@deploy1002> | 
  Finished deploy [search/mjolnir/deploy@daf8c32]: bump mjolnir to v2.3.0 (duration: 00m 28s) | 
  [production] | 
            
  | 20:24 | 
  <ebernhardson@deploy1002> | 
  Started deploy [search/mjolnir/deploy@daf8c32]: bump mjolnir to v2.3.0 | 
  [production] | 
            
  | 20:20 | 
  <urbanecm@deploy1002> | 
  Finished scap: Backport for [[gerrit:911799|Switch on creating Babel categories in Russian Wiktionary (T335136)]] (duration: 15m 47s) | 
  [production] | 
            
  | 20:06 | 
  <urbanecm@deploy1002> | 
  urbanecm and iniquity: Backport for [[gerrit:911799|Switch on creating Babel categories in Russian Wiktionary (T335136)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet | 
  [production] | 
            
  | 20:04 | 
  <urbanecm@deploy1002> | 
  Started scap: Backport for [[gerrit:911799|Switch on creating Babel categories in Russian Wiktionary (T335136)]] | 
  [production] | 
            
  | 19:40 | 
  <bking@cumin1001> | 
  END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in search_codfw | 
  [production] | 
            
  | 19:40 | 
  <bking@cumin1001> | 
  START - Cookbook sre.elasticsearch.ban Unbanning all hosts in search_codfw | 
  [production] | 
            
  | 19:28 | 
  <otto@deploy1002> | 
  helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply | 
  [production] | 
            
  | 19:28 | 
  <otto@deploy1002> | 
  helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply | 
  [production] | 
            
  | 19:18 | 
  <bking@deploy1002> | 
  Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 05s) | 
  [production] | 
            
  | 19:18 | 
  <bking@deploy1002> | 
  Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) | 
  [production] | 
            
  | 19:13 | 
  <bking@deploy1002> | 
  Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 16s) | 
  [production] | 
            
  | 19:12 | 
  <bking@deploy1002> | 
  Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) | 
  [production] | 
            
  | 19:12 | 
  <bking@deploy1002> | 
  Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 07m 13s) | 
  [production] | 
            
  | 19:05 | 
  <bking@deploy1002> | 
  Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) | 
  [production] | 
            
  | 19:04 | 
  <bking@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on wdqs2022.codfw.wmnet with reason: attempting WDQS stack on bullseye | 
  [production] | 
            
  | 19:04 | 
  <bking@cumin1001> | 
  START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on wdqs2022.codfw.wmnet with reason: attempting WDQS stack on bullseye | 
  [production] | 
            
  | 18:56 | 
  <bking@deploy1002> | 
  Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 03s) | 
  [production] | 
            
  | 18:56 | 
  <bking@deploy1002> | 
  Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) | 
  [production] | 
            
  | 18:56 | 
  <bking@deploy1002> | 
  Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 19s) | 
  [production] | 
            
  | 18:55 | 
  <bking@deploy1002> | 
  Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) | 
  [production] | 
            
  | 18:50 | 
  <bking@cumin1001> | 
  conftool action : set/pooled=inactive; selector: name=wdqs2022.codfw.wmnet | 
  [production] | 
            
  | 18:38 | 
  <ejegg> | 
  civicrm upgraded from e7904ea6 to a3d84de3 | 
  [production] | 
            
  | 18:19 | 
  <milimetric@deploy1002> | 
  Finished deploy [analytics/refinery@c42021f] (thin): Regular analytics weekly train THIN [analytics/refinery@c42021f] (duration: 00m 07s) | 
  [production] | 
            
  | 18:19 | 
  <milimetric@deploy1002> | 
  Started deploy [analytics/refinery@c42021f] (thin): Regular analytics weekly train THIN [analytics/refinery@c42021f] | 
  [production] | 
            
  | 18:11 | 
  <brennen@deploy1002> | 
  rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.7  refs T330213 | 
  [production] | 
            
  | 18:03 | 
  <brennen> | 
  train 1.41.0-wmf.7 (T330213): (correction: group0 today) | 
  [production] | 
            
  | 18:01 | 
  <brennen> | 
  train 1.41.0-wmf.7 (T330213): no current blockers, rolling to group1 with `scap train` | 
  [production] | 
            
  | 17:45 | 
  <milimetric@deploy1002> | 
  Finished deploy [analytics/refinery@c42021f]: Regular analytics weekly train [analytics/refinery@c42021f] (duration: 06m 26s) | 
  [production] | 
            
  | 17:39 | 
  <milimetric@deploy1002> | 
  Started deploy [analytics/refinery@c42021f]: Regular analytics weekly train [analytics/refinery@c42021f] | 
  [production] | 
            
  | 17:36 | 
  <sukhe> | 
  cr*-eqiad: delete backup routes for ns0: delete routing-options static route 208.80.153.231/32: T330670 | 
  [production] | 
            
  | 17:34 | 
  <sukhe> | 
  [correction] cr*-codfw: delete backup routes for ns0: delete routing-options static route 208.80.154.238/32: T330670 | 
  [production] | 
            
  | 17:32 | 
  <sukhe> | 
  cr*-codfw: delete backup routes for ns1: delete routing-options static route 208.80.154.238/32: T330670 | 
  [production] | 
            
  | 17:28 | 
  <sukhe> | 
  ns1 set routing-options static route 208.80.153.231/32 next-hop [ 208.80.153.77 208.80.153.111 208.80.153.10 ]: T330670 | 
  [production] | 
            
  | 17:25 | 
  <sukhe> | 
  ns0 set routing-options static route 208.80.154.238/32 next-hop [ 208.80.154.10 208.80.155.108 208.80.154.134 ]: T330670 | 
  [production] | 
            
  | 17:03 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 16:58 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.hosts.reboot-single for host sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 16:38 | 
  <btullis@cumin1001> | 
  END (PASS) - Cookbook sre.aqs.roll-restart (exit_code=0) for AQS aqs cluster: Roll restart of all AQS's nodejs daemons. | 
  [production] | 
            
  | 16:24 | 
  <btullis@cumin1001> | 
  START - Cookbook sre.aqs.roll-restart for AQS aqs cluster: Roll restart of all AQS's nodejs daemons. | 
  [production] | 
            
  | 16:16 | 
  <ebernhardson@deploy1002> | 
  Finished deploy [search/mjolnir/deploy@bb96aca]: Add snappy dependency for kafka daemons (duration: 00m 26s) | 
  [production] | 
            
  | 16:16 | 
  <sukhe> | 
  ns0 backup routes: delete routing-options static route 208.80.154.238/32 next-hop 208.80.153.111, set to 208.80.153.77 | 
  [production] | 
            
  | 16:16 | 
  <ebernhardson@deploy1002> | 
  Started deploy [search/mjolnir/deploy@bb96aca]: Add snappy dependency for kafka daemons | 
  [production] | 
            
  | 16:12 | 
  <sukhe> | 
  ns1: delete routing-options static route 208.80.153.231/32 next-hop 208.80.153.111, set to 208.80.153.77 | 
  [production] |