| 
      
        2019-12-09
      
      §
     | 
  
    
  | 15:40 | 
  <jiji@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 15:37 | 
  <jiji@cumin1001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 15:09 | 
  <elukey> | 
  upload prometheus-memcached-exporter 0.6.0+git20191209.bac8a8c-1 to buster-wikimedia | 
  [production] | 
            
  | 15:01 | 
  <jiji@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 14:58 | 
  <jiji@cumin1001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 14:34 | 
  <ladsgroup@deploy1001> | 
  Synchronized php-1.35.0-wmf.5/extensions/Wikibase/repo/includes/ParserOutput/FullEntityParserOutputGenerator.php: T229407, clean up debugging info (duration: 00m 59s) | 
  [production] | 
            
  | 14:26 | 
  <ladsgroup@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: [[gerrit:555941|Disable sanity check cirrus jobs for Wikidata (T239931 T229407)]] (duration: 00m 57s) | 
  [production] | 
            
  | 14:15 | 
  <jiji@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 14:13 | 
  <jiji@cumin1001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 13:55 | 
  <effie> | 
  reimage mw2270.codfw.wmnet mw2269.codfw.wmnet mw2268.codfw.wmnet | 
  [production] | 
            
  | 11:36 | 
  <jdrewniak@deploy1001> | 
  Synchronized portals: Wikimedia Portals Update: [[gerrit:555907| Bumping portals to master (T128546)]] (duration: 01m 00s) | 
  [production] | 
            
  | 11:35 | 
  <jdrewniak@deploy1001> | 
  Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:555907| Bumping portals to master (T128546)]] (duration: 01m 23s) | 
  [production] | 
            
  | 10:46 | 
  <addshore> | 
  T239470 addshore@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildItemTerms.php --wiki wikidatawiki --from-id=10000007 --to-id=10000007 | 
  [production] | 
            
  | 10:06 | 
  <rlazarus> | 
  rolling restart php-fpm in mw-eqiad due to APCu fragmentation | 
  [production] | 
            
  | 08:58 | 
  <oblivian@cumin1001> | 
  conftool action : set/weight=10; selector: service=parsoid-php | 
  [production] | 
            
  | 08:49 | 
  <kart_> | 
  Updated cxserver to 2019-12-05-090549-production (T217585, T230195) | 
  [production] | 
            
  | 08:46 | 
  <kartik@deploy1001> | 
  helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . | 
  [production] | 
            
  | 08:41 | 
  <kartik@deploy1001> | 
  helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . | 
  [production] | 
            
  | 08:39 | 
  <kartik@deploy1001> | 
  helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . | 
  [production] | 
            
  | 08:33 | 
  <elukey> | 
  powercycle mw1280, mgmt console stuck, dimm errors in getsel | 
  [production] | 
            
  | 08:24 | 
  <ema> | 
  cp3064: ats-tls-restart to clear "tls process restarted" alert T240183 | 
  [production] | 
            
  | 07:44 | 
  <onimisionipe> | 
  resetting cron on wdqs1010 to fix cronspam | 
  [production] | 
            
  | 04:05 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@9847a28]: (no justification provided) (duration: 03m 37s) | 
  [production] | 
            
  | 04:01 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@9847a28]: (no justification provided) | 
  [production] | 
            
  | 03:54 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@d1cba62]: (no justification provided) (duration: 01m 51s) | 
  [production] | 
            
  | 03:52 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@d1cba62]: (no justification provided) | 
  [production] | 
            
  
    | 
      
        2019-12-08
      
      §
     | 
  
    
  | 20:40 | 
  <ejegg> | 
  disabled Ingenico Connect recurring charge job | 
  [production] | 
            
  | 02:58 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@ff0a0e7]: (no justification provided) (duration: 01m 53s) | 
  [production] | 
            
  | 02:56 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@ff0a0e7]: (no justification provided) | 
  [production] | 
            
  | 02:19 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@ed2243c]: (no justification provided) (duration: 01m 50s) | 
  [production] | 
            
  | 02:17 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@ed2243c]: (no justification provided) | 
  [production] | 
            
  | 01:49 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@accbbd1]: (no justification provided) (duration: 01m 55s) | 
  [production] | 
            
  | 01:47 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@accbbd1]: (no justification provided) | 
  [production] | 
            
  | 01:44 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@accbbd1]: (no justification provided) (duration: 01m 47s) | 
  [production] | 
            
  | 01:43 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@accbbd1]: (no justification provided) | 
  [production] | 
            
  | 01:40 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@accbbd1]: (no justification provided) (duration: 01m 49s) | 
  [production] | 
            
  | 01:38 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@accbbd1]: (no justification provided) | 
  [production] | 
            
  | 01:37 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@accbbd1]: (no justification provided) (duration: 00m 07s) | 
  [production] | 
            
  | 01:36 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@accbbd1]: (no justification provided) | 
  [production] | 
            
  | 01:16 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@accbbd1]: (no justification provided) (duration: 01m 53s) | 
  [production] | 
            
  | 01:14 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@accbbd1]: (no justification provided) | 
  [production] | 
            
  | 01:11 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@841693b]: (no justification provided) (duration: 01m 48s) | 
  [production] | 
            
  | 01:09 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@841693b]: (no justification provided) | 
  [production] |