| 2019-12-09
      
      § | 
    
  | 17:08 | <brennen@deploy1001> | rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.8 | [production] | 
            
  | 17:03 | <brennen> | attempting to roll 1.35.0-wmf.8 forward to group1 | [production] | 
            
  | 15:57 | <moritzm> | installing openslp security updates | [production] | 
            
  | 15:40 | <jiji@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 15:37 | <jiji@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 15:09 | <elukey> | upload prometheus-memcached-exporter 0.6.0+git20191209.bac8a8c-1 to buster-wikimedia | [production] | 
            
  | 15:01 | <jiji@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 14:58 | <jiji@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 14:34 | <ladsgroup@deploy1001> | Synchronized php-1.35.0-wmf.5/extensions/Wikibase/repo/includes/ParserOutput/FullEntityParserOutputGenerator.php: T229407, clean up debugging info (duration: 00m 59s) | [production] | 
            
  | 14:26 | <ladsgroup@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: [[gerrit:555941|Disable sanity check cirrus jobs for Wikidata (T239931 T229407)]] (duration: 00m 57s) | [production] | 
            
  | 14:15 | <jiji@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 14:13 | <jiji@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 13:55 | <effie> | reimage mw2270.codfw.wmnet mw2269.codfw.wmnet mw2268.codfw.wmnet | [production] | 
            
  | 11:36 | <jdrewniak@deploy1001> | Synchronized portals: Wikimedia Portals Update: [[gerrit:555907| Bumping portals to master (T128546)]] (duration: 01m 00s) | [production] | 
            
  | 11:35 | <jdrewniak@deploy1001> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:555907| Bumping portals to master (T128546)]] (duration: 01m 23s) | [production] | 
            
  | 10:46 | <addshore> | T239470 addshore@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildItemTerms.php --wiki wikidatawiki --from-id=10000007 --to-id=10000007 | [production] | 
            
  | 10:06 | <rlazarus> | rolling restart php-fpm in mw-eqiad due to APCu fragmentation | [production] | 
            
  | 08:58 | <oblivian@cumin1001> | conftool action : set/weight=10; selector: service=parsoid-php | [production] | 
            
  | 08:49 | <kart_> | Updated cxserver to 2019-12-05-090549-production (T217585, T230195) | [production] | 
            
  | 08:46 | <kartik@deploy1001> | helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . | [production] | 
            
  | 08:41 | <kartik@deploy1001> | helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . | [production] | 
            
  | 08:39 | <kartik@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . | [production] | 
            
  | 08:33 | <elukey> | powercycle mw1280, mgmt console stuck, dimm errors in getsel | [production] | 
            
  | 08:24 | <ema> | cp3064: ats-tls-restart to clear "tls process restarted" alert T240183 | [production] | 
            
  | 07:44 | <onimisionipe> | resetting cron on wdqs1010 to fix cronspam | [production] | 
            
  | 04:05 | <andrew@deploy1001> | Finished deploy [horizon/deploy@9847a28]: (no justification provided) (duration: 03m 37s) | [production] | 
            
  | 04:01 | <andrew@deploy1001> | Started deploy [horizon/deploy@9847a28]: (no justification provided) | [production] | 
            
  | 03:54 | <andrew@deploy1001> | Finished deploy [horizon/deploy@d1cba62]: (no justification provided) (duration: 01m 51s) | [production] | 
            
  | 03:52 | <andrew@deploy1001> | Started deploy [horizon/deploy@d1cba62]: (no justification provided) | [production] | 
            
  
    | 2019-12-08
      
      § | 
    
  | 20:40 | <ejegg> | disabled Ingenico Connect recurring charge job | [production] | 
            
  | 02:58 | <andrew@deploy1001> | Finished deploy [horizon/deploy@ff0a0e7]: (no justification provided) (duration: 01m 53s) | [production] | 
            
  | 02:56 | <andrew@deploy1001> | Started deploy [horizon/deploy@ff0a0e7]: (no justification provided) | [production] | 
            
  | 02:19 | <andrew@deploy1001> | Finished deploy [horizon/deploy@ed2243c]: (no justification provided) (duration: 01m 50s) | [production] | 
            
  | 02:17 | <andrew@deploy1001> | Started deploy [horizon/deploy@ed2243c]: (no justification provided) | [production] | 
            
  | 01:49 | <andrew@deploy1001> | Finished deploy [horizon/deploy@accbbd1]: (no justification provided) (duration: 01m 55s) | [production] | 
            
  | 01:47 | <andrew@deploy1001> | Started deploy [horizon/deploy@accbbd1]: (no justification provided) | [production] | 
            
  | 01:44 | <andrew@deploy1001> | Finished deploy [horizon/deploy@accbbd1]: (no justification provided) (duration: 01m 47s) | [production] | 
            
  | 01:43 | <andrew@deploy1001> | Started deploy [horizon/deploy@accbbd1]: (no justification provided) | [production] | 
            
  | 01:40 | <andrew@deploy1001> | Finished deploy [horizon/deploy@accbbd1]: (no justification provided) (duration: 01m 49s) | [production] | 
            
  | 01:38 | <andrew@deploy1001> | Started deploy [horizon/deploy@accbbd1]: (no justification provided) | [production] | 
            
  | 01:37 | <andrew@deploy1001> | Finished deploy [horizon/deploy@accbbd1]: (no justification provided) (duration: 00m 07s) | [production] | 
            
  | 01:36 | <andrew@deploy1001> | Started deploy [horizon/deploy@accbbd1]: (no justification provided) | [production] | 
            
  | 01:16 | <andrew@deploy1001> | Finished deploy [horizon/deploy@accbbd1]: (no justification provided) (duration: 01m 53s) | [production] | 
            
  | 01:14 | <andrew@deploy1001> | Started deploy [horizon/deploy@accbbd1]: (no justification provided) | [production] | 
            
  | 01:11 | <andrew@deploy1001> | Finished deploy [horizon/deploy@841693b]: (no justification provided) (duration: 01m 48s) | [production] | 
            
  | 01:09 | <andrew@deploy1001> | Started deploy [horizon/deploy@841693b]: (no justification provided) | [production] |