| 2017-07-13
      
      § | 
    
  | 14:49 | <marostegui> | Skip maiwikimedia database creation which is breaking dbstore2001 replication - T168788 | [production] | 
            
  | 14:42 | <godog> | roll-restart cassandra in services-test to pick up renewed certs | [production] | 
            
  | 14:21 | <marostegui> | Run redact_sanitarium on db1069 and db1095 for maiwikimedia - T168788 | [production] | 
            
  | 14:19 | <Reedy> | `mwscript extensions/WikimediaMaintenance/createExtensionTables.php --wiki=maiwikimedia Translate` for T168782 | [production] | 
            
  | 14:13 | <moritzm> | rebooting graphite1* for kernel update | [production] | 
            
  | 13:11 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 13:09 | <zfilipin@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:364983|Add enwiki as import source for specieswiki (T170094)]] (duration: 00m 47s) | [production] | 
            
  | 12:52 | <moritzm> | installing nginx security updates on cp1* | [production] | 
            
  | 12:12 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1053 - T168661 (duration: 01m 03s) | [production] | 
            
  | 11:40 | <akosiaris> | stop ircecho, icinga is misbehaving badly, no point it having it around | [production] | 
            
  | 11:28 | <akosiaris> | restart icinga, it's reporting wrong stuff all over the place | [production] | 
            
  | 10:35 | <moritzm> | installing nginx security updates on cp3* | [production] | 
            
  | 10:09 | <moritzm> | rebooting graphite2* for kernel update | [production] | 
            
  | 10:04 | <ema> | lvs[12]006: upgrade pybal to 1.13.9 T82747 T154759 | [production] | 
            
  | 09:43 | <ema> | lvs1010: upgrade pybal to 1.13.9 T82747 T154759 | [production] | 
            
  | 09:41 | <ema> | pybal 1.13.9 uploaded to apt.w.o | [production] | 
            
  | 09:21 | <moritzm> | installing nginx security updates on cp2* | [production] | 
            
  | 08:32 | <moritzm> | enabling jobrunner/jobchron on mw1260 (jessie video scaler) | [production] | 
            
  | 08:19 | <godog> | upgrade grafana to 4.4.1 on krypton - T169773 | [production] | 
            
  | 08:11 | <jynus> | powercycle pc2006, was down | [production] | 
            
  | 08:09 | <jmm@puppetmaster1001> | conftool action : set/pooled=yes; selector: mw1260.eqiad.wmnet | [production] | 
            
  | 07:58 | <marostegui> | Deploy alter table on s4 - db1053 - T168661 | [production] | 
            
  | 07:48 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1053 - T168661 (duration: 00m 47s) | [production] | 
            
  | 07:33 | <moritzm> | rebooting netmon1001 | [production] | 
            
  | 06:57 | <moritzm> | installing apache security updates on remaining mw1* hosts | [production] | 
            
  | 06:51 | <moritzm> | installing nginx security updates on cp4* | [production] | 
            
  | 06:51 | <marostegui> | Manually deploy some alter tables on dbstore1001 for enwiki - T166204 | [production] | 
            
  | 06:42 | <_joe_> | rolling restart of pybal on low-traffic balancers | [production] | 
            
  | 06:14 | <XioNoX> | restricting ssh algorithms on network devices - T170369 | [production] | 
            
  | 06:11 | <moritzm> | fixed salt setup for reimaged stat1006 | [production] | 
            
  | 03:09 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Thu Jul 13 03:09:35 UTC 2017 (duration 7m 8s) | [production] | 
            
  | 03:02 | <l10nupdate@tin> | scap sync-l10n completed (1.30.0-wmf.9) (duration: 07m 57s) | [production] | 
            
  | 02:34 | <l10nupdate@tin> | scap sync-l10n completed (1.30.0-wmf.7) (duration: 09m 54s) | [production] | 
            
  | 02:26 | <mutante> | labtestpuppetmaster2001 - flapping icinga alerts about salt-minion starting and stopping constantly - there is an accepted salt-key but it was rejected by the master, server was reinstalled but still old key - deleted old key, accepted new key (T167157) | [production] | 
            
  
    | 2017-07-12
      
      § | 
    
  | 23:28 | <thcipriani@tin> | Synchronized php-1.30.0-wmf.9/extensions/CirrusSearch/resources/ext.cirrus.explore-similar.js: SWAT: [[gerrit:364834|Adding full URLs to Explore Similar API calls]] T149809 T164856 (duration: 00m 47s) | [production] | 
            
  | 23:08 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:363669|Index deletes everywhere]] T163235 (duration: 00m 47s) | [production] | 
            
  | 22:08 | <mobrovac@tin> | Finished deploy [recommendation-api/deploy@d5076c2]: (no justification provided) (duration: 01m 50s) | [production] | 
            
  | 22:06 | <mobrovac@tin> | Started deploy [recommendation-api/deploy@d5076c2]: (no justification provided) | [production] | 
            
  | 21:54 | <andrewbogott> | restarting nodepool to pick up a config change | [production] | 
            
  | 21:42 | <mobrovac@tin> | Finished deploy [recommendation-api/deploy@ca816ac]: (no justification provided) (duration: 02m 24s) | [production] | 
            
  | 21:40 | <mobrovac@tin> | Started deploy [recommendation-api/deploy@ca816ac]: (no justification provided) | [production] | 
            
  | 21:29 | <demon@tin> | Synchronized wmf-config/mobile.php: MinervaNeue config (duration: 00m 46s) | [production] | 
            
  | 21:28 | <demon@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: MinervaNeue config (duration: 00m 46s) | [production] | 
            
  | 21:27 | <demon@tin> | Synchronized wmf-config/InitialiseSettings.php: MinervaNeue config (duration: 00m 47s) | [production] | 
            
  | 21:22 | <demon@tin> | Finished scap: Rebuilding l10n cache for new skin (duration: 38m 47s) | [production] | 
            
  | 20:43 | <demon@tin> | Started scap: Rebuilding l10n cache for new skin | [production] | 
            
  | 20:16 | <bsitzmann@tin> | Finished deploy [mobileapps/deploy@3f90bf1]: Update mobileapps to d30dae2 (T169930, T170225) (duration: 05m 00s) | [production] | 
            
  | 20:11 | <bsitzmann@tin> | Started deploy [mobileapps/deploy@3f90bf1]: Update mobileapps to d30dae2 (T169930, T170225) | [production] | 
            
  | 19:37 | <XioNoX> | adding ignore-l3-incompletes to all peering/transit interfaces - T163542 | [production] | 
            
  | 19:27 | <thcipriani@tin> | Synchronized php: promote php symlink group1 wikis to 1.30.0-wmf.9 (duration: 00m 45s) | [production] |