| 2016-10-20
      
      § | 
    
  | 09:16 | <apergos> | restarts of mw2075,6,7 done, starting rolling restarts shortly of 8,9, 2120-2147 | [production] | 
            
  | 08:57 | <akosiaris> | rebooting wtp10{02,06,12,13,17,22} for kernel upgrade | [production] | 
            
  | 08:57 | <elukey> | rebooting eventlog2001 for kernel upgrades (EL spare host) | [production] | 
            
  | 08:54 | <elukey> | rebooting eventlog1001 for kernel upgrades (Eventlogging host) | [production] | 
            
  | 08:53 | <moritzm> | rebooting bast4001 for kernel update | [production] | 
            
  | 08:49 | <moritzm> | rebooting restbase-test* for kernel upgrade | [production] | 
            
  | 08:43 | <akosiaris> | rebooting wtp10{01,03,04,05,18,23} for kernel upgrade | [production] | 
            
  | 08:34 | <akosiaris> | rebooting wtp10{07,08,09,10,19,24} for kernel upgrade | [production] | 
            
  | 08:32 | <elukey> | rebooting aqs100[456] for kernel upgrades (one at the time, de-pool/reboot/pool) | [production] | 
            
  | 08:31 | <elukey> | rebooting aqs100[123] for kernel upgrades (one at the time, de-pool/reboot/pool) | [production] | 
            
  | 08:25 | <akosiaris> | rebooting wtp10{10,14,15,16,20,21} for kernel upgrade | [production] | 
            
  | 08:19 | <akosiaris> | reboot the rest of the wtp20XX hosts for kernel upgrade | [production] | 
            
  | 08:15 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: wtp2019.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) | [production] | 
            
  | 08:10 | <akosiaris> | reboot wtp20{03,05,08,09,12,15,17,18,20} for kernel upgrade | [production] | 
            
  | 08:09 | <mobrovac> | change-prop deploying 3a11886 | [production] | 
            
  | 07:52 | <moritzm> | rebooting bast3001 for kernel update | [production] | 
            
  | 07:51 | <gehel> | start of elasticsearch codfw rolling restart | [production] | 
            
  | 07:32 | <moritzm> | rebooting snapshot1001 for kernel update | [production] | 
            
  | 07:27 | <moritzm> | rebooting snapshot1005-1007 for kernel update | [production] | 
            
  | 07:17 | <LinedweII> | AlexZ vale mierda | [production] | 
            
  | 07:17 | <LinedweII> | J O I N #wikipedia-es | [production] | 
            
  | 06:01 | <Ajraddatz> | AlvaroMolina loves AlexZ_ | [production] | 
            
  | 05:43 | <CarlosMorales> | AlvaroMolina loves AlexZ_ | [production] | 
            
  | 02:16 | <Krenair> | test | [production] | 
            
  | 01:17 | <legoktm@mira> | Synchronized wmf-config/InitialiseSettings.php: Revert Enable AbuseFilterCachingParser by default - T148673 (duration: 00m 51s) | [production] | 
            
  | 00:23 | <bblack> | restarting pybal on lvs1002 for new recdns IP | [production] | 
            
  
    | 2016-10-19
      
      § | 
    
  | 23:58 | <krenair@mira> | Synchronized php-1.28.0-wmf.22/extensions/OpenStackManager: https://gerrit.wikimedia.org/r/#/c/316909/ (duration: 01m 00s) | [production] | 
            
  | 23:41 | <mutante> | Host mw1239 is not in mediawiki-installation dsh group | [production] | 
            
  | 23:35 | <dereckson@mira> | Synchronized wmf-config/InitialiseSettings.php: Reverting votewiki back to English (T148352) (duration: 00m 50s) | [production] | 
            
  | 23:20 | <dereckson@mira> | Synchronized wmf-config/InitialiseSettings.php: Switching 10 more wikis to numeric category collation (T146675) (duration: 00m 59s) | [production] | 
            
  | 21:02 | <bearND> | deployed mobileapps 2551db4 | [production] | 
            
  | 20:59 | <bearND> | starting mobileapps deploy | [production] | 
            
  | 20:11 | <demon@mira> | Synchronized docroot/mediawiki/keys/: adding tylers key (duration: 01m 09s) | [production] | 
            
  | 20:04 | <ejegg> | disabled CiviCRM generic dedupe job | [production] | 
            
  | 20:00 | <ejegg> | enabled CiviCRM major gifts dedupe | [production] | 
            
  | 19:56 | <bblack> | installing new kernel packages on lvs:primary | [production] | 
            
  | 19:30 | <bblack> | upgrading nginx+openssl on remaining cache nodes (eqiad+esams/text+upload) - T144523 | [production] | 
            
  | 19:26 | <bblack> | installing new kernel packages on lvs:secondary | [production] | 
            
  | 19:26 | <bblack> | installing new kernel packages on authdns | [production] | 
            
  | 19:18 | <bblack> | installing new kernel packages on cp* | [production] | 
            
  | 18:33 | <bblack> | restarting stuck Jenkins | [production] | 
            
  | 18:02 | <urandom> | T133395: RESTBase: Altering keyspace local_group_wikipedia_T_parsoid_html.data to enable time-window compaction | [production] | 
            
  | 17:41 | <ori@mira> | Synchronized wmf-config/InitialiseSettings.php: I6d28e534: Disable AbuseFilterCachingParser on bgwiki (T148660) (duration: 00m 50s) | [production] | 
            
  | 17:34 | <moritzm> | rebooting xenon/cerium/praseodymium to new kernels | [production] | 
            
  | 17:33 | <bblack> | cp1008 / pinkunicorn reboot | [production] | 
            
  | 17:30 | <ori@mira> | Synchronized wmf-config/InitialiseSettings.php: Ieb8cdab9: Enable AbuseFilterCachingParser by default (duration: 01m 01s) | [production] | 
            
  | 17:15 | <elukey> | depooled mw1239.eqiad.wmnet to allow hw investigation (T148421) (was done today but didn't logged properly) | [production] | 
            
  | 16:54 | <Zppix|mobile> | 15:58 <mark> Issuing secure erase on cp3021 sdb | [production] | 
            
  | 16:36 | <bblack> | depooling cp3009 (esams cache_misc), possible HW issues | [production] | 
            
  | 16:30 | <bblack> | depooling cp3009 (esams cache_misc), possible HW issues | [production] |