| 2018-02-28
      
      § | 
    
  | 18:32 | <godog> | puppet reenable on einsteinium | [production] | 
            
  | 18:30 | <niharika29@tin> | Synchronized wmf-config/Wikibase-production.php: Enable reading from full term entity id everywhere T114903 (duration: 00m 57s) | [production] | 
            
  | 18:23 | <niharika29@tin> | Synchronized wmf-config/Wikibase-production.php: Enable Wikibase RC injection for ruwiki [mediawiki-config] - https://gerrit.wikimedia.org/r/415078 (duration: 00m 57s) | [production] | 
            
  | 18:19 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Deploy Compact Language Links out of Beta on English Wikipedia T187677 (duration: 00m 58s) | [production] | 
            
  | 18:17 | <mutante> | gerrit2001 - reboot for kernel upgrade | [production] | 
            
  | 18:12 | <godog> | force a puppet run on failed hosts in eqiad for recovery | [production] | 
            
  | 18:09 | <apergos> | rebooting dataset1001 (dumps.wm.o) for new kernel | [production] | 
            
  | 18:06 | <godog> | stop and restart apache2 on puppetmaster1002 | [production] | 
            
  | 17:58 | <godog> | restart apache2 on puppetmaster1002 | [production] | 
            
  | 17:46 | <milimetric@tin> | Finished deploy [analytics/refinery@e551744]: Update sqoop job and orm artifact (duration: 06m 45s) | [production] | 
            
  | 17:46 | <kart_> | Finished running CLL preference migration script on terbium (T187677) | [production] | 
            
  | 17:39 | <milimetric@tin> | Started deploy [analytics/refinery@e551744]: Update sqoop job and orm artifact | [production] | 
            
  | 17:38 | <mutante> | phab2001 - downtimed, rebooting for kernel upgrade | [production] | 
            
  | 16:44 | <moritzm> | draining restbase2008 for eventual reboot for kernel security update | [production] | 
            
  | 16:10 | <moritzm> | rebooting prometheus servers in codfw for kernel security update | [production] | 
            
  | 16:10 | <ppchelko@tin> | Finished deploy [cpjobqueue/deploy@3622e38]: Enable refreshLinks for all but wikipedia,  wiktionary and commons (duration: 00m 41s) | [production] | 
            
  | 16:09 | <ppchelko@tin> | Started deploy [cpjobqueue/deploy@3622e38]: Enable refreshLinks for all but wikipedia,  wiktionary and commons | [production] | 
            
  | 16:02 | <moritzm> | draining restbase2007 for eventual reboot for kernel security update | [production] | 
            
  | 15:45 | <godog> | repool rhodium as puppet master backend | [production] | 
            
  | 15:22 | <moritzm> | rebooting ores in eqiad for kernel security update | [production] | 
            
  | 15:22 | <ema> | upgrade cache_text@eqiad to varnish 5 | [production] | 
            
  | 15:20 | <moritzm> | draining restbase2006 for eventual reboot for kernel security update | [production] | 
            
  | 15:16 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 15:15 | <zfilipin@tin> | Synchronized php-1.31.0-wmf.23/extensions/WikibaseQualityConstraints/: SWAT: [[gerrit:415288|Don’t query WikiPageEntityMetaDataAccessor with empty list (T188311)]] [[gerrit:415290|Bump cache key for check results (T188384)]] (duration: 01m 02s) | [production] | 
            
  | 15:11 | <zfilipin@tin> | Synchronized php-1.31.0-wmf.22/extensions/WikibaseQualityConstraints: SWAT: [[gerrit:415289|Bump cache key for check results (T188384)]] (duration: 01m 02s) | [production] | 
            
  | 14:54 | <moritzm> | rebooting ores in codfw for kernel security update | [production] | 
            
  | 14:53 | <jynus> | stopping labsdb1011 to clone it to labsdb1010 T186579 | [production] | 
            
  | 14:50 | <zfilipin@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:404942|Drop the medlem user group and editallpages user right (T184981)]] (duration: 00m 57s) | [production] | 
            
  | 14:48 | <zfilipin@tin> | Synchronized php-1.31.0-wmf.22/extensions/WikibaseQualityConstraints: SWAT: [[gerrit:415287|Don’t query WikiPageEntityMetaDataAccessor with empty list (T188311)]] (duration: 01m 02s) | [production] | 
            
  | 14:47 | <zfilipin@tin> | Synchronized php-1.31.0-wmf.22/extensions/WikibaseQualityConstraints/: SWAT: [[gerrit:415285|Only filter statuses after collecting metadata (T188384)]] (duration: 01m 03s) | [production] | 
            
  | 14:38 | <jynus> | dropping sqldata on dbstore1001 | [production] | 
            
  | 14:32 | <zfilipin@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:414751|Enable HTML Previews on all wikipedias (T182319)]] (duration: 00m 57s) | [production] | 
            
  | 14:28 | <moritzm> | rebooting kubestage* for kernel security update | [production] | 
            
  | 14:25 | <gehel@tin> | Finished deploy [tilerator/deploy@455a31a]: adding Brighmed, Meddo and ClearTables to tilerator (duration: 04m 27s) | [production] | 
            
  | 14:22 | <moritzm> | draining restbase2005 for eventual reboot for kernel security update | [production] | 
            
  | 14:21 | <gehel@tin> | Started deploy [tilerator/deploy@455a31a]: adding Brighmed, Meddo and ClearTables to tilerator | [production] | 
            
  | 14:17 | <zfilipin@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:414769|beta: enable VirtualPagePreviews events on beta cluster (T184793 T186728)]] (duration: 00m 57s) | [production] | 
            
  | 13:13 | <moritzm> | draining restbase2004 for eventual reboot for kernel security update | [production] | 
            
  | 12:44 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Remove db2011 - T187886 (duration: 00m 59s) | [production] | 
            
  | 12:42 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Remove db2011 - T187886 (duration: 00m 58s) | [production] | 
            
  | 12:35 | <moritzm> | draining restbase2003 for eventual reboot for kernel security update | [production] | 
            
  | 12:00 | <marostegui> | Reboot db1115 tendril master to pick up new my.cnf options - T184704 | [production] | 
            
  | 11:49 | <moritzm> | draining restbase2002 for eventual reboot for kernel security update | [production] | 
            
  | 11:37 | <marostegui> | Reset slave all on db2093 - T184704 | [production] | 
            
  | 11:35 | <moritzm> | rebooting eqiad job runners for kernel security update | [production] | 
            
  | 11:18 | <moritzm> | powercycling restbase2001, stuck in reboot | [production] | 
            
  | 11:10 | <godog> | rollout thumbor 1.15 to codfw/eqiad | [production] | 
            
  | 10:59 | <godog> | upload python-thumbor-wikimedia 1.15 - T187822 T187350 | [production] | 
            
  | 10:59 | <oblivian@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=mw1261.eqiad.wmnet | [production] | 
            
  | 10:54 | <moritzm> | draining restbase2001 for eventual reboot for kernel security update | [production] |