| 
      
        2016-10-05
      
      ยง
     | 
  
    
  | 18:51 | 
  <awight> | 
  update fundraising CRM from 5f53ef867cf3c2bb2f919c2feb9323eededfb7e7 to d52c04db4de38d3961661d719b462d27f44c831c | 
  [production] | 
            
  | 18:46 | 
  <urandom> | 
  T146211: Performing rolling restart of RESTBase eqiad rack 'd' Cassandra instances, and marking SSTables unrepaired. | 
  [production] | 
            
  | 18:39 | 
  <demon@tin> | 
  Synchronized wmf-config/CommonSettings.php: disable gzip internally, T125938 (duration: 00m 50s) | 
  [production] | 
            
  | 18:25 | 
  <demon@tin> | 
  Synchronized php-1.28.0-wmf.21/extensions/TimedMediaHandler/: fix fatal (duration: 00m 54s) | 
  [production] | 
            
  | 18:18 | 
  <XenoRyet> | 
  updated civicrm from 412d999b671e13982d718437ab3be56efaa25baf to 5f53ef867cf3c2bb2f919c2feb9323eededfb7e7 | 
  [production] | 
            
  | 18:17 | 
  <urandom> | 
  T146211: Performing rolling restart of RESTBase rack 'b' Cassandra instances, and marking SSTables unrepaired. | 
  [production] | 
            
  | 17:58 | 
  <urandom> | 
  T146211: Performing rolling restart of restbase1011.eqiad.wmnet Cassandra instances, and marking SSTables unrepaired. | 
  [production] | 
            
  | 17:35 | 
  <moritzm> | 
  installing chromium security updates on osmium | 
  [production] | 
            
  | 17:31 | 
  <urandom> | 
  T146211: Performing rolling restart of restbase1010.eqiad.wmnet Cassandra instances, and marking SSTables unrepaired. | 
  [production] | 
            
  | 17:23 | 
  <moritzm> | 
  installing libav security updates | 
  [production] | 
            
  | 16:35 | 
  <legoktm@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Don't grant editcontentmodel to all users yet (duration: 01m 01s) | 
  [production] | 
            
  | 16:28 | 
  <godog> | 
  upgrade mysqld_exporter to 0.9.0 on db2030 T147476 | 
  [production] | 
            
  | 15:54 | 
  <urandom> | 
  T146211: Restarting Cassandra on restbase1007-c.eqiad.wmnet to mark parsoid.data-parsoid tables unrepaired | 
  [production] | 
            
  | 15:48 | 
  <urandom> | 
  T146211: Restarting Cassandra on restbase1007-b.eqiad.wmnet to mark parsoid.data-parsoid tables unrepaired | 
  [production] | 
            
  | 15:44 | 
  <paravoid> | 
  upgrading JunOS on cr2-knams | 
  [production] | 
            
  | 15:39 | 
  <urandom> | 
  T146211: Restarting Cassandra on restbase1007-a.eqiad.wmnet to mark parsoid.data-parsoid tables unrepaired | 
  [production] | 
            
  | 15:38 | 
  <moritzm> | 
  restarted hhvm on mw1274, was stuck | 
  [production] | 
            
  | 15:35 | 
  <godog> | 
  reimage lithium with bigger disks T143307 | 
  [production] | 
            
  | 15:18 | 
  <paravoid> | 
  upgrading JunOS on cr1-esams | 
  [production] | 
            
  | 15:04 | 
  <godog> | 
  add lpxelinux.0 to volatile/tftpboot on puppet.eqiad.wmnet | 
  [production] | 
            
  | 14:33 | 
  <gehel@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: dc=codfw,cluster=wdqs,service=wdqs | 
  [production] | 
            
  | 14:32 | 
  <gehel@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: dc=eqiad,cluster=wdqs,service=wdqs | 
  [production] | 
            
  | 14:27 | 
  <gehel> | 
  restarting pybal on lvs1003 - T132457 | 
  [production] | 
            
  | 14:25 | 
  <cmjohnson1> | 
  db1055 replacing disk slot 0  | 
  [production] | 
            
  | 14:22 | 
  <gehel> | 
  restarting pybal on lvs1006 - T132457 | 
  [production] | 
            
  | 14:18 | 
  <gehel> | 
  restarting pybal on lvs1003 - T132457 | 
  [production] | 
            
  | 14:17 | 
  <bblack> | 
  rebooting baham (ns1.wikimedia.org) | 
  [production] | 
            
  | 14:17 | 
  <gehel> | 
  restarting pybal on lvs1012 - T132457 | 
  [production] | 
            
  | 14:15 | 
  <gehel> | 
  restarting pybal on lvs1009 - T132457 | 
  [production] | 
            
  | 14:11 | 
  <gehel> | 
  restarting pybal on lvs1006 - T132457 | 
  [production] | 
            
  | 14:02 | 
  <bblack> | 
  rebooting eeden (ns2.wikimedia.org) | 
  [production] | 
            
  | 13:57 | 
  <paravoid> | 
  upgrading JunOS on cr1-ulsfo | 
  [production] | 
            
  | 13:47 | 
  <elukey> | 
  adding mw120[67] back to the api appservers live pool after reimage | 
  [production] | 
            
  | 13:46 | 
  <gehel> | 
  deploying new LVS configuration for WDQS service - T132457 | 
  [production] | 
            
  | 13:42 | 
  <moritzm> | 
  upgrading neodymium to Linux 4.4 | 
  [production] | 
            
  | 13:32 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: wmf-config/db-codfw.php Remove db1019 entries as it is going to be decommissioned - T146265 (duration: 00m 49s) | 
  [production] | 
            
  | 13:32 | 
  <paravoid> | 
  upgrading JunOS on cr2-ulsfo (attempt 2) | 
  [production] | 
            
  | 13:17 | 
  <bblack> | 
  upgrading kernel packages on cp* cache hosts (no reboots yet) | 
  [production] | 
            
  | 13:07 | 
  <paravoid> | 
  upgrading JunOS on cr2-ulsfo | 
  [production] | 
            
  | 12:50 | 
  <marostegui> | 
  dropping views jamwiki_p.abuse_filter_history drop view adywiki_p.abuse_filter_history - T147413 | 
  [production] | 
            
  | 12:14 | 
  <reedy@tin> | 
  Synchronized php-1.28.0-wmf.21/extensions/UserMerge: Fix fatal when using special page (duration: 00m 50s) | 
  [production] | 
            
  | 12:10 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: scb2001.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=apertium']) | 
  [production] | 
            
  | 11:44 | 
  <elukey> | 
  reimaging mw120[67] to Debian Jessie | 
  [production] | 
            
  | 11:23 | 
  <moritzm> | 
  reimaging mw1184-mw1186 to jessie | 
  [production] | 
            
  | 10:41 | 
  <moritzm> | 
  reimaging mw1181-mw1183 to jessie | 
  [production] | 
            
  | 10:29 | 
  <elukey> | 
  adding mw120[01] back to the mw api live pool after reimage | 
  [production] | 
            
  | 10:18 | 
  <kart_> | 
  Update cxserver to 0b2c3fa (T144588) | 
  [production] | 
            
  | 10:12 | 
  <godog> | 
  reimage bast3001 with /srv partition scheme | 
  [production] | 
            
  | 10:05 | 
  <akosiaris> | 
  restart pybal on lvs1003, lvs2003 T147288 | 
  [production] | 
            
  | 09:43 | 
  <akosiaris> | 
  restart pybal on lvs1006, lvs1009, lvs1012, lvs2006 T147288 | 
  [production] |