| 2018-01-11
      
      § | 
    
  | 22:35 | <ottomata> | restarting kafka-jumbo brokers to apply https://gerrit.wikimedia.org/r/403774 | [production] | 
            
  | 22:04 | <ottomata> | restarting kafka-jumbo brokers to apply https://gerrit.wikimedia.org/r/#/c/403762/ | [production] | 
            
  | 20:57 | <ottomata> | restarting kafka-jumbo brokers to apply https://gerrit.wikimedia.org/r/#/c/403753/ | [production] | 
            
  | 20:52 | <andrewbogott> | rebooting labvirt1003 | [production] | 
            
  | 20:12 | <twentyafterfour@tin> | rebuilt and synchronized wikiversions files: Rollback group1 to wmf.15 due to T184749 refs T180749 | [production] | 
            
  | 20:12 | <andrewbogott> | rebooting labvirt1017 for kernel upgrade | [production] | 
            
  | 20:04 | <catrope@tin> | Finished scap: SWAT (duration: 30m 12s) | [production] | 
            
  | 19:58 | <gehel> | elasticsearch / cirrus / codfw rolling reboot completed. Cluster still recovering | [production] | 
            
  | 19:34 | <catrope@tin> | Started scap: SWAT | [production] | 
            
  | 19:20 | <catrope@tin> | Synchronized php-1.31.0-wmf.16/includes/: Deprecate old interwiki search result widget (duration: 02m 17s) | [production] | 
            
  | 19:09 | <catrope@tin> | Synchronized php-1.31.0-wmf.16/extensions/Flow/modules/styles/flow/widgets/editor/mw.flow.ui.EditorWidget.less: T184631 (duration: 01m 22s) | [production] | 
            
  | 18:06 | <ema> | lvs4007: upgrade to latest jessie point release (8.10) T182656 and linux kernel 4.9.65-3+deb9u1~bpo8+2 (KPTI) T184267 | [production] | 
            
  | 18:00 | <jynus> | upgrade and restart db1102- it may add some minutes of lag to some wikis on wikireplicas | [production] | 
            
  | 17:32 | <jynus> | shutting down db1059 for maintenance | [production] | 
            
  | 16:57 | <akosiaris> | upgrade apertium on scb100* nodes done | [production] | 
            
  | 16:55 | <godog> | start rolling restart of restbase-test / restbase-dev cluster | [production] | 
            
  | 16:54 | <jynus> | upgrade and restart db1095- it may add some minutes of lag to some wikis on wikireplicas | [production] | 
            
  | 16:39 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Fully repool db1099:3311 (duration: 01m 22s) | [production] | 
            
  | 16:28 | <moritzm> | rebooting mwlog2001 for kernel security update | [production] | 
            
  | 16:19 | <moritzm> | rebooting mwlog1001 for kernel security update | [production] | 
            
  | 16:05 | <moritzm> | rebooting notebook1001 for kernel security update | [production] | 
            
  | 16:05 | <akosiaris> | upgrade apertium on scb200* nodes | [production] | 
            
  | 15:59 | <moritzm> | reboot lithium for kernel security update | [production] | 
            
  | 15:51 | <moritzm> | reboot oxygen for kernel security update | [production] | 
            
  | 15:43 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase db1099:3311 weight (duration: 01m 21s) | [production] | 
            
  | 15:28 | <moritzm> | reboot ruthenium for kernel security update | [production] | 
            
  | 15:26 | <filippo@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=ms-fe1008.eqiad.wmnet | [production] | 
            
  | 15:18 | <akosiaris> | clear trusty-wikimedia from apertium packages. The apertium services is a long time now on jessie and all users should have migrated by now. If not, they should | [production] | 
            
  | 15:15 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase db1099:3311 weight (duration: 01m 23s) | [production] | 
            
  | 15:08 | <filippo@puppetmaster1001> | conftool action : set/pooled=no; selector: name=ms-fe1008.eqiad.wmnet | [production] | 
            
  | 15:05 | <moritzm> | rolling reboot of prometheus in eqiad for kernel security update | [production] | 
            
  | 15:01 | <filippo@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=ms-fe1007.eqiad.wmnet | [production] | 
            
  | 14:58 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1067,db1099:3318,db1099:3311, depool db1066 (duration: 01m 19s) | [production] | 
            
  | 14:58 | <marostegui> | Upgrade mariadb and kernel on db1066 | [production] | 
            
  | 14:47 | <filippo@puppetmaster1001> | conftool action : set/pooled=no; selector: name=ms-fe1007.eqiad.wmnet | [production] | 
            
  | 14:47 | <godog> | continue swift frontend eqiad roll-restart, ms-fe1007 / ms-fe1008 | [production] | 
            
  | 14:45 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Promote db2040 as the new codfw-s7 master (duration: 01m 22s) | [production] | 
            
  | 14:40 | <moritzm> | rolling reboot of prometheus in codfw for kernel security update | [production] | 
            
  | 14:37 | <jmm@puppetmaster1001> | conftool action : set/pooled=inactive; selector: mw1271.eqiad.wmnet | [production] | 
            
  | 14:36 | <joal@tin> | Finished deploy [analytics/refinery@ed8ecbc]: Patching interlanguage link and manually add a jar to our collection (duration: 04m 10s) | [production] | 
            
  | 14:36 | <jynus> | running scap pull on mw1271 | [production] | 
            
  | 14:32 | <joal@tin> | Started deploy [analytics/refinery@ed8ecbc]: Patching interlanguage link and manually add a jar to our collection | [production] | 
            
  | 14:26 | <moritzm> | powercycling mw1271 | [production] |