| 2018-01-12
      
      § | 
    
  | 08:14 | <moritzm> | reboot video scalers in codfw for kernel security update | [production] | 
            
  | 07:42 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1105:3312 with low weight (duration: 01m 22s) | [production] | 
            
  | 07:01 | <marostegui> | Stop replication in sync db1089 db1105:3311 - T162807 | [production] | 
            
  | 06:46 | <marostegui> | Update mariadb and kernel on db1105 - T184256 | [production] | 
            
  | 06:46 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1105:3311, db1105:3312 - T162807 T184256 (duration: 01m 22s) | [production] | 
            
  | 06:24 | <marostegui> | Deploy schema change on db1100 - T174569 | [production] | 
            
  | 06:24 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1100 - T174569 (duration: 01m 22s) | [production] | 
            
  | 00:51 | <thcipriani@tin> | Synchronized php-1.31.0-wmf.15/extensions/WikibaseQualityConstraints/extension.json: SWAT: [[gerrit:403850|Declare dependency on jquery.makeCollapsible]] (duration: 01m 21s) | [production] | 
            
  | 00:43 | <thcipriani@tin> | Synchronized php-1.31.0-wmf.15/extensions/WikibaseQualityConstraints/modules/ui/ConstraintReportGroup.less: SWAT: [[gerrit:403845|Do not hide default [Expand] link]] (duration: 01m 22s) | [production] | 
            
  | 00:40 | <thcipriani@tin> | Synchronized php-1.31.0-wmf.16/extensions/WikibaseQualityConstraints/modules/ui/ConstraintReportGroup.less: SWAT: [[gerrit:403846|Do not hide default [Expand] link]] (duration: 01m 24s) | [production] | 
            
  
    | 2018-01-11
      
      § | 
    
  | 22:35 | <ottomata> | restarting kafka-jumbo brokers to apply https://gerrit.wikimedia.org/r/403774 | [production] | 
            
  | 22:04 | <ottomata> | restarting kafka-jumbo brokers to apply https://gerrit.wikimedia.org/r/#/c/403762/ | [production] | 
            
  | 20:57 | <ottomata> | restarting kafka-jumbo brokers to apply https://gerrit.wikimedia.org/r/#/c/403753/ | [production] | 
            
  | 20:52 | <andrewbogott> | rebooting labvirt1003 | [production] | 
            
  | 20:12 | <twentyafterfour@tin> | rebuilt and synchronized wikiversions files: Rollback group1 to wmf.15 due to T184749 refs T180749 | [production] | 
            
  | 20:12 | <andrewbogott> | rebooting labvirt1017 for kernel upgrade | [production] | 
            
  | 20:04 | <catrope@tin> | Finished scap: SWAT (duration: 30m 12s) | [production] | 
            
  | 19:58 | <gehel> | elasticsearch / cirrus / codfw rolling reboot completed. Cluster still recovering | [production] | 
            
  | 19:34 | <catrope@tin> | Started scap: SWAT | [production] | 
            
  | 19:20 | <catrope@tin> | Synchronized php-1.31.0-wmf.16/includes/: Deprecate old interwiki search result widget (duration: 02m 17s) | [production] | 
            
  | 19:09 | <catrope@tin> | Synchronized php-1.31.0-wmf.16/extensions/Flow/modules/styles/flow/widgets/editor/mw.flow.ui.EditorWidget.less: T184631 (duration: 01m 22s) | [production] | 
            
  | 18:06 | <ema> | lvs4007: upgrade to latest jessie point release (8.10) T182656 and linux kernel 4.9.65-3+deb9u1~bpo8+2 (KPTI) T184267 | [production] | 
            
  | 18:00 | <jynus> | upgrade and restart db1102- it may add some minutes of lag to some wikis on wikireplicas | [production] | 
            
  | 17:32 | <jynus> | shutting down db1059 for maintenance | [production] | 
            
  | 16:57 | <akosiaris> | upgrade apertium on scb100* nodes done | [production] | 
            
  | 16:55 | <godog> | start rolling restart of restbase-test / restbase-dev cluster | [production] | 
            
  | 16:54 | <jynus> | upgrade and restart db1095- it may add some minutes of lag to some wikis on wikireplicas | [production] | 
            
  | 16:39 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Fully repool db1099:3311 (duration: 01m 22s) | [production] | 
            
  | 16:28 | <moritzm> | rebooting mwlog2001 for kernel security update | [production] | 
            
  | 16:19 | <moritzm> | rebooting mwlog1001 for kernel security update | [production] | 
            
  | 16:05 | <moritzm> | rebooting notebook1001 for kernel security update | [production] | 
            
  | 16:05 | <akosiaris> | upgrade apertium on scb200* nodes | [production] | 
            
  | 15:59 | <moritzm> | reboot lithium for kernel security update | [production] | 
            
  | 15:51 | <moritzm> | reboot oxygen for kernel security update | [production] | 
            
  | 15:43 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase db1099:3311 weight (duration: 01m 21s) | [production] | 
            
  | 15:28 | <moritzm> | reboot ruthenium for kernel security update | [production] | 
            
  | 15:26 | <filippo@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=ms-fe1008.eqiad.wmnet | [production] | 
            
  | 15:18 | <akosiaris> | clear trusty-wikimedia from apertium packages. The apertium services is a long time now on jessie and all users should have migrated by now. If not, they should | [production] | 
            
  | 15:15 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase db1099:3311 weight (duration: 01m 23s) | [production] | 
            
  | 15:08 | <filippo@puppetmaster1001> | conftool action : set/pooled=no; selector: name=ms-fe1008.eqiad.wmnet | [production] | 
            
  | 15:05 | <moritzm> | rolling reboot of prometheus in eqiad for kernel security update | [production] | 
            
  | 15:01 | <filippo@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=ms-fe1007.eqiad.wmnet | [production] | 
            
  | 14:58 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1067,db1099:3318,db1099:3311, depool db1066 (duration: 01m 19s) | [production] | 
            
  | 14:58 | <marostegui> | Upgrade mariadb and kernel on db1066 | [production] | 
            
  | 14:47 | <filippo@puppetmaster1001> | conftool action : set/pooled=no; selector: name=ms-fe1007.eqiad.wmnet | [production] | 
            
  | 14:47 | <godog> | continue swift frontend eqiad roll-restart, ms-fe1007 / ms-fe1008 | [production] | 
            
  | 14:45 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Promote db2040 as the new codfw-s7 master (duration: 01m 22s) | [production] | 
            
  | 14:40 | <moritzm> | rolling reboot of prometheus in codfw for kernel security update | [production] | 
            
  | 14:37 | <jmm@puppetmaster1001> | conftool action : set/pooled=inactive; selector: mw1271.eqiad.wmnet | [production] | 
            
  | 14:36 | <joal@tin> | Finished deploy [analytics/refinery@ed8ecbc]: Patching interlanguage link and manually add a jar to our collection (duration: 04m 10s) | [production] |