| 2017-06-19
      
      § | 
    
  | 14:59 | <godog> | cold reset ms-be1013 drac | [production] | 
            
  | 14:53 | <gehel> | pausing cluster restart of elasticsearch eqiad | [production] | 
            
  | 14:24 | <godog> | roll-upgrade swift to 2.10 on ms-be10[22-30] - T162609 | [production] | 
            
  | 14:08 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1070 - T153743 (duration: 00m 41s) | [production] | 
            
  | 14:06 | <gehel> | starting cluster restart on elasticsearch / cirrus / eqiad for ltr plugin deployment | [production] | 
            
  | 14:01 | <gehel> | restarting elasticsearch / relforge for ltr plugin deployment | [production] | 
            
  | 13:58 | <gehel> | remove decommissioned nodes from redis / trebuchet for elasticsearch/plugins | [production] | 
            
  | 13:48 | <gehel> | deploying latest elasticsearch plugin (ltr plugin) | [production] | 
            
  | 13:48 | <moritzm> | fixing salt minion setup on wtp1047 | [production] | 
            
  | 13:44 | <hashar> | European SWAT completed | [production] | 
            
  | 13:44 | <aude@tin> | Synchronized wmf-config/Wikibase.php: Remove old constraints section config (duration: 00m 41s) | [production] | 
            
  | 13:42 | <aude@tin> | Synchronized wmf-config/Wikibase-production.php: Add constraints section to property pages on test.wikidata (duration: 00m 41s) | [production] | 
            
  | 13:29 | <dcausse@tin> | Synchronized wmf-config/InitialiseSettings.php: [cleanup] remove old interwiki search config (duration: 00m 41s) | [production] | 
            
  | 13:28 | <dcausse@tin> | Synchronized wmf-config/CirrusSearch-labs.php: [cleanup] remove old interwiki search config (duration: 00m 41s) | [production] | 
            
  | 13:21 | <hashar@tin> | Synchronized wmf-config/InitialiseSettings.php:  Enable OOjs UI buttons on EditPage for plwiki - T162849 (duration: 00m 42s) | [production] | 
            
  | 13:08 | <hashar@tin> | Synchronized wmf-config/InitialiseSettings.php: Add sandbox link for dtywiki - T168038 (duration: 00m 42s) | [production] | 
            
  | 12:54 | <dcausse> | restarting elasticsearch on relforge1* to pickup new snapshot of the ltr plugin | [production] | 
            
  | 12:36 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=inactive; selector: name=chlorine.eqiad.wmnet | [production] | 
            
  | 12:04 | <elukey> | run 'echo "autoLearnMode=1" > /tmp/disable_learn && megacli -AdpBbuCmd -SetBbuProperties -f /tmp/disable_learn -a0' on all the analytics workers to disable BBU Auto learn - T167809 | [production] | 
            
  | 11:33 | <marostegui> | Rename user Smuconlaw → Sgconlaw - T168109 | [production] | 
            
  | 11:31 | <jynus> | restarting replication on dbstore1002:s3 and db1015 | [production] | 
            
  | 11:19 | <moritzm> | rebooting cp3007 for kernel update | [production] | 
            
  | 11:01 | <_joe_> | depooling mw1170-mw1179 for decommissioning, T168271 | [production] | 
            
  | 10:15 | <godog> | roll-upgrade swift to 2.10 on to ms-fe1* - T162609 | [production] | 
            
  | 09:56 | <akosiaris> | migrate neon.eqiad.wmnet to ganeti01.svc.eqiad.wmnet's row_A  nodegroup | [production] | 
            
  | 09:55 | <dcausse> | restarting elasticsearch on relforge1* to pickup new snapshot of the ltr plugin | [production] | 
            
  | 09:33 | <jynus> | temporarily stop dbstore1002:s3 and db1015 to fix srwiki | [production] | 
            
  | 09:30 | <marostegui> | Deploy alter table on s2 - dbstore1001 - T166205 | [production] | 
            
  | 09:18 | <godog> | swift eqiad-prod: remove ms-be1001 - ms-be1012 - T166489 | [production] | 
            
  | 09:13 | <paravoid> | rebooting achernar to address CPU throttling and apply the BIOS update | [production] | 
            
  | 09:11 | <paravoid> | upgrading achernar's BIOS from 1.2.4 to 2.4.2 hoping it will address recurring CPU throttling issue (T162850) | [production] | 
            
  | 09:07 | <akosiaris> | restart ircecho on einsteinium, was not notifying due to a thrown exception | [production] | 
            
  | 08:35 | <marostegui> | Drop table title key from s2 - T164949 | [production] | 
            
  | 08:16 | <marostegui> | Drop table titlekey on s6 - T164949 | [production] | 
            
  | 07:59 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Repool pc2004,5,6 after maintenance (duration: 00m 41s) | [production] | 
            
  | 07:42 | <moritzm> | restarting app server canaries to pick up gnutls update | [production] | 
            
  | 07:13 | <marostegui> | Reboot ms-be1010 | [production] | 
            
  | 07:10 | <marostegui> | Deploy alter table s5 - codfw master - db2023 (and will replicate) so this will generate lag on codfw slaves - T166207 | [production] | 
            
  | 07:09 | <jynus> | upgrade, reboot and clear data on pc2006 | [production] | 
            
  | 07:05 | <jynus> | upgrade, reboot and clear data on pc2005 | [production] | 
            
  | 07:03 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Depool pc2005 & pc2006 (duration: 00m 41s) | [production] | 
            
  | 06:58 | <moritzm> | installing gnutls security updates | [production] | 
            
  | 06:38 | <marostegui> | Deploy alter table s2 - labsdb1001 - T166205 | [production] | 
            
  | 06:37 | <jynus> | force learning cycle to db1046 controller T166141 | [production] | 
            
  | 06:23 | <marostegui> | Deploy alter table on s2 - db1021 - T166205 | [production] | 
            
  | 06:18 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1021 - T166205 (duration: 00m 41s) | [production] | 
            
  | 04:21 | <reedy@tin> | Synchronized composer.lock: update (duration: 00m 41s) | [production] | 
            
  | 04:20 | <reedy@tin> | Synchronized composer.json: update (duration: 00m 41s) | [production] | 
            
  | 04:19 | <reedy@tin> | Synchronized multiversion/vendor/: Update! (duration: 01m 05s) | [production] | 
            
  | 04:05 | <reedy@tin> | Synchronized wmf-config/CommonSettings.php: Fix comments minor code style (duration: 00m 42s) | [production] |