| 2017-03-23
      
      § | 
    
  | 19:34 | <thcipriani@tin> | Synchronized php: Swap symlink for 1.29.0-wmf.17 (duration: 00m 43s) | [production] | 
            
  | 19:11 | <thcipriani@tin> | rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.29.0-wmf.17 | [production] | 
            
  | 18:51 | <bblack> | systemctl enable+start of lldpd on cp2009, cp1051, cp1061 (mysteriously dead and disabled) | [production] | 
            
  | 18:16 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Remove exception on Other Projects sidebar for Dutch Wikipedia (T159634) (duration: 00m 47s) | [production] | 
            
  | 18:04 | <Pchelolo> | update RESTBase to 9d2b393fb - production | [production] | 
            
  | 17:52 | <Pchelolo> | update RESTBase to 9d2b393fb - staging | [production] | 
            
  | 16:46 | <mobrovac@tin> | Started restart [parsoid/deploy@0c22f72]: (no justification provided) | [production] | 
            
  | 16:45 | <_joe_> | reenabling puppet on all jobqueue redises | [production] | 
            
  | 16:24 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase db1082 weight - T137191 (duration: 00m 43s) | [production] | 
            
  | 16:22 | <hashar> | Merged operations/puppet.git Jenkins job in a single one that runs tox then rake - T160923 | [production] | 
            
  | 16:10 | <urandom> | T111113: Live-hacking client encryption to be non-optional, to verify cqlsh encryption, restbase1007-a.eqiad.wmnet | [production] | 
            
  | 16:07 | <mobrovac> | restbase deploy 752ca4b7 | [production] | 
            
  | 15:36 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase db1082 weight - T137191 (duration: 00m 43s) | [production] | 
            
  | 15:32 | <moritzm> | upgrading restbase-test* to Linux 4.9 | [production] | 
            
  | 14:59 | <akosiaris> | enabling and running puppet on rdb200X fleet in a rolling restart scheme | [production] | 
            
  | 14:59 | <akosiaris> | disabled puppet on rdb* fleet | [production] | 
            
  | 14:56 | <andrewbogott> | dist-upgrading labvirt1001 and rebooting it a few times | [production] | 
            
  | 14:22 | <moritzm> | installing exim4 updates from jessie point release | [production] | 
            
  | 14:03 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1082 with low weight - T137191 (duration: 00m 48s) | [production] | 
            
  | 13:53 | <dcausse> | cirrus: refreshing comp suggest indices in elastic@eqiad to measure times | [production] | 
            
  | 12:59 | <marostegui> | Deploy schema change s4 on db1064 https://phabricator.wikimedia.org/T160415 - https://phabricator.wikimedia.org/T73563 | [production] | 
            
  | 12:58 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1059, depool db1064 T160415 - T73563 (duration: 00m 43s) | [production] | 
            
  | 12:27 | <moritzm> | installing libxml2 security updates | [production] | 
            
  | 12:21 | <marostegui> | Deploy schema change s4 on labsdb1003 https://phabricator.wikimedia.org/T160415 - https://phabricator.wikimedia.org/T73563 | [production] | 
            
  | 12:04 | <jynus> | converting es2014 tables back to uncompressed InnoDB T129350 | [production] | 
            
  | 11:08 | <godog> | codfw-prod: bump ms-be2028 ms-be2039 object weight to 2000 T158337 | [production] | 
            
  | 11:01 | <godog> | pool prometheus200[34] / depool prometheus200[12] - T148408 | [production] | 
            
  | 11:01 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Pool all es2XXX servers, depool es2014 for maintenance (duration: 00m 43s) | [production] | 
            
  | 10:59 | <hashar> | Actually restarting Jenkins for email plugins upgrades | [production] | 
            
  | 10:20 | <hashar> | Jenkins jobs got slightly blocked because I forgot to cancel the shutdown when jobs had to run. | [production] | 
            
  | 09:58 | <hashar> | Jenkins: upgrading plugins email-ext and mailer | [production] | 
            
  | 09:14 | <hashar> | Jenkins upgrading SSH Slaves plugin. Might cause disruption in CI | [production] | 
            
  | 08:47 | <moritzm> | repooled mw1261 now that T161095 is deployed | [production] | 
            
  | 08:29 | <marostegui> | Stop db1070 MySQL db1070 for maintenance - T137191 | [production] | 
            
  | 08:06 | <moritzm> | installing audiofile security updates | [production] | 
            
  | 07:37 | <marostegui> | Deploy schema change s4 on db1068 and labsdb1001 T160415 - T73563 | [production] | 
            
  | 07:36 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1068, depool db1059 T160415 - T73563 (duration: 00m 43s) | [production] | 
            
  | 07:08 | <marostegui> | Stop MySQL db1082 for maintenance - https://phabricator.wikimedia.org/T137191 | [production] | 
            
  | 06:52 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1082 - T137191 (duration: 00m 44s) | [production] | 
            
  | 03:14 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Thu Mar 23 03:14:05 UTC 2017 (duration 5m 47s) | [production] | 
            
  | 03:08 | <l10nupdate@tin> | scap sync-l10n completed (1.29.0-wmf.17) (duration: 14m 39s) | [production] | 
            
  | 02:35 | <l10nupdate@tin> | scap sync-l10n completed (1.29.0-wmf.16) (duration: 13m 26s) | [production] | 
            
  | 01:46 | <mutante> | added ottomata and milimetric to "wmf-deployers" in Gerrit web ui, both have existing (deployment resp. root) shell already (T161157) | [production] |