| 2016-05-10
      
      ยง | 
    
  | 23:04 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Undeploy UploadWizard from test2wiki ([[Gerrit:287944]], 1/2) (duration: 00m 30s) | [production] | 
            
  | 22:28 | <yurik> | graphoid was restarted on all scb servers with the new caching configuration. T134542 | [production] | 
            
  | 22:08 | <mutante> | ocg1003 - papaul fixed the install issue | [production] | 
            
  | 22:08 | <mutante> | ocg1003 - revoked old puppet cert, signed new cert, re-adding after reinstall | [production] | 
            
  | 21:07 | <gehel> | merging and applying configuration for new maps servers | [production] | 
            
  | 20:24 | <mutante> | scheduled icinga downtime for ocg1003 and all services on it, rebooting to PXE (T84723) | [production] | 
            
  | 20:01 | <bblack> | re-enabling puppet on caches | [production] | 
            
  | 19:53 | <demon@tin> | Finished scap: group0 wikis to 1.28.0-wmf.1 (duration: 26m 49s) | [production] | 
            
  | 19:26 | <demon@tin> | Started scap: group0 wikis to 1.28.0-wmf.1 | [production] | 
            
  | 19:20 | <ottomata> | upgraded kafka1022 to confluent kafka 0.9.0.1 | [production] | 
            
  | 19:11 | <ottomata> | reenabling camus and puppet on analytics1027 | [production] | 
            
  | 18:38 | <mutante> | deleted /tmp/make-wmf-branch on tin by request | [production] | 
            
  | 18:20 | <yurik> | finished graphoid deployment & restart.  T134575 | [production] | 
            
  | 18:18 | <bblack> | disabling puppet on caches for nginx change observe/deploy... | [production] | 
            
  | 18:10 | <jynus> | testing GTID replication on es2019 T133385 T130702 | [production] | 
            
  | 18:01 | <cscott> | OCG: script reported "Cleared 0 (of 363141 total) entries from cache in 56.894 seconds" (T120079) | [production] | 
            
  | 18:01 | <ottomata> | stopping kafka on kafka1022 to upgrade to 0.9 | [production] | 
            
  | 18:00 | <cscott> | OCG: clearing cache for ocg1003.eqiad.wmnet and ocg1003 (T120079) | [production] | 
            
  | 17:57 | <ottomata> | stopping camus and puppet on analytics1027 during upgrade of one kafka broker | [production] | 
            
  | 17:56 | <yurik> | about to deploy graphoid | [production] | 
            
  | 17:41 | <cscott> | updated OCG to version b0c57a1c6890e9fa1f2c3743fc14cb6a7f244fc3 (T120079) | [production] | 
            
  | 17:38 | <cscott> | starting OCG deploy | [production] | 
            
  | 16:40 | <ema> | repooling cp3007 running varnish 4 | [production] | 
            
  | 16:04 | <godog> | nodetool cleanup on restbase2005 T132976 | [production] | 
            
  | 16:03 | <robh> | i fubar'd sinistra's grub, it'll be offline for a bit while longer. | [production] | 
            
  | 15:52 | <csteipp> | deployed patch for T134863 | [production] | 
            
  | 15:48 | <godog> | collect mysqld metrics with prometheus-metrics-collector 0.8.1 on db2070 for 24h T128185 | [production] | 
            
  | 15:35 | <thcipriani@tin> | Synchronized wmf-config/CommonSettings.php: SWAT: Configure $wgCheckUserCAMultiLock for CentralAuth wikis [[gerrit:286927]] (duration: 00m 26s) | [production] | 
            
  | 15:27 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Simplify $wgApiFrameOptions configuration (2/2) PART II [[gerrit:287968]] (duration: 00m 27s) | [production] | 
            
  | 15:26 | <thcipriani@tin> | Synchronized wmf-config/CommonSettings.php: SWAT: Simplify $wgApiFrameOptions configuration (2/2) PART I [[gerrit:287968]] (duration: 00m 26s) | [production] | 
            
  | 15:23 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Simplify $wgApiFrameOptions configuration (1/2) [[gerrit:287939]] (duration: 00m 26s) | [production] | 
            
  | 15:22 | <robh> | sinistra powercycling and troubleshooting starting for disk issue | [production] | 
            
  | 15:15 | <moritzm> | restarting apache on silver (wikitech host) for openssl update | [production] | 
            
  | 15:15 | <godog> | graphite-web reload on graphite1001 after merging https://gerrit.wikimedia.org/r/281631 | [production] | 
            
  | 15:10 | <thcipriani@tin> | Synchronized portals: (no message) (duration: 00m 33s) | [production] | 
            
  | 15:10 | <thcipriani@tin> | Synchronized portals/prod/wikipedia.org/assets: (no message) (duration: 00m 27s) | [production] | 
            
  | 15:09 | <thcipriani> | running sync-portals for portals SWAT | [production] | 
            
  | 15:07 | <moritzm> | restarted apache on californium for openssl update | [production] | 
            
  | 15:06 | <thcipriani@tin> | Synchronized wmf-config/CommonSettings.php: SWAT: Remove misleading comment in UploadWizard configuration [[gerrit:287948]] (duration: 00m 47s) | [production] | 
            
  | 14:56 | <jynus> | dropped pdns db and associated user accounts on m5-master | [production] | 
            
  | 14:54 | <bblack> | restarting pybal on lvs3002 | [production] | 
            
  | 14:53 | <moritzm> | restarting ntp on nescio for openssl update | [production] | 
            
  | 14:52 | <bblack> | restarting pybal on lvs3004 | [production] | 
            
  | 14:45 | <moritzm> | restarting ntp on maerlant for openssl update | [production] | 
            
  | 14:37 | <moritzm> | restarting ntp on acamar for openssl update | [production] | 
            
  | 14:32 | <moritzm> | restarting ntp on chromium for openssl update | [production] | 
            
  | 14:27 | <ema> | upgrading cp3007 (misc) to varnish 4 | [production] | 
            
  | 14:24 | <moritzm> | restarting ntp on hydrogen for openssl update | [production] | 
            
  | 14:15 | <moritzm> | restarting ntp on achernar for openssl update | [production] | 
            
  | 14:10 | <moritzm> | restarting apache on neon for openssl update | [production] |