| 2016-10-24
      
      ยง | 
    
  | 23:14 | <dereckson@mira> | Synchronized wmf-config/InitialiseSettings.php: Remove duplicated wmgCirrusSearchClusterOverrides entry (duration: 00m 50s) | [production] | 
            
  | 23:07 | <dapatrick> | Deployed patch for T148600 to wmf22 | [production] | 
            
  | 22:10 | <ejegg> | updated civicrm from 3b76de564aef4dad7807be2d3e570dec38696227 to 9e288691de2e918d00928c9164e0f2389563888d | [production] | 
            
  | 21:43 | <godog> | rolling-restart of ms-fe in codfw/eqiad for kernel update | [production] | 
            
  | 21:01 | <Amir1> | rollbacking ores to 8bbd3ab | [production] | 
            
  | 20:49 | <Amir1> | deploying 0caa589 to all ores nodes | [production] | 
            
  | 20:44 | <Amir1> | deploying 0caa589 on ores canary node | [production] | 
            
  | 20:42 | <arlolra> | updated Parsoid to version 63f1e151 (T139032, T146612, T141905) | [production] | 
            
  | 20:29 | <bearND> | deployed mobileapps f872894 | [production] | 
            
  | 20:26 | <bearND> | starting mobileapps deploy | [production] | 
            
  | 20:25 | <gehel> | stopping elasticsearch eqiad cluster restart for the night. | [production] | 
            
  | 20:18 | <arlolra> | starting Parsoid deploy | [production] | 
            
  | 20:06 | <gehel> | powering on elastic2020 (no idea why it is powered off) | [production] | 
            
  | 19:34 | <ejegg> | updated SmashPig from f9e185b7b14749ae24155c69bc1927dc6222e5f7 to 31c0757ca17499deac6a8f49eb7ed17924630419 | [production] | 
            
  | 19:30 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:317159|[cirrus] Activate BM25 on top 10 wikis: Step 2 (take 2) (T147508)]] (duration: 00m 50s) | [production] | 
            
  | 19:22 | <thcipriani@mira> | Synchronized php-1.28.0-wmf.22/extensions/CirrusSearch/includes/SearchConfig.php: SWAT: [[gerrit:317512|Add wgContentNamespaces to the list of vars loaded by SearchConfig (T148840)]] (duration: 00m 58s) | [production] | 
            
  | 19:16 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:317555|Fix capitalization for change 317387 (T148328)]] (duration: 00m 51s) | [production] | 
            
  | 19:11 | <thcipriani@mira> | Synchronized wmf-config/CommonSettings.php: [[gerrit:317523|Fix capitalization for change 317387 (T148328)]] PART II (duration: 00m 50s) | [production] | 
            
  | 19:10 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: [[gerrit:317523|Fix capitalization for change 317387 (T148328)]] PART I (duration: 00m 50s) | [production] | 
            
  | 19:03 | <thcipriani@mira> | Synchronized php-1.28.0-wmf.22/resources/src/mediawiki/mediawiki.js: SWAT: [[gerrit:317283|resourceloader: Make cache-eval in mw.loader.work asynchronous (T142129)]] (duration: 00m 52s) | [production] | 
            
  | 18:32 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:317502|Switch bs, hr and uk wikis to numeric collation (T148682)]] (duration: 00m 50s) | [production] | 
            
  | 18:19 | <thcipriani@mira> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:317139|Set $wgCategoryCollation to uca-hr for Croatian wikipedia (T148749)]] (duration: 00m 57s) | [production] | 
            
  | 18:06 | <ejegg> | updated payments-wiki settings to f4b79f02c2897349a96b023aaef4cbf24e7708f0 | [production] | 
            
  | 18:05 | <bblack> | downgrading nginx(+linked openssl implicitly) on cp* | [production] | 
            
  | 17:02 | <gehel> | deplyoing latest GUI for WDQS | [production] | 
            
  | 16:22 | <ejegg> | updated SmashPig from e28b2cd9f0c1429acdd2a08c68f95884dbffb594 to f9e185b7b14749ae24155c69bc1927dc6222e5f7 | [production] | 
            
  | 15:04 | <bblack> | enabling/running puppet on caches for 8x varnish ports changes - T107749 | [production] | 
            
  | 14:57 | <paravoid> | restarting ferm on es2015 | [production] | 
            
  | 14:54 | <bblack> | starting ferm server on eeden, radon | [production] | 
            
  | 14:41 | <gehel@puppetmaster1001> | conftool action : set/pooled=yes; selector: dc=eqiad,cluster=maps,service=kartotherian,name=maps1002.eqiad.wmnet | [production] | 
            
  | 14:38 | <dereckson@mira> | Synchronized wmf-config/CommonSettings.php: Toggle wgDefaultUserOptions['watchdefault'] on for cs.wikipedia, off elsewhere (T148328, 2/2) (duration: 00m 50s) | [production] | 
            
  | 14:36 | <dereckson@mira> | Synchronized wmf-config/InitialiseSettings.php: Toggle wgDefaultUserOptions['watchdefault'] on for cs.wikipedia, off elsewhere (T148328, 1/2) (duration: 00m 54s) | [production] | 
            
  | 14:36 | <bblack> | disabling puppet on all caches ahead of port# work, to test - T107749 / https://gerrit.wikimedia.org/r/#/c/317405 | [production] | 
            
  | 14:29 | <yurik> | re-deployed current kartotherian to all servers (maps1002 & maps-test* were stale) | [production] | 
            
  | 14:11 | <marostegui> | Deploy schema change s5 dewiki.revision - only codfw T148967 | [production] | 
            
  | 14:03 | <l10nupdate@mira> | ResourceLoader cache refresh completed at Mon Oct 24 14:03:07 UTC 2016 (duration 6m 17s) | [production] | 
            
  | 13:56 | <dereckson@mira> | scap sync-l10n completed (1.28.0-wmf.22) (duration: 10m 46s) | [production] | 
            
  | 13:42 | <bblack> | restarting all varnish frontends (serially per-cluster with proper depooling, etc) | [production] | 
            
  | 13:20 | <elukey> | reimaging mc120[89] and mc1030 | [production] | 
            
  | 13:18 | <Dereckson> | Started manually l10nupdate, as it didn't run for 6 days, and more especially to fix T148921 user-facing issue. | [production] | 
            
  | 13:13 | <dereckson@mira> | Synchronized wmf-config/throttle.php: Edit-a-thon BDA (Poitiers) throttle rule (T148852) (duration: 01m 13s) | [production] | 
            
  | 10:47 | <elukey> | reimaged mc102[56], currently doing mc1027 | [production] | 
            
  | 10:21 | <_joe_> | rebooting kubernetes1002 | [production] | 
            
  | 09:20 | <mobrovac> | change-prop deploying c7feda2 | [production] | 
            
  | 09:09 | <mobrovac> | restbase deploy end of f9017ad | [production] | 
            
  | 08:55 | <akosiaris> | rebooting cobalt (gerrit) for kernel upgrades | [production] | 
            
  | 08:53 | <elukey> | reimaging mc1024 | [production] | 
            
  | 08:46 | <mobrovac> | restbase deploy start of f9017ad | [production] | 
            
  | 08:38 | <gehel> | continue rolling restart of elasticsearch eqiad cluster | [production] | 
            
  | 08:38 | <hashar> | Restarting gallium (Jenkins/Zuul) for kernel upgrades | [production] |