| 
      
        2017-11-14
      
      §
     | 
  
    
  | 09:27 | 
  <ppchelko@tin> | 
  Finished deploy [cpjobqueue/deploy@df5fca9]: Enable RecordLintJob processing (duration: 00m 40s) | 
  [production] | 
            
  | 09:27 | 
  <ppchelko@tin> | 
  Started deploy [cpjobqueue/deploy@df5fca9]: Enable RecordLintJob processing | 
  [production] | 
            
  | 09:07 | 
  <moritzm> | 
  rebooting remaining app servers in codfw for update to Linux 4.9.51 (and to pick up OpenSSL updates) | 
  [production] | 
            
  | 09:05 | 
  <jmm@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: mw2108.codfw.wmnet | 
  [production] | 
            
  | 09:05 | 
  <jmm@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: wtp2018.codfw.wmnet | 
  [production] | 
            
  | 08:31 | 
  <marostegui> | 
  Deploy alter table on s5 - dbstore1002 - T174569 | 
  [production] | 
            
  | 08:22 | 
  <addshore@tin> | 
  Synchronized wmf-config/extension-list-labs: [[gerrit:390385|Add AdvancedSearch to extension-list]] T180147 PT 2/2 LABS ONLY (duration: 00m 46s) | 
  [production] | 
            
  | 08:21 | 
  <addshore@tin> | 
  Synchronized wmf-config/extension-list: [[gerrit:390385|Add AdvancedSearch to extension-list]] T180147 PT 1/2 (duration: 00m 47s) | 
  [production] | 
            
  | 08:13 | 
  <moritzm> | 
  rebooting job runners in codfw for update to Linux 4.9.51 (and to pick up OpenSSL updates) | 
  [production] | 
            
  | 06:28 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Increase weight for db1103 on s2 and s4 - T178359 (duration: 00m 47s) | 
  [production] | 
            
  | 06:18 | 
  <marostegui> | 
  Deploy alter table on s6 primary master (db1061) - T174569 | 
  [production] | 
            
  | 02:30 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Tue Nov 14 02:30:59 UTC 2017 (duration 6m 38s) | 
  [production] | 
            
  | 02:24 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.31.0-wmf.7) (duration: 07m 28s) | 
  [production] | 
            
  | 01:35 | 
  <mdholloway> | 
  mobileapps finished rolling back to 11/8 deployment | 
  [production] | 
            
  | 01:34 | 
  <mholloway-shell@tin> | 
  Finished deploy [mobileapps/deploy@00e60b2]: (no justification provided) (duration: 02m 27s) | 
  [production] | 
            
  | 01:31 | 
  <mholloway-shell@tin> | 
  Started deploy [mobileapps/deploy@00e60b2]: (no justification provided) | 
  [production] | 
            
  | 01:30 | 
  <mdholloway> | 
  mobileapps rolling back today's deployment due to a significant increase in errors. | 
  [production] | 
            
  
    | 
      
        2017-11-13
      
      §
     | 
  
    
  | 22:49 | 
  <bawolff> | 
  deployed patch T119158 (Will affect language converter. -{}- no longer allowed in link urls) | 
  [production] | 
            
  | 22:42 | 
  <bawolff> | 
  deployed patch T124404 | 
  [production] | 
            
  | 22:02 | 
  <mholloway-shell@tin> | 
  Finished deploy [mobileapps/deploy@9b10959]: Update mobileapps to c002862 (duration: 05m 31s) | 
  [production] | 
            
  | 21:57 | 
  <mholloway-shell@tin> | 
  Started deploy [mobileapps/deploy@9b10959]: Update mobileapps to c002862 | 
  [production] | 
            
  | 21:40 | 
  <urandom> | 
  Decommissioning Cassandra, restbase1012-b.eqiad.wmnet (T179422) | 
  [production] | 
            
  | 20:20 | 
  <ejegg> | 
  updated CiviCRM from ddc388195e1974e17c1f6f3f67f285898c0eb2bb to f571c67ceb353b457f250cc4606cfaa882343e39 | 
  [production] | 
            
  | 19:20 | 
  <smalyshev@tin> | 
  Finished deploy [wdqs/wdqs@b44cf27]: data reload/T176593 (duration: 00m 20s) | 
  [production] | 
            
  | 19:20 | 
  <smalyshev@tin> | 
  Started deploy [wdqs/wdqs@b44cf27]: data reload/T176593 | 
  [production] | 
            
  | 19:18 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/abusefilter.php: SWAT: [[gerrit:390153|Enable per-filter profiling on enwiki]] T179323 (duration: 00m 45s) | 
  [production] | 
            
  | 19:16 | 
  <thcipriani@tin> | 
  Synchronized docroot/search.wikimedia.org/index.php: [[gerrit:390357|search.wikimedia.org: Clean up result returning logic]] (duration: 00m 47s) | 
  [production] | 
            
  | 19:15 | 
  <madhuvishy> | 
  Kick of second dumps rsync from ms1001 to labstore1006 | 
  [production] | 
            
  | 18:28 | 
  <gehel> | 
  deploy latest blazegraph + GUI on wdqs200[23] to switch vocabulary - T176593 | 
  [production] | 
            
  | 18:20 | 
  <elukey> | 
  drain + shutdown analytics1029 as prep step to replace the BBU - T178742 | 
  [production] | 
            
  | 18:09 | 
  <hoo> | 
  Ran "scap pull" on mwdebug1001/snapshot1001 after (further) tests re T177486 | 
  [production] | 
            
  | 18:02 | 
  <urandom> | 
  Restarting Cassandra, restbase-dev1004.eqiad.wmnet (testing new `c-foreach-restart`) | 
  [production] | 
            
  | 18:00 | 
  <demon@tin> | 
  Synchronized docroot/search.wikimedia.org/index.php: minor cleanup (duration: 00m 47s) | 
  [production] | 
            
  | 17:28 | 
  <hoo> | 
  Ran "scap pull" on mwdebug1001 after tests re T177486 | 
  [production] | 
            
  | 17:12 | 
  <mobrovac> | 
  restbase depooling restbase1007, restbase1012, restbase1014, restbase2002, restbase2004, restbase2006 for T179422 | 
  [production] | 
            
  | 16:54 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Increase weight for db1103 on s2 and s4 - T178359 (duration: 00m 47s) | 
  [production] | 
            
  | 16:45 | 
  <mobrovac@tin> | 
  Finished deploy [mathoid/deploy@63b2ddc]: Update to service-template-node v0.5.3 - T151396 (duration: 03m 45s) | 
  [production] | 
            
  | 16:42 | 
  <mobrovac@tin> | 
  Started deploy [mathoid/deploy@63b2ddc]: Update to service-template-node v0.5.3 - T151396 | 
  [production] | 
            
  | 16:30 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1085 - T174569 (duration: 00m 46s) | 
  [production] | 
            
  | 15:58 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=inactive; selector: name=wtp2017.codfw.wmnet | 
  [production] | 
            
  | 15:58 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=wtp2017.codfw.wmnet | 
  [production] | 
            
  | 15:22 | 
  <otto@tin> | 
  Finished deploy [eventlogging/analytics@e024af3]: T179625 (duration: 00m 02s) | 
  [production] | 
            
  | 15:22 | 
  <otto@tin> | 
  Started deploy [eventlogging/analytics@e024af3]: T179625 | 
  [production] | 
            
  | 15:09 | 
  <otto@tin> | 
  Finished deploy [eventlogging/analytics@03285e4]: Reverting, got an error: userAgent is a <type unicode>. (duration: 00m 02s) | 
  [production] | 
            
  | 15:09 | 
  <otto@tin> | 
  Started deploy [eventlogging/analytics@03285e4]: Reverting, got an error: userAgent is a <type unicode>. | 
  [production] | 
            
  | 15:08 | 
  <urandom> | 
  Decommissioning Cassandra, restbase1012-a.eqiad.wmnet (T179422) | 
  [production] | 
            
  | 15:06 | 
  <otto@tin> | 
  Finished deploy [eventlogging/analytics@5796c27]: T179625 (duration: 00m 04s) | 
  [production] | 
            
  | 15:06 | 
  <otto@tin> | 
  Started deploy [eventlogging/analytics@5796c27]: T179625 | 
  [production] | 
            
  | 14:58 | 
  <herron> | 
  upgrading puppetmaster2002 to puppet 4 | 
  [production] | 
            
  | 14:15 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] |