| 
      
        2016-09-15
      
      §
     | 
  
    
  | 19:08 | 
  <ema> | 
  depool and restart varnish-be on cp1072 | 
  [production] | 
            
  | 19:08 | 
  <awight> | 
  disabled fredge, donations, and banner-history consumers | 
  [production] | 
            
  | 19:07 | 
  <hashar@tin> | 
  Synchronized php-1.28.0-wmf.18/extensions/CentralAuth/maintenance/fixStuckGlobalRename.php: To unblock renames stuck on mediawiki.org T145596 (duration: 00m 47s) | 
  [production] | 
            
  | 19:06 | 
  <hashar@tin> | 
  Synchronized php-1.28.0-wmf.19/extensions/CentralAuth/maintenance/fixStuckGlobalRename.php: To unblock renames stuck on mediawiki.org T145596 (duration: 00m 47s) | 
  [production] | 
            
  | 19:05 | 
  <thcipriani@tin> | 
  Finished scap: SWAT: [[gerrit:310851|Add missing close button title message (T145774)]] and [[gerrit:310872|Revert "Remove jquery.arrowSteps module" (T144974)]] (duration: 28m 08s) | 
  [production] | 
            
  | 18:59 | 
  <ema> | 
  depool and restart varnish-be on cp1099 | 
  [production] | 
            
  | 18:43 | 
  <ejegg> | 
  updated smashpig consume pending job with new queue name | 
  [production] | 
            
  | 18:36 | 
  <thcipriani@tin> | 
  Started scap: SWAT: [[gerrit:310851|Add missing close button title message (T145774)]] and [[gerrit:310872|Revert "Remove jquery.arrowSteps module" (T144974)]] | 
  [production] | 
            
  | 18:33 | 
  <mutante> | 
  titanium - stop salt, stop puppet, revoke puppet cert, delete salt key | 
  [production] | 
            
  | 18:23 | 
  <thcipriani@tin> | 
  Synchronized php-1.28.0-wmf.19/extensions/Kartographer: SWAT: [[gerrit:310848|Fix map popup CSS (T145716)]] (duration: 00m 56s) | 
  [production] | 
            
  | 18:23 | 
  <ema> | 
  depool and restart varnish-be on cp1074 | 
  [production] | 
            
  | 17:56 | 
  <awight> | 
  Purging GC messages from pending with timestamp < '2016-09-15 13:44:55' | 
  [production] | 
            
  | 17:44 | 
  <ema> | 
  depool and restart varnish-be on cp1049 | 
  [production] | 
            
  | 17:18 | 
  <Pchelolo> | 
  change-prop deploy 310877 | 
  [production] | 
            
  | 16:51 | 
  <Pchelolo> | 
  change-prop deploy gerrit 310873 | 
  [production] | 
            
  | 16:49 | 
  <akosiaris> | 
  uploaded to apt.wikimedia.org jessie-wikimedia: zuul_2.5.0-8-gcbc7f62-wmf3jessie1 | 
  [production] | 
            
  | 16:49 | 
  <akosiaris> | 
  uploaded to apt.wikimedia.org precise-wikimedia: zuul_2.5.0-8-gcbc7f62-wmf3precise1 | 
  [production] | 
            
  | 15:55 | 
  <moritzm> | 
  uploaded trebuchet-trigger 0.5.6-1~jessie1 to carbon (no change rebuild for jessie) | 
  [production] | 
            
  | 15:45 | 
  <kart_> | 
  Update cxserver to a1949e9 | 
  [production] | 
            
  | 14:59 | 
  <_joe_> | 
  starting a noop run on all nodes to puppetmaster2001 to test puppetdb | 
  [production] | 
            
  | 14:57 | 
  <elukey> | 
  deployed new-aqs-cluster branch (--rev new-aqs-cluster) to aqs100[456] (new AQS cluster not serving live traffic) | 
  [production] | 
            
  | 14:30 | 
  <_joe_> | 
  removing old reports from the puppet directory | 
  [production] | 
            
  | 14:03 | 
  <godog> | 
  empty big log file on thumbor1001 /var/log/thumbor/thumbor.log | 
  [production] | 
            
  | 13:31 | 
  <zeljkof> | 
  EU SWAT done! | 
  [production] | 
            
  | 13:28 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:306161|Update outdated comment for Wikibase]] (duration: 00m 48s) | 
  [production] | 
            
  | 13:25 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:306178|Remove $wgTranslateEC]] (duration: 00m 48s) | 
  [production] | 
            
  | 12:43 | 
  <addshore@tin> | 
  Finished scap: [[gerrit:310751|Update RevisionSlider i18n]] (duration: 30m 26s) | 
  [production] | 
            
  | 12:13 | 
  <addshore@tin> | 
  Started scap: [[gerrit:310751|Update RevisionSlider i18n]] | 
  [production] | 
            
  | 11:11 | 
  <hashar> | 
  CI is catching up. It is starved processing a long serie of dependent changes in Gerrit | 
  [production] | 
            
  | 11:08 | 
  <hashar> | 
  CI / Jenkins is starved. Investigating | 
  [production] | 
            
  | 10:09 | 
  <moritzm> | 
  reimaging mw1251 to jessie | 
  [production] | 
            
  | 09:35 | 
  <moritzm> | 
  reimaging mw1250 to jessie | 
  [production] | 
            
  | 08:11 | 
  <marostegui> | 
  altering tables in S7 - eqiad hosts - T141951 | 
  [production] | 
            
  | 07:00 | 
  <moritzm> | 
  installing libidn security updates | 
  [production] | 
            
  | 06:54 | 
  <marostegui> | 
  renaming tables before dropping them - T145487 | 
  [production] | 
            
  | 06:29 | 
  <moritzm> | 
  installing chromium security updates on osmium | 
  [production] | 
            
  | 06:24 | 
  <_joe_> | 
  turning off nitrogen for memory reduction, reimage | 
  [production] | 
            
  | 03:23 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Thu Sep 15 03:23:49 UTC 2016 (duration 6m 44s) | 
  [production] | 
            
  | 03:17 | 
  <mwdeploy@tin> | 
  scap sync-l10n completed (1.28.0-wmf.19) (duration: 18m 25s) | 
  [production] | 
            
  | 02:39 | 
  <mwdeploy@tin> | 
  scap sync-l10n completed (1.28.0-wmf.18) (duration: 17m 49s) | 
  [production] | 
            
  | 02:04 | 
  <mutante> | 
  ms-be1022 - down per icinga, but also mgmt is not reachable | 
  [production] | 
            
  
    | 
      
        2016-09-14
      
      §
     | 
  
    
  | 23:44 | 
  <dereckson@tin> | 
  Synchronized php-1.28.0-wmf.19/extensions/Kartographer/tests/phpunit/KartographerTest.php: Always serve all the data on preview (T145615, 2/2, no-op part) (duration: 00m 50s) | 
  [production] | 
            
  | 23:43 | 
  <dereckson@tin> | 
  Synchronized php-1.28.0-wmf.19/extensions/Kartographer/includes/Tag/TagHandler.php: Always serve all the data on preview (T145615, 1/2) (duration: 00m 47s) | 
  [production] | 
            
  | 23:34 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Add logging channel for NewUserMessage (T131957) (duration: 00m 47s) | 
  [production] | 
            
  | 22:36 | 
  <krinkle@tin> | 
  Synchronized php-1.28.0-wmf.19/includes/resourceloader/ResourceLoaderWikiModule.php: T145673 (duration: 00m 47s) | 
  [production] | 
            
  | 21:18 | 
  <Pchelolo> | 
  RESTBase update to fd43f3a58  | 
  [production] | 
            
  | 21:13 | 
  <Pchelolo> | 
  RESTBase update to fd43f3a58 canary on restbase1007 | 
  [production] | 
            
  | 20:57 | 
  <Pchelolo> | 
  RESTBase update to fd43f3a58 staging | 
  [production] | 
            
  | 20:28 | 
  <hashar@tin> | 
  Synchronized php-1.28.0-wmf.19/extensions/CentralAuth/includes/LocalRenameJob/LocalRenameJob.php: Fix LocalRenameJob transaction owner to match JobRunner T143328 T145596 (duration: 00m 48s) | 
  [production] | 
            
  | 20:23 | 
  <yuvipanda> | 
  manually raise max_connections on labtestcontrol2001, see T145679 for ticket | 
  [production] |