| 
      
        2016-09-20
      
      §
     | 
  
    
  | 10:28 | 
  <akosiaris> | 
  force mw2232 to use palladium for report handler testing | 
  [production] | 
            
  | 10:25 | 
  <jynus> | 
  deploying schema change on s1 hosts T139090 | 
  [production] | 
            
  | 10:15 | 
  <moritzm> | 
  upgrading ganeti2003 to Linux 4.4 | 
  [production] | 
            
  | 10:12 | 
  <mobrovac> | 
  change-prop deploying e1ef51e | 
  [production] | 
            
  | 09:57 | 
  <moritzm> | 
  upgrading ganeti2002 to Linux 4.4 | 
  [production] | 
            
  | 09:13 | 
  <moritzm> | 
  reimaging API servers mw1192/mw1193 to jessie | 
  [production] | 
            
  | 08:55 | 
  <moritzm> | 
  reimaging mw1243-mw1245 to jessie | 
  [production] | 
            
  | 07:36 | 
  <elukey> | 
  restart cassandra on aqs100[456] for T130861 - only aqs1004 is taking live traffic | 
  [production] | 
            
  | 02:47 | 
  <eileen> | 
  CiviCRM update from c9157ba6aac3ad3c2fd61c7bb0475851fb8ec421 to de1df9ec4fe58487eeb61cc69160f228e009f2cf | 
  [production] | 
            
  | 02:40 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Tue Sep 20 02:40:17 UTC 2016 (duration 6m 52s) | 
  [production] | 
            
  | 02:33 | 
  <mwdeploy@tin> | 
  scap sync-l10n completed (1.28.0-wmf.18) (duration: 10m 35s) | 
  [production] | 
            
  | 00:43 | 
  <mutante> | 
  wtp2019 - down again, powercycled, probably damaged RAM | 
  [production] | 
            
  
    | 
      
        2016-09-19
      
      §
     | 
  
    
  | 23:22 | 
  <Pchelolo> | 
  restart restbase in staging | 
  [production] | 
            
  | 23:01 | 
  <awight> | 
  update orphan rectifier config for T145848 | 
  [production] | 
            
  | 22:58 | 
  <thcipriani@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: Restore testwiki to 1.28.0-wmf.18 | 
  [production] | 
            
  | 22:53 | 
  <dapatrick> | 
  Deployed patch for T144573 to wmf18 and wmf19 | 
  [production] | 
            
  | 22:48 | 
  <thcipriani@tin> | 
  Finished scap: testwiki to php-1.28.0-wmf.19 and rebuild l10n cache (duration: 52m 03s) | 
  [production] | 
            
  | 22:31 | 
  <bblack> | 
  cache_upload: pooling cp1099 (storage experiment - T145661) | 
  [production] | 
            
  | 22:02 | 
  <awight> | 
  update paymentswiki from 4cd18776ca67fe0db04b4173cb47f39dda59f43b to d572ee9e3ef0a97c044f02e9866469a8f3fa5858 | 
  [production] | 
            
  | 22:00 | 
  <bblack> | 
  cp1099: depooling varnish backends for storage size experimentation | 
  [production] | 
            
  | 21:56 | 
  <thcipriani@tin> | 
  Started scap: testwiki to php-1.28.0-wmf.19 and rebuild l10n cache | 
  [production] | 
            
  | 21:41 | 
  <thcipriani@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: Revert group0 wikis to 1.28.0-wmf.19 | 
  [production] | 
            
  | 21:30 | 
  <thcipriani@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: group0 wikis to 1.28.0-wmf.19 | 
  [production] | 
            
  | 20:40 | 
  <hoo> | 
  Removed today's Wikidata json dumps: All shards succeeded, but final dump composition apparently failed. | 
  [production] | 
            
  | 20:14 | 
  <chasemp> | 
  reboot labstore1004 | 
  [production] | 
            
  | 20:08 | 
  <Pchelolo> | 
  restbase deploy 4829630f staging | 
  [production] | 
            
  | 18:49 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/throttle.php: SWAT: [[gerrit:311417|Throttle for RCL (T145838)]] (duration: 00m 47s) | 
  [production] | 
            
  | 18:43 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:311229|ORES default threshold to high for wikidatawiki (T144784)]] (duration: 00m 47s) | 
  [production] | 
            
  | 18:32 | 
  <jynus> | 
  emergency/unscheduled restart of mariadb @ labsdb1003 - close to OOM, unusable | 
  [production] | 
            
  | 18:14 | 
  <thcipriani> | 
  ran on terbium: mwscript extensions/ShortUrl/populateShortUrlTable.php --wiki=bdwikimedia | 
  [production] | 
            
  | 17:47 | 
  <awight> | 
  reenable banner history queue consumer | 
  [production] | 
            
  | 17:46 | 
  <awight> | 
  update civicrm from 1df25962834885121bd7a9ba856c0c69c2b9cfda to c9157ba6aac3ad3c2fd61c7bb0475851fb8ec421 | 
  [production] | 
            
  | 17:39 | 
  <ejegg> | 
  updated payments-wiki from 392d67520d14998d61823755b22df50ab45afb35 to 4cd18776ca67fe0db04b4173cb47f39dda59f43b | 
  [production] | 
            
  | 17:36 | 
  <Krenair> | 
  Reset wikitech/horizon 2fa for Greg per request | 
  [production] | 
            
  | 15:50 | 
  <akosiaris> | 
  T107306 uploaded to apt.wikimedia.org jessie-wikimedia: apertium-nno-nob_1.1.0~r66076-1+wmf1 | 
  [production] | 
            
  | 15:50 | 
  <akosiaris> | 
  T107306 uploaded to apt.wikimedia.org jessie-wikimedia: apertium-br-fr_0.5.0~r61325-1+wmf1 | 
  [production] | 
            
  | 14:40 | 
  <chasemp> | 
  testing nfs export performance on labstore1004/1005 cluster | 
  [production] | 
            
  | 14:35 | 
  <yurik> | 
  depl graphoid https://gerrit.wikimedia.org/r/#/c/311374/ | 
  [production] | 
            
  | 14:28 | 
  <moritzm> | 
  uploaded apache 2.4.10-10+deb8u7+wmf1 for jessie-wikimedia to carbon | 
  [production] | 
            
  | 14:21 | 
  <elukey> | 
  adding aqs1004 to live traffic - aqs.svc.eqiad.wmnet - T144497 | 
  [production] | 
            
  | 14:10 | 
  <moritzm> | 
  reimaging mw1246-mw1248 to jessie | 
  [production] | 
            
  | 14:10 | 
  <hashar> | 
  European SWAT is complete. | 
  [production] | 
            
  | 14:05 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] | 
            
  | 14:05 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:311327|Add WT namespace alias to NS_PROJECT in mywiktionary (T140998)]] (duration: 00m 47s) | 
  [production] | 
            
  | 14:01 | 
  <hashar@tin> | 
  Synchronized php-1.28.0-wmf.19/extensions/Graph: Fixed wikiraw: protocol bug T146010 (duration: 00m 47s) | 
  [production] | 
            
  | 14:00 | 
  <hashar@tin> | 
  Synchronized php-1.28.0-wmf.18/extensions/Graph: Fixed wikiraw: protocol bug T146010 (duration: 00m 48s) | 
  [production] | 
            
  | 13:58 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:309823|Enable WikidataPageBanner on itwikiwoyage (T145328)]] (duration: 00m 48s) | 
  [production] | 
            
  | 13:55 | 
  <hashar> | 
  Europe SWAT extended as we still have some patches to process | 
  [production] | 
            
  | 13:47 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/throttle.php: SWAT: [[gerrit:311086|Throttling rule for RCL (T145838)]] [[gerrit:311087|[throttle] Allow the same number accounts]] [[gerrit:311088|Throttle for RCL]] (duration: 00m 47s) | 
  [production] | 
            
  | 13:18 | 
  <hashar@tin> | 
  Synchronized php-1.28.0-wmf.19/includes/api/ApiQueryBacklinksprop.php: API: Force straight join for prop=linkshere|transcludedin|fileusage T145079 (duration: 00m 47s) | 
  [production] |