| 
      
        2017-05-25
      
      §
     | 
  
    
  | 19:22 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:354612|Add Code of Conduct footer links to wikitech and mw.o]] Part I (duration: 00m 39s) | 
  [production] | 
            
  | 19:09 | 
  <thcipriani@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.30.0-wmf.2 | 
  [production] | 
            
  | 18:47 | 
  <volans> | 
  completed upgrade of facter across the fleet T166203 (apart few hosts down) | 
  [production] | 
            
  | 18:39 | 
  <volans> | 
  forcing BBU learn on db1016 | 
  [production] | 
            
  | 18:34 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:355114|Remove special Math extension settings for hewiki]] [[gerrit:353971|Remove UseMathJax from CommonSettings.php]] T165475 (duration: 00m 43s) | 
  [production] | 
            
  | 18:27 | 
  <urandom> | 
  T164865: RESTBase dev, re-enable render range deletes | 
  [production] | 
            
  | 18:12 | 
  <thcipriani> | 
  mwscript namespaceDupes.php hewiki --fix | 
  [production] | 
            
  | 18:12 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:352889|Add namespace aliases for Hebrew Wikipedia]] T164858 (duration: 00m 47s) | 
  [production] | 
            
  | 17:51 | 
  <volans@sarin> | 
  conftool action : set/pooled=inactive; selector: name=mw2140.codfw.wmnet | 
  [production] | 
            
  | 17:31 | 
  <jynus@neodymium> | 
  conftool action : set/pooled=no; selector: name=mw2140.codfw.wmnet | 
  [production] | 
            
  | 17:30 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-codfw.php: Repool db2055 after maintenance, 2nd try (duration: 02m 42s) | 
  [production] | 
            
  | 17:25 | 
  <jynus@neodymium> | 
  conftool action : set/pooled=inactive; selector: name=mw2140.codfw.wmnet | 
  [production] | 
            
  | 17:14 | 
  <bsitzmann@tin> | 
  Finished deploy [mobileapps/deploy@614d752]: Update mobileapps to 946fe1f (duration: 04m 04s) | 
  [production] | 
            
  | 17:12 | 
  <jynus> | 
  powercycling mw2140 | 
  [production] | 
            
  | 17:10 | 
  <bsitzmann@tin> | 
  Started deploy [mobileapps/deploy@614d752]: Update mobileapps to 946fe1f | 
  [production] | 
            
  | 17:07 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-codfw.php: Repool db2055 after maintenance (duration: 02m 43s) | 
  [production] | 
            
  | 16:27 | 
  <urandom> | 
  T164865: RESTBase dev, re-enable revision range deletes | 
  [production] | 
            
  | 15:43 | 
  <godog> | 
  delete thumbnails with > 2000px for wikivoyage / wikiversity / wikisource / wikiquote - T162796 | 
  [production] | 
            
  | 15:28 | 
  <jynus> | 
  restarting and upgrading db2055 for kernel downgrade | 
  [production] | 
            
  | 14:40 | 
  <bblack> | 
  restart cp1074 backend (mailbox) | 
  [production] | 
            
  | 14:08 | 
  <godog> | 
  shut ms-be1021 for BBU replacement - T163777 | 
  [production] | 
            
  | 13:39 | 
  <jynus> | 
  restarting and upgrading db2055 for maintenance | 
  [production] | 
            
  | 13:29 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-codfw.php: Depool db2055 for maintenance (duration: 00m 41s) | 
  [production] | 
            
  | 13:22 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1077 back to high load after maintenance (duration: 00m 41s) | 
  [production] | 
            
  | 13:04 | 
  <elukey> | 
  restart cassandra-a on aqs1004 to test https://gerrit.wikimedia.org/r/354107 | 
  [production] | 
            
  | 12:41 | 
  <akosiaris> | 
  cordon kubernetes100{2,3,4} for testing calico-node on kubernetes1001 | 
  [production] | 
            
  | 10:01 | 
  <elukey> | 
  restart HDFS datanode daemons on all the hadoop worker nodes for jvm upgrades | 
  [production] | 
            
  | 09:39 | 
  <elukey> | 
  reimage analytics1030 to Debian Jessie - T165529 | 
  [production] | 
            
  | 09:35 | 
  <elukey> | 
  restart Yarn nodemanager daemons on all the hadoop worker nodes for jvm upgrades | 
  [production] | 
            
  | 09:28 | 
  <godog> | 
  ban commons object on request in ulsfo | 
  [production] | 
            
  | 09:07 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1077 after maintenance with low weight (duration: 00m 41s) | 
  [production] | 
            
  | 08:25 | 
  <jynus> | 
  stopping and restarting db1077 | 
  [production] | 
            
  | 08:03 | 
  <volans> | 
  resuming slow upgrade of facter across the fleet checking is a noop T166203 | 
  [production] | 
            
  | 07:58 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1077 for maintenance and upgrade (duration: 00m 41s) | 
  [production] | 
            
  | 07:40 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Depool db2057 - T166278 (duration: 00m 41s) | 
  [production] | 
            
  | 07:28 | 
  <godog> | 
  roll-restart jessie ms-be2* for linux 4.9 update - T162029 | 
  [production] | 
            
  | 06:21 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1097 - T166206 (duration: 00m 55s) | 
  [production] | 
            
  | 05:58 | 
  <marostegui> | 
  Start pt-table-checksum on s1 - T162807 | 
  [production] | 
            
  | 02:51 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Thu May 25 02:51:53 UTC 2017 (duration 6m 38s) | 
  [production] | 
            
  | 02:45 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.30.0-wmf.2) (duration: 07m 18s) | 
  [production] | 
            
  | 02:26 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.30.0-wmf.1) (duration: 09m 46s) | 
  [production] | 
            
  | 00:18 | 
  <aaron@tin> | 
  Synchronized wmf-config/ProductionServices.php: Enable HTTPs for Swift usage (duration: 00m 41s) | 
  [production] | 
            
  | 00:15 | 
  <aaron@tin> | 
  Synchronized wmf-config/filebackend.php: Enable HTTPs for Swift usage (duration: 00m 41s) | 
  [production] | 
            
  | 00:10 | 
  <twentyafterfour> | 
  phabricator upgrade complete, service is online | 
  [production] | 
            
  | 00:06 | 
  <twentyafterfour> | 
  upgrading phabricator, expect momentary downtime | 
  [production] |