| 
      
        2017-09-05
      
      §
     | 
  
    
  | 12:24 | 
  <hashar> | 
  ci: switched mediawiki/core mediawiki/vendor php5.5 jobs from trusty to jessie - T161882 | 
  [production] | 
            
  | 12:15 | 
  <ladsgroup@tin> | 
  Synchronized wmf-config/Wikibase-production.php: Enable sendEchoNotification for enwiki, dewiki, frwiki (T142102) (duration: 00m 46s) | 
  [production] | 
            
  | 11:54 | 
  <marostegui> | 
  Drop reader_feedback, reader_feedback_history, reader_feedback_pages tables - T174586 | 
  [production] | 
            
  | 11:07 | 
  <hoo@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: (Actually) Enable the ArticlePlaceholder on sqwiki (T174335) (duration: 00m 45s) | 
  [production] | 
            
  | 11:05 | 
  <hoo@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Enable the ArticlePlaceholder on sqwiki (T174335) (duration: 00m 46s) | 
  [production] | 
            
  | 10:38 | 
  <hashar> | 
  Nodepool / CI are fully backup and processing queued jobs | 
  [production] | 
            
  | 10:25 | 
  <hashar> | 
  Restarting Nodepool. I have managed to spawn instances manually for contintcloud tenant | 
  [production] | 
            
  | 10:18 | 
  <_joe_> | 
  stopping puppet, nginx on mw2249 for experimentation | 
  [production] | 
            
  | 10:11 | 
  <ema> | 
  reboot cp4024 T174891 | 
  [production] | 
            
  | 10:08 | 
  <godog> | 
  copy python-logstash from jessie-wikimedia to stretch-wikimedia | 
  [production] | 
            
  | 09:59 | 
  <hashar> | 
  Stopped Nodepool on labnodepool1001.eqiad.wmnet | 
  [production] | 
            
  | 09:52 | 
  <akosiaris> | 
  reimage kubernetes[12]00[1-4] T170119 | 
  [production] | 
            
  | 08:49 | 
  <moritzm> | 
  upgrading canary app servers to hhvm-luasandbox 2.0.14 (T173705) | 
  [production] | 
            
  | 08:47 | 
  <moritzm> | 
  uploaded php-luasandbox/hhvm-luasandbox 2.0.14 to apt.wikimedia.org (T173705) | 
  [production] | 
            
  | 07:14 | 
  <moritzm> | 
  installing libgd security updates on canary app servers (along with hhvm restart) | 
  [production] | 
            
  | 07:03 | 
  <_joe_> | 
  launching manually 3 workers for refreshLinks jobs on commons, T173710 | 
  [production] | 
            
  | 06:32 | 
  <marostegui> | 
  Deploy alter table on db1083 - T174509 | 
  [production] | 
            
  | 06:29 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1083 - T174509 (duration: 00m 46s) | 
  [production] | 
            
  | 06:25 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1089 - T174509 (duration: 00m 46s) | 
  [production] | 
            
  | 06:09 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1089 - T174509 (duration: 00m 55s) | 
  [production] | 
            
  | 02:30 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Tue Sep  5 02:30:03 UTC 2017 (duration 6m 37s) | 
  [production] | 
            
  | 02:23 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.30.0-wmf.16) (duration: 07m 28s) | 
  [production] | 
            
  
    | 
      
        2017-09-04
      
      §
     | 
  
    
  | 23:32 | 
  <Dereckson> | 
  Set e-mail to Hexabot bot account to allow account recovery (T174973) | 
  [production] | 
            
  | 22:07 | 
  <legoktm> | 
  starting script to reparse all pages in parsoid for Linter (python2 parsoid-reparse.py http://parsoid.discovery.wmnet:8000 --sitematrix --linter-only --skip-closed https://aa.wikipedia.org/w/api.php) - T161556 | 
  [production] | 
            
  | 17:50 | 
  <moritzm> | 
  uploaded debdeploy 0.0.99-2 to apt.wikimedia.org | 
  [production] | 
            
  | 17:19 | 
  <gehel@tin> | 
  Finished deploy [wdqs/wdqs@1caaa30]: weekly WDQS deployment (duration: 02m 46s) | 
  [production] | 
            
  | 17:17 | 
  <gehel@tin> | 
  Started deploy [wdqs/wdqs@1caaa30]: weekly WDQS deployment | 
  [production] | 
            
  | 16:29 | 
  <mobrovac@tin> | 
  Finished deploy [restbase/deploy@8c9c436]: (no justification provided) (duration: 06m 23s) | 
  [production] | 
            
  | 16:23 | 
  <mobrovac@tin> | 
  Started deploy [restbase/deploy@8c9c436]: (no justification provided) | 
  [production] | 
            
  | 16:10 | 
  <mobrovac> | 
  restbase depooled restbase10(0[89]|10) and restbase2005 for T169939 | 
  [production] | 
            
  | 16:07 | 
  <_joe_> | 
  rolling restart of pybal in codfw/eqiad low-traffic pools for picking up the new jobrunner LVS endpoint | 
  [production] | 
            
  | 15:42 | 
  <oblivian@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: cluster=jobrunner,service=nginx | 
  [production] | 
            
  | 14:51 | 
  <godog> | 
  reimage restbase2003 for use with cassandra 3 / jbod - T169939 | 
  [production] | 
            
  | 14:27 | 
  <moritzm> | 
  enabled LDAP authentication for ganglia.wikimedia.org | 
  [production] | 
            
  | 13:37 | 
  <gehel> | 
  rolling restart of elasticsearch/logstash to cleanup unused plugins - T174933 | 
  [production] | 
            
  | 13:34 | 
  <gehel> | 
  delete leftover grafana-dashboards index on elasticsearch logstash cluster | 
  [production] | 
            
  | 13:22 | 
  <gehel> | 
  restart elasticsearch on logstash1006 to test plugin removal - T174933 | 
  [production] | 
            
  | 12:26 | 
  <moritzm> | 
  uploaded debdeploy 0.0.99-1+trusty/trusty-wikimedia to apt.wikimedia.org | 
  [production] | 
            
  | 12:18 | 
  <marostegui> | 
  Stop MySQL on db1037 as it is going to be decommissioned - T174902 | 
  [production] | 
            
  | 12:10 | 
  <elukey> | 
  rolling restart of zookeeper on conf100[123] for jvm security updates | 
  [production] | 
            
  | 11:53 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Remove db1037 as it will be decommissioned - T174902 (duration: 00m 46s) | 
  [production] | 
            
  | 11:52 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Remove db1037 as it will be decommissioned - T174902 (duration: 00m 46s) | 
  [production] | 
            
  | 11:45 | 
  <godog> | 
  restart varnish on cp1099 - mailbox lag | 
  [production] | 
            
  | 10:22 | 
  <ariel@tin> | 
  Finished deploy [dumps/dumps@0b32eef]: fix abstract dumps variants regression (duration: 00m 02s) | 
  [production] | 
            
  | 10:22 | 
  <ariel@tin> | 
  Started deploy [dumps/dumps@0b32eef]: fix abstract dumps variants regression | 
  [production] | 
            
  | 09:51 | 
  <moritzm> | 
  uploaded debdeploy 0.0.99-1+jessie/jessie-wikimedia to apt.wikimedia.org | 
  [production] | 
            
  | 09:41 | 
  <mobrovac@tin> | 
  Started restart [mathoid/deploy@44ea6d8]: Restart for libxml update | 
  [production] | 
            
  | 09:36 | 
  <moritzm> | 
  uploaded debdeploy 0.0.99-1/stretch-wikimedia to apt.wikimedia.org | 
  [production] | 
            
  | 08:52 | 
  <elukey> | 
  restart zookeeper on conf2003 for jvm security updates | 
  [production] | 
            
  | 08:48 | 
  <marostegui> | 
  Stop MySQL on db1045 as it will be decommissioned - T174806 | 
  [production] |