| 
      
        2018-04-11
      
      §
     | 
  
    
  | 23:19 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Allow sysops to create Flow boards on euwiki (T190500) (duration: 01m 17s) | 
  [production] | 
            
  | 23:09 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Stop logging autopatrol actions everywhere (T184485) (duration: 01m 18s) | 
  [production] | 
            
  | 22:47 | 
  <samwilson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Deploy GlobalPreferences T184121 (duration: 01m 17s) | 
  [production] | 
            
  | 22:47 | 
  <mutante> | 
  ores2* - puppet ran to change venv config, then 'rm -rf /srv/deployment/ores/venv/' via cumin to clean-up (T181071) | 
  [production] | 
            
  | 22:41 | 
  <mutante> | 
  ores1002-1009 - deleting old venv dir - rm -f /srv/deployment/ores/venv (T181071) | 
  [production] | 
            
  | 22:37 | 
  <mutante> | 
  ores1001 - rm -rf /srv/deployment/ores/venv/ | 
  [production] | 
            
  | 22:37 | 
  <mutante> | 
  ores - same for codfw instances, change of venv path to /srv/deployment/ores/deploy/venv/ | 
  [production] | 
            
  | 22:30 | 
  <mutante> | 
  ores - all eqiad instances are being restarted by puppet after config change | 
  [production] | 
            
  | 22:28 | 
  <mutante> | 
  ores - running puppet on all instances to apply venv path change for T181071 | 
  [production] | 
            
  | 22:24 | 
  <musikanimal@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Enabling PageAssessments on huwiki (T191697) (duration: 01m 17s) | 
  [production] | 
            
  | 22:23 | 
  <bstorm_> | 
  views updated on labsdb1009 | 
  [production] | 
            
  | 22:13 | 
  <musikanimal@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Enabling PageAssessments on frwiki (T153393) (duration: 01m 26s) | 
  [production] | 
            
  | 20:36 | 
  <urandom> | 
  increase change-prop sample rate in dev env to 40% (from 20) -- T186751 | 
  [production] | 
            
  | 20:20 | 
  <awight@tin> | 
  Finished deploy [ores/deploy@b6deb5d]: Transitional virtualenv for ORES (take 2), T181071 (duration: 18m 34s) | 
  [production] | 
            
  | 20:02 | 
  <thcipriani@tin> | 
  Synchronized php: group1 to 1.31.0-wmf.29 (duration: 01m 16s) | 
  [production] | 
            
  | 20:02 | 
  <awight@tin> | 
  Started deploy [ores/deploy@b6deb5d]: Transitional virtualenv for ORES (take 2), T181071 | 
  [production] | 
            
  | 20:00 | 
  <thcipriani@tin> | 
  rebuilt and synchronized wikiversions files: group1 to 1.31.0-wmf.29 | 
  [production] | 
            
  | 19:23 | 
  <thcipriani@tin> | 
  rebuilt and synchronized wikiversions files: Group0 to 1.31.0-wmf.29 | 
  [production] | 
            
  | 19:11 | 
  <thcipriani@tin> | 
  rebuilt and synchronized wikiversions files: testwiki back to 1.31.0-wmf.29 | 
  [production] | 
            
  | 19:09 | 
  <thcipriani@tin> | 
  Synchronized php-1.31.0-wmf.29/includes/libs/rdbms/database: [[gerrit:425566|rdbms: fix transaction flushing in Database::close]] T191916 (duration: 01m 01s) | 
  [production] | 
            
  | 18:47 | 
  <urandom> | 
  restarting cassandra, dev environment (set -XX:+PerfDisableSharedMem) -- T186751 | 
  [production] | 
            
  | 18:11 | 
  <mutante> | 
  deploy1001 is back on stretch once again - it has been removed from scap hosts though (T175288 T185275) | 
  [production] | 
            
  | 17:40 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:425522|Deploy page previews for anons on dewiki]] T191966 (duration: 00m 54s) | 
  [production] | 
            
  | 17:30 | 
  <sbisson@tin> | 
  Finished deploy [kartotherian/deploy@4cd5a19]: Deploying kartotherian v0.0.38 everywhere (duration: 02m 27s) | 
  [production] | 
            
  | 17:29 | 
  <Krinkle> | 
  actually re-enabled puppet on graphite2001 | 
  [production] | 
            
  | 17:28 | 
  <sbisson@tin> | 
  Started deploy [kartotherian/deploy@4cd5a19]: Deploying kartotherian v0.0.38 everywhere | 
  [production] | 
            
  | 17:24 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:423496|Enable RemexHtml on wikis with <50 issues in high priority linter cats]] T190731 (duration: 00m 59s) | 
  [production] | 
            
  | 16:53 | 
  <sbisson@tin> | 
  Finished deploy [kartotherian/deploy@4cd5a19]: Deploying kartotherian v0.0.38 to maps-test* (duration: 01m 16s) | 
  [production] | 
            
  | 16:51 | 
  <sbisson@tin> | 
  Started deploy [kartotherian/deploy@4cd5a19]: Deploying kartotherian v0.0.38 to maps-test* | 
  [production] | 
            
  | 16:44 | 
  <elukey> | 
  restart hadoop hdfs namenodes on analytics100[12] to pick up HDFS Trash settings - T189051 | 
  [production] | 
            
  | 16:35 | 
  <robh> | 
  cp2018 returned to service | 
  [production] | 
            
  | 16:33 | 
  <foks> | 
  See T191887 | 
  [production] | 
            
  | 16:24 | 
  <robh> | 
  cp2011 returned to service | 
  [production] | 
            
  | 16:23 | 
  <marostegui> | 
  Reload haproxy on dbproxy1011 to depool labsdb1009 | 
  [production] | 
            
  | 16:14 | 
  <elukey> | 
  reboot notebook1001 for kernel updates | 
  [production] | 
            
  | 16:11 | 
  <urandom> | 
  restarting cassandra, dev environment (testing default GC settings) -- T186751 | 
  [production] | 
            
  | 15:58 | 
  <Krinkle> | 
  Re-enabled puppet and coal on graphite2001 | 
  [production] | 
            
  | 15:43 | 
  <robh> | 
  cp2008 repooled after memory swap | 
  [production] | 
            
  | 15:20 | 
  <Krinkle> | 
  disabling coal service on graphite2001 and disabling puppet – T191239 | 
  [production] | 
            
  | 15:19 | 
  <jynus> | 
  fixing grant issue on db1114 | 
  [production] | 
            
  | 15:14 | 
  <ema> | 
  restart pybal on lvs1003 for logstash-{json,syslog} UDP monitoring config changes https://gerrit.wikimedia.org/r/#/c/425253/ | 
  [production] | 
            
  | 15:08 | 
  <ema> | 
  restart pybal on lvs1006 for logstash-{json,syslog} UDP monitoring config changes https://gerrit.wikimedia.org/r/#/c/425253/ | 
  [production] | 
            
  | 15:06 | 
  <robh> | 
  shutting down cp2008, cp2011, and cp2018 for onsite work | 
  [production] | 
            
  | 15:01 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool es1012 (duration: 01m 00s) | 
  [production] | 
            
  | 15:01 | 
  <marlier> | 
  Stopping coal on graphite2001.codfw.wmnet for data replay | 
  [production] | 
            
  | 14:54 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-codfw.php: Repool es2013 (duration: 01m 00s) | 
  [production] | 
            
  | 14:54 | 
  <gehel> | 
  starting rolling restart of elasticsearch cirrus / eqiad for jvm upgrade | 
  [production] | 
            
  | 14:39 | 
  <moritzm> | 
  rolling restart of restbase in eqiad to pick up openssl update | 
  [production] | 
            
  | 14:38 | 
  <Krinkle> | 
  Turned regular coal back on (T191239) | 
  [production] | 
            
  | 14:37 | 
  <ppchelko@tin> | 
  Finished deploy [cpjobqueue/deploy@a090a3c]: Fix the low priority jobs topic names (duration: 00m 38s) | 
  [production] |