| 
      
        2017-06-29
      
      §
     | 
  
    
  | 07:10 | 
  <elukey@tin> | 
  Started deploy [analytics/refinery@f6cccf9]: Updated stat1002 with the last refinery deployment | 
  [production] | 
            
  | 07:10 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1028 - T166208 (duration: 00m 47s) | 
  [production] | 
            
  | 07:09 | 
  <joal@tin> | 
  Finished deploy [analytics/refinery@f6cccf9]: (no justification provided) (duration: 05m 55s) | 
  [production] | 
            
  | 07:03 | 
  <joal@tin> | 
  Started deploy [analytics/refinery@f6cccf9]: (no justification provided) | 
  [production] | 
            
  | 04:33 | 
  <Krinkle> | 
  'service hhvm restart' on mwdebug1001 and mwdebug1002 (T168540) | 
  [production] | 
            
  | 03:56 | 
  <Krinkle> | 
  'service hhvm restart' on mwdebug1001 and mwdebug1002 to help investigate T168540 | 
  [production] | 
            
  | 03:09 | 
  <kartik@tin> | 
  Finished deploy [cxserver/deploy@6f0e9a7]: Update cxserver to e69353b (duration: 02m 28s) | 
  [production] | 
            
  | 03:07 | 
  <kartik@tin> | 
  Started deploy [cxserver/deploy@6f0e9a7]: Update cxserver to e69353b | 
  [production] | 
            
  | 02:52 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Thu Jun 29 02:52:57 UTC 2017 (duration 6m 52s) | 
  [production] | 
            
  | 02:46 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.30.0-wmf.7) (duration: 07m 43s) | 
  [production] | 
            
  | 02:26 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.30.0-wmf.6) (duration: 09m 24s) | 
  [production] | 
            
  | 01:08 | 
  <mutante> | 
  mwlog1001 - deleted /srv/xenon/logs from 2015 and 2016 as requested by Krinkle. Also merged https://gerrit.wikimedia.org/r/#/c/362114/ so now logs are retained for 14 days | 
  [production] | 
            
  | 00:23 | 
  <krinkle@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: I8ce28a4ce7 - test2wiki config cleanup (duration: 00m 47s) | 
  [production] | 
            
  
    | 
      
        2017-06-28
      
      §
     | 
  
    
  | 23:44 | 
  <thcipriani@tin> | 
  Synchronized php-1.30.0-wmf.7/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: SWAT: [[gerrit:361950|Adding ssclick events for sister-search results]] T168916 (duration: 00m 46s) | 
  [production] | 
            
  | 23:36 | 
  <thcipriani@tin> | 
  Synchronized php-1.30.0-wmf.6/extensions/MobileFrontend/includes/specials/SpecialMobileDiff.php: SWAT: [[gerrit:361944|Revert "Run DiffViewHeader in mobile mode, too"]] T169024 (duration: 00m 46s) | 
  [production] | 
            
  | 23:35 | 
  <thcipriani@tin> | 
  Synchronized php-1.30.0-wmf.7/extensions/MobileFrontend/includes/specials/SpecialMobileDiff.php: SWAT: [[gerrit:361945|Revert "Run DiffViewHeader in mobile mode, too"]] T169024 (duration: 00m 47s) | 
  [production] | 
            
  | 22:10 | 
  <demon@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: rm more stupid logging, wow this stuff has piled up (duration: 00m 46s) | 
  [production] | 
            
  | 22:09 | 
  <ppchelko@tin> | 
  Finished deploy [eventstreams/deploy@ba71a84]: redeploy to pick up config changes (duration: 02m 01s) | 
  [production] | 
            
  | 22:07 | 
  <ppchelko@tin> | 
  Started deploy [eventstreams/deploy@ba71a84]: redeploy to pick up config changes | 
  [production] | 
            
  | 22:06 | 
  <demon@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: kill temp-debug (duration: 00m 46s) | 
  [production] | 
            
  | 21:50 | 
  <robh> | 
  wtp1025-1048 are having icinga reporting errors, they are new installs on stretch | 
  [production] | 
            
  | 21:48 | 
  <demon@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: kill weird testwiki logging (duration: 00m 47s) | 
  [production] | 
            
  | 21:38 | 
  <ppchelko@tin> | 
  Finished deploy [eventstreams/deploy@05bcc8f]: redeploy to pick up config changes (duration: 00m 20s) | 
  [production] | 
            
  | 21:37 | 
  <ppchelko@tin> | 
  Started deploy [eventstreams/deploy@05bcc8f]: redeploy to pick up config changes | 
  [production] | 
            
  | 21:34 | 
  <demon@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: kill oai logging channel (duration: 00m 47s) | 
  [production] | 
            
  | 20:17 | 
  <twentyafterfour@tin> | 
  Synchronized php-1.30.0-wmf.7/extensions/VisualEditor/VisualEditor.hooks.php: sync https://gerrit.wikimedia.org/r/#/c/361941/ refs T169132 T167536 (duration: 00m 47s) | 
  [production] | 
            
  | 20:08 | 
  <mutante> | 
  migrating servermon to stretch on netmon1002 is currently blocked by "python-django-south" package not existing anymore | 
  [production] | 
            
  | 19:36 | 
  <robh> | 
  puppet suspended on install1002 for robh to livehack the dhcp file for a single reboot of wtp1025 | 
  [production] | 
            
  | 19:26 | 
  <twentyafterfour@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.30.0-wmf.7 refs T167536 | 
  [production] | 
            
  | 19:26 | 
  <twentyafterfour@tin> | 
  Synchronized php-1.30.0-wmf.7/extensions/LoginNotify/includes/Hooks.php: deploy https://gerrit.wikimedia.org/r/#/c/361935/ to wmf.7 refs T168899 + T167536 (duration: 00m 45s) | 
  [production] | 
            
  | 19:17 | 
  <twentyafterfour> | 
  cherry-picked https://gerrit.wikimedia.org/r/#/c/361935/ to wmf.7 refs T168899 + T167536 | 
  [production] | 
            
  | 19:00 | 
  <ebernhardson> | 
  starting load testing of elasticsearch in codfw | 
  [production] | 
            
  | 18:31 | 
  <joal@tin> | 
  Finished deploy [analytics/refinery@f6cccf9]: Regular deploy - One week late- Big changes (duration: 04m 49s) | 
  [production] | 
            
  | 18:26 | 
  <joal@tin> | 
  Started deploy [analytics/refinery@f6cccf9]: Regular deploy - One week late- Big changes | 
  [production] | 
            
  | 18:13 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:361695|Enable autopatrol flag on ptwikivoyage]] T168981 (duration: 00m 47s) | 
  [production] | 
            
  | 18:05 | 
  <aaron@tin> | 
  Synchronized wmf-config/CommonSettings.php: Set $wgTrxProfilerLimits[PostSend] to avoid notices for now (duration: 00m 47s) | 
  [production] | 
            
  | 18:04 | 
  <kartik@tin> | 
  Finished deploy [cxserver/deploy@894e3fe]: (no justification provided) (duration: 02m 03s) | 
  [production] | 
            
  | 18:02 | 
  <kartik@tin> | 
  Started deploy [cxserver/deploy@894e3fe]: (no justification provided) | 
  [production] | 
            
  | 15:52 | 
  <marostegui> | 
  Temporary ignore jawiki.watchlist table during replication on dbstore1001 - T169050 | 
  [production] | 
            
  | 15:47 | 
  <kartik@tin> | 
  Finished deploy [cxserver/deploy@894e3fe]: (no justification provided) (duration: 02m 47s) | 
  [production] | 
            
  | 15:44 | 
  <kartik@tin> | 
  Started deploy [cxserver/deploy@894e3fe]: (no justification provided) | 
  [production] | 
            
  | 15:29 | 
  <jynus> | 
  slowly enabling puppet on pending database hosts, checking diff on each one | 
  [production] | 
            
  | 14:42 | 
  <hashar> | 
  pypi.python.org is back again - T169091 | 
  [production] | 
            
  | 14:06 | 
  <hashar> | 
  pypi.python.org has an issue with its CDN . That would affect any CI jobs relying on tox/python  - See https://status.python.org for updates and T169091 | 
  [production] | 
            
  | 14:03 | 
  <hashar> | 
  pypi.python.org has an issue with its CDN . That would affect any CI jobs relying on tox/python  - See https://status.python.org for updates | 
  [production] | 
            
  | 13:51 | 
  <XioNoX> | 
  tigntening BGP configuration on cr* routers - T169048 | 
  [production] | 
            
  | 13:44 | 
  <gehel> | 
  start reimage of the maps-test cluster - T169011 | 
  [production] | 
            
  | 13:30 | 
  <akosiaris> | 
  renumber install1002 | 
  [production] | 
            
  | 12:47 | 
  <marostegui> | 
  Deploy alter table on s3 directly on codfw master (db2018) and let it replicate - T168661 | 
  [production] | 
            
  | 12:42 | 
  <jynus> | 
  starting enabling puppet on db2* hosts | 
  [production] |