| 
      
        2016-11-30
      
      §
     | 
  
    
  | 14:44 | 
  <marostegui> | 
  Stop MySQL and shutdown db2048 for maintenance - T149553 | 
  [production] | 
            
  | 14:44 | 
  <Dereckson> | 
  EU SWAT done | 
  [production] | 
            
  | 14:42 | 
  <jynus> | 
  mysql restart and general upgrade for es2011 T151995 | 
  [production] | 
            
  | 14:42 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Add WMF staff local groups to $wmgPrivilegedGroups (T150951) (duration: 00m 46s) | 
  [production] | 
            
  | 14:40 | 
  <dereckson@tin> | 
  Synchronized php-1.29.0-wmf.4/extensions/ContentTranslation/modules/tools/ext.cx.tools.template.js: Allow template editor even if parameter mapping fails completely (T151868) (duration: 00m 45s) | 
  [production] | 
            
  | 14:23 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Add dashboard.wikiedu.org IPv6 to en.wikipedia rate limit exempt (T151823) (duration: 00m 45s) | 
  [production] | 
            
  | 14:17 | 
  <dereckson@tin> | 
  Synchronized static/images/project-logos: New project logos for wiki to create (arbcom cs, fi.wikivoyage) (duration: 00m 46s) | 
  [production] | 
            
  | 14:06 | 
  <jynus> | 
  mysql restart and general upgrade for es2014 T151995 | 
  [production] | 
            
  | 13:55 | 
  <Dereckson> | 
  Reset user email for projectcomwiki initial account "Mjohnson (WMF)" | 
  [production] | 
            
  | 13:15 | 
  <jynus> | 
  mysql restart and general upgrade for es2017 T151995 | 
  [production] | 
            
  | 13:10 | 
  <reedy@tin> | 
  Synchronized php-1.29.0-wmf.4/extensions/CentralAuth/maintenance/populateLocalAndGlobalIds.php: More skipping (duration: 00m 44s) | 
  [production] | 
            
  | 13:09 | 
  <reedy@tin> | 
  Synchronized php-1.29.0-wmf.3/extensions/CentralAuth/maintenance/populateLocalAndGlobalIds.php: More skipping (duration: 01m 34s) | 
  [production] | 
            
  | 13:08 | 
  <jynus> | 
  mysql restart and general upgrade for es2019 T151995 | 
  [production] | 
            
  | 12:55 | 
  <ema> | 
  bumping vsl log buffer on cp3032 (depooled) -- T151643 | 
  [production] | 
            
  | 12:29 | 
  <jynus> | 
  mysql restart and general upgrade for es2015 T151995 | 
  [production] | 
            
  | 11:44 | 
  <_joe_> | 
  upgrading HHVM across appservers in eqiad | 
  [production] | 
            
  | 11:28 | 
  <ariel@tin> | 
  Finished deploy [dumps/dumps@50689c8]: (no message) (duration: 00m 07s) | 
  [production] | 
            
  | 11:28 | 
  <ariel@tin> | 
  Starting deploy [dumps/dumps@50689c8]: (no message) | 
  [production] | 
            
  | 11:22 | 
  <_joe_> | 
  repooling mw1276, after tests for T151702 | 
  [production] | 
            
  | 11:16 | 
  <marostegui> | 
  Stop replication s3 - db1095 - maintenance - T147052 | 
  [production] | 
            
  | 11:07 | 
  <_joe_> | 
  rolling upgrade of hhvm on the eqiad api cluster | 
  [production] | 
            
  | 09:42 | 
  <marostegui> | 
  Stop mysql on db2048 for maintenance - https://phabricator.wikimedia.org/T149553 | 
  [production] | 
            
  | 08:44 | 
  <_joe_> | 
  stopped dedicated commonswiki jobrunner T151196 | 
  [production] | 
            
  | 07:17 | 
  <marostegui> | 
  Deploy alter table dbstore1002 - dewiki.revision - T148967 | 
  [production] | 
            
  | 07:06 | 
  <marostegui> | 
  Stop mysql db2048 maintenance - T149553 | 
  [production] | 
            
  | 02:07 | 
  <hoo> | 
  Updated Wikidata's property suggester with data from Monday's json dump and applied the T132839 workarounds | 
  [production] | 
            
  | 00:53 | 
  <kaldari@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: sync InitialiseSettings to test cookie blocking on Test Wikipedia (duration: 00m 45s) | 
  [production] | 
            
  | 00:52 | 
  <TimStarling> | 
  on mw1276: tuning jemalloc, will restart hhvm several times, running it in a terminal | 
  [production] | 
            
  | 00:40 | 
  <mutante> | 
  phab2001 - enabled puppet to bring it up2date with a various changes | 
  [production] | 
            
  
    | 
      
        2016-11-29
      
      §
     | 
  
    
  | 23:41 | 
  <ejegg> | 
  updated fundraising dashboard from 43039fde037aa983d4490da08c8072bb2788e28a to 7ce4f03da78fe0469727033db8d514e9596dd9ac | 
  [production] | 
            
  | 23:04 | 
  <demon@tin> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: prod no-op (duration: 00m 46s) | 
  [production] | 
            
  | 22:58 | 
  <demon@tin> | 
  Synchronized php-1.29.0-wmf.4/includes/debug/logger/monolog: logging fixes (duration: 00m 45s) | 
  [production] | 
            
  | 22:56 | 
  <demon@tin> | 
  Synchronized php-1.29.0-wmf.4/autoload.php: logging fixes (duration: 00m 45s) | 
  [production] | 
            
  | 22:49 | 
  <ejegg> | 
  extended donation queue consumer duty cycle from 90 to 105 seconds | 
  [production] | 
            
  | 22:33 | 
  <ejegg> | 
  disabled CiviMail activity creation for thank you sender | 
  [production] | 
            
  | 22:23 | 
  <demon@tin> | 
  Finished scap: Ok, back to normal now (duration: 26m 14s) | 
  [production] | 
            
  | 21:57 | 
  <demon@tin> | 
  Started scap: Ok, back to normal now | 
  [production] | 
            
  | 21:55 | 
  <demon@tin> | 
  scap aborted: probably won't work, no-op (duration: 01m 03s) | 
  [production] | 
            
  | 21:54 | 
  <demon@tin> | 
  Started scap: probably won't work, no-op | 
  [production] | 
            
  | 21:48 | 
  <demon@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: group0 back to wmf.3 | 
  [production] | 
            
  | 21:47 | 
  <demon@tin> | 
  scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.cPclJsf3pO" ' returned non-zero exit status 139 (duration: 00m 23s) | 
  [production] | 
            
  | 21:47 | 
  <demon@tin> | 
  Started scap: mw.org back to wmf.3 | 
  [production] | 
            
  | 21:44 | 
  <demon@tin> | 
  scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.v5ELy9acbV" ' returned non-zero exit status 139 (duration: 00m 23s) | 
  [production] | 
            
  | 21:44 | 
  <demon@tin> | 
  Started scap: rebuild l10n for wmf.4 -- attempt #3 | 
  [production] | 
            
  | 21:42 | 
  <demon@tin> | 
  scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.6ehbXfKDfD" ' returned non-zero exit status 139 (duration: 00m 23s) | 
  [production] | 
            
  | 21:42 | 
  <demon@tin> | 
  Started scap: rebuild l10n for wmf.4 -- attempt #2 | 
  [production] | 
            
  | 21:41 | 
  <demon@tin> | 
  scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.wDhBxhXGtC" ' returned non-zero exit status 139 (duration: 00m 57s) | 
  [production] | 
            
  | 21:41 | 
  <demon@tin> | 
  Started scap: rebuild l10n for wmf.4 | 
  [production] | 
            
  | 21:40 | 
  <demon@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: helps to actually sync updated files | 
  [production] | 
            
  | 21:39 | 
  <mutante> | 
  servermon - manually running "make_updates" command from cron for debugging - failed with a mysql_excetpion, lock wait timeout exceeded | 
  [production] |