| 2016-11-29
      
      § | 
    
  | 23:41 | <ejegg> | updated fundraising dashboard from 43039fde037aa983d4490da08c8072bb2788e28a to 7ce4f03da78fe0469727033db8d514e9596dd9ac | [production] | 
            
  | 23:04 | <demon@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: prod no-op (duration: 00m 46s) | [production] | 
            
  | 22:58 | <demon@tin> | Synchronized php-1.29.0-wmf.4/includes/debug/logger/monolog: logging fixes (duration: 00m 45s) | [production] | 
            
  | 22:56 | <demon@tin> | Synchronized php-1.29.0-wmf.4/autoload.php: logging fixes (duration: 00m 45s) | [production] | 
            
  | 22:49 | <ejegg> | extended donation queue consumer duty cycle from 90 to 105 seconds | [production] | 
            
  | 22:33 | <ejegg> | disabled CiviMail activity creation for thank you sender | [production] | 
            
  | 22:23 | <demon@tin> | Finished scap: Ok, back to normal now (duration: 26m 14s) | [production] | 
            
  | 21:57 | <demon@tin> | Started scap: Ok, back to normal now | [production] | 
            
  | 21:55 | <demon@tin> | scap aborted: probably won't work, no-op (duration: 01m 03s) | [production] | 
            
  | 21:54 | <demon@tin> | Started scap: probably won't work, no-op | [production] | 
            
  | 21:48 | <demon@tin> | rebuilt wikiversions.php and synchronized wikiversions files: group0 back to wmf.3 | [production] | 
            
  | 21:47 | <demon@tin> | scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.cPclJsf3pO" ' returned non-zero exit status 139 (duration: 00m 23s) | [production] | 
            
  | 21:47 | <demon@tin> | Started scap: mw.org back to wmf.3 | [production] | 
            
  | 21:44 | <demon@tin> | scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.v5ELy9acbV" ' returned non-zero exit status 139 (duration: 00m 23s) | [production] | 
            
  | 21:44 | <demon@tin> | Started scap: rebuild l10n for wmf.4 -- attempt #3 | [production] | 
            
  | 21:42 | <demon@tin> | scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.6ehbXfKDfD" ' returned non-zero exit status 139 (duration: 00m 23s) | [production] | 
            
  | 21:42 | <demon@tin> | Started scap: rebuild l10n for wmf.4 -- attempt #2 | [production] | 
            
  | 21:41 | <demon@tin> | scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.wDhBxhXGtC" ' returned non-zero exit status 139 (duration: 00m 57s) | [production] | 
            
  | 21:41 | <demon@tin> | Started scap: rebuild l10n for wmf.4 | [production] | 
            
  | 21:40 | <demon@tin> | rebuilt wikiversions.php and synchronized wikiversions files: helps to actually sync updated files | [production] | 
            
  | 21:39 | <mutante> | servermon - manually running "make_updates" command from cron for debugging - failed with a mysql_excetpion, lock wait timeout exceeded | [production] | 
            
  | 21:21 | <mutante> | phab2001 - upgrading scap and other packages (we need to get puppet running here again) | [production] | 
            
  | 20:30 | <demon@tin> | Finished scap: wmf.4 for fun and profit (duration: 20m 55s) | [production] | 
            
  | 20:26 | <awight> | new thank-you letter deployed... | [production] | 
            
  | 20:23 | <awight> | update civicrm  from 8c76f437c9a9739ffae2892339a46d62d13fdf61 to f8f9263d4aa0b5ba9b09827174c9b2e9a90a004c | [production] | 
            
  | 20:09 | <demon@tin> | Started scap: wmf.4 for fun and profit | [production] | 
            
  | 20:07 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:323708|wikitech cloudadmin: remove right that no longer exists]] (duration: 00m 45s) | [production] | 
            
  | 20:05 | <twentyafterfour> | deploying D478 (refs T151844 ) | [production] | 
            
  | 20:05 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:321713|Allow __NOINDEX__ on all namespaces on meta]] (T150245) (duration: 00m 44s) | [production] | 
            
  | 20:00 | <thcipriani@tin> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:321712|Allow a wiki to use __NOINDEX__ and __INDEX__ in all namespaces]] PART II (duration: 00m 48s) | [production] | 
            
  | 19:58 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:321712|Allow a wiki to use __NOINDEX__ and __INDEX__ in all namespaces]] PART I (duration: 00m 51s) | [production] | 
            
  | 19:44 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:303183|Add autopatrolled group for wikitech]] (duration: 00m 45s) | [production] | 
            
  | 19:30 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:324096|Add "global-renamer" to the list of privileged wiki groups]] T150951 (duration: 00m 45s) | [production] | 
            
  | 19:23 | <thcipriani@tin> | Synchronized wmf-config/abusefilter.php: SWAT: [[gerrit:321660|Set "abusefilter-modify-global" to stewards locally at Meta-Wiki]] T150752 (duration: 00m 45s) | [production] | 
            
  | 19:15 | <thcipriani@tin> | Synchronized wmf-config/flaggedrevs.php: SWAT: [[gerrit:322262|Remove FlaggedRevs autopromotion function at eowiki]] T150591 (duration: 01m 37s) | [production] | 
            
  | 18:02 | <marostegui> | Stopping replication db1095 (new sanitarium, not in use) on s1 instance for maintenance - T150802 | [production] | 
            
  | 17:36 | <otto@tin> | Finished deploy [analytics/pivot/deploy@0513a6e]: (no message) (duration: 00m 08s) | [production] | 
            
  | 17:36 | <otto@tin> | Starting deploy [analytics/pivot/deploy@0513a6e]: (no message) | [production] | 
            
  | 16:49 | <ema> | setting gethdr_extrachance=0 on all cp* hosts T150247 | [production] | 
            
  | 16:31 | <mutante> | upgrading libicu on mc1020-1036 | [production] | 
            
  | 16:25 | <ema> | doubling workspace_backend on all cp* hosts | [production] | 
            
  | 15:59 | <marostegui> | Stop temporarily stop MySQL db2070 maintenance - T149553 | [production] |