| 
      
        2016-11-30
      
      §
     | 
  
    
  | 11:28 | 
  <ariel@tin> | 
  Finished deploy [dumps/dumps@50689c8]: (no message) (duration: 00m 07s) | 
  [production] | 
            
  | 11:28 | 
  <ariel@tin> | 
  Starting deploy [dumps/dumps@50689c8]: (no message) | 
  [production] | 
            
  | 11:22 | 
  <_joe_> | 
  repooling mw1276, after tests for T151702 | 
  [production] | 
            
  | 11:16 | 
  <marostegui> | 
  Stop replication s3 - db1095 - maintenance - T147052 | 
  [production] | 
            
  | 11:07 | 
  <_joe_> | 
  rolling upgrade of hhvm on the eqiad api cluster | 
  [production] | 
            
  | 09:42 | 
  <marostegui> | 
  Stop mysql on db2048 for maintenance - https://phabricator.wikimedia.org/T149553 | 
  [production] | 
            
  | 08:44 | 
  <_joe_> | 
  stopped dedicated commonswiki jobrunner T151196 | 
  [production] | 
            
  | 07:17 | 
  <marostegui> | 
  Deploy alter table dbstore1002 - dewiki.revision - T148967 | 
  [production] | 
            
  | 07:06 | 
  <marostegui> | 
  Stop mysql db2048 maintenance - T149553 | 
  [production] | 
            
  | 02:07 | 
  <hoo> | 
  Updated Wikidata's property suggester with data from Monday's json dump and applied the T132839 workarounds | 
  [production] | 
            
  | 00:53 | 
  <kaldari@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: sync InitialiseSettings to test cookie blocking on Test Wikipedia (duration: 00m 45s) | 
  [production] | 
            
  | 00:52 | 
  <TimStarling> | 
  on mw1276: tuning jemalloc, will restart hhvm several times, running it in a terminal | 
  [production] | 
            
  | 00:40 | 
  <mutante> | 
  phab2001 - enabled puppet to bring it up2date with a various changes | 
  [production] | 
            
  
    | 
      
        2016-11-29
      
      §
     | 
  
    
  | 23:41 | 
  <ejegg> | 
  updated fundraising dashboard from 43039fde037aa983d4490da08c8072bb2788e28a to 7ce4f03da78fe0469727033db8d514e9596dd9ac | 
  [production] | 
            
  | 23:04 | 
  <demon@tin> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: prod no-op (duration: 00m 46s) | 
  [production] | 
            
  | 22:58 | 
  <demon@tin> | 
  Synchronized php-1.29.0-wmf.4/includes/debug/logger/monolog: logging fixes (duration: 00m 45s) | 
  [production] | 
            
  | 22:56 | 
  <demon@tin> | 
  Synchronized php-1.29.0-wmf.4/autoload.php: logging fixes (duration: 00m 45s) | 
  [production] | 
            
  | 22:49 | 
  <ejegg> | 
  extended donation queue consumer duty cycle from 90 to 105 seconds | 
  [production] | 
            
  | 22:33 | 
  <ejegg> | 
  disabled CiviMail activity creation for thank you sender | 
  [production] | 
            
  | 22:23 | 
  <demon@tin> | 
  Finished scap: Ok, back to normal now (duration: 26m 14s) | 
  [production] | 
            
  | 21:57 | 
  <demon@tin> | 
  Started scap: Ok, back to normal now | 
  [production] | 
            
  | 21:55 | 
  <demon@tin> | 
  scap aborted: probably won't work, no-op (duration: 01m 03s) | 
  [production] | 
            
  | 21:54 | 
  <demon@tin> | 
  Started scap: probably won't work, no-op | 
  [production] | 
            
  | 21:48 | 
  <demon@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: group0 back to wmf.3 | 
  [production] | 
            
  | 21:47 | 
  <demon@tin> | 
  scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.cPclJsf3pO" ' returned non-zero exit status 139 (duration: 00m 23s) | 
  [production] | 
            
  | 21:47 | 
  <demon@tin> | 
  Started scap: mw.org back to wmf.3 | 
  [production] | 
            
  | 21:44 | 
  <demon@tin> | 
  scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.v5ELy9acbV" ' returned non-zero exit status 139 (duration: 00m 23s) | 
  [production] | 
            
  | 21:44 | 
  <demon@tin> | 
  Started scap: rebuild l10n for wmf.4 -- attempt #3 | 
  [production] | 
            
  | 21:42 | 
  <demon@tin> | 
  scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.6ehbXfKDfD" ' returned non-zero exit status 139 (duration: 00m 23s) | 
  [production] | 
            
  | 21:42 | 
  <demon@tin> | 
  Started scap: rebuild l10n for wmf.4 -- attempt #2 | 
  [production] | 
            
  | 21:41 | 
  <demon@tin> | 
  scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.wDhBxhXGtC" ' returned non-zero exit status 139 (duration: 00m 57s) | 
  [production] | 
            
  | 21:41 | 
  <demon@tin> | 
  Started scap: rebuild l10n for wmf.4 | 
  [production] | 
            
  | 21:40 | 
  <demon@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: helps to actually sync updated files | 
  [production] | 
            
  | 21:39 | 
  <mutante> | 
  servermon - manually running "make_updates" command from cron for debugging - failed with a mysql_excetpion, lock wait timeout exceeded | 
  [production] | 
            
  | 21:21 | 
  <mutante> | 
  phab2001 - upgrading scap and other packages (we need to get puppet running here again) | 
  [production] | 
            
  | 20:30 | 
  <demon@tin> | 
  Finished scap: wmf.4 for fun and profit (duration: 20m 55s) | 
  [production] | 
            
  | 20:26 | 
  <awight> | 
  new thank-you letter deployed... | 
  [production] | 
            
  | 20:23 | 
  <awight> | 
  update civicrm  from 8c76f437c9a9739ffae2892339a46d62d13fdf61 to f8f9263d4aa0b5ba9b09827174c9b2e9a90a004c | 
  [production] | 
            
  | 20:09 | 
  <demon@tin> | 
  Started scap: wmf.4 for fun and profit | 
  [production] | 
            
  | 20:07 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:323708|wikitech cloudadmin: remove right that no longer exists]] (duration: 00m 45s) | 
  [production] | 
            
  | 20:05 | 
  <twentyafterfour> | 
  deploying D478 (refs T151844 ) | 
  [production] | 
            
  | 20:05 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:321713|Allow __NOINDEX__ on all namespaces on meta]] (T150245) (duration: 00m 44s) | 
  [production] | 
            
  | 20:00 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:321712|Allow a wiki to use __NOINDEX__ and __INDEX__ in all namespaces]] PART II (duration: 00m 48s) | 
  [production] | 
            
  | 19:58 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:321712|Allow a wiki to use __NOINDEX__ and __INDEX__ in all namespaces]] PART I (duration: 00m 51s) | 
  [production] | 
            
  | 19:44 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:303183|Add autopatrolled group for wikitech]] (duration: 00m 45s) | 
  [production] | 
            
  | 19:30 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:324096|Add "global-renamer" to the list of privileged wiki groups]] T150951 (duration: 00m 45s) | 
  [production] | 
            
  | 19:23 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/abusefilter.php: SWAT: [[gerrit:321660|Set "abusefilter-modify-global" to stewards locally at Meta-Wiki]] T150752 (duration: 00m 45s) | 
  [production] | 
            
  | 19:15 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/flaggedrevs.php: SWAT: [[gerrit:322262|Remove FlaggedRevs autopromotion function at eowiki]] T150591 (duration: 01m 37s) | 
  [production] | 
            
  | 18:02 | 
  <marostegui> | 
  Stopping replication db1095 (new sanitarium, not in use) on s1 instance for maintenance - T150802 | 
  [production] | 
            
  | 17:36 | 
  <otto@tin> | 
  Finished deploy [analytics/pivot/deploy@0513a6e]: (no message) (duration: 00m 08s) | 
  [production] |