| 2019-02-28
      
      § | 
    
  | 06:23 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1079 (duration: 00m 55s) | [production] | 
            
  | 06:18 | <kart_> | Finished manual run of unpublished ContentTranslation draft purge script (T216983) | [production] | 
            
  | 05:56 | <marostegui> | Upgrade MySQL on db1124 (Sanitarium) lag will be generated on s1,s3,s5,s8 | [production] | 
            
  | 03:03 | <kart_> | Manual run of unpublished ContentTranslation draft purge script (T216983) | [production] | 
            
  | 02:08 | <bstorm_> | clouddb1002 is now in place to replace labsdb1004 as replica for toolsdb but not wikilabels postgres yet T193264 | [production] | 
            
  | 01:43 | <twentyafterfour> | phabricator upgrade completed without issues (actually completed at 01:23 UTC but I failed to hit enter and submit this message) | [production] | 
            
  | 01:20 | <twentyafterfour> | deploying phabricator update 2019-02-27 | [production] | 
            
  | 01:03 | <twentyafterfour> | preparing to deploy phabricator-2019-02-27 | [production] | 
            
  | 00:55 | <ebernhardson@deploy1001> | Synchronized php-1.33.0-wmf.19/vendor/: vendor/ruflin/Elastica: Remove scalar return type hints (duration: 01m 33s) | [production] | 
            
  | 00:22 | <ebernhardson@deploy1001> | Synchronized vendor/: Remove scalar type hints from ruflin/Elastica (duration: 00m 58s) | [production] | 
            
  | 00:10 | <ebernhardson@deploy1001> | Synchronized wmf-config/CommonSettings.php: T215725 Remove mediawikiwiki from wgCentralAuthAutoCreateWikis (duration: 00m 54s) | [production] | 
            
  | 00:07 | <ebernhardson@deploy1001> | Synchronized wmf-config/: T215684 Add config for switching Wikibase search to WikibaseCirrusSearch codebase (duration: 00m 55s) | [production] | 
            
  
    | 2019-02-27
      
      § | 
    
  | 21:57 | <XioNoX> | delete local pref for peering sessions in eqiad - T204281 | [production] | 
            
  | 21:44 | <eileen> | civicrm revision is c81fe7a4fd, config revision is 050abdf9e8 | [production] | 
            
  | 21:26 | <XioNoX> | delete local pref for peering sessions in eqord - T204281 | [production] | 
            
  | 20:53 | <XioNoX> | delete local pref for peering sessions in codfw/eqdfw - T204281 | [production] | 
            
  | 20:50 | <hashar> | 1.33.0-wmf.19 not rolled to group1. Pending T217285 (Wikibase raising exception on commonswiki). To be figured out during European day time. | [production] | 
            
  | 20:50 | <eileen> | civicrm revision changed from 224bf15206 to c81fe7a4fd, config revision is d1826e371b | [production] | 
            
  | 20:14 | <hashar@deploy1001> | rebuilt and synchronized wikiversions files: (no justification provided) | [production] | 
            
  | 20:04 | <hashar@deploy1001> | Synchronized php: group1 wikis to 1.33.0-wmf.19 (duration: 00m 53s) | [production] | 
            
  | 20:04 | <hashar@deploy1001> | rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.19 | [production] | 
            
  | 19:49 | <bstorm_> | stopped slave on labsbd1004 for T193264 | [production] | 
            
  | 19:43 | <bstorm_> | downtimed labsdb1004 to stop mysql for transferring data for T193264 | [production] | 
            
  | 19:32 | <SMalyshev> | repooled wdqs1005, caught up | [production] | 
            
  | 19:26 | <herron> | replacing kafka on logstash1004 with logstash1010 T213898 | [production] | 
            
  | 18:56 | <SMalyshev> | depooled wdqs1005 to let it catch up | [production] | 
            
  | 18:36 | <smalyshev@deploy1001> | Finished deploy [wdqs/wdqs@465673b]: Redeploy GUI for T217161 (duration: 10m 51s) | [production] | 
            
  | 18:28 | <cmjohnson1> | powering off mw126[3-6] one at a time  to move to different rack A5  T212348 | [production] | 
            
  | 18:25 | <smalyshev@deploy1001> | Started deploy [wdqs/wdqs@465673b]: Redeploy GUI for T217161 | [production] | 
            
  | 18:21 | <cmjohnson1> | powering off mw1262 to move to different rack A5  T212348 | [production] | 
            
  | 18:15 | <cmjohnson1> | powering off mw1261 to move to different rack A5  T212348 | [production] | 
            
  | 17:57 | <niharika29@deploy1001> | Synchronized php-1.33.0-wmf.19/extensions/Flow/: Make VisualEditor unwrap <section> tags T217206 (duration: 01m 00s) | [production] | 
            
  | 17:56 | <elukey> | roll restart hadoop hdfs namenodes on an-master100[1,2] to pick up the new rack config of analytics1071 | [production] | 
            
  | 17:37 | <niharika29@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Welcome survey: add a control group to viwiki T216669 (duration: 00m 54s) | [production] | 
            
  | 17:34 | <niharika29@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Stop collecting data for CitaitonUsage and CitationUsagePageLoad T213969 (duration: 00m 55s) | [production] | 
            
  | 17:22 | <elukey> | drain + shutdown of analytics1071 to allow its move to A5 - T212348 | [production] | 
            
  | 17:19 | <cmjohnson1> | powering off wtp1030 to move to different rack A5  T212348 | [production] | 
            
  | 17:14 | <cmjohnson1> | powering off wtp1029 to move to different rack A5  T212348 | [production] | 
            
  | 17:06 | <cmjohnson1> | powering off wtp1029 to move to different rack A5  T212348 | [production] | 
            
  | 17:05 | <RoanKattouw> | Running foreachwikiindblist dblists/echo.dblist extensions/Echo/maintenance/removeOrphanedEvents.php  on mwmaint1002 | [production] | 
            
  | 16:58 | <hashar@deploy1001> | Synchronized php-1.33.0-wmf.19/extensions/Score: Revert "beautify lilypond error message output" - T217241 (duration: 00m 56s) | [production] | 
            
  | 16:49 | <jijiki> | Deploy LVS for eventgate-analytics - T211247 | [production] | 
            
  | 16:26 | <volans> | temporarily disabled puppet on icinga[12]001 to deploy g/493171 | [production] | 
            
  | 16:20 | <volans> | force-rebooting icinga1001 (to test some puppet changes) - T214760 | [production] | 
            
  | 15:34 | <jbond42> | rolling openssl security updates to jessie canary servers | [production] | 
            
  | 14:25 | <marostegui> | Deploy schema change on abuse_filter_log on s7 codfw - lag will be generated on codfw - T187295 | [production] | 
            
  | 14:01 | <marostegui> | Change indexes on abuse_filter_log on db1089 - T187295 | [production] | 
            
  | 14:00 | <moritzm> | uploaded openssl 1.0.2r to jessie-wikimedia | [production] | 
            
  | 12:08 | <jbond42> | correction: rolling updates of apache on mw api servers *not* jobrunners | [production] | 
            
  | 12:04 | <jbond42> | rolling updates of apache on mw jobrunners | [production] |