| 2018-02-21
      
      § | 
    
  | 09:46 | <moritzm> | installing dbus updates from stretch point release | [production] | 
            
  | 09:23 | <moritzm> | installing sqlite security updates on stretch | [production] | 
            
  | 08:35 | <godog> | roll-restart thumbor in codfw and eqiad to apply https://gerrit.wikimedia.org/r/c/412980 | [production] | 
            
  | 08:20 | <gilles> | foreachwikiindblist "% private.dblist" extensions/WikimediaMaintenance/filebackend/setZoneAccess.php --backend=local-multiwrite --private | [production] | 
            
  | 07:20 | <marostegui> | Stop Mariadb on db1108 for kernel upgrade | [production] | 
            
  | 06:36 | <marostegui> | Deploy schema change on db1105:3312 - T187089 T185128 T153182 | [production] | 
            
  | 06:36 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1105 for alter table (duration: 01m 17s) | [production] | 
            
  | 05:00 | <eileen> | enable major gifts address job | [production] | 
            
  | 04:41 | <eileen> | update civicrm revision changed from 43a7641597 to b27e6a5019, config revision is ef884a2c5d | [production] | 
            
  | 04:13 | <andrew@tin> | Finished deploy [horizon/deploy@0e7783d]: updating branded graphics slightly more (duration: 02m 45s) | [production] | 
            
  | 04:10 | <andrew@tin> | Started deploy [horizon/deploy@0e7783d]: updating branded graphics slightly more | [production] | 
            
  | 03:34 | <andrew@tin> | Finished deploy [horizon/deploy@0e28f49]: updating branded graphics (duration: 02m 49s) | [production] | 
            
  | 03:31 | <andrew@tin> | Started deploy [horizon/deploy@0e28f49]: updating branded graphics | [production] | 
            
  | 02:31 | <l10nupdate@tin> | scap sync-l10n completed (1.31.0-wmf.21) (duration: 06m 18s) | [production] | 
            
  | 02:15 | <no_justification> | running `initSiteStats.php --update` for all wikis in medium.dblist. T187845 | [production] | 
            
  | 02:01 | <no_justification> | running `initSiteStats.php --update` for all wikis in small.dblist. T187845 | [production] | 
            
  | 01:54 | <no_justification> | WikipediaMobileFirefoxOS submodule references caused labsdb* (and related) puppet failures. They should recover now (self reverted my docroot changes). Filed T187850 | [production] | 
            
  | 01:51 | <demon@tin> | Synchronized docroot/: revert docroot improvements. some servers don't like improvements (duration: 01m 12s) | [production] | 
            
  | 01:36 | <demon@tin> | Synchronized docroot/: Swapping wikimedia.org docroot for symlink (second try, old WPFirefoxMobileOS cleanup was still needed) (duration: 01m 12s) | [production] | 
            
  | 01:32 | <demon@tin> | Synchronized docroot/: Swapping wikimedia.org docroot for symlink (duration: 01m 27s) | [production] | 
            
  | 01:16 | <eileen> | update civicrm revision changed from efba904b06 to 43a7641597, config revision is ef884a2c5d | [production] | 
            
  | 01:10 | <cwd> | disabled process-control | [production] | 
            
  | 01:08 | <eileen> | start outage to upgrade civicrm to 4.7.31 | [production] | 
            
  | 00:56 | <mutante> | gerrit2001 - restarted gerrit to test that gerrit:411397 and gerrit:411394 don't break anything - didn't touch cobalt right now to minimize affecting users and their logins | [production] | 
            
  | 00:43 | <thcipriani@tin> | Synchronized wmf-config/abusefilter.php: SWAT: [[gerrit:413062|Allow CheckUsers and Stewards to access private data from the AbuseLog]] T160357 (duration: 01m 12s) | [production] | 
            
  | 00:29 | <thcipriani@tin> | Synchronized php-1.31.0-wmf.21/includes/page/WikiPage.php: SWAT: [[gerrit:413059|site_stats: Unbreak counting newly created pages]] (duration: 01m 12s) | [production] | 
            
  | 00:26 | <thcipriani@tin> | Synchronized php-1.31.0-wmf.21/resources/src/mediawiki/mediawiki.ForeignStructuredUpload.js: SWAT: Follow-up I0bb4ed7f7: [[gerrit:411298|Use correct "this"]] T187523 (duration: 01m 13s) | [production] | 
            
  | 00:14 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:412664|Enable x-kill feature everywhere]] T186714 T184322 (duration: 01m 13s) | [production] | 
            
  
    | 2018-02-20
      
      § | 
    
  | 22:58 | <ejegg> | restarted donations queue consumer | [production] | 
            
  | 22:26 | <ejegg> | turned off donations queue consumer for timing test | [production] | 
            
  | 22:25 | <demon@tin> | Synchronized php-1.31.0-wmf.21/extensions/Thanks/modules/ext.thanks.revthank.js: T187757 (duration: 01m 14s) | [production] | 
            
  | 22:20 | <chasemp> | T184209 create labs-instance-transport1-b-codfw | [production] | 
            
  | 22:06 | <eileen> | update  civicrm revision changed from 915a4419c8 to efba904b06, config revision is 8c7ce87207 (extended report update for regex) | [production] | 
            
  | 21:44 | <twentyafterfour@tin> | rebuilt and synchronized wikiversions files: group0 wikis to 1.31.0-wmf.22 | [production] | 
            
  | 21:39 | <no_justification> | ran `namespaceDupes.php --wiki=enwikiversity` for  T187660 | [production] | 
            
  | 21:18 | <twentyafterfour@tin> | Finished scap: Sync 1.31.0-wmf.22 and promote test wikis - refs T183961 (duration: 46m 59s) | [production] | 
            
  | 20:34 | <ejegg> | updated CiviCRM from 31115684f6 to 915a4419c8 | [production] | 
            
  | 20:31 | <twentyafterfour@tin> | Started scap: Sync 1.31.0-wmf.22 and promote test wikis - refs T183961 | [production] | 
            
  | 20:20 | <chasemp> | labtestmetal2001:~# aptitude install linux-image-4.4.0-109-generic && aptitude install linux-image-extra-4.4.0-109-generic | [production] | 
            
  | 20:17 | <chasemp> | labtestmetal mkfs -t xfs -i size=512 /dev/mapper/labtestmetal2001--vg-data | [production] | 
            
  | 20:16 | <andrew@tin> | Finished deploy [horizon/deploy@b02c819]: trying to get a clean deploy (duration: 01m 54s) | [production] | 
            
  | 20:14 | <andrew@tin> | Started deploy [horizon/deploy@b02c819]: trying to get a clean deploy | [production] | 
            
  | 20:10 | <andrew@tin> | Finished deploy [horizon/deploy@b02c819]: a couple of bug fixes (duration: 02m 55s) | [production] | 
            
  | 20:07 | <andrew@tin> | Started deploy [horizon/deploy@b02c819]: a couple of bug fixes | [production] | 
            
  | 20:07 | <andrew@tin> | Started deploy [horizon/deploy@6a40f84]: a couple of bug fixes | [production] | 
            
  | 19:57 | <twentyafterfour> | Cutting new branch wmf/1.31.0-wmf.22 - Deployment blockers: T183961 | [production] | 
            
  | 19:45 | <demon@tin> | Synchronized docroot/mediawiki/keys/: symlink magic (duration: 00m 56s) | [production] | 
            
  | 19:26 | <mobrovac@tin> | Started restart [changeprop/deploy@5fdc03a]: (no justification provided) | [production] | 
            
  | 19:00 | <ppchelko@tin> | Finished deploy [restbase/deploy@e9bef90]: Do not return the response for summaery right away, store first T179875 take 2 (duration: 02m 47s) | [production] | 
            
  | 18:57 | <ppchelko@tin> | Started deploy [restbase/deploy@e9bef90]: Do not return the response for summaery right away, store first T179875 take 2 | [production] |