| 2015-09-23
      
      § | 
    
  | 15:15 | <demon@tin> | Synchronized php-1.26wmf22/extensions/Wikidata: (no message) (duration: 00m 20s) | [production] | 
            
  | 14:13 | <demon@tin> | Synchronized wmf-config/abusefilter.php: (no message) (duration: 00m 12s) | [production] | 
            
  | 14:08 | <demon@tin> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 12s) | [production] | 
            
  | 14:05 | <demon@tin> | Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 12s) | [production] | 
            
  | 14:04 | <demon@tin> | Synchronized langlist-labs: (no message) (duration: 00m 11s) | [production] | 
            
  | 14:04 | <demon@tin> | Synchronized docroot/noc/conf/: (no message) (duration: 00m 13s) | [production] | 
            
  | 14:01 | <demon@tin> | Synchronized multiversion/MWRealm.php: (no message) (duration: 00m 11s) | [production] | 
            
  | 13:56 | <godog> | force puppet run on restbase2001 to deploy new cassandra config | [production] | 
            
  | 13:28 | <godog> | reboot ms-be1012, xfs hosed | [production] | 
            
  | 13:22 | <paravoid> | upgrading cr1-codfw with newer junos | [production] | 
            
  | 07:43 | <demon@tin> | Synchronized wmf-config/CommonSettings.php: semver the special:version hook (duration: 00m 12s) | [production] | 
            
  | 03:05 | <l10nupdate@tin> | Synchronized php-1.26wmf24/cache/l10n: l10nupdate for 1.26wmf24 (duration: 10m 12s) | [production] | 
            
  | 02:38 | <l10nupdate@tin> | LocalisationUpdate completed (1.26wmf23) at 2015-09-23 02:38:44+00:00 | [production] | 
            
  | 02:35 | <l10nupdate@tin> | Synchronized php-1.26wmf23/cache/l10n: l10nupdate for 1.26wmf23 (duration: 06m 21s) | [production] | 
            
  | 00:56 | <legoktm@tin> | Synchronized php-1.26wmf24/extensions/Echo/Hooks.php: Remove duplicate 'MediaWiki' prefix from echo.unseen stats (duration: 00m 12s) | [production] | 
            
  | 00:03 | <RoanKattouw> | Running FlowFixLinks.php on testwiki | [production] | 
            
  
    | 2015-09-22
      
      § | 
    
  | 23:40 | <mutante> | renaming search mailing lists to discovery mailing lists | [production] | 
            
  | 23:35 | <krenair@tin> | Synchronized php-1.26wmf24/extensions/Echo: https://gerrit.wikimedia.org/r/#/c/240283/ and https://gerrit.wikimedia.org/r/#/c/240281/ (duration: 00m 13s) | [production] | 
            
  | 23:18 | <krenair@tin> | Synchronized wmf-config/abusefilter.php: https://gerrit.wikimedia.org/r/#/c/240278/ (duration: 00m 12s) | [production] | 
            
  | 23:16 | <krenair@tin> | Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/240259/ (duration: 00m 12s) | [production] | 
            
  | 23:14 | <krenair@tin> | Synchronized w/static/images/sul/wikimania.png: https://gerrit.wikimedia.org/r/#/c/239308/ (duration: 00m 11s) | [production] | 
            
  | 23:14 | <krenair@tin> | Synchronized w/static/images/sul/commons.png: https://gerrit.wikimedia.org/r/#/c/239308/ (duration: 00m 12s) | [production] | 
            
  | 22:43 | <catrope@tin> | Synchronized wmf-config/CommonSettings.php: Set $wgFlowMigrateReferenceWiki to false in production (duration: 00m 12s) | [production] | 
            
  | 22:38 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable Flow opt-in on testwiki for testing (duration: 00m 12s) | [production] | 
            
  | 21:49 | <chasemp> | unban elastic1030 from T112559 | [production] | 
            
  | 21:33 | <twentyafterfour@tin> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.26wmf24 | [production] | 
            
  | 21:13 | <twentyafterfour@tin> | Finished scap: Test 1.26wmf24 (duration: 50m 34s) | [production] | 
            
  | 20:44 | <mutante> | cancel backup job of bast1001 on helium because running low on disk | [production] | 
            
  | 20:22 | <twentyafterfour@tin> | Started scap: Test 1.26wmf24 | [production] | 
            
  | 16:50 | <robh> | all mw servers returned to puppet enabled, puppet swat window over | [production] | 
            
  | 16:23 | <robh> | re-enabled puppet on mw hosts, as both redirection changes are good | [production] | 
            
  | 16:14 | <robh> | re-enabling puppet on mw hosts, as the new patchset 239278 deployed and tested fine on a single host, deploying to rest | [production] | 
            
  | 16:04 | <robh> | disabling puppet across mw hosts for new configuration deployment | [production] | 
            
  | 15:46 | <godog> | running puppet on restbase2001 | [production] | 
            
  | 15:41 | <godog> | stop puppet on restbase2* pending codfw expansion | [production] | 
            
  | 14:42 | <cmjohnson1> | shutting down elastic1005 and elastic1030 to move around within the data center | [production] | 
            
  | 14:19 | <bblack> | starting slow restart of varnish + varnish-frontend daemon processes on global text, upload, and mobile clusters for shm_reclen (all randomly blended, no parallelism, ~5 minute spacing, will take ~9 hours - FEs will lose cache data, BEs will not) | [production] | 
            
  | 14:14 | <chasemp> | depool elastic nodes for T112559 | [production] | 
            
  | 11:18 | <aude@tin> | Synchronized php-1.26wmf23/extensions/Wikidata: Fix autocomment and change handling bugs (duration: 00m 21s) | [production] | 
            
  | 10:42 | <aude@tin> | Synchronized arbitraryaccess.dblist: Enable arbitrary access for Wikibooks (duration: 00m 12s) | [production] | 
            
  | 10:42 | <aude@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable data access for Wikibooks - try again for snapshot hosts (duration: 00m 12s) | [production] | 
            
  | 10:35 | <aude@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable data access for Wikibooks (duration: 01m 12s) | [production] | 
            
  | 10:17 | <moritzm> | enabled ferm on mw1152 (videoscaler) | [production] | 
            
  | 10:03 | <godog> | finished stressdisk on restbase200[123] no errors reported | [production] | 
            
  | 10:03 | <moritzm> | enabled ferm on mw1259 (videoscaler) | [production] | 
            
  | 04:35 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Tue Sep 22 04:35:46 UTC 2015 (duration 35m 45s) | [production] | 
            
  | 02:22 | <l10nupdate@tin> | LocalisationUpdate completed (1.26wmf23) at 2015-09-22 02:22:56+00:00 | [production] | 
            
  | 02:19 | <l10nupdate@tin> | Synchronized php-1.26wmf23/cache/l10n: l10nupdate for 1.26wmf23 (duration: 06m 00s) | [production] | 
            
  | 01:53 | <mutante> | sodium - deleted salt key, revoked puppet cert, rm from icinga .. | [production] | 
            
  | 00:32 | <ori> | Disabled Puppet for 24h on hafnium and stopped ganglia-monitor. gmond was saturating CPU. | [production] |