| 2016-02-17
      
      § | 
    
  | 08:19 | <akosiaris> | gnt-instance reboot alsafi.wikimedia.org | [production] | 
            
  | 08:19 | <akosiaris> | enabled puppet on sca1001, sca1002 | [production] | 
            
  | 03:15 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Wed Feb 17 03:15:40 UTC 2016 (duration 9m 30s) | [production] | 
            
  | 03:06 | <mwdeploy@tin> | sync-l10n completed (1.27.0-wmf.14) (duration: 10m 31s) | [production] | 
            
  | 02:39 | <mwdeploy@tin> | sync-l10n completed (1.27.0-wmf.13) (duration: 18m 59s) | [production] | 
            
  | 01:36 | <krenair@tin> | Synchronized php-1.27.0-wmf.13/extensions/VisualEditor/modules/ve-mw/init/targets/ve.init.mw.DesktopArticleTarget.init.js: touch - https://phabricator.wikimedia.org/T125249#2012068 (duration: 01m 31s) | [production] | 
            
  | 01:33 | <krenair@tin> | Synchronized php-1.27.0-wmf.13/extensions/VisualEditor/extension.json: https://gerrit.wikimedia.org/r/#/c/271174/ (duration: 01m 29s) | [production] | 
            
  | 01:26 | <mutante> | labservices1001 - out of disk again (T126572) - moved designate-mdns.log files to /srv/var/ | [production] | 
            
  | 01:13 | <krenair@tin> | Synchronized php-1.27.0-wmf.13/extensions/CentralAuth/includes/session/CentralAuthSessionProvider.php: https://gerrit.wikimedia.org/r/#/c/271153/ (duration: 01m 31s) | [production] | 
            
  | 00:47 | <krenair@tin> | Synchronized php-1.27.0-wmf.13/extensions/Math/MathValidator.php: https://gerrit.wikimedia.org/r/#/c/270981/ (duration: 01m 31s) | [production] | 
            
  | 00:33 | <krenair@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/271074 (duration: 01m 29s) | [production] | 
            
  | 00:29 | <krenair@tin> | Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/266603 (duration: 01m 30s) | [production] | 
            
  | 00:26 | <Krenair> | ... after showing rsync common finished line | [production] | 
            
  | 00:25 | <Krenair> | sync-common taking a while to terminate | [production] | 
            
  | 00:14 | <krenair@tin> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/270985 (duration: 01m 34s) | [production] | 
            
  
    | 2016-02-16
      
      § | 
    
  | 23:39 | <demon@tin> | Finished scap: pre-deploying wmf.14 to testwiki to prime l10n cache (duration: 30m 36s) | [production] | 
            
  | 23:17 | <hashar> | Jenkins accepting slave creations again. Root cause is /var/lib/jenkins/config-history/nodes/ has reached the 32k inode limit. | [production] | 
            
  | 23:12 | <mobrovac> | restbase deploy end of 6f69a30 | [production] | 
            
  | 23:08 | <demon@tin> | Started scap: pre-deploying wmf.14 to testwiki to prime l10n cache | [production] | 
            
  | 23:04 | <demon@tin> | Synchronized w/health-check.php: Ensure procinfo exists (duration: 00m 58s) | [production] | 
            
  | 23:02 | <hashar> | Nodepool can not authenticate with Jenkins anymore. Thus it can not add slaves it spawned. | [production] | 
            
  | 22:58 | <mobrovac> | restbase deploy start of 6f69a30 | [production] | 
            
  | 22:56 | <hashar> | contint: Nodepool instances pool exhausted | [production] | 
            
  | 22:02 | <hashar> | tin/mira : git -C /srv/patches/ config core.sharedRepository true | [production] | 
            
  | 21:55 | <chasemp> | "chgrp -R mwdeploy /srv/mediawiki-staging/.git/objects && chmod -R g+w /srv/mediawiki-staging/.git/objects" on tin | [production] | 
            
  | 20:50 | <demon@tin> | Finished scap: removing expired wmf.9 branch (duration: 28m 03s) | [production] | 
            
  | 20:22 | <demon@tin> | Started scap: removing expired wmf.9 branch | [production] | 
            
  | 20:14 | <twentyafterfour> | restarted phd on iridium to kick-start the outbound email queue | [production] | 
            
  | 19:38 | <hashar@tin> | Synchronized multiversion/updateBranchPointers: Missing require_once MWWikiversions (duration: 00m 57s) | [production] | 
            
  | 19:16 | <ori@mira> | Synchronized wmf-config/InitialiseSettings.php: I2926f73b78fa0: Revert "Test HTML stripping in production mobile beta" (duration: 01m 29s) | [production] | 
            
  | 19:01 | <hashar> | tin: checking out mw 1.27.0-wmf.14 | [production] | 
            
  | 18:15 | <ori@tin> | Synchronized wmf-config/mobile.php: I5818f0350925: Don't serve HiDPI thumbs on mobile web (duration: 00m 58s) | [production] | 
            
  | 18:06 | <aude@tin> | Synchronized php-1.27.0-wmf.13/extensions/Wikidata/extensions/Wikibase/repo/resources/dataTypes/wikibase.dataTypeStore.js: Try to fix T127095 (duration: 00m 57s) | [production] | 
            
  | 18:03 | <krinkle@tin> | Synchronized php-1.27.0-wmf.13/includes/mime.types: Fix .htc static (T99096) (duration: 00m 58s) | [production] | 
            
  | 17:48 | <krinkle@tin> | Synchronized wmf-config/CommonSettings.php: Enable wmfstatic (wgResourceBasePath) for group0 wikis (duration: 01m 00s) | [production] | 
            
  | 17:31 | <krinkle@tin> | Synchronized wmf-config/CommonSettings.php: wgLocalStylePath cleanup (use /static) (duration: 00m 59s) | [production] | 
            
  | 17:26 | <volans> | Reboot+reimage of db1021 (T126996) | [production] | 
            
  | 17:07 | <volans> | Disabled puppet on db1021 for reimaging: T126996 | [production] | 
            
  | 17:01 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:270556]] [[gerrit:270679]] [[gerrit:270556]] (duration: 00m 59s) | [production] | 
            
  | 16:54 | <thcipriani@tin> | Synchronized wmf-config/CommonSettings.php: SWAT: CX: Remove ContentTranslationCorpora setting PART II [[gerrit:267236]] (duration: 00m 59s) | [production] | 
            
  | 16:52 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: CX: Remove ContentTranslationCorpora setting PART I [[gerrit:267236]] (duration: 00m 58s) | [production] | 
            
  | 16:24 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert "Enable survey at reduced sample rate" (duration: 00m 58s) | [production] | 
            
  | 16:20 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert "Enable survey at reduced sample rate" (duration: 01m 01s) | [production] | 
            
  | 16:18 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable survey at reduced sample rate [[gerrit:270344]] (duration: 01m 00s) | [production] | 
            
  | 16:12 | <thcipriani@tin> | Synchronized php-1.27.0-wmf.13/extensions/OpenStackManager: SWAT: rebase openstack submodule (duration: 00m 58s) | [production] | 
            
  | 16:08 | <thcipriani@tin> | Synchronized wmf-config/throttle.php: Termporary lift of IP cap for an Edit-a-thon [[gerrit:270646]], Cleanup: removing expired event [[gerrit:270648]] (duration: 00m 58s) | [production] | 
            
  | 15:54 | <urandom> | running `nodetool cleanup' on restbase{1,2,7-a}.eqiad.wmnet (bootstrap of 1007-b now complete) | [production] | 
            
  | 15:34 | <aude@tin> | Synchronized wmf-config/InitialiseSettings.php: Remove other projects sidebar beta feature and per wiki settings (duration: 01m 09s) | [production] | 
            
  | 15:32 | <aude@tin> | Synchronized wmf-config/Wikibase.php: Enable in other projects sidebar feature by default, out of beta (duration: 00m 58s) | [production] | 
            
  | 15:24 | <aude@tin> | Synchronized wmf-config/Wikibase-production.php: Enable external identifier data type on Wikidata (duration: 00m 57s) | [production] |