| 
      
        2015-02-19
      
      §
     | 
  
    
  | 17:46 | 
  <demon> | 
  Synchronized php-1.25wmf17/extensions/DoubleWiki/DoubleWiki_body.php: shut up warnings finally (duration: 00m 05s) | 
  [production] | 
            
  | 17:42 | 
  <oblivian> | 
  Synchronized wmf-config/session.php: mc1011-12 IP change (duration: 00m 05s) | 
  [production] | 
            
  | 17:35 | 
  <kartik> | 
  Finished scap: ContentTranslation update (duration: 25m 31s) | 
  [production] | 
            
  | 17:25 | 
  <^d> | 
  jenkins stuck communicating to beta, restarting | 
  [production] | 
            
  | 17:10 | 
  <kartik> | 
  Started scap: ContentTranslation update | 
  [production] | 
            
  | 16:53 | 
  <_joe_> | 
  shutting down mc1009 and mc1010 | 
  [production] | 
            
  | 16:39 | 
  <oblivian> | 
  Synchronized wmf-config/session.php: mc1009-10 IP change (duration: 00m 05s) | 
  [production] | 
            
  | 16:23 | 
  <kart_> | 
  Updated cxserver to 395be27 | 
  [production] | 
            
  | 16:16 | 
  <kart_> | 
  started cxserver deployment | 
  [production] | 
            
  | 16:01 | 
  <demon> | 
  Synchronized wmf-config/CommonSettings-labs.php: (no message) (duration: 00m 07s) | 
  [production] | 
            
  | 15:49 | 
  <oblivian> | 
  Synchronized wmf-config/session.php: mc1007-8 IP change (duration: 00m 06s) | 
  [production] | 
            
  | 15:21 | 
  <_joe_> | 
  restarting hhvm on mw1103, mw1078,mw1032 - TC full as well. | 
  [production] | 
            
  | 15:17 | 
  <_joe_> | 
  restarting hhvm on mw1027, TC full | 
  [production] | 
            
  | 15:11 | 
  <_joe_> | 
  powering down mc1007,mc1008 | 
  [production] | 
            
  | 09:58 | 
  <AaronS> | 
  Deleted more bogus GlobalUserPage purge job queues | 
  [production] | 
            
  | 06:11 | 
  <springle> | 
  bacula-director restart to pick up m1-master CNAME | 
  [production] | 
            
  | 06:07 | 
  <springle> | 
  ran RT update-rt-siteconfig + apache restart to pick up m1-master CNAME | 
  [production] | 
            
  | 05:55 | 
  <springle> | 
  etherpad-lite restart to pick up m1-master CNAME | 
  [production] | 
            
  | 05:49 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Thu Feb 19 05:48:40 UTC 2015 (duration 48m 39s) | 
  [production] | 
            
  | 04:32 | 
  <ori> | 
  txstatsd on graphite1001: disabled profiling and returned service to normal state | 
  [production] | 
            
  | 04:23 | 
  <ori> | 
  restarting txstatsd on graphite1001 with --profile; will disable profiling in a few minutes. | 
  [production] | 
            
  | 02:41 | 
  <mutante> | 
  restarted hhvm on mw1141 (locked up, T89912?) | 
  [production] | 
            
  | 02:36 | 
  <LocalisationUpdate> | 
  completed (1.25wmf18) at 2015-02-19 02:35:41+00:00 | 
  [production] | 
            
  | 02:35 | 
  <l10nupdate> | 
  Synchronized php-1.25wmf18/cache/l10n: (no message) (duration: 00m 01s) | 
  [production] | 
            
  | 02:21 | 
  <LocalisationUpdate> | 
  completed (1.25wmf17) at 2015-02-19 02:20:01+00:00 | 
  [production] | 
            
  | 02:19 | 
  <l10nupdate> | 
  Synchronized php-1.25wmf17/cache/l10n: (no message) (duration: 00m 01s) | 
  [production] | 
            
  | 02:18 | 
  <mutante> | 
  restbase1004 - starting restbase service, running puppet | 
  [production] | 
            
  | 02:11 | 
  <mutante> | 
  restbase1004/1005 systemctl daemon-reload to run systemd-sysv-generator to make it create missing unit for restbase and unbreak puppet running the service | 
  [production] | 
            
  | 01:12 | 
  <ejegg> | 
  Synchronized wmf-config/CommonSettings.php: Use URLs without mobile redirects for CentralNotice (duration: 00m 07s) | 
  [production] | 
            
  | 00:54 | 
  <demon> | 
  Finished scap: global user page extension-list fix + l10n rebuild (duration: 15m 21s) | 
  [production] | 
            
  | 00:39 | 
  <AaronS> | 
  Deleted labswiki redis jobs (labswiki uses the db queue) for GlobalUserPage and flushed the queue aggregator | 
  [production] | 
            
  | 00:38 | 
  <demon> | 
  Started scap: global user page extension-list fix + l10n rebuild | 
  [production] | 
            
  | 00:33 | 
  <demon> | 
  Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 06s) | 
  [production] | 
            
  | 00:26 | 
  <demon> | 
  Synchronized php-1.25wmf17/extensions/VisualEditor/modules/ve-mw/init/ve.init.mw.Target.js: (no message) (duration: 00m 06s) | 
  [production] | 
            
  | 00:16 | 
  <demon> | 
  Synchronized wmf-config/InitialiseSettings.php: RL image debug logs (duration: 00m 07s) | 
  [production] | 
            
  | 00:14 | 
  <demon> | 
  Synchronized php-1.25wmf17/includes/skins/SkinTemplate.php: (no message) (duration: 00m 05s) | 
  [production] | 
            
  | 00:14 | 
  <demon> | 
  Synchronized php-1.25wmf17/includes/skins/Skin.php: (no message) (duration: 00m 05s) | 
  [production] | 
            
  | 00:12 | 
  <demon> | 
  Synchronized php-1.25wmf18/includes/resourceloader/ResourceLoaderImage.php: fix up svg handling in RL (duration: 00m 07s) | 
  [production] | 
            
  | 00:12 | 
  <demon> | 
  Synchronized php-1.25wmf17/includes/resourceloader/ResourceLoaderImage.php: fix up svg handling in RL (duration: 00m 07s) | 
  [production] | 
            
  | 00:09 | 
  <demon> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: no-op, for completeness (duration: 00m 05s) | 
  [production] | 
            
  | 00:04 | 
  <aaron> | 
  Synchronized php-1.25wmf16/includes/db/LoadBalancer.php: 9dc01855bca9ba322f6cb15092b29c654d74cecc (duration: 00m 05s) | 
  [production] | 
            
  
    | 
      
        2015-02-18
      
      §
     | 
  
    
  | 23:51 | 
  <demon> | 
  Synchronized wmf-config/CommonSettings.php: rm no-op profile calls (duration: 00m 06s) | 
  [production] | 
            
  | 23:48 | 
  <aaron> | 
  Synchronized php-1.25wmf17/includes/db/LoadBalancer.php: 42a56404328547a0b8bd07f001b1c4dff67b3498 (duration: 00m 05s) | 
  [production] | 
            
  | 23:46 | 
  <legoktm> | 
  Synchronized wmf-config: Enable GlobalUserPage extension on all public, CentralAuth wikis  (duration: 00m 05s) | 
  [production] | 
            
  | 23:39 | 
  <twentyafterfour> | 
  fixed symlinks. uploaded release notes. deployment finished 1.5 hours behind schedule | 
  [production] | 
            
  | 23:25 | 
  <twentyafterfour> | 
  Purged l10n cache for 1.25wmf16 | 
  [production] | 
            
  | 23:23 | 
  <twentyafterfour> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf18 | 
  [production] | 
            
  | 23:23 | 
  <ori> | 
  HHVM on mw1141 locked up (threads stuck in __lll_lock_wait). Depooling for further investigation. | 
  [production] | 
            
  | 23:17 | 
  <twentyafterfour> | 
  Finished scap: testwiki to php-1.25wmf18 and rebuild l10n cache (duration: 42m 58s) | 
  [production] | 
            
  | 22:34 | 
  <twentyafterfour> | 
  Started scap: testwiki to php-1.25wmf18 and rebuild l10n cache | 
  [production] |