| 2016-03-24
      
      § | 
    
  | 11:20 | <hashar> | Restarted Jenkins, jobs got blocked notifying to IRC | [production] | 
            
  | 11:10 | <gehel> | running puppet-merge manually on strontium to correct unmerged changes. | [production] | 
            
  | 10:18 | <gehel> | activating SSL certificate check on elasticsearch - T130366 | [production] | 
            
  | 10:07 | <moritzm> | installing exim upgrades on non-mail hubs in production | [production] | 
            
  | 09:56 | <elukey> | puppet disabled on analitycs1027 to disable Camus | [production] | 
            
  | 09:50 | <elukey> | puppet disabled on analytics1001/1002 (HDFS namenodes) as pre-step before enabling automatic failover | [production] | 
            
  | 09:30 | <jynus> | stopping slave on db2018 | [production] | 
            
  | 09:18 | <jynus> | stopping db1027 for upgrade and cloning to db1078 | [production] | 
            
  | 08:57 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1044; Pool db1077; Depool db1027 (duration: 00m 31s) | [production] | 
            
  | 08:56 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Add db1077 and db1078 (duration: 00m 28s) | [production] | 
            
  | 05:05 | <Krinkle> | mwscript deleteEqualMessages.php --wiki zhwikiquote (T45917 , P1988) | [production] | 
            
  | 05:05 | <Krinkle> | mwscript deleteEqualMessages.php --wiki zhwiktionary | [production] | 
            
  | 05:03 | <Krinkle> | mwscript deleteEqualMessages.php --wiki zhwiki | [production] | 
            
  | 05:03 | <Krinkle> | mwscript deleteEqualMessages.php --wiki zhwikibooks | [production] | 
            
  | 04:58 | <krinkle@tin> | Synchronized wmf-config/InitialiseSettings.php: 3f2943e (duration: 00m 26s) | [production] | 
            
  | 04:54 | <krinkle@tin> | Synchronized wmf-config/CommonSettings.php: 3f2943e (duration: 00m 41s) | [production] | 
            
  | 04:43 | <krinkle@tin> | Synchronized wmf-config/CommonSettings-labs.php: (no message) (duration: 00m 35s) | [production] | 
            
  | 03:02 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Thu Mar 24 03:02:09 UTC 2016 (duration 8m 52s) | [production] | 
            
  | 02:53 | <mwdeploy@tin> | sync-l10n completed (1.27.0-wmf.18) (duration: 09m 59s) | [production] | 
            
  | 02:27 | <mwdeploy@tin> | sync-l10n completed (1.27.0-wmf.17) (duration: 11m 07s) | [production] | 
            
  | 00:47 | <twentyafterfour> | phab upgrade/maintenance finished | [production] | 
            
  | 00:47 | <ori@tin> | Synchronized php-1.27.0-wmf.18/includes/media/DjVu.php: Idbd11637a8: Request-local caching of DjVu dimensions (duration: 00m 39s) | [production] | 
            
  | 00:13 | <catrope@tin> | Synchronized php-1.27.0-wmf.18/extensions/Echo/modules/ooui/mw.echo.ui.FooterNoticeWidget.js: touch (duration: 00m 26s) | [production] | 
            
  | 00:06 | <catrope@tin> | Finished scap: Oops, Echo had i18n changes (duration: 26m 50s) | [production] | 
            
  | 00:02 | <moritzm> | rebooting iridium (phabricator host) for kernel upgrade | [production] | 
            
  
    | 2016-03-23
      
      § | 
    
  | 23:45 | <yuvipanda> | restart nova-compute on labvirt1008 | [production] | 
            
  | 23:39 | <catrope@tin> | Started scap: Oops, Echo had i18n changes | [production] | 
            
  | 23:33 | <catrope@tin> | Synchronized wmf-config/CommonSettings.php: Plumbing for Echo footer link settings (duration: 00m 26s) | [production] | 
            
  | 23:32 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable Echo footer link on testwiki (duration: 00m 26s) | [production] | 
            
  | 23:32 | <catrope@tin> | Synchronized php-1.27.0-wmf.18/extensions/UploadWizard/: SWAT (duration: 00m 27s) | [production] | 
            
  | 23:31 | <catrope@tin> | Synchronized php-1.27.0-wmf.18/extensions/Echo/: sWAT (duration: 00m 32s) | [production] | 
            
  | 23:29 | <catrope@tin> | Synchronized php-1.27.0-wmf.18/includes/specials/SpecialEditWatchlist.php: Try to fix watchlist fatals (duration: 00m 25s) | [production] | 
            
  | 23:28 | <catrope@tin> | Synchronized php-1.27.0-wmf.17/extensions/VisualEditor/lib/ve/src/ce/ve.ce.Surface.js: Move table paste logic out of external paste block (duration: 00m 26s) | [production] | 
            
  | 23:24 | <catrope@tin> | Synchronized wmf-config/CommonSettings.php: Use extension registration for Cite (duration: 00m 28s) | [production] | 
            
  | 23:22 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Namespace config for newiktionary (duration: 00m 43s) | [production] | 
            
  | 23:21 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Import sources for newikibooks (duration: 00m 47s) | [production] | 
            
  | 23:03 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Add channel for slow diff logs (duration: 00m 28s) | [production] | 
            
  | 22:17 | <andrewbogott> | rebooting labvirt1010 | [production] | 
            
  | 22:17 | <csteipp@tin> | Synchronized php-1.27.0-wmf.18/extensions/OATHAuth: Deploy HTMLForm update for OATH (duration: 00m 30s) | [production] | 
            
  | 22:13 | <andrewbogott> | rebooting labvirt1007 <- correction | [production] | 
            
  | 22:12 | <andrewbogott> | rebooting labvirt1006 | [production] | 
            
  | 22:12 | <csteipp> | ran update_scratch_token_format.php on silver | [production] | 
            
  | 22:03 | <csteipp@tin> | Synchronized php-1.27.0-wmf.18/extensions/OATHAuth: (no message) (duration: 00m 34s) | [production] | 
            
  | 21:59 | <andrewbogott> | rebooting labvirt1006 | [production] | 
            
  | 21:43 | <andrewbogott> | rebooting labvirt1005 | [production] | 
            
  | 21:41 | <bblack> | depooling cp3043 - T125485 | [production] | 
            
  | 21:38 | <bblack> | depooling cp3042 - T125485 | [production] | 
            
  | 20:53 | <chasemp> | reboot labvirt1003 | [production] | 
            
  | 20:40 | <mdholloway> | found an issue with the mobileapps deployment, reverting to 85856f7 | [production] | 
            
  | 20:29 | <mdholloway> | starting mobileapps deployment | [production] |