| 
      
        2015-08-26
      
      §
     | 
  
    
  | 08:17 | 
  <godog> | 
  disable puppet on ms-be/ms-fe in preparation for merging firewall changes | 
  [production] | 
            
  | 07:53 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Wed Aug 26 07:53:31 UTC 2015 (duration 53m 30s) | 
  [production] | 
            
  | 07:01 | 
  <jynus> | 
  restarting mw1239 HHVM, which is unresponsive | 
  [production] | 
            
  | 04:47 | 
  <ori@tin> | 
  Synchronized wmf-config: I73721936: Enable ParsoidBatchAPI everywhere (duration: 00m 13s) | 
  [production] | 
            
  | 03:11 | 
  <l10nupdate@tin> | 
  LocalisationUpdate completed (1.26wmf20) at 2015-08-26 03:11:29+00:00 | 
  [production] | 
            
  | 03:06 | 
  <awight@tin> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: Push labs config to keep in sync with master (duration: 00m 13s) | 
  [production] | 
            
  | 03:05 | 
  <l10nupdate@tin> | 
  Synchronized php-1.26wmf20/cache/l10n: l10nupdate for 1.26wmf20 (duration: 10m 45s) | 
  [production] | 
            
  | 02:37 | 
  <l10nupdate@tin> | 
  LocalisationUpdate completed (1.26wmf19) at 2015-08-26 02:37:51+00:00 | 
  [production] | 
            
  | 02:34 | 
  <l10nupdate@tin> | 
  Synchronized php-1.26wmf19/cache/l10n: l10nupdate for 1.26wmf19 (duration: 06m 29s) | 
  [production] | 
            
  | 02:00 | 
  <ottomata> | 
  kafka topic webrequest_upload has finished rebalancing across new brokers.  starting move of last topic webrequest_text | 
  [production] | 
            
  | 01:50 | 
  <mattflaschen@tin> | 
  Synchronized php-1.26wmf19/extensions/Flow/: Sync Flow for reply fix (duration: 00m 15s) | 
  [production] | 
            
  | 00:28 | 
  <ori@tin> | 
  Synchronized php-1.26wmf20/extensions/Scribunto/engines/LuaCommon/LuaCommon.php: (no message) (duration: 00m 13s) | 
  [production] | 
            
  | 00:26 | 
  <ori@tin> | 
  Synchronized php-1.26wmf19/extensions/Scribunto/engines/LuaCommon/LuaCommon.php: (no message) (duration: 00m 13s) | 
  [production] | 
            
  | 00:26 | 
  <Danny_B> | 
  2586dd1c7c obviously broke many pages | 
  [production] | 
            
  | 00:19 | 
  <ori@tin> | 
  Synchronized php-1.26wmf19/extensions/Scribunto/engines/LuaCommon/LuaCommon.php: (no message) (duration: 00m 14s) | 
  [production] | 
            
  | 00:14 | 
  <ori@tin> | 
  Synchronized wmf-config/CommonSettings.php: I79ffa78fa: Collection/OCG: Turn on plain text output format in Book Creator (duration: 00m 12s) | 
  [production] | 
            
  | 00:12 | 
  <ori@tin> | 
  Synchronized php-1.26wmf20/extensions/Scribunto/engines/LuaCommon/LuaCommon.php: 2586dd1c7c: Updated mediawiki/core Project: mediawiki/extensions/Scribunto (duration: 00m 13s) | 
  [production] | 
            
  
    | 
      
        2015-08-25
      
      §
     | 
  
    
  | 23:39 | 
  <krenair@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/233860/ (duration: 00m 12s) | 
  [production] | 
            
  | 23:16 | 
  <krenair@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/233872/ (duration: 00m 13s) | 
  [production] | 
            
  | 23:13 | 
  <krenair@tin> | 
  Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/232963/ (duration: 00m 12s) | 
  [production] | 
            
  | 23:12 | 
  <krenair@tin> | 
  Synchronized wmf-config/extension-list: https://gerrit.wikimedia.org/r/#/c/232963/ (duration: 00m 12s) | 
  [production] | 
            
  | 23:10 | 
  <krenair@tin> | 
  Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/232962/ (duration: 00m 12s) | 
  [production] | 
            
  | 23:10 | 
  <krenair@tin> | 
  Synchronized wmf-config/extension-list: https://gerrit.wikimedia.org/r/#/c/232962/ (duration: 00m 12s) | 
  [production] | 
            
  | 23:05 | 
  <krenair@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/233781/ (duration: 00m 12s) | 
  [production] | 
            
  | 22:20 | 
  <cscott> | 
  updated Parsoid to version c3b037b0 | 
  [production] | 
            
  | 21:16 | 
  <ori@tin> | 
  Synchronized php-1.26wmf19/extensions/AbuseFilter: I15f5b5b6 & I9c23b607 (duration: 00m 13s) | 
  [production] | 
            
  | 21:13 | 
  <ori@tin> | 
  Synchronized php-1.26wmf19/extensions/Cite/modules/ext.cite.styles.css: 7344e02216: Updated mediawiki/core Project: mediawiki/extensions/Cite (duration: 00m 12s) | 
  [production] | 
            
  | 21:09 | 
  <ori@tin> | 
  Synchronized php-1.26wmf20/extensions/AbuseFilter: I15f5b5b6 & I9c23b607 (duration: 00m 14s) | 
  [production] | 
            
  | 20:54 | 
  <tgr> | 
  finished OAuth migration | 
  [production] | 
            
  | 20:34 | 
  <tgr@tin> | 
  Synchronized wmf-config/CommonSettings.php: make OAuth DB writable again T108648 (duration: 00m 12s) | 
  [production] | 
            
  | 20:32 | 
  <tgr@tin> | 
  Synchronized wmf-config/CommonSettings.php: change wgMWOAuthCentralWiki mediawikiwiki -> metawiki T108648 (duration: 00m 12s) | 
  [production] | 
            
  | 20:24 | 
  <tgr@tin> | 
  Synchronized wmf-config/CommonSettings.php: set OAuth to readonly for DB migration T108648 (duration: 00m 13s) | 
  [production] | 
            
  | 20:13 | 
  <subbu> | 
  deployed parsoid version 759916fc | 
  [production] | 
            
  | 19:24 | 
  <twentyafterfour@tin> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.26wmf20 | 
  [production] | 
            
  | 19:21 | 
  <twentyafterfour@tin> | 
  Finished scap: testwiki to 1.26wmf20 (duration: 50m 12s) | 
  [production] | 
            
  | 18:31 | 
  <twentyafterfour@tin> | 
  Started scap: testwiki to 1.26wmf20 | 
  [production] | 
            
  | 17:11 | 
  <YuviPanda> | 
  run authdns-update on radon (ns0.wikimedia.org) | 
  [production] | 
            
  | 17:10 | 
  <urandom> | 
  bouncing Cassandra on restbase1001 to apply temporary GC settings | 
  [production] | 
            
  | 16:58 | 
  <Krinkle> | 
  mwscript deleteEqualMessages.php --wiki kawiki | 
  [production] | 
            
  | 16:56 | 
  <andrewbogott> | 
  restarting pdns on labcontrol1001 and labcontrol2001 to handle a nembus reboot | 
  [production] | 
            
  | 16:53 | 
  <Krinkle> | 
  mwscript deleteEqualMessages.php --wiki huwiki | 
  [production] | 
            
  | 16:31 | 
  <Krinkle> | 
  mwscript deleteEqualMessages.php --wiki frwiki | 
  [production] | 
            
  | 16:17 | 
  <Krinkle> | 
  mwscript deleteEqualMessages.php --wiki frpwiki | 
  [production] | 
            
  | 15:50 | 
  <godog> | 
  powercycle ms-be1004, likely xfs | 
  [production] | 
            
  | 15:44 | 
  <andrewbogott> | 
  dist-upgrade and rebooting nembus in an attempt to resolve this acpi_pad issue | 
  [production] | 
            
  | 15:36 | 
  <Krinkle> | 
  mwscript deleteEqualMessages.php --wiki euwiki (T45917) | 
  [production] | 
            
  | 15:29 | 
  <Krinkle> | 
  mwscript deleteEqualMessages.php --wiki eowiki (T45917) | 
  [production] | 
            
  | 15:07 | 
  <krenair@tin> | 
  Synchronized php-1.26wmf19/extensions/Flow: https://gerrit.wikimedia.org/r/#/c/233718/ (duration: 00m 16s) | 
  [production] | 
            
  | 13:56 | 
  <jynus> | 
  dropping old tables on s7 - T5493 | 
  [production] | 
            
  | 13:48 | 
  <jynus> | 
  dropping old tables on s6 - T54932 | 
  [production] |