| 
      
        2013-02-21
      
      §
     | 
  
    
  | 22:35 | 
  <awjrichards> | 
  synchronized php-1.21wmf9/extensions/MobileFrontend/ | 
  [production] | 
            
  | 22:33 | 
  <awjrichards> | 
  synchronized php-1.21wmf10/extensions/MobileFrontend | 
  [production] | 
            
  | 22:12 | 
  <awjrichards> | 
  synchronized wmf-config/mobile.php  'Add photo upload schema for event logging' | 
  [production] | 
            
  | 21:56 | 
  <notpeter> | 
  running do-release-upgrade on dbs 52, 39, 51, and 35 | 
  [production] | 
            
  | 21:49 | 
  <olivneh> | 
  synchronized php-1.21wmf10/extensions/EventLogging | 
  [production] | 
            
  | 21:48 | 
  <py> | 
  synchronized wmf-config/db-pmtpa.php  'removing 1 slave for s2-5 from db-secondary for upgrades and maria' | 
  [production] | 
            
  | 21:48 | 
  <olivneh> | 
  synchronized php-1.21wmf9/extensions/EventLogging | 
  [production] | 
            
  | 21:47 | 
  <olivneh> | 
  synchronized php-1.21wmf9/extensions/CodeEditor | 
  [production] | 
            
  | 21:37 | 
  <notpeter> | 
  restarting mysql on db1047 to pick up conf changes | 
  [production] | 
            
  | 21:31 | 
  <olivneh> | 
  synchronized php-1.21wmf10/extensions/SyntaxHighlight_GeSHi  'Disable highlighting of very large files.' | 
  [production] | 
            
  | 21:23 | 
  <olivneh> | 
  synchronized php-1.21wmf9/extensions/SyntaxHighlight_GeSHi  'Disable highlighting of very large files.' | 
  [production] | 
            
  | 21:05 | 
  <olivneh> | 
  synchronized wmf-config/CommonSettings.php | 
  [production] | 
            
  | 20:02 | 
  <binasher> | 
  some wikis have myisam page_props tables. converting all to innodb via osc | 
  [production] | 
            
  | 18:39 | 
  <Ryan_Lane> | 
  enabled Extension:OpenID as a provider on labsconsole | 
  [production] | 
            
  | 11:04 | 
  <hashar> | 
  Ariel saved Gerrit by restarting it! | 
  [production] | 
            
  | 10:51 | 
  <hashar> | 
  huge CPU spike on manganese (gerrit host) | 
  [production] | 
            
  | 10:06 | 
  <hashar> | 
  Jenkins: reseting git branch specifier :-/ | 
  [production] | 
            
  | 09:32 | 
  <hashar> | 
  Jenkins: removing git branch specifier from all mediawiki-core jobs. | 
  [production] | 
            
  | 05:50 | 
  <tstarling> | 
  synchronized wmf-config/CommonSettings.php  'shell cgroup' | 
  [production] | 
            
  | 02:54 | 
  <LocalisationUpdate> | 
  completed (1.21wmf9) at Thu Feb 21 02:54:17 UTC 2013 | 
  [production] | 
            
  | 02:30 | 
  <asher> | 
  synchronized wmf-config/db-pmtpa.php  'new extension1 shard (as an externalload config) - initially for AFTv5' | 
  [production] | 
            
  | 02:30 | 
  <asher> | 
  synchronized wmf-config/db-eqiad.php  'new extension1 shard (as an externalload config) - initially for AFTv5' | 
  [production] | 
            
  | 02:28 | 
  <LocalisationUpdate> | 
  completed (1.21wmf10) at Thu Feb 21 02:28:20 UTC 2013 | 
  [production] | 
            
  | 00:53 | 
  <RobH> | 
  issues with new mw servers 86+, took back out of pybal until i can troubleshoot | 
  [production] | 
            
  | 00:49 | 
  <reedy> | 
  synchronized php-1.21wmf9/extensions/WikimediaMaintenance/ | 
  [production] | 
            
  | 00:48 | 
  <reedy> | 
  synchronized php-1.21wmf10/extensions/WikimediaMaintenance/ | 
  [production] | 
            
  | 00:34 | 
  <binasher> | 
  moved wikidatawiki tables on s3 to wikidatawiki_old to keep around for a time just in case; then "drop database wikidatawiki" | 
  [production] | 
            
  | 00:20 | 
  <asher> | 
  synchronized wmf-config  'enabling wikidatawiki on shard s5' | 
  [production] | 
            
  | 00:18 | 
  <asher> | 
  synchronized s5.dblist  'adding wikidatawiki' | 
  [production] | 
            
  | 00:17 | 
  <asher> | 
  synchronized s3.dblist  'removing wikidatawiki' | 
  [production] | 
            
  
    | 
      
        2013-02-20
      
      §
     | 
  
    
  | 22:48 | 
  <RobH> | 
  authdns-update | 
  [production] | 
            
  | 22:35 | 
  <binasher> | 
  importing wikidatawiki with schema changes into the s5 master, with sql_log_bin disabled | 
  [production] | 
            
  | 22:24 | 
  <binasher> | 
  importing wikidatawiki with schema changes into the inactive pmtpa side of the s5 shard, with replication of the import just in pmtpa. ignore repl warnings for db{35,44,45,55} | 
  [production] | 
            
  | 21:48 | 
  <RobH> | 
  authdns-update for wtp1002-1004 | 
  [production] | 
            
  | 21:45 | 
  <maxsem> | 
  synchronized wmf-config/CommonSettings.php  'Take pmtpa Solr servers out of rotation, increase load on master: https://gerrit.wikimedia.org/r/#/c/50056/' | 
  [production] | 
            
  | 21:41 | 
  <RobH> | 
  ignore db66 errors, asher is working on it | 
  [production] | 
            
  | 21:25 | 
  <binasher> | 
  running wikidata wb_items / wb_items_per_site schema migrations in parallel on the db66 slave (creating primary keys, cannot be done via online-schema-change) | 
  [production] | 
            
  | 21:24 | 
  <RobH> | 
  kicked knsq23 to clear puppet freshness alarm | 
  [production] | 
            
  | 21:24 | 
  <RobH> | 
  maerlant still offline (200 days?).  dropped esams ticket for onsite troubleshooting, as mgmt is offline. | 
  [production] | 
            
  | 21:20 | 
  <asher> | 
  synchronized wmf-config/InitialiseSettings.php  'setting wgReadOnly for wikidatawiki durring maintenance' | 
  [production] | 
            
  | 21:18 | 
  <RobH> | 
  forced puppet run on lardner, was tired of it showing error for no runs | 
  [production] | 
            
  | 21:13 | 
  <RobH> | 
  mw112-125 now in service as api apaches in tampa | 
  [production] | 
            
  | 20:58 | 
  <reedy> | 
  synchronized wmf-config/CommonSettings.php | 
  [production] | 
            
  | 20:38 | 
  <RobH> | 
  mw86-mw111 tested ok, pushing into apache service in pmtpa | 
  [production] | 
            
  | 20:32 | 
  <RobH> | 
  mw86-mw111 being added to nodelists, ignore errors on them for next few minutes | 
  [production] | 
            
  | 19:40 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: wikibooks to 1.21wmf10 | 
  [production] | 
            
  | 19:37 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: wikiversity, wikisource and wikiquote to 1.21wmf10 | 
  [production] | 
            
  | 19:29 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: wikivoyage, wikinews and wiktionary to 1.21wmf10 | 
  [production] | 
            
  | 19:25 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: closed, special, wikimedia, private and fishbowl to 1.21wmf10 | 
  [production] | 
            
  | 05:34 | 
  <tstarling> | 
  synchronized wmf-config/CommonSettings.php  're-enable Scribunto profiler' | 
  [production] |