| 
      
        2014-01-30
      
      §
     | 
  
    
  | 19:55 | 
  <Reedy> | 
  Update indexes on wb_terms for testwikidatawiki https://gerrit.wikimedia.org/r/#/c/99660 | 
  [production] | 
            
  | 19:53 | 
  <Reedy> | 
  Changed wb_items_per_site.ips_row_id and wb_terms.term_row_id to BIGINT on testwikidatawiki | 
  [production] | 
            
  | 19:43 | 
  <reedy> | 
  synchronized php-1.23wmf12/includes/api/ApiQueryRevisions.php  'bug 60635' | 
  [production] | 
            
  | 19:36 | 
  <reedy> | 
  synchronized php-1.23wmf12/extensions/PdfHandler | 
  [production] | 
            
  | 19:31 | 
  <manybubbles> | 
  rebuilding search index on test2wiki went perfectly.  proceeding with test, testwikidatawiki, and mediawikiwiki | 
  [production] | 
            
  | 19:29 | 
  <manybubbles> | 
  rebuilding search index for test2wiki and checking that everything is sane | 
  [production] | 
            
  | 19:25 | 
  <awight_> | 
  updated crm from 2516fe6fe95c1915c981fcad287fdd6119202344 to 600e09e35c59c3b8c127e5f3c3cf2df11db4f20e | 
  [production] | 
            
  | 19:20 | 
  <reedy> | 
  synchronized wmf-config/ | 
  [production] | 
            
  | 19:20 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.23wmf12 | 
  [production] | 
            
  | 19:19 | 
  <reedy> | 
  updated /a/common to {{Gerrit|Ie5c11239f}}: Update php symlink to php-1.23wmf11 | 
  [production] | 
            
  | 19:08 | 
  <Reedy> | 
  testwiki back to 1.23wmf11 even | 
  [production] | 
            
  | 19:06 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: all wikipedias to 1.23wmf11. testwiki back to 1.23wmf10 | 
  [production] | 
            
  | 19:02 | 
  <reedy> | 
  finished scap: testwiki to 1.23wmf12 and build l10n cache (duration: 18m 45s) | 
  [production] | 
            
  | 19:01 | 
  <awight_> | 
  crm updated from 9dc1887ce8391ca3a97dbb52d1d23454bbb21b03 to 2516fe6fe95c1915c981fcad287fdd6119202344 | 
  [production] | 
            
  | 18:57 | 
  <^d> | 
  jenkins: aborted another one of those pywiki jobs, was starting to back things up again. this job is broken methinks. | 
  [production] | 
            
  | 18:46 | 
  <reedy> | 
  started scap: testwiki to 1.23wmf12 and build l10n cache | 
  [production] | 
            
  | 18:42 | 
  <reedy> | 
  synchronized docroot and w | 
  [production] | 
            
  | 18:42 | 
  <reedy> | 
  synchronized php-1.23wmf12  'staging' | 
  [production] | 
            
  | 18:32 | 
  <^d> | 
  jenkins: killed job, queue seems to be trying to catch up now | 
  [production] | 
            
  | 18:31 | 
  <^d> | 
  jenkins backed up due to pywikibot-core-test job stuck again | 
  [production] | 
            
  | 18:26 | 
  <awight_> | 
  crm updated from 7c675028cf9a51d4b2d6c8f0d716c343225eb0db to 9dc1887ce8391ca3a97dbb52d1d23454bbb21b03 | 
  [production] | 
            
  | 17:51 | 
  <reedy> | 
  updated /a/common to {{Gerrit|Id0633e5a0}}: depool db1020 for schema changes | 
  [production] | 
            
  | 17:41 | 
  <cmjohnson1_> | 
  labnet1001 down for card install | 
  [production] | 
            
  | 17:26 | 
  <demon> | 
  synchronized wmf-config/InitialiseSettings.php  'Id0dea6e4: Revert "New extra language for wikidata: Ottoman Turkish (ota)"' | 
  [production] | 
            
  | 17:20 | 
  <awight_> | 
  crm updated from 704a029a01e2cbe0e99625f78cd472edbd86cd64 to 7c675028cf9a51d4b2d6c8f0d716c343225eb0db | 
  [production] | 
            
  | 04:09 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'depool db1020 for schema changes' | 
  [production] | 
            
  | 03:21 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'repool db1042' | 
  [production] | 
            
  | 02:09 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at 2014-01-30 02:09:15+00:00 | 
  [production] | 
            
  | 02:03 | 
  <LocalisationUpdate> | 
  completed (1.23wmf10) at 2014-01-30 02:02:54+00:00 | 
  [production] | 
            
  | 02:02 | 
  <LocalisationUpdate> | 
  completed (1.23wmf11) at 2014-01-30 02:02:05+00:00 | 
  [production] | 
            
  | 01:04 | 
  <awight> | 
  crm updated from f71526fa021fe3963a5d94151881f5a8a5c40dab to e0dbcef91fdad7223c78707c83c8163a160776bc | 
  [production] | 
            
  | 00:52 | 
  <awight> | 
  rollback crm to f71526fa021fe3963a5d94151881f5a8a5c40dab | 
  [production] | 
            
  | 00:51 | 
  <awight> | 
  crm updated from f71526fa021fe3963a5d94151881f5a8a5c40dab to 37c6dc5c5034b196679b4321e7fdc1b452741827 | 
  [production] | 
            
  | 00:40 | 
  <awight> | 
  rollback crm to f71526fa021fe3963a5d94151881f5a8a5c40dab | 
  [production] | 
            
  | 00:39 | 
  <awight> | 
  updated crm from f71526fa021fe3963a5d94151881f5a8a5c40dab to fa36e6c13397d86455bd4963dff9d91181c05af3 | 
  [production] | 
            
  | 00:18 | 
  <awight> | 
  updated payments from 3cda9052104d90a746ba5ca243c22ab8d36e0274 to fac21c9d394f6d7c9da172cee18c805304c8fe1b | 
  [production] | 
            
  
    | 
      
        2014-01-29
      
      §
     | 
  
    
  | 23:58 | 
  <RobH> | 
  all lists.w.o updates done and now on individual certificate | 
  [production] | 
            
  | 23:26 | 
  <awight> | 
  rollback payments to 3cda9052104d90a746ba5ca243c22ab8d36e0274 | 
  [production] | 
            
  | 23:14 | 
  <awight> | 
  updated payments from 65d6fa8d44a483a3789dbdee2c4926143c3a2338 to bcf5ec47bd995f89f000f4e57ffeee527eb29e11 | 
  [production] | 
            
  | 22:41 | 
  <awight> | 
  updating payments from 3cda9052104d90a746ba5ca243c22ab8d36e0274 to 65d6fa8d44a483a3789dbdee2c4926143c3a2338 | 
  [production] | 
            
  | 22:13 | 
  <RobH> | 
  otrs now using its own cert per rt 6702, confirmed working chain | 
  [production] | 
            
  | 21:48 | 
  <RobH> | 
  svn.w.o on own cert, confirmed chain is properly functioning | 
  [production] | 
            
  | 21:45 | 
  <RobH> | 
  updating svn to use own cert, service disruption may (but shouldnt) occur | 
  [production] | 
            
  | 19:49 | 
  <cmjohnson1> | 
  tungsten replacing failing disk at slot 10 | 
  [production] | 
            
  | 19:42 | 
  <cmjohnson1> | 
  db1002 replacing disk at slot 1 | 
  [production] | 
            
  | 18:53 | 
  <manybubbles> | 
  shutting down searchidx1001 for hardware fix | 
  [production] | 
            
  | 17:27 | 
  <demon> | 
  synchronized wmf-config/db-eqiad.php  'Removing underscores from class names' | 
  [production] | 
            
  | 17:27 | 
  <demon> | 
  synchronized wmf-config/db-labs.php  'Removing underscores from class names' | 
  [production] | 
            
  | 17:26 | 
  <demon> | 
  synchronized wmf-config/db-pmtpa.php  'Removing underscores from class names' | 
  [production] | 
            
  | 17:06 | 
  <demon> | 
  synchronized wmf-config/InitialiseSettings.php  'Enable Cirrus for huwiki + some shard config' | 
  [production] |