| 
      
        2013-11-20
      
      §
     | 
  
    
  | 09:46 | 
  <hashar> | 
  restarting Jenkins to update gearman plugin | 
  [production] | 
            
  | 09:38 | 
  <hashar> | 
  Zuul upgraded with Gearman support to trigger build in Jenkins. Will monitor for the rest of the morning. | 
  [production] | 
            
  | 09:34 | 
  <hashar> | 
  enabling Gearman in Jenkins, making it register with Zuul new version | 
  [production] | 
            
  | 09:34 | 
  <hashar> | 
  restarted Zuul with Gearman version | 
  [production] | 
            
  | 09:27 | 
  <hashar> | 
  removing all old versions of zuul: rm -fR  /usr/local/lib/python2.7/dist-packages/zuul* | 
  [production] | 
            
  | 09:20 | 
  <hashar> | 
  gallium temp install of python-pip to be able to ugprade Zuul | 
  [production] | 
            
  | 09:15 | 
  <hashar> | 
  Zuul: bumped source code in integration/zuul.git to Gearman based version: 1e3adfd...6241272 labs -> master | 
  [production] | 
            
  | 09:05 | 
  <hashar> | 
  stopping Zuul on gallium for upgrading purposes. | 
  [production] | 
            
  | 07:51 | 
  <apergos> | 
  rebooting sq37, we had /dev//sdc gone and reappeared as /dev/sdc killing back-end squid | 
  [production] | 
            
  | 07:40 | 
  <ori> | 
  synchronized php-1.23wmf3/extensions/WikimediaEvents/modules/ext.wikimediaEvents.moduleStorage.js  'Re-syncing I51d2d6495' | 
  [production] | 
            
  | 07:38 | 
  <ori> | 
  synchronized php-1.23wmf4/extensions/WikimediaEvents/modules/ext.wikimediaEvents.moduleStorage.js  'Re-syncing I51d2d6495' | 
  [production] | 
            
  | 06:47 | 
  <apergos> | 
  removed on mw* hosts from /tmp all *png/map/err/tif older than an hour, as some tmpfs were full | 
  [production] | 
            
  | 05:55 | 
  <ori-l> | 
  /tmp on Apaches filling up with math .pngs; moving some of the oldest away as a stopgap | 
  [production] | 
            
  | 05:04 | 
  <springle> | 
  synchronized wmf-config/db-pmtpa.php | 
  [production] | 
            
  | 03:17 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Wed Nov 20 03:17:15 UTC 2013 | 
  [production] | 
            
  | 02:31 | 
  <LocalisationUpdate> | 
  completed (1.23wmf3) at Wed Nov 20 02:31:26 UTC 2013 | 
  [production] | 
            
  | 02:15 | 
  <LocalisationUpdate> | 
  completed (1.23wmf4) at Wed Nov 20 02:15:34 UTC 2013 | 
  [production] | 
            
  | 01:38 | 
  <paravoid> | 
  rebooting ms-be1001, i/o stuck kernel bug | 
  [production] | 
            
  | 01:37 | 
  <ori> | 
  synchronized php-1.23wmf4/extensions/WikimediaEvents  'Update WikimediaEvents to I5b8cfe592' | 
  [production] | 
            
  | 01:35 | 
  <ori> | 
  synchronized php-1.23wmf3/resources/startup.js  'touch' | 
  [production] | 
            
  | 01:33 | 
  <ori> | 
  synchronized php-1.23wmf3/extensions/WikimediaEvents  'Update WikimediaEvents to I5b8cfe592' | 
  [production] | 
            
  | 00:43 | 
  <csteipp> | 
  synchronized php-1.23wmf4/extensions/OAuth  'update OAuth to master for last blocker fix' | 
  [production] | 
            
  | 00:33 | 
  <ori> | 
  synchronized php-1.23wmf3/resources/startup.js  'touch' | 
  [production] | 
            
  | 00:28 | 
  <ori> | 
  synchronized php-1.23wmf3/extensions/MobileFrontend  'Updating MobileFrontend for I3efc1fa64' | 
  [production] | 
            
  
    | 
      
        2013-11-19
      
      §
     | 
  
    
  | 23:58 | 
  <ori-l> | 
  Restarting EventLogging jobs on vanadium | 
  [production] | 
            
  | 23:54 | 
  <ori> | 
  synchronized php-1.23wmf3/resources/startup.js  'touch' | 
  [production] | 
            
  | 23:14 | 
  <ori> | 
  synchronized wmf-config/InitialiseSettings.php  'Iee7332c97: Disable infobox experiment' | 
  [production] | 
            
  | 23:13 | 
  <ori> | 
  updated /a/common to {{Gerrit|Iee7332c97}}: Disable infobox experiment | 
  [production] | 
            
  | 22:53 | 
  <reedy> | 
  synchronized php-1.23wmf4/extensions/AbuseFilter/  'bug 57268' | 
  [production] | 
            
  | 21:59 | 
  <mholmquist> | 
  synchronized php-1.23wmf3/extensions/VectorBeta/  'Sync VectorBeta code to wikis that will never use it' | 
  [production] | 
            
  | 21:45 | 
  <mholmquist> | 
  synchronized wmf-config/extension-list  'Add VectorBeta to extension-list' | 
  [production] | 
            
  | 21:44 | 
  <mholmquist> | 
  updated /a/common to {{Gerrit|Ib532e5558}}: Add VectorBeta to extension-list | 
  [production] | 
            
  | 21:41 | 
  <mholmquist> | 
  Finished syncing Wikimedia installation... : Adding VectorBeta | 
  [production] | 
            
  | 21:21 | 
  <mholmquist> | 
  synchronized php-1.23wmf4/extensions/VectorBeta/ | 
  [production] | 
            
  | 21:17 | 
  <mholmquist> | 
  Started syncing Wikimedia installation... : Adding VectorBeta | 
  [production] | 
            
  | 21:10 | 
  <mholmquist> | 
  synchronized wmf-config/InitialiseSettings.php  'Set wmgUseVectorBeta = true for phase0 wikis' | 
  [production] | 
            
  | 21:09 | 
  <mholmquist> | 
  synchronized wmf-config/CommonSettings.php  'Add wmgUseVectorBeta' | 
  [production] | 
            
  | 21:08 | 
  <mholmquist> | 
  updated /a/common to {{Gerrit|Ic3a64b434}}: Enable VectorBeta on group0 wikis | 
  [production] | 
            
  | 20:55 | 
  <reedy> | 
  synchronized wmf-config/ | 
  [production] | 
            
  | 20:04 | 
  <ori> | 
  synchronized php-1.23wmf4/extensions/WikimediaEvents  'Update WikimediaEvents to d4f2a43' | 
  [production] | 
            
  | 20:04 | 
  <ori> | 
  synchronized php-1.23wmf3/extensions/WikimediaEvents  'Update WikimediaEvents to d4f2a43' | 
  [production] | 
            
  | 20:01 | 
  <ori> | 
  synchronized php-1.23wmf3/extensions/WikimediaEvents  'Update WikimediaEvents to d4f2a43' | 
  [production] | 
            
  | 20:00 | 
  <ori> | 
  synchronized php-1.23wmf4/extensions/WikimediaEvents  'Update WikimediaEvents to d4f2a43' | 
  [production] | 
            
  | 19:49 | 
  <reedy> | 
  synchronized php-1.23wmf3/extensions/MassMessage  'Update to master' | 
  [production] | 
            
  | 19:39 | 
  <ori> | 
  synchronized php-1.23wmf4/extensions/WikimediaEvents  'Update WikimediaEvents to 4aa9c629e5: Controlled experiment to assess performance of module storage' | 
  [production] | 
            
  | 19:37 | 
  <ori> | 
  synchronized php-1.23wmf3/extensions/WikimediaEvents  'Update WikimediaEvents to 4aa9c629e5: Controlled experiment to assess performance of module storage' | 
  [production] | 
            
  | 19:22 | 
  <reedy> | 
  synchronized wmf-config/  'Enable MassMessage Ib29cb042e739e26fc5ef56f41317454ea690d0cb' | 
  [production] | 
            
  | 19:08 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: https://gerrit.wikimedia.org/r/96297 | 
  [production] | 
            
  | 19:07 | 
  <reedy> | 
  updated /a/common to {{Gerrit|I9b48be4c0}}: try to reduce "no working slave" notice flood in pmtpa dberror.log (attempt 2) | 
  [production] | 
            
  | 18:53 | 
  <Nemo_bis> | 
  but now ok | 
  [production] |