| 2014-04-10
      
      § | 
    
  | 07:57 | <aude> | rebuilt wikiversions.cdb and synchronized wikiversions files: Rebuild wikiversions and put wikidata on 1.23wmf20 | [production] | 
            
  | 07:53 | <aude> | synchronized wikiversions.json  'Put Wikidata back on 1.23wmf20, due to localisation cache issues' | [production] | 
            
  | 07:21 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Apr 10 07:21:16 UTC 2014 (duration 7m 21s) | [production] | 
            
  | 06:46 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-10 06:45:59+00:00 | [production] | 
            
  | 06:27 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-04-10 06:27:30+00:00 | [production] | 
            
  | 06:27 | <ori> | synchronized wmf-config/CommonSettings.php  'I20bbe05cc: Avoid using bits on beta-hhvm.wmflabs.org' | [production] | 
            
  | 06:27 | <ori> | updated /a/common to {{Gerrit|I20bbe05cc}}: Avoid using bits on beta-hhvm.wmflabs.org | [production] | 
            
  | 06:15 | <ori> | Some interface messages are missing on wikidata.org. Started a manual l10nupdate. | [production] | 
            
  | 04:11 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Apr 10 04:11:47 UTC 2014 (duration 11m 46s) | [production] | 
            
  | 03:19 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-10 03:19:18+00:00 | [production] | 
            
  | 03:02 | <ori> | synchronized multiversion/MWMultiVersion.php  'Ibdbac982b: Update multiversion regexp for *.beta-hhvm.wmflabs.org' | [production] | 
            
  | 03:01 | <ori> | updated /a/common to {{Gerrit|Ibdbac982b}}: Update multiversion regexp for *.beta-hhvm.wmflabs.org | [production] | 
            
  | 02:22 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-04-10 02:22:11+00:00 | [production] | 
            
  | 01:49 | <ori> | synchronized wmf-config/InitialiseSettings-labs.php  'I697f7e4a6: Use  to branch on interpreter' | [production] | 
            
  | 01:48 | <ori> | synchronized wmf-config/CommonSettings.php  'I697f7e4a6: Use  to branch on interpreter' | [production] | 
            
  | 01:48 | <ori> | updated /a/common to {{Gerrit|I697f7e4a6}}: Use '$channel' to branch on interpreter | [production] | 
            
  | 01:08 | <K4-713> | updated payments to e1d00b61a703 | [production] | 
            
  | 01:06 | <Krinkle> | git-deploy: Deploying integration/slave-scripts 'If2539ccb3152bd0' | [production] | 
            
  | 01:05 | <Krinkle> | Undid local patch to "grunt-lib-phantomjs/phantomjs/main.js" (for bug  63579) in "/srv/deployment/integration/slave-scripts" on gallium | [production] | 
            
  | 00:20 | <yurik> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 00:08 | <awight> | updated crm from e726e4213f1d65cae7276f91379eb1b229b19134 to e3f285984f786ca9a05ded1662aba415b0259856 | [production] | 
            
  | 00:07 | <K4-713> | updated payments to 70dce8f4bc7 | [production] | 
            
  
    | 2014-04-09
      
      § | 
    
  | 23:36 | <ebernhardson> | synchronized php-1.23wmf21/extensions/Math/modules/VisualEditor/ve.ui.MWMathInspectorTool.js  'Update Math VE tool to use a command in 1.23wmf21' | [production] | 
            
  | 23:32 | <ebernhardson> | synchronized wmf-config/CommonSettings.php  'Update Flow cache version' | [production] | 
            
  | 23:22 | <ebernhardson> | synchronized php-1.23wmf21/extensions/Flow  'Backport fix DB-to-cache pipeline for 1.23wmd21' | [production] | 
            
  | 23:05 | <ebernhardson> | synchronized wmf-config/InitialiseSettings-labs.php  'Enable math VE plugin on labs' | [production] | 
            
  | 23:04 | <Krinkle> | Jenkins and Zuul are back up. Queues have not been preserved. | [production] | 
            
  | 23:01 | <^d> | gerrit: reloaded bugzilla plugin to force it to log back in | [production] | 
            
  | 23:00 | <Krinkle> | Restarting Jenkins because I have no clue what is going on and have no time to investigate yet another random clogging of all jobs. Restart ought to fix it. | [production] | 
            
  | 22:54 | <Krinkle> | Zuul has lots of queued jobs for npm slaves, but neither Jenkins nor integration-slave1001.eqiad.wmflabs and 1002 themselves have anything queued. They're idle, responsive and waiting for jobs. | [production] | 
            
  | 22:47 | <Krinkle> | Jenkins slaves in labs seem to be down. Zuul is stacking up jobs for hasNpm nodes (integration slaves in labs). Both slaves have 7/7 executors idle. | [production] | 
            
  | 22:33 | <hoo> | Logged out all Bugzilla users by deleting all session cookie data from mysql | [production] | 
            
  | 19:15 | <csteipp> | synchronized php-1.23wmf21/extensions/CentralAuth/maintenance | [production] | 
            
  | 19:10 | <yurik> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 17:39 | <yurik> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 17:22 | <manybubbles> | regenerating Elasticsearch index from mediawiki for testwiki to soak up  geo changes. | [production] | 
            
  | 16:48 | <maxsem> | synchronized wmf-config/InitialiseSettings.php  'https://gerrit.wikimedia.org/r/124880' | [production] | 
            
  | 16:41 | <manybubbles> | reindexed testwiki to soak up geo changes | [production] | 
            
  | 16:37 | <maxsem> | synchronized wmf-config/InitialiseSettings.php  'https://gerrit.wikimedia.org/r/124876' | [production] | 
            
  | 16:32 | <maxsem> | synchronized php-1.23wmf21/extensions/GeoData | [production] | 
            
  | 16:28 | <manybubbles> | fiddling with Elasticsearch cluster balancing options trying to get enwiki better balanced | [production] | 
            
  | 16:17 | <aude> | synchronized php-1.23wmf21/extensions/Wikidata  'Switch Wikidata back to previous version of Wikibase' | [production] | 
            
  | 15:52 | <mutante> | ms6 - revoke puppet cert, salt key, remove from icinga | [production] | 
            
  | 15:02 | <ottomata> | stopped puppet on emery to test sqstat on analytics1003 | [production] | 
            
  | 14:48 | <ottomata> | disabling puppet to test sqstat on analytics1003 | [production] | 
            
  | 14:14 | <RobH> | otrs back up, live hacked apache change, now working permanent puppet change (puppet is disabled on iodine at present) | [production] | 
            
  | 14:02 | <RobH> | yes, otrs is totally ssl borked, robh is working on it | [production] | 
            
  | 14:00 | <mutante> | adding filippo to ops/wmf LDAP groups | [production] | 
            
  | 13:58 | <RobH> | updating otrs cert | [production] | 
            
  | 09:19 | <hashar> | synchronized wmf-config/InitialiseSettings.php  '[] = 'musees.cg70.fr'; {{gerrit|124754}} {{bug|63449}}' | [production] |