| 
      
        2015-08-26
      
      §
     | 
  
    
  | 23:59 | 
  <Krinkle> | 
  mwscript deleteEqualMessages.php --wiki rowiki | 
  [production] | 
            
  | 23:57 | 
  <yurik> | 
  git deployed tilerator - had the 4/5 issue - https://phabricator.wikimedia.org/T110434 | 
  [production] | 
            
  | 23:46 | 
  <krenair@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/234072/ (duration: 01m 12s) | 
  [production] | 
            
  | 23:37 | 
  <krenair@tin> | 
  Synchronized php-1.26wmf20/maintenance/deleteEqualMessages.php: https://gerrit.wikimedia.org/r/#/c/234038/ (duration: 01m 12s) | 
  [production] | 
            
  | 23:35 | 
  <krenair@tin> | 
  Synchronized php-1.26wmf19/maintenance/deleteEqualMessages.php: https://gerrit.wikimedia.org/r/#/c/234037/1 (duration: 01m 12s) | 
  [production] | 
            
  | 23:27 | 
  <yurik> | 
  deployed kartotherian | 
  [production] | 
            
  | 23:21 | 
  <jynus> | 
  cloning es1005 into es1011, ETA 9 hours | 
  [production] | 
            
  | 22:41 | 
  <ori> | 
  armed keyholder on tin | 
  [production] | 
            
  | 22:40 | 
  <ori> | 
  Disabled Puppet on mw1017 for 2hrs and applied I059b0c96c9 for testing. | 
  [production] | 
            
  | 21:55 | 
  <krinkle@tin> | 
  Synchronized php-1.26wmf19/includes/poolcounter/PoolWorkArticleView.php: (no message) (duration: 01m 12s) | 
  [production] | 
            
  | 21:48 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool es1005 (duration: 01m 12s) | 
  [production] | 
            
  | 21:40 | 
  <krinkle@tin> | 
  Synchronized php-1.26wmf20/includes/poolcounter/PoolWorkArticleView.php: (no message) (duration: 01m 12s) | 
  [production] | 
            
  | 21:32 | 
  <ori> | 
  Disabling Puppet on tin again to test an ssh-agent-proxy change | 
  [production] | 
            
  | 20:30 | 
  <ori@tin> | 
  Synchronized README: testing ssh-agent-proxy changes (duration: 00m 13s) | 
  [production] | 
            
  | 20:25 | 
  <ori> | 
  Disabling puppet on tin and hacking some debug logging into ssh-agent-proxy | 
  [production] | 
            
  | 20:24 | 
  <ori> | 
  armed ssh-agent key on mira | 
  [production] | 
            
  | 20:21 | 
  <krinkle@tin> | 
  Synchronized php-1.26wmf20/includes/poolcounter/PoolWorkArticleView.php: (no message) (duration: 00m 03s) | 
  [production] | 
            
  | 20:11 | 
  <subbu> | 
  deployed parsoid version 44d657de | 
  [production] | 
            
  | 19:52 | 
  <krenair@tin> | 
  Synchronized php-1.26wmf20/extensions/Echo/includes/mapper/EventMapper.php: https://gerrit.wikimedia.org/r/#/c/234082/ (duration: 00m 12s) | 
  [production] | 
            
  | 19:47 | 
  <mutante> | 
  sodium - deleting shunted messages older than 7 days | 
  [production] | 
            
  | 19:23 | 
  <krenair@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/234042/ (duration: 00m 12s) | 
  [production] | 
            
  | 19:22 | 
  <krenair@tin> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/#/c/234024/ (duration: 00m 12s) | 
  [production] | 
            
  | 19:20 | 
  <krenair@tin> | 
  Synchronized multiversion/MWWikiversions.php: https://gerrit.wikimedia.org/r/#/c/232672/ (duration: 00m 12s) | 
  [production] | 
            
  | 18:50 | 
  <krinkle@tin> | 
  Synchronized php-1.26wmf20/maintenance/deleteEqualMessages.php: (no message) (duration: 00m 11s) | 
  [production] | 
            
  | 18:50 | 
  <krinkle@tin> | 
  Synchronized php-1.26wmf19/maintenance/deleteEqualMessages.php: (no message) (duration: 00m 13s) | 
  [production] | 
            
  | 18:38 | 
  <twentyafterfour> | 
  ^ stupid typo.  That sync was group1 to 1.26wmf20 | 
  [production] | 
            
  | 18:37 | 
  <twentyafterfour@tin> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: tig | 
  [production] | 
            
  | 18:31 | 
  <ori@tin> | 
  Synchronized w/404.php: Ided1facc0: Remove auto-redirection from 404 page. (duration: 00m 13s) | 
  [production] | 
            
  | 17:30 | 
  <urandom> | 
  bouncing Cassandra on restbase1001 to apply temporary GC setting | 
  [production] | 
            
  | 17:11 | 
  <andrewbogott> | 
  ok, /now/ I’m running a dist-upgrade on labcontrol1001, to sort out weird oslo dependencies | 
  [production] | 
            
  | 17:09 | 
  <chasemp> | 
  adding firewall to elasticsearch2[4-6] (3 was just done as a pilot) | 
  [production] | 
            
  | 17:03 | 
  <andrewbogott> | 
  upgraded labnet1002 nova services to Juno | 
  [production] | 
            
  | 16:34 | 
  <andrewbogott> | 
  stopping keystone, updating db, restarting | 
  [production] | 
            
  | 16:23 | 
  <andrewbogott> | 
  correction on that last:  Upgrading nova and glance services piecemeal | 
  [production] | 
            
  | 16:22 | 
  <andrewbogott> | 
  running dist-upgrade on labcontrol1001 | 
  [production] | 
            
  | 16:18 | 
  <andrewbogott> | 
  switching labcontrol1001 hiera to Juno which will add the cloud-archive repo for Juno. | 
  [production] | 
            
  | 16:11 | 
  <andrewbogott> | 
  backing up labs openstack databases into /home/andrew/openstackdbbackups on db1009 | 
  [production] | 
            
  | 16:11 | 
  <andrewbogott> | 
  starting labs openstack update to Juno | 
  [production] | 
            
  | 15:53 | 
  <moritzm> | 
  ferm enabled on elastic1023 | 
  [production] | 
            
  | 15:45 | 
  <godog> | 
  repool restbase1009 in pybal | 
  [production] | 
            
  | 15:28 | 
  <thcipriani@tin> | 
  Synchronized php-1.26wmf20/extensions/Wikidata: SWAT: Update Wikidata - wrap usage tracking batch updates in transaction [[gerrit:233970]] (duration: 00m 23s) | 
  [production] | 
            
  | 13:47 | 
  <andrewbogott> | 
  rebooting/reimaging labnet1001 | 
  [production] | 
            
  | 13:11 | 
  <mobrovac> | 
  restbase deploying 1dfba85 | 
  [production] | 
            
  | 12:54 | 
  <yurik> | 
  git synced kartotherian | 
  [production] | 
            
  | 11:02 | 
  <jynus> | 
  dropping optin_survey_old table on all wikis | 
  [production] |