| 2015-08-26
      
      § | 
    
  | 23:59 | <Krinkle> | mwscript deleteEqualMessages.php --wiki rowiki | [production] | 
            
  | 23:57 | <yurik> | git deployed tilerator - had the 4/5 issue - https://phabricator.wikimedia.org/T110434 | [production] | 
            
  | 23:46 | <krenair@tin> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/234072/ (duration: 01m 12s) | [production] | 
            
  | 23:37 | <krenair@tin> | Synchronized php-1.26wmf20/maintenance/deleteEqualMessages.php: https://gerrit.wikimedia.org/r/#/c/234038/ (duration: 01m 12s) | [production] | 
            
  | 23:35 | <krenair@tin> | Synchronized php-1.26wmf19/maintenance/deleteEqualMessages.php: https://gerrit.wikimedia.org/r/#/c/234037/1 (duration: 01m 12s) | [production] | 
            
  | 23:27 | <yurik> | deployed kartotherian | [production] | 
            
  | 23:21 | <jynus> | cloning es1005 into es1011, ETA 9 hours | [production] | 
            
  | 22:41 | <ori> | armed keyholder on tin | [production] | 
            
  | 22:40 | <ori> | Disabled Puppet on mw1017 for 2hrs and applied I059b0c96c9 for testing. | [production] | 
            
  | 21:55 | <krinkle@tin> | Synchronized php-1.26wmf19/includes/poolcounter/PoolWorkArticleView.php: (no message) (duration: 01m 12s) | [production] | 
            
  | 21:48 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Depool es1005 (duration: 01m 12s) | [production] | 
            
  | 21:40 | <krinkle@tin> | Synchronized php-1.26wmf20/includes/poolcounter/PoolWorkArticleView.php: (no message) (duration: 01m 12s) | [production] | 
            
  | 21:32 | <ori> | Disabling Puppet on tin again to test an ssh-agent-proxy change | [production] | 
            
  | 20:30 | <ori@tin> | Synchronized README: testing ssh-agent-proxy changes (duration: 00m 13s) | [production] | 
            
  | 20:25 | <ori> | Disabling puppet on tin and hacking some debug logging into ssh-agent-proxy | [production] | 
            
  | 20:24 | <ori> | armed ssh-agent key on mira | [production] | 
            
  | 20:21 | <krinkle@tin> | Synchronized php-1.26wmf20/includes/poolcounter/PoolWorkArticleView.php: (no message) (duration: 00m 03s) | [production] | 
            
  | 20:11 | <subbu> | deployed parsoid version 44d657de | [production] | 
            
  | 19:52 | <krenair@tin> | Synchronized php-1.26wmf20/extensions/Echo/includes/mapper/EventMapper.php: https://gerrit.wikimedia.org/r/#/c/234082/ (duration: 00m 12s) | [production] | 
            
  | 19:47 | <mutante> | sodium - deleting shunted messages older than 7 days | [production] | 
            
  | 19:23 | <krenair@tin> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/234042/ (duration: 00m 12s) | [production] | 
            
  | 19:22 | <krenair@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/#/c/234024/ (duration: 00m 12s) | [production] | 
            
  | 19:20 | <krenair@tin> | Synchronized multiversion/MWWikiversions.php: https://gerrit.wikimedia.org/r/#/c/232672/ (duration: 00m 12s) | [production] | 
            
  | 18:50 | <krinkle@tin> | Synchronized php-1.26wmf20/maintenance/deleteEqualMessages.php: (no message) (duration: 00m 11s) | [production] | 
            
  | 18:50 | <krinkle@tin> | Synchronized php-1.26wmf19/maintenance/deleteEqualMessages.php: (no message) (duration: 00m 13s) | [production] | 
            
  | 18:38 | <twentyafterfour> | ^ stupid typo.  That sync was group1 to 1.26wmf20 | [production] | 
            
  | 18:37 | <twentyafterfour@tin> | rebuilt wikiversions.cdb and synchronized wikiversions files: tig | [production] | 
            
  | 18:31 | <ori@tin> | Synchronized w/404.php: Ided1facc0: Remove auto-redirection from 404 page. (duration: 00m 13s) | [production] | 
            
  | 17:30 | <urandom> | bouncing Cassandra on restbase1001 to apply temporary GC setting | [production] | 
            
  | 17:11 | <andrewbogott> | ok, /now/ I’m running a dist-upgrade on labcontrol1001, to sort out weird oslo dependencies | [production] | 
            
  | 17:09 | <chasemp> | adding firewall to elasticsearch2[4-6] (3 was just done as a pilot) | [production] | 
            
  | 17:03 | <andrewbogott> | upgraded labnet1002 nova services to Juno | [production] | 
            
  | 16:34 | <andrewbogott> | stopping keystone, updating db, restarting | [production] | 
            
  | 16:23 | <andrewbogott> | correction on that last:  Upgrading nova and glance services piecemeal | [production] | 
            
  | 16:22 | <andrewbogott> | running dist-upgrade on labcontrol1001 | [production] | 
            
  | 16:18 | <andrewbogott> | switching labcontrol1001 hiera to Juno which will add the cloud-archive repo for Juno. | [production] | 
            
  | 16:11 | <andrewbogott> | backing up labs openstack databases into /home/andrew/openstackdbbackups on db1009 | [production] | 
            
  | 16:11 | <andrewbogott> | starting labs openstack update to Juno | [production] | 
            
  | 15:53 | <moritzm> | ferm enabled on elastic1023 | [production] | 
            
  | 15:45 | <godog> | repool restbase1009 in pybal | [production] | 
            
  | 15:28 | <thcipriani@tin> | Synchronized php-1.26wmf20/extensions/Wikidata: SWAT: Update Wikidata - wrap usage tracking batch updates in transaction [[gerrit:233970]] (duration: 00m 23s) | [production] | 
            
  | 13:47 | <andrewbogott> | rebooting/reimaging labnet1001 | [production] | 
            
  | 13:11 | <mobrovac> | restbase deploying 1dfba85 | [production] | 
            
  | 12:54 | <yurik> | git synced kartotherian | [production] | 
            
  | 11:02 | <jynus> | dropping optin_survey_old table on all wikis | [production] | 
            
  | 10:33 | <godog> | reenable puppet on ms-fe/ms-be, base::firewall still not enabled | [production] | 
            
  | 09:58 | <godog> | test-reboot ms-be2001 | [production] | 
            
  | 08:17 | <godog> | disable puppet on ms-be/ms-fe in preparation for merging firewall changes | [production] |