| 2017-06-21
      
      ยง | 
    
  | 20:49 | <arlolra@tin> | Finished deploy [parsoid/deploy@2c4c0de]: Updating Parsoid to 881ade32 (duration: 12m 02s) | [production] | 
            
  | 20:37 | <arlolra@tin> | Started deploy [parsoid/deploy@2c4c0de]: Updating Parsoid to 881ade32 | [production] | 
            
  | 20:35 | <mutante> | install1002 - removing rsyncd config fragments from carbon migration, running puppet | [production] | 
            
  | 20:25 | <twentyafterfour@tin> | rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.30.0-wmf.6 | [production] | 
            
  | 20:15 | <bearND> | rolled back deploy since scap could not connect to scb1003 | [production] | 
            
  | 20:14 | <twentyafterfour@tin> | Synchronized php-1.30.0-wmf.6/includes/gallery/ImageGalleryBase.php: deploy https://gerrit.wikimedia.org/r/#/c/360695/ refs T168479 to unblock the train (duration: 00m 56s) | [production] | 
            
  | 20:13 | <bsitzmann@tin> | Finished deploy [mobileapps/deploy@7bfe571]: Update mobileapps to 21f771d (duration: 08m 43s) | [production] | 
            
  | 20:13 | <andrewbogott> | deleting the old IAD wikitech-static server so we stop paying rackspace for it | [production] | 
            
  | 20:11 | <ppchelko@tin> | Finished deploy [changeprop/deploy@63e6a7b]: Actually start black-listing and rate-limiting articles. T161710 (duration: 01m 16s) | [production] | 
            
  | 20:09 | <ppchelko@tin> | Started deploy [changeprop/deploy@63e6a7b]: Actually start black-listing and rate-limiting articles. T161710 | [production] | 
            
  | 20:04 | <bsitzmann@tin> | Started deploy [mobileapps/deploy@7bfe571]: Update mobileapps to 21f771d | [production] | 
            
  | 19:41 | <mutante> | copper: building gerrit_2.13.8+git1-wmf.6 for stretch (experimental) | [production] | 
            
  | 19:39 | <mutante> | copper: building gerrit_2.13.8+git1-wmf.6 for jessie | [production] | 
            
  | 19:30 | <twentyafterfour> | The train for wmf.6 (T167535) is currently blocked by T168479 | [production] | 
            
  | 19:13 | <madhuvishy> | Rebooting labstore1004 (secondary in drbd pair) | [production] | 
            
  | 18:55 | <andrewbogott> | rebooting labnet1001, which will cause a labs-wide network outage | [production] | 
            
  | 18:46 | <gehel> | restarting wdqs-updater on all wdqs servers | [production] | 
            
  | 18:38 | <krinkle@tin> | Synchronized static/images/: I737e6f9fce (duration: 00m 46s) | [production] | 
            
  | 18:20 | <gehel@tin> | Finished deploy [wdqs/wdqs@d67d4a4]: (no justification provided) (duration: 01m 50s) | [production] | 
            
  | 18:18 | <gehel@tin> | Started deploy [wdqs/wdqs@d67d4a4]: (no justification provided) | [production] | 
            
  | 18:17 | <gehel> | deploying wdqs to fix missing lib | [production] | 
            
  | 18:14 | <andrewbogott> | rebooting labnet1002 | [production] | 
            
  | 18:02 | <andrewbogott> | rebooting californium | [production] | 
            
  | 17:59 | <andrewbogott> | rebooting labservices1001 | [production] | 
            
  | 17:58 | <andrewbogott> | disabling the openstack scheduler so that we don't get new inconsistent VMs during some reboots | [production] | 
            
  | 17:53 | <andrewbogott> | rebooting labcontrol1002 | [production] | 
            
  | 17:53 | <andrewbogott> | rebooting labservices1002 | [production] | 
            
  | 17:37 | <twentyafterfour> | phabricator is back online | [production] | 
            
  | 17:36 | <andrewbogott> | rebooting labvirt1013 | [production] | 
            
  | 17:35 | <herron> | iridium - upgraded exim packages and rebooted to apply kernel upgrade | [production] | 
            
  | 17:35 | <ottomata> | beginning reboots of kafka10(14|18|20|22) for kernel upgrade | [production] | 
            
  | 17:34 | <twentyafterfour> | phabricator will be offline momentarily while iridium reboots | [production] | 
            
  | 17:25 | <andrewbogott> | rebooting labvirt1012 | [production] | 
            
  | 17:12 | <andrewbogott> | rebooting labvirt1011 | [production] | 
            
  | 16:59 | <andrewbogott> | rebooting labvirt1010 | [production] | 
            
  | 16:57 | <herron> | reboot fermium (lists) for kernel upgrade | [production] | 
            
  | 16:42 | <andrewbogott> | rebooting labvirt1009 | [production] | 
            
  | 16:41 | <moritzm> | rebooting video scalers in codfw for kernel update | [production] | 
            
  | 16:35 | <moritzm> | rebooting mw1293/mw1294 for kernel update | [production] | 
            
  | 16:32 | <andrewbogott> | rebooting labvirt1008 | [production] | 
            
  | 15:53 | <godog> | upgrade ms-be10[31-39] to swift 2.10 | [production] | 
            
  | 15:46 | <ema> | reboot lvs[4001-4002] (ulsfo primaries) for kernel update | [production] | 
            
  | 15:45 | <moritzm> | upgrade ms-be2013/ms-be2014 to final stretch release and reboot for kernel update | [production] | 
            
  | 15:34 | <ema> | reboot lvs[4003-4004] (ulsfo secondaries) for kernel update | [production] | 
            
  | 15:32 | <moritzm> | reboot image scalers in codfw for kernel update | [production] | 
            
  | 15:32 | <andrewbogott> | rebooting labvirt1007 | [production] | 
            
  | 15:13 | <andrewbogott> | rebooting labvirt1006 | [production] | 
            
  | 15:04 | <moritzm> | rebooting ruthenium for kernel update | [production] | 
            
  | 15:01 | <moritzm> | reboot job runners in codfw for kernel update | [production] | 
            
  | 15:01 | <elukey> | reboot kafka200[23] for kernel updates (eventbus codfw) | [production] |