|
2017-06-21
ยง
|
| 20:15 |
<bearND> |
rolled back deploy since scap could not connect to scb1003 |
[production] |
| 20:14 |
<twentyafterfour@tin> |
Synchronized php-1.30.0-wmf.6/includes/gallery/ImageGalleryBase.php: deploy https://gerrit.wikimedia.org/r/#/c/360695/ refs T168479 to unblock the train (duration: 00m 56s) |
[production] |
| 20:13 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@7bfe571]: Update mobileapps to 21f771d (duration: 08m 43s) |
[production] |
| 20:13 |
<andrewbogott> |
deleting the old IAD wikitech-static server so we stop paying rackspace for it |
[production] |
| 20:11 |
<ppchelko@tin> |
Finished deploy [changeprop/deploy@63e6a7b]: Actually start black-listing and rate-limiting articles. T161710 (duration: 01m 16s) |
[production] |
| 20:09 |
<ppchelko@tin> |
Started deploy [changeprop/deploy@63e6a7b]: Actually start black-listing and rate-limiting articles. T161710 |
[production] |
| 20:04 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@7bfe571]: Update mobileapps to 21f771d |
[production] |
| 19:41 |
<mutante> |
copper: building gerrit_2.13.8+git1-wmf.6 for stretch (experimental) |
[production] |
| 19:39 |
<mutante> |
copper: building gerrit_2.13.8+git1-wmf.6 for jessie |
[production] |
| 19:30 |
<twentyafterfour> |
The train for wmf.6 (T167535) is currently blocked by T168479 |
[production] |
| 19:13 |
<madhuvishy> |
Rebooting labstore1004 (secondary in drbd pair) |
[production] |
| 18:55 |
<andrewbogott> |
rebooting labnet1001, which will cause a labs-wide network outage |
[production] |
| 18:46 |
<gehel> |
restarting wdqs-updater on all wdqs servers |
[production] |
| 18:38 |
<krinkle@tin> |
Synchronized static/images/: I737e6f9fce (duration: 00m 46s) |
[production] |
| 18:20 |
<gehel@tin> |
Finished deploy [wdqs/wdqs@d67d4a4]: (no justification provided) (duration: 01m 50s) |
[production] |
| 18:18 |
<gehel@tin> |
Started deploy [wdqs/wdqs@d67d4a4]: (no justification provided) |
[production] |
| 18:17 |
<gehel> |
deploying wdqs to fix missing lib |
[production] |
| 18:14 |
<andrewbogott> |
rebooting labnet1002 |
[production] |
| 18:02 |
<andrewbogott> |
rebooting californium |
[production] |
| 17:59 |
<andrewbogott> |
rebooting labservices1001 |
[production] |
| 17:58 |
<andrewbogott> |
disabling the openstack scheduler so that we don't get new inconsistent VMs during some reboots |
[production] |
| 17:53 |
<andrewbogott> |
rebooting labcontrol1002 |
[production] |
| 17:53 |
<andrewbogott> |
rebooting labservices1002 |
[production] |
| 17:37 |
<twentyafterfour> |
phabricator is back online |
[production] |
| 17:36 |
<andrewbogott> |
rebooting labvirt1013 |
[production] |
| 17:35 |
<herron> |
iridium - upgraded exim packages and rebooted to apply kernel upgrade |
[production] |
| 17:35 |
<ottomata> |
beginning reboots of kafka10(14|18|20|22) for kernel upgrade |
[production] |
| 17:34 |
<twentyafterfour> |
phabricator will be offline momentarily while iridium reboots |
[production] |
| 17:25 |
<andrewbogott> |
rebooting labvirt1012 |
[production] |
| 17:12 |
<andrewbogott> |
rebooting labvirt1011 |
[production] |
| 16:59 |
<andrewbogott> |
rebooting labvirt1010 |
[production] |
| 16:57 |
<herron> |
reboot fermium (lists) for kernel upgrade |
[production] |
| 16:42 |
<andrewbogott> |
rebooting labvirt1009 |
[production] |
| 16:41 |
<moritzm> |
rebooting video scalers in codfw for kernel update |
[production] |
| 16:35 |
<moritzm> |
rebooting mw1293/mw1294 for kernel update |
[production] |
| 16:32 |
<andrewbogott> |
rebooting labvirt1008 |
[production] |
| 15:53 |
<godog> |
upgrade ms-be10[31-39] to swift 2.10 |
[production] |
| 15:46 |
<ema> |
reboot lvs[4001-4002] (ulsfo primaries) for kernel update |
[production] |
| 15:45 |
<moritzm> |
upgrade ms-be2013/ms-be2014 to final stretch release and reboot for kernel update |
[production] |
| 15:34 |
<ema> |
reboot lvs[4003-4004] (ulsfo secondaries) for kernel update |
[production] |
| 15:32 |
<moritzm> |
reboot image scalers in codfw for kernel update |
[production] |
| 15:32 |
<andrewbogott> |
rebooting labvirt1007 |
[production] |
| 15:13 |
<andrewbogott> |
rebooting labvirt1006 |
[production] |
| 15:04 |
<moritzm> |
rebooting ruthenium for kernel update |
[production] |
| 15:01 |
<moritzm> |
reboot job runners in codfw for kernel update |
[production] |
| 15:01 |
<elukey> |
reboot kafka200[23] for kernel updates (eventbus codfw) |
[production] |
| 14:53 |
<andrewbogott> |
rebooting labvirt1005 |
[production] |
| 14:40 |
<moritzm> |
reboot remaining scb* hosts for kernel update |
[production] |
| 14:38 |
<andrewbogott> |
rebooting labvirt1004 |
[production] |
| 14:32 |
<ema> |
reboot lvs[3001-3002] (esams primaries) for kernel update |
[production] |