|
2017-06-21
ยง
|
| 21:05 |
<mutante> |
apt.wm.org - reprepro, include gerrit_2.13.8+git1-wmf.6 for jessie-wikimedia |
[production] |
| 21:02 |
<mutante> |
install1002 - rsynced gerrit packages from copper, closed firewall again, cleaned up rsyncd config from old unused things |
[production] |
| 20:57 |
<arlolra> |
Updated Parsoid to 881ade32 (T127421, T167933, T167714) |
[production] |
| 20:50 |
<mutante> |
install1002 - allow rsync from copper (build host) to /srv/wikimedia/incoming , temp for package upload |
[production] |
| 20:49 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@2c4c0de]: Updating Parsoid to 881ade32 (duration: 12m 02s) |
[production] |
| 20:37 |
<arlolra@tin> |
Started deploy [parsoid/deploy@2c4c0de]: Updating Parsoid to 881ade32 |
[production] |
| 20:35 |
<mutante> |
install1002 - removing rsyncd config fragments from carbon migration, running puppet |
[production] |
| 20:25 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.30.0-wmf.6 |
[production] |
| 20:15 |
<bearND> |
rolled back deploy since scap could not connect to scb1003 |
[production] |
| 20:14 |
<twentyafterfour@tin> |
Synchronized php-1.30.0-wmf.6/includes/gallery/ImageGalleryBase.php: deploy https://gerrit.wikimedia.org/r/#/c/360695/ refs T168479 to unblock the train (duration: 00m 56s) |
[production] |
| 20:13 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@7bfe571]: Update mobileapps to 21f771d (duration: 08m 43s) |
[production] |
| 20:13 |
<andrewbogott> |
deleting the old IAD wikitech-static server so we stop paying rackspace for it |
[production] |
| 20:11 |
<ppchelko@tin> |
Finished deploy [changeprop/deploy@63e6a7b]: Actually start black-listing and rate-limiting articles. T161710 (duration: 01m 16s) |
[production] |
| 20:09 |
<ppchelko@tin> |
Started deploy [changeprop/deploy@63e6a7b]: Actually start black-listing and rate-limiting articles. T161710 |
[production] |
| 20:04 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@7bfe571]: Update mobileapps to 21f771d |
[production] |
| 19:41 |
<mutante> |
copper: building gerrit_2.13.8+git1-wmf.6 for stretch (experimental) |
[production] |
| 19:39 |
<mutante> |
copper: building gerrit_2.13.8+git1-wmf.6 for jessie |
[production] |
| 19:30 |
<twentyafterfour> |
The train for wmf.6 (T167535) is currently blocked by T168479 |
[production] |
| 19:13 |
<madhuvishy> |
Rebooting labstore1004 (secondary in drbd pair) |
[production] |
| 18:55 |
<andrewbogott> |
rebooting labnet1001, which will cause a labs-wide network outage |
[production] |
| 18:46 |
<gehel> |
restarting wdqs-updater on all wdqs servers |
[production] |
| 18:38 |
<krinkle@tin> |
Synchronized static/images/: I737e6f9fce (duration: 00m 46s) |
[production] |
| 18:20 |
<gehel@tin> |
Finished deploy [wdqs/wdqs@d67d4a4]: (no justification provided) (duration: 01m 50s) |
[production] |
| 18:18 |
<gehel@tin> |
Started deploy [wdqs/wdqs@d67d4a4]: (no justification provided) |
[production] |
| 18:17 |
<gehel> |
deploying wdqs to fix missing lib |
[production] |
| 18:14 |
<andrewbogott> |
rebooting labnet1002 |
[production] |
| 18:02 |
<andrewbogott> |
rebooting californium |
[production] |
| 17:59 |
<andrewbogott> |
rebooting labservices1001 |
[production] |
| 17:58 |
<andrewbogott> |
disabling the openstack scheduler so that we don't get new inconsistent VMs during some reboots |
[production] |
| 17:53 |
<andrewbogott> |
rebooting labcontrol1002 |
[production] |
| 17:53 |
<andrewbogott> |
rebooting labservices1002 |
[production] |
| 17:37 |
<twentyafterfour> |
phabricator is back online |
[production] |
| 17:36 |
<andrewbogott> |
rebooting labvirt1013 |
[production] |
| 17:35 |
<herron> |
iridium - upgraded exim packages and rebooted to apply kernel upgrade |
[production] |
| 17:35 |
<ottomata> |
beginning reboots of kafka10(14|18|20|22) for kernel upgrade |
[production] |
| 17:34 |
<twentyafterfour> |
phabricator will be offline momentarily while iridium reboots |
[production] |
| 17:25 |
<andrewbogott> |
rebooting labvirt1012 |
[production] |
| 17:12 |
<andrewbogott> |
rebooting labvirt1011 |
[production] |
| 16:59 |
<andrewbogott> |
rebooting labvirt1010 |
[production] |
| 16:57 |
<herron> |
reboot fermium (lists) for kernel upgrade |
[production] |
| 16:42 |
<andrewbogott> |
rebooting labvirt1009 |
[production] |
| 16:41 |
<moritzm> |
rebooting video scalers in codfw for kernel update |
[production] |
| 16:35 |
<moritzm> |
rebooting mw1293/mw1294 for kernel update |
[production] |
| 16:32 |
<andrewbogott> |
rebooting labvirt1008 |
[production] |
| 15:53 |
<godog> |
upgrade ms-be10[31-39] to swift 2.10 |
[production] |
| 15:46 |
<ema> |
reboot lvs[4001-4002] (ulsfo primaries) for kernel update |
[production] |
| 15:45 |
<moritzm> |
upgrade ms-be2013/ms-be2014 to final stretch release and reboot for kernel update |
[production] |
| 15:34 |
<ema> |
reboot lvs[4003-4004] (ulsfo secondaries) for kernel update |
[production] |
| 15:32 |
<moritzm> |
reboot image scalers in codfw for kernel update |
[production] |
| 15:32 |
<andrewbogott> |
rebooting labvirt1007 |
[production] |