|
2016-10-26
ยง
|
| 23:46 |
<madhuvishy> |
tools reenabled puppet across proxy hosts. /.well-known/healthz now live on tools-proxy T143638 |
[production] |
| 23:41 |
<dereckson@tin> |
Synchronized wmf-config/CommonSettings.php: For $wmgGalleryOptions, use isset() ([[Gerrit:318223]]) (duration: 00m 45s) |
[production] |
| 23:22 |
<dereckson@tin> |
Synchronized wmf-config/CommonSettings.php: Fix for current Undefined variable: wmgGalleryOptions issue (duration: 00m 48s) |
[production] |
| 23:19 |
<dereckson@tin> |
Synchronized wmf-config/CommonSettings.php: Test setting gallery config differently on Beta Cluster enwiki (T141349, 2/2) (duration: 00m 45s) |
[production] |
| 23:18 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: Test setting gallery config differently on Beta Cluster enwiki (T141349, 1/2, no-op in prod) (duration: 00m 49s) |
[production] |
| 21:08 |
<hashar> |
gallium: stopped rsync server |
[production] |
| 21:02 |
<jynus> |
restarting mysql and rebooting db1035 |
[production] |
| 20:54 |
<jynus> |
restarting mariadb on db2011 to test configuration change |
[production] |
| 20:50 |
<hashar> |
syncing /var/lib/jenkins from gallium to contint1001 . rsync server spawned on gallium in a term, contint1001 using rsync --bwlimit=5m --delete --info=progress2 -az rsync://gallium.wikimedia.org/jenkins /var/lib/jenkins |
[production] |
| 20:49 |
<Pchelolo> |
RESTBase deploy e835f9b8 |
[production] |
| 20:46 |
<Pchelolo> |
RESTBase deploy e835f9b8 - canary on restbase1007 |
[production] |
| 20:43 |
<arlolra> |
reverted Parsoid to version 63f1e151 |
[production] |
| 20:41 |
<Pchelolo> |
RESTBase deploy e835f9b8 - staging |
[production] |
| 20:36 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.28.0-wmf.23 |
[production] |
| 20:31 |
<arlolra> |
reverting Parsoid to version 63f1e151 |
[production] |
| 20:31 |
<arlolra> |
updated Parsoid to version ede4353 |
[production] |
| 20:28 |
<twentyafterfour@tin> |
Synchronized php-1.28.0-wmf.23/extensions/GlobalBlocking/: Deploy fix for T149232 to unblock the train refs T147517 (duration: 00m 51s) |
[production] |
| 20:14 |
<arlolra> |
starting Parsoid deploy |
[production] |
| 19:14 |
<hoo@tin> |
Synchronized wmf-config/Wikibase-labs.php: For consistency (duration: 00m 45s) |
[production] |
| 18:47 |
<hoo@tin> |
Synchronized wmf-config/Wikibase-labs.php: For consistency (duration: 00m 47s) |
[production] |
| 18:39 |
<mark> |
Reactivated BGP to AS6461 on cr1-eqiad |
[production] |
| 18:38 |
<mark> |
Chris moved cr1-eqiad:xe-5/3/1 to xe-3/3/1 |
[production] |
| 18:31 |
<mark> |
Disabling BGP session to AS6461 on cr1-eqiad, preparing for port migration |
[production] |
| 18:27 |
<mark> |
Chris is moving cr1-eqiad and cr2-eqiad xe-5/3/0 to xe-3/3/0 (both sides) |
[production] |
| 18:20 |
<maxsem@tin> |
Synchronized php-1.28.0-wmf.23/extensions/GeoData/: https://gerrit.wikimedia.org/r/#/c/318138/ (duration: 00m 47s) |
[production] |
| 18:19 |
<mark> |
Chris is moving cr1-eqiad and cr2-eqiad xe-5/2/0 to xe-3/2/0 (both sides) |
[production] |
| 18:12 |
<mark> |
Disabling cr1-eqiad:xe-5/2/0 |
[production] |
| 18:10 |
<bd808@tin> |
Synchronized wmf-config/CommonSettings.php: wikitech: Re-enable OAuth management interfaces T149150 (duration: 00m 46s) |
[production] |
| 18:04 |
<ema> |
cache_text - finished rolling downtimed reboots for kernel update |
[production] |
| 17:23 |
<cwd> |
updated smashpig from daba8c07108246261ca7ec557e3f1e5da430826e to f5f49d79fac0887df78ddcc68a2f5ced0670c387 |
[production] |
| 16:58 |
<mark> |
Shutting down cr1-eqiad:xe-5/0/[0-2] (part of aggregated links to rows A-C switches) |
[production] |
| 16:58 |
<mark> |
Chris moved cr1-eqiad:xe-5/2/1 to xe-3/0/3 |
[production] |
| 16:54 |
<mark> |
Chris moved cr1-eqiad:xe-5/1/[0-3] to xe-3/1/[0-3] |
[production] |
| 16:39 |
<moritzm> |
restarted ntp on mc2008 (stuck in XFAC state) |
[production] |
| 16:36 |
<jynus> |
stopping db2011 to replace disks T149099 |
[production] |
| 15:59 |
<mark> |
Disabling cr1-eqiad:ae4; VRRP conflict |
[production] |
| 15:58 |
<mark> |
Reenabling cr1-eqiad:ae4 |
[production] |
| 15:57 |
<mark> |
Restored cr1-eqiad:ae4 |
[production] |
| 15:37 |
<ema> |
cache_text - start rolling downtimed reboots for kernel update (~3 hours to completion) |
[production] |
| 15:27 |
<ema> |
cp1054 reboot for kernel update |
[production] |
| 15:16 |
<bblack> |
restarting grrrit-wm |
[production] |
| 14:34 |
<moritzm> |
rearmed keyholder on mira after reboot |
[production] |
| 14:24 |
<bblack> |
cache_upload - start rolling downtimed reboots for kernel update (~4 hours to completion) |
[production] |
| 14:19 |
<moritzm> |
rolling reboot of ocg cluster for kernel update |
[production] |
| 14:10 |
<demon@tin> |
Synchronized w: replacing wiki.phtml with a symlink (duration: 00m 47s) |
[production] |
| 13:39 |
<hashar> |
European SWAT deploy completed |
[production] |
| 13:37 |
<hashar> |
mw2098 is all set now after I ran "scap pull". It is properly in tin:/etc/dsh/group/mediawiki-installation |
[production] |
| 13:30 |
<hashar> |
mw2098: scap pull . It failed yesterday on reboot and is back in pull |
[production] |
| 13:28 |
<hashar> |
mw2098 spurts bunch of Notice: Undefined variable: wmgWatchlistDefault in /srv/mediawiki/wmf-config/CommonSettings.php on line 1871 |
[production] |
| 13:25 |
<hashar@tin> |
Synchronized wmf-config/CommonSettings.php: Remove obsolete config values (duration: 00m 46s) |
[production] |