|
2013-09-24
ยง
|
| 21:48 |
<LeslieCarr> |
routing changes in ulsfo, commit confirmed 5 for safety |
[production] |
| 21:45 |
<maxsem> |
Finished syncing Wikimedia installation... : Weekly mobile deployment |
[production] |
| 21:34 |
<maxsem> |
Started syncing Wikimedia installation... : Weekly mobile deployment |
[production] |
| 19:35 |
<reedy> |
synchronized wmf-config 'touch' |
[production] |
| 19:19 |
<bsitu> |
synchronized echowikis.dblist 'Enable Echo and Thanks on various wikis' |
[production] |
| 19:07 |
<bsitu> |
synchronized echowikis.dblist 'Enable Echo and Thanks on various wikis' |
[production] |
| 19:06 |
<bsitu> |
synchronized wmf-config/InitialiseSettings.php 'Enable Echo and Thanks on various wikis' |
[production] |
| 18:55 |
<bsitu> |
Finished syncing Wikimedia installation... : Update Echo and Thanks to master |
[production] |
| 18:54 |
<cmjohnson> |
apache-graceful on mw1046 |
[production] |
| 18:53 |
<bblack> |
varnish updated to -wm16 on all eqiad mobile caches now, yell at me if something starts looking "off" there... |
[production] |
| 18:53 |
<cmjohnson> |
sync'ing mw1046 |
[production] |
| 18:43 |
<bsitu> |
Started syncing Wikimedia installation... : Update Echo and Thanks to master |
[production] |
| 18:09 |
<bblack> |
upgraded varnish pkg to -wm16 on cp1046 |
[production] |
| 17:59 |
<RobH> |
bast4001 reinstall |
[production] |
| 17:58 |
<manybubbles> |
finished building search indexes on closed wikis |
[production] |
| 17:49 |
<LeslieCarr> |
Hurricane electric peering moved to 10GE port. the spice packets must flow... |
[production] |
| 17:14 |
<MaxSem> |
Recreating GeoData index |
[production] |
| 16:38 |
<manybubbles> |
rebuilt search indecies in place for all other wikis runnig cirrus except cawiki and enwikisource. skipped them because they are already up to date. |
[production] |
| 16:27 |
<cmjohnson> |
adding mw1046 back to pybal |
[production] |
| 16:24 |
<manybubbles> |
rebuilding search indecies in place for all other wikis running cirrus |
[production] |
| 16:19 |
<mutante> |
DNS update, add wikipediastories domains |
[production] |
| 16:18 |
<mutante> |
sync-apache, graceful for wikipediastories |
[production] |
| 16:16 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Disable CleanChanges on meta' |
[production] |
| 16:10 |
<manybubbles> |
building search indecies for all closed wikis |
[production] |
| 16:06 |
<manybubbles> |
synchronized wmf-config/InitialiseSettings.php 'Cirrus on closed wikis' |
[production] |
| 15:25 |
<demon> |
synchronized php-1.22wmf18/extensions/CirrusSearch |
[production] |
| 15:24 |
<mutante> |
freshly activated http://wikimediastories.org/ (and .com,.net) |
[production] |
| 15:21 |
<mutante> |
sync-apache and graceful-all for wikimediastories and other cleanup |
[production] |
| 15:21 |
<yurik> |
synchronized php-1.22wmf18/extensions/ZeroRatedMobileAccess/ |
[production] |
| 15:13 |
<mutante> |
during sync-apache: mw1072 - read-only file system |
[production] |
| 15:07 |
<cmjohnson> |
db1053 removing/replacing disk 3 |
[production] |
| 15:05 |
<yurik> |
synchronized php-1.22wmf17/extensions/ZeroRatedMobileAccess/ |
[production] |
| 14:59 |
<cmjohnson> |
db1001 removing/replacing disk 7 |
[production] |
| 14:48 |
<cmjohnson> |
db1031 removing/replacing disk 7 |
[production] |
| 14:38 |
<cmjohnson> |
replacing mw1046 hard drive --requires reinstall |
[production] |
| 14:21 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue Sep 24 14:21:10 UTC 2013 |
[production] |
| 14:15 |
<LocalisationUpdate> |
completed (1.22wmf17) at Tue Sep 24 14:15:56 UTC 2013 |
[production] |
| 14:15 |
<LocalisationUpdate> |
completed (1.22wmf18) at Tue Sep 24 14:15:16 UTC 2013 |
[production] |
| 14:13 |
<demon> |
synchronized php-1.22wmf18/extensions/Elastica 'Sync message fixes' |
[production] |
| 12:26 |
<mutante> |
shutting down sq45 |
[production] |
| 11:04 |
<mutante> |
powercycled sq45 |
[production] |
| 10:08 |
<p858snake|l> |
[20:01AEST] <mark> upped to weight 5 |
[production] |
| 10:08 |
<p858snake|l> |
[19:51AEST] <mark> !log Pooled Varnish Text caches in eqiad with weight 1 (affecting wikidata, wikivoyage, *.wikimedia.org) |
[production] |
| 10:07 |
<p858snake|l> |
[19:36AEST] <akosiaris> !log rebooted labstore4, controller configuration lost ? |
[production] |
| 10:07 |
<p858snake|l> |
[19:36AEST] <akosiaris> !log rebooted labstore3 (thought the 14days NFS issue was resolved???) |
[production] |
| 10:04 |
<akosiaris> |
rebooted labstore4, controller configuration lost ? |
[production] |
| 10:04 |
<akosiaris> |
rebooted labstore3 (thought the 14days NFS issue was resolved???) |
[production] |
| 08:30 |
<hashar> |
restarting Jenkins again for one last plugin upgrade |
[production] |
| 08:30 |
<springle> |
labstore4 disk issues, /a failed mount in console, ssh key bouncing. awaiting input from ryan or coren |
[production] |
| 08:30 |
<hashar> |
8:20am INFO: Jenkins is fully up and running |
[production] |