|
2013-02-14
§
|
| 21:45 |
<olivneh> |
synchronized php-1.21wmf9/extensions/EventLogging |
[production] |
| 21:39 |
<sbernardin> |
taking down srv266 and srv268 for decommissioning ... https://rt.wikimedia.org/Ticket/Display.html?id=4534 |
[production] |
| 21:31 |
<ottomata1> |
restarted solr jetty on solr2 |
[production] |
| 21:30 |
<bsitu> |
Finished syncing Wikimedia installation... : Update ArticleFeedbackv5, Echo, PageTriage to master |
[production] |
| 21:25 |
<ottomata> |
restarted solr jetty on solr3 and solr1003 for MaxSem |
[production] |
| 21:03 |
<bsitu> |
Started syncing Wikimedia installation... : Update ArticleFeedbackv5, Echo, PageTriage to master |
[production] |
| 20:24 |
<kaldari> |
synchronized wmf-config/CommonSettings.php 'updating CommonSettings.php for Echo' |
[production] |
| 20:15 |
<apergos> |
rebooting mw1010 after some issues with OOM |
[production] |
| 19:22 |
<RobH> |
new servers are NOT in pybal yet, and thus not getting traffic |
[production] |
| 19:22 |
<RobH> |
just added mw1161-1200 into node lists for eventual service, some may throw sync script errors as I track them down |
[production] |
| 19:15 |
<Ryan_Lane> |
rebooting labstore3 |
[production] |
| 19:08 |
<Ryan_Lane> |
rebooting labstore4 |
[production] |
| 19:01 |
<Ryan_Lane> |
rebooting labstore2 |
[production] |
| 18:52 |
<Ryan_Lane> |
rebooting labstore1 |
[production] |
| 15:22 |
<demon> |
synchronized wmf-config/InitialiseSettings.php 'Updating wikibase sort order' |
[production] |
| 15:22 |
<demon> |
synchronized php-1.21wmf9/extensions/Wikibase/client/includes/SortUtils.php 'Updating wikibase sort order' |
[production] |
| 14:52 |
<mutante> |
re-enabled cp1044 in pybal - mobile varnish cache servers all on precise now |
[production] |
| 14:39 |
<hashar> |
Jenkins: adding in several extension to Zuul configuration {{gerrit|49041}} |
[production] |
| 14:30 |
<hashar> |
jenkins : updated all jobs using latest version jjb-config |
[production] |
| 13:35 |
<mark> |
Fixed fixing |
[production] |
| 13:27 |
<mutante> |
disabling cp1044 in pybal, reinstalling with precise |
[production] |
| 13:22 |
<mutante> |
re-enabling cp1043 in pybal |
[production] |
| 13:11 |
<mark> |
Upgraded varnish to latest version with updated range patch on cp1021-1028 |
[production] |
| 12:16 |
<mark> |
Inserted varnish 3.0.3plus~rc1-wm7 into the precise-wikimedia APT repository |
[production] |
| 12:14 |
<mutante> |
stopping varnish backend on cp1043 and starting reinstall |
[production] |
| 12:10 |
<mutante> |
disabling cp1043 in pybal |
[production] |
| 11:31 |
<mutante> |
ms1004 - full disk, deleted large HTCPpurger.log file, fixed puppet runs |
[production] |
| 02:29 |
<LocalisationUpdate> |
completed (1.21wmf9) at Thu Feb 14 02:29:05 UTC 2013 |
[production] |
| 01:17 |
<andrewbogott> |
updated OpenStackManager to git head on virt0. Previous state is preserved (temporarily) in the local 'premerge' branch. |
[production] |
| 01:13 |
<paravoid> |
removing mysql & apache from emery(!) |
[production] |
| 00:03 |
<RobH> |
db29 os installed, handed off to peter |
[production] |
|
2013-02-13
§
|
| 23:50 |
<RobH> |
db29 reinstalling |
[production] |
| 23:48 |
<paravoid> |
reinstalling sq48 |
[production] |
| 23:22 |
<RobH> |
db27 and db29 will be up and down for reinstallations |
[production] |
| 23:17 |
<sbernardin> |
rebooting db29 per https://rt.wikimedia.org/Ticket/Display.html?id=4528 |
[production] |
| 23:17 |
<sbernardin> |
rebooting db27 per https://rt.wikimedia.org/Ticket/Display.html?id=4528 |
[production] |
| 23:11 |
<RobH> |
db1013 online and puppet updated, needs to be pushed into some db cluster service |
[production] |
| 22:45 |
<RobH> |
mw27 locked up, powercycling |
[production] |
| 22:36 |
<notpeter> |
powercycling all eqiad jobrunners |
[production] |
| 22:13 |
<RobH> |
adding mw1201-1208 to eqiad apache pool |
[production] |
| 21:44 |
<Reedy> |
Running sync-common on mw1203 |
[production] |
| 21:43 |
<reedy> |
synchronized php-1.21wmf9 'resync to fix file permission errors' |
[production] |
| 21:32 |
<Reedy> |
Running sync-common on mw1204 |
[production] |
| 21:30 |
<Reedy> |
Running sync-common on mw1202 |
[production] |
| 21:27 |
<RobH> |
db27 rebooting for reinstallation |
[production] |
| 21:27 |
<RobH> |
db29 offline due to hardware issue, related ticket 4526 |
[production] |
| 21:19 |
<reedy> |
synchronized wmf-config/CommonSettings.php |
[production] |
| 21:11 |
<csteipp> |
synchronized wmf-config |
[production] |
| 21:09 |
<reedy> |
cleared profiling data |
[production] |
| 20:25 |
<reedy> |
synchronized wmf-config/CommonSettings.php 'Uncommenting enwiki from localClientDatabases' |
[production] |