|
2014-04-16
§
|
| 23:19 |
<mwalker> |
Finished scap: SWAT deploy: configuration change {{gerrit|126223}} and multimediaviewer {{gerrit|126852}} (duration: 04m 07s) |
[production] |
| 23:15 |
<mwalker> |
Started scap: SWAT deploy: configuration change {{gerrit|126223}} and multimediaviewer {{gerrit|126852}} |
[production] |
| 20:03 |
<RobH> |
osmium cleared from salt, puppetca, and puppetstoredconfig for reinstall with trusty (ignore any icinga alerts, there are no pages) |
[production] |
| 18:58 |
<ottomata> |
reinstalling elastic1015 |
[production] |
| 17:54 |
<reedy> |
synchronized php-1.23wmf22/includes/jobqueue/ 'I4b4dbe4637dc50cd4630ef19d54f01efba10e138' |
[production] |
| 17:09 |
<paravoid> |
starting swiftrepl on copper for eqiad->esams copy |
[production] |
| 17:08 |
<ori> |
synchronized wmf-config/InitialiseSettings.php 'I7b6e5c2d7: Enable web fonts by default on Hebrew Wikisource' |
[production] |
| 17:07 |
<ori> |
synchronized fc-list 'Ib7b2bc21a: updated fonts list and sorted it, rt #810' |
[production] |
| 17:06 |
<ori> |
updated /a/common to {{Gerrit|I7b6e5c2d7}}: Enable web fonts by default on Hebrew Wikisource |
[production] |
| 16:37 |
<reedy> |
synchronized php-1.23wmf21/includes/jobqueue/JobQueueRedis.php 'I678ab55ae3678b5cd944393f2f2048851625f153' |
[production] |
| 16:36 |
<reedy> |
synchronized php-1.23wmf22/includes/jobqueue/JobQueueRedis.php 'I678ab55ae3678b5cd944393f2f2048851625f153' |
[production] |
| 15:38 |
<ottomata> |
reinstalling elastic1012 |
[production] |
| 13:50 |
<manybubbles> |
restarting elastic1009 to suck up new config |
[production] |
| 13:50 |
<manybubbles> |
raised the number of replicas for labswiki's search directly in elasticsearch because I can't easilly do for cirrus due to access restrictions |
[production] |
| 13:45 |
<ottomata> |
reinstalling elastic1011 |
[production] |
| 13:22 |
<mutante> |
DNS update - remove virt5-15 |
[production] |
| 12:12 |
<mutante> |
virt5-11 - shut down |
[production] |
| 11:41 |
<akosiaris> |
upgraded python-voluptuous on apt.wikimedia.org to 0.8.2-1wmf1 |
[production] |
| 11:39 |
<hashar> |
Upgraded Zuul to wmf-deploy-20140416-3 (bring in a84f0e4 - "Make queue processing more efficient" which was much needed) |
[production] |
| 11:29 |
<hashar> |
upgraded Zuul to wmf-deploy-20140416-2 |
[production] |
| 11:16 |
<mutante> |
virt5-11 removing from icinga |
[production] |
| 11:03 |
<mutante> |
virt5-11 revoked puppet certs and salt keys |
[production] |
| 10:56 |
<mutante> |
stopping puppet on virt5-11 |
[production] |
| 10:47 |
<hashar> |
Upgraded Zuul on gallium to wmf-deploy-20140416 (depends on python-voluptuous 0.7+ , Alexandros packaged 0.8.2 which I manually installed to validate). |
[production] |
| 09:26 |
<mutante> |
disabling mw1163 in pybal |
[production] |
| 07:03 |
<mutante> |
zirconium - upgrading apache2, php5 packages |
[production] |
| 06:07 |
<springle> |
stop mysqld on db38 (x1) for decom |
[production] |
| 03:46 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed Apr 16 03:46:23 UTC 2014 (duration 46m 22s) |
[production] |
| 02:55 |
<LocalisationUpdate> |
completed (1.23wmf22) at 2014-04-16 02:55:28+00:00 |
[production] |
| 02:28 |
<LocalisationUpdate> |
completed (1.23wmf21) at 2014-04-16 02:28:01+00:00 |
[production] |
| 00:43 |
<K4-713> |
updated listener credentials on thulium |
[production] |
|
2014-04-15
§
|
| 23:25 |
<mwalker> |
synchronized wmf-config/abusefilter.php '{{gerrit|126168}} more abuse filter configuration fun' |
[production] |
| 23:21 |
<mwalker> |
Finished scap: Configuration change {{gerrit|126163}} and MultimediaViewer {{gerrit|126158}} (duration: 02m 15s) |
[production] |
| 23:19 |
<mwalker> |
Started scap: Configuration change {{gerrit|126163}} and MultimediaViewer {{gerrit|126158}} |
[production] |
| 23:08 |
<mwalker> |
Finished scap: Configuration changes, {{gerrit|113656}}, {{gerrit|121834}}, {{gerrit|126065}} (duration: 03m 11s) |
[production] |
| 23:05 |
<mwalker> |
Started scap: Configuration changes, {{gerrit|113656}}, {{gerrit|121834}}, {{gerrit|126065}} |
[production] |
| 23:01 |
<hashar> |
restarting Zuul to clear leaked file descriptor (know issue, fixed upstream) |
[production] |
| 22:12 |
<awight> |
crm updated from e3f285984f786ca9a05ded1662aba415b0259856 to 7dafce5f8fe265fb0ab6c96e01e59fc4362ea5b4 |
[production] |
| 21:51 |
<manybubbles> |
restarting elastic1009 again |
[production] |
| 21:39 |
<hashar> |
jenkins /var/lib/git cleaned up on gallium |
[production] |
| 21:16 |
<manybubbles> |
restarting elastic1009 to test performance changes. cluster will go yellow for a few minutes. might go red (wikitech is busted) |
[production] |
| 21:15 |
<hashar> |
Jenkins is processing jobs again |
[production] |
| 21:14 |
<hashar> |
cleared /tmp/ on integration-slave1002 (filled up by hhvm job, known issue, bug filled already) |
[production] |
| 21:12 |
<hashar> |
Zuul locked again :/ Unpooling and repooling Jenkins slaves. |
[production] |
| 19:50 |
<RoanKattouw> |
Restarting stuck Jenkins |
[production] |
| 19:31 |
<manybubbles> |
setting refresh interval on elasticsearch indexes to 30s to test effect on load |
[production] |