2901-2950 of 10000 results (29ms)
2014-04-17 §
07:47 <mutante> db35,db38, stop puppet and salt, revoke certs,keys [production]
07:45 <mutante> restarting gitblit [production]
03:49 <LocalisationUpdate> ResourceLoader cache refresh completed at Thu Apr 17 03:49:19 UTC 2014 (duration 49m 18s) [production]
03:06 <subbu> deployed Parsoid 0bccf02c (deploy SHA 5e25f3b05) @ 1:30 pm PST, Apr 16th, 2014 [production]
03:02 <LocalisationUpdate> completed (1.23wmf22) at 2014-04-17 03:02:25+00:00 [production]
02:33 <LocalisationUpdate> completed (1.23wmf21) at 2014-04-17 02:33:47+00:00 [production]
02:03 <springle> stop mysqld on db35 (m1) for decom [production]
01:42 <springle> xtrabackup db63 to db60 [production]
2014-04-16 §
23:19 <mwalker> Finished scap: SWAT deploy: configuration change {{gerrit|126223}} and multimediaviewer {{gerrit|126852}} (duration: 04m 07s) [production]
23:15 <mwalker> Started scap: SWAT deploy: configuration change {{gerrit|126223}} and multimediaviewer {{gerrit|126852}} [production]
20:03 <RobH> osmium cleared from salt, puppetca, and puppetstoredconfig for reinstall with trusty (ignore any icinga alerts, there are no pages) [production]
18:58 <ottomata> reinstalling elastic1015 [production]
17:54 <reedy> synchronized php-1.23wmf22/includes/jobqueue/ 'I4b4dbe4637dc50cd4630ef19d54f01efba10e138' [production]
17:09 <paravoid> starting swiftrepl on copper for eqiad->esams copy [production]
17:08 <ori> synchronized wmf-config/InitialiseSettings.php 'I7b6e5c2d7: Enable web fonts by default on Hebrew Wikisource' [production]
17:07 <ori> synchronized fc-list 'Ib7b2bc21a: updated fonts list and sorted it, rt #810' [production]
17:06 <ori> updated /a/common to {{Gerrit|I7b6e5c2d7}}: Enable web fonts by default on Hebrew Wikisource [production]
16:37 <reedy> synchronized php-1.23wmf21/includes/jobqueue/JobQueueRedis.php 'I678ab55ae3678b5cd944393f2f2048851625f153' [production]
16:36 <reedy> synchronized php-1.23wmf22/includes/jobqueue/JobQueueRedis.php 'I678ab55ae3678b5cd944393f2f2048851625f153' [production]
15:38 <ottomata> reinstalling elastic1012 [production]
13:50 <manybubbles> restarting elastic1009 to suck up new config [production]
13:50 <manybubbles> raised the number of replicas for labswiki's search directly in elasticsearch because I can't easilly do for cirrus due to access restrictions [production]
13:45 <ottomata> reinstalling elastic1011 [production]
13:22 <mutante> DNS update - remove virt5-15 [production]
12:12 <mutante> virt5-11 - shut down [production]
11:41 <akosiaris> upgraded python-voluptuous on apt.wikimedia.org to 0.8.2-1wmf1 [production]
11:39 <hashar> Upgraded Zuul to wmf-deploy-20140416-3 (bring in a84f0e4 - "Make queue processing more efficient" which was much needed) [production]
11:29 <hashar> upgraded Zuul to wmf-deploy-20140416-2 [production]
11:16 <mutante> virt5-11 removing from icinga [production]
11:03 <mutante> virt5-11 revoked puppet certs and salt keys [production]
10:56 <mutante> stopping puppet on virt5-11 [production]
10:47 <hashar> Upgraded Zuul on gallium to wmf-deploy-20140416 (depends on python-voluptuous 0.7+ , Alexandros packaged 0.8.2 which I manually installed to validate). [production]
09:26 <mutante> disabling mw1163 in pybal [production]
07:03 <mutante> zirconium - upgrading apache2, php5 packages [production]
06:07 <springle> stop mysqld on db38 (x1) for decom [production]
03:46 <LocalisationUpdate> ResourceLoader cache refresh completed at Wed Apr 16 03:46:23 UTC 2014 (duration 46m 22s) [production]
02:55 <LocalisationUpdate> completed (1.23wmf22) at 2014-04-16 02:55:28+00:00 [production]
02:28 <LocalisationUpdate> completed (1.23wmf21) at 2014-04-16 02:28:01+00:00 [production]
00:43 <K4-713> updated listener credentials on thulium [production]
2014-04-15 §
23:25 <mwalker> synchronized wmf-config/abusefilter.php '{{gerrit|126168}} more abuse filter configuration fun' [production]
23:21 <mwalker> Finished scap: Configuration change {{gerrit|126163}} and MultimediaViewer {{gerrit|126158}} (duration: 02m 15s) [production]
23:19 <mwalker> Started scap: Configuration change {{gerrit|126163}} and MultimediaViewer {{gerrit|126158}} [production]
23:08 <mwalker> Finished scap: Configuration changes, {{gerrit|113656}}, {{gerrit|121834}}, {{gerrit|126065}} (duration: 03m 11s) [production]
23:05 <mwalker> Started scap: Configuration changes, {{gerrit|113656}}, {{gerrit|121834}}, {{gerrit|126065}} [production]
23:01 <hashar> restarting Zuul to clear leaked file descriptor (know issue, fixed upstream) [production]
22:12 <awight> crm updated from e3f285984f786ca9a05ded1662aba415b0259856 to 7dafce5f8fe265fb0ab6c96e01e59fc4362ea5b4 [production]
21:51 <manybubbles> restarting elastic1009 again [production]
21:39 <hashar> jenkins /var/lib/git cleaned up on gallium [production]
21:16 <manybubbles> restarting elastic1009 to test performance changes. cluster will go yellow for a few minutes. might go red (wikitech is busted) [production]
21:15 <hashar> Jenkins is processing jobs again [production]