2401-2450 of 10000 results (28ms)
2014-06-17 §
03:20 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Jun 17 03:19:12 UTC 2014 (duration 19m 11s) [production]
02:35 <LocalisationUpdate> completed (1.24wmf9) at 2014-06-17 02:34:09+00:00 [production]
02:23 <LocalisationUpdate> completed (1.24wmf8) at 2014-06-17 02:22:46+00:00 [production]
2014-06-16 §
23:12 <maxsem> Synchronized php-1.24wmf8/extensions/MobileFrontend/: https://gerrit.wikimedia.org/r/#/c/139562/ (duration: 00m 05s) [production]
23:11 <maxsem> Synchronized php-1.24wmf9/extensions/MobileFrontend/: https://gerrit.wikimedia.org/r/#/c/139562/ (duration: 00m 06s) [production]
23:05 <maxsem> Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/139888/ (duration: 00m 08s) [production]
21:30 <ori> upgraded eventlogging to 3012aad [production]
20:45 <ori> updated eventlogging to b4b42effc6 [production]
17:36 <csteipp> Synchronized php-1.24wmf8/extensions/EducationProgram/includes/api/ApiAddStudents.php: Bug66631 (duration: 00m 05s) [production]
17:34 <csteipp> Synchronized php-1.24wmf9/extensions/EducationProgram/includes/api/ApiAddStudents.php: (no message) (duration: 00m 05s) [production]
15:59 <godog> manually ran update-ubuntu-mirror on carbon, successful [production]
15:57 <awight> updated crm from e52a4eb1bfab622f612dc84f687678fff1fdbc04 to 26460d6eaec26861661322df8e9f07a8b0519677 [production]
15:30 <ottomata> reinstalling analytics1018 [production]
13:38 <twkozlowski> _joe_ also working on recovering the list which was deleted by mistake [production]
13:37 <_joe_> closed wikimedia-de-by list [production]
13:13 <_joe_> removing chip-l mailing list as for bug #63877 [production]
13:03 <godog> restarting swift-proxy-server on ms-fe1001 to test statsd metrics [production]
10:47 <godog> restarting swift-proxy-server on ms-fe3002 to test statsd metrics [production]
10:23 <hoo> Touched all 1.24wmf8 extension/wikidata files and ran sync-common after that on mw1070 [production]
10:18 <hoo> Synchronized php-1.24wmf8/extensions/Wikidata/: Update Wikidata to fix a suggester bug (duration: 00m 09s) [production]
10:16 <godog> restarting swift-proxy-server on ms-fe3001 to test statsd metrics [production]
10:13 <hoo> Synchronized php-1.24wmf9/extensions/Wikidata/: Update Wikidata to fix a suggester bug (duration: 00m 13s) [production]
09:29 <apergos> restarted search1015 about 15 mns ago, it's now recovered afaict, restarted search1016, it's doing index setup now [production]
03:00 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Jun 16 02:59:43 UTC 2014 (duration 59m 42s) [production]
02:27 <LocalisationUpdate> completed (1.24wmf9) at 2014-06-16 02:26:05+00:00 [production]
02:15 <LocalisationUpdate> completed (1.24wmf8) at 2014-06-16 02:14:38+00:00 [production]
2014-06-15 §
17:44 <hoo> Synchronized php-1.24wmf8/extensions/Wikidata/: Touched various JavaScripts (duration: 00m 09s) [production]
14:26 <Reedy> Job runners were restarted on tmh100[12] and are now processing jobs [production]
14:15 <godog> extended palladium root partition by +20G [production]
13:50 <_joe|away> restarted mw-job-runner on tmh1001 [production]
10:02 <paravoid> nuked ms-be1001 sdj with zeros, reformatting and placing into production again [production]
02:59 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Jun 15 02:58:21 UTC 2014 (duration 58m 20s) [production]
02:27 <LocalisationUpdate> completed (1.24wmf9) at 2014-06-15 02:26:03+00:00 [production]
02:15 <LocalisationUpdate> completed (1.24wmf8) at 2014-06-15 02:14:46+00:00 [production]
2014-06-14 §
22:27 <bawolff> video scalers seem to have stopped doing webVideoTranscode jobs [production]
20:24 <legoktm> ran "delete from ep_students where student_user_id =0 limit 1;" on enwiki for bug 66624 [production]
20:10 <legoktm> ran "delete from ep_users_per_course where upc_user_id=0 limit 1" on enwiki for bug 66624 [production]
19:19 <paravoid> unmounting ms-be1001's sdj1, corrupted filesystem [production]
18:47 <paravoid> rebooting ms-be1001, XFS: Internal error XFS_WANT_CORRUPTED_RETURN, lots of processes in D [production]
03:08 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Jun 14 03:07:14 UTC 2014 (duration 7m 13s) [production]
02:37 <LocalisationUpdate> completed (1.24wmf9) at 2014-06-14 02:36:35+00:00 [production]
02:36 <bblack> enabled amssq43-46 frontends (esams text varnish) in pybal [production]
02:17 <LocalisationUpdate> completed (1.24wmf8) at 2014-06-14 02:16:38+00:00 [production]
00:46 <bblack> enabled amssq39-42 frontends (esams text varnish) in pybal [production]
2014-06-13 §
22:01 <manybubbles> logstash1002 seems to be properly restoring nodes to itself. I'll monitor it for the next few minutes but I believe my work here is done. [production]
21:55 <manybubbles> bouncing logstash1002 because it seems stuck. not sure why. no useful logs. [production]
21:07 <bblack> turned on amssq35-38 text frontends in esams (in pybal) [production]
20:57 <awight> update crm from c38296add61421f87e12cb5b4f3dd68bdf2340db to e52a4eb1bfab622f612dc84f687678fff1fdbc04 [production]
20:23 <bblack> turned on amssq31-34 text frontends in esams [production]
18:41 <mutante> DNS update - removing manutius' public IP [production]