651-700 of 10000 results (27ms)
2014-10-15 §
19:47 <yurik> Synchronized php-1.25wmf3/extensions/ZeroBanner/: Latest ZeroBanner (duration: 01m 11s) [production]
19:37 <yurik> Synchronized php-1.25wmf2/extensions/ZeroBanner/: Latest ZeroBanner (duration: 01m 07s) [production]
19:05 <ottomata> deployed webstatscollector 0.4 on oxygen (filter) and gadolinium (collector) [production]
18:46 <ori> adjusting pybal weight for mw1114 back up to 20 to confirm that leak is in luasandbox [production]
17:57 <ori_> installed lua5.1 on mw1114 so i can switch scribunto to luastandalone and thus potentially isolate the leak to luasandbox [production]
15:38 <andrewbogott> running sync-common on virt1000 [production]
15:36 <marktraceur> Synchronized php-1.25wmf3/extensions/OpenStackManager/: [SWAT] [wmf3] Make list=novainstances available to anons (duration: 00m 06s) [production]
15:36 <marktraceur> Synchronized php-1.25wmf2/extensions/OpenStackManager/: [SWAT] [wmf2] Make list=novainstances available to anons (duration: 00m 05s) [production]
15:22 <paravoid> AMS-IX renumbering: remove old IP from interface, migration over; > 75% of total peers migrated, accounting for much more bandwidth/routes [production]
15:13 <marktraceur> Synchronized php-1.25wmf3/extensions/VisualEditor/modules/ve-mw/ui: [SWAT] [wmf3] Update OOjs UI to v0.1.0-pre (d74a46ca6a) and VisualEditor-MediaWiki to Ie06056b (duration: 00m 05s) [production]
15:12 <marktraceur> Synchronized php-1.25wmf3/resources/lib/oojs-ui: [SWAT] [wmf3] Update OOjs UI to v0.1.0-pre (d74a46ca6a) and VisualEditor-MediaWiki to Ie06056b (duration: 00m 06s) [production]
14:32 <paravoid> AMS-IX renumbering: move all remaining ASNs to the new space [production]
14:20 <Coren> Not reimaging mw1035 after all; hhvm is in our base, killing our ramz. [production]
14:16 <paravoid> AMS-IX renumbering: peering with (renumbered) top-10 ASNs + ASNs with large number of prefixes [production]
14:12 <Coren> reimaging mw1035 for great justice!!! (HHVM) [production]
14:11 <_joe_> powercycling mw1205, down since this morning, console blank [production]
13:29 <Jeff_Green> dist-upgrade and reboot indium [production]
12:40 <hashar> disabled/reenabled gearman plugin at https://integration.wikimedia.org/ci/manage [production]
12:34 <hashar> Zuul frozen \\O/ [production]
11:38 <_joe_> depooling mw1114 again [production]
10:59 <paravoid> AMS-IX renumbering: adding second IP, peering with RS1 [production]
10:47 <_joe_> repooled mw1114 with reduced load, using jemalloc with prof_leak enabled for sampling. will depool again soon [production]
10:27 <_joe_> depooling mw1114, stopping puppet for debugging purposes [production]
09:24 <godog> enable container sync for commons containers [production]
08:09 <hashar> restarting Jenkins [production]
08:06 <hashar> Jenkins: upgrading Gearman plugin to Patchset 9 of https://review.openstack.org/#/c/125755/ [production]
07:52 <springle> ongoing schema changes rev_content_(model|format) multiple shards, ok to kill osc_host.sh jobs on terbium in emergency [production]
06:58 <_joe_> restarting hhvm on mw1114 to avoid memory exhaustion [production]
05:54 <K4-713> updated payments to 944596744e0de23fee098 [production]
03:34 <LocalisationUpdate> ResourceLoader cache refresh completed at Wed Oct 15 03:34:50 UTC 2014 (duration 34m 49s) [production]
02:28 <LocalisationUpdate> completed (1.25wmf3) at 2014-10-15 02:28:00+00:00 [production]
02:15 <LocalisationUpdate> completed (1.25wmf2) at 2014-10-15 02:15:31+00:00 [production]
2014-10-14 §
23:42 <catrope> Synchronized php-1.25wmf3/extensions/Collection: SWAT (duration: 00m 08s) [production]
23:42 <catrope> Synchronized php-1.25wmf2/extensions/Collection: SWAT (duration: 00m 04s) [production]
22:24 <hoo> Gracefulled apache on mw1075 [production]
19:16 <reedy> Synchronized wmf-config/: (no message) (duration: 00m 17s) [production]
19:07 <reedy> Synchronized images/: (no message) (duration: 00m 14s) [production]
18:52 <Reedy> Purged php-1.24wmf18 from mediawiki-appservers [production]
18:41 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.25wmf3 [production]
18:20 <reedy> Purged l10n cache for 1.25wmf1 [production]
18:15 <godog> stop diamond on virt1000 and zirconium to test [production]
17:52 <godog> conntrack full on virt1000 and zirconium, suspected diamond collector runaway [production]
16:33 <_joe_> repooling mw1114 [production]
15:27 <_joe_> reimaging mw1114 with HHVM - first server in the API pool; depooling and reinstalling now. [production]
15:22 <marktraceur> Synchronized php-1.25wmf3/resources/lib/oojs-ui/: [SWAT] [wmf3] OOjs UI: New pull-through to 837b2f733e to fix a missed dependency (duration: 00m 06s) [production]
15:12 <marktraceur> Synchronized php-1.25wmf3/includes/api/ApiQueryBacklinks.php: [SWAT] [wmf3] API: Fix ApiQueryBacklinks redirlinks (duration: 00m 05s) [production]
15:11 <marktraceur> Synchronized php-1.25wmf2/includes/api/ApiQueryBacklinks.php: [SWAT] [wmf2] API: Fix ApiQueryBacklinks redirlinks (duration: 00m 06s) [production]
13:56 <godog> enable container sync on non-commons sharded containers [production]
12:27 <hashar> Jenkins restarting [production]
12:25 <hashar> Jenkins: upgrading Gearman plugin to fix jobs registrations ( cherry picked https://review.openstack.org/#/c/125755/ and compiled it via maven ). [production]