|
2014-10-15
§
|
| 19:37 |
<yurik> |
Synchronized php-1.25wmf2/extensions/ZeroBanner/: Latest ZeroBanner (duration: 01m 07s) |
[production] |
| 19:05 |
<ottomata> |
deployed webstatscollector 0.4 on oxygen (filter) and gadolinium (collector) |
[production] |
| 18:46 |
<ori> |
adjusting pybal weight for mw1114 back up to 20 to confirm that leak is in luasandbox |
[production] |
| 17:57 |
<ori_> |
installed lua5.1 on mw1114 so i can switch scribunto to luastandalone and thus potentially isolate the leak to luasandbox |
[production] |
| 15:38 |
<andrewbogott> |
running sync-common on virt1000 |
[production] |
| 15:36 |
<marktraceur> |
Synchronized php-1.25wmf3/extensions/OpenStackManager/: [SWAT] [wmf3] Make list=novainstances available to anons (duration: 00m 06s) |
[production] |
| 15:36 |
<marktraceur> |
Synchronized php-1.25wmf2/extensions/OpenStackManager/: [SWAT] [wmf2] Make list=novainstances available to anons (duration: 00m 05s) |
[production] |
| 15:22 |
<paravoid> |
AMS-IX renumbering: remove old IP from interface, migration over; > 75% of total peers migrated, accounting for much more bandwidth/routes |
[production] |
| 15:13 |
<marktraceur> |
Synchronized php-1.25wmf3/extensions/VisualEditor/modules/ve-mw/ui: [SWAT] [wmf3] Update OOjs UI to v0.1.0-pre (d74a46ca6a) and VisualEditor-MediaWiki to Ie06056b (duration: 00m 05s) |
[production] |
| 15:12 |
<marktraceur> |
Synchronized php-1.25wmf3/resources/lib/oojs-ui: [SWAT] [wmf3] Update OOjs UI to v0.1.0-pre (d74a46ca6a) and VisualEditor-MediaWiki to Ie06056b (duration: 00m 06s) |
[production] |
| 14:32 |
<paravoid> |
AMS-IX renumbering: move all remaining ASNs to the new space |
[production] |
| 14:20 |
<Coren> |
Not reimaging mw1035 after all; hhvm is in our base, killing our ramz. |
[production] |
| 14:16 |
<paravoid> |
AMS-IX renumbering: peering with (renumbered) top-10 ASNs + ASNs with large number of prefixes |
[production] |
| 14:12 |
<Coren> |
reimaging mw1035 for great justice!!! (HHVM) |
[production] |
| 14:11 |
<_joe_> |
powercycling mw1205, down since this morning, console blank |
[production] |
| 13:29 |
<Jeff_Green> |
dist-upgrade and reboot indium |
[production] |
| 12:40 |
<hashar> |
disabled/reenabled gearman plugin at https://integration.wikimedia.org/ci/manage |
[production] |
| 12:34 |
<hashar> |
Zuul frozen \\O/ |
[production] |
| 11:38 |
<_joe_> |
depooling mw1114 again |
[production] |
| 10:59 |
<paravoid> |
AMS-IX renumbering: adding second IP, peering with RS1 |
[production] |
| 10:47 |
<_joe_> |
repooled mw1114 with reduced load, using jemalloc with prof_leak enabled for sampling. will depool again soon |
[production] |
| 10:27 |
<_joe_> |
depooling mw1114, stopping puppet for debugging purposes |
[production] |
| 09:24 |
<godog> |
enable container sync for commons containers |
[production] |
| 08:09 |
<hashar> |
restarting Jenkins |
[production] |
| 08:06 |
<hashar> |
Jenkins: upgrading Gearman plugin to Patchset 9 of https://review.openstack.org/#/c/125755/ |
[production] |
| 07:52 |
<springle> |
ongoing schema changes rev_content_(model|format) multiple shards, ok to kill osc_host.sh jobs on terbium in emergency |
[production] |
| 06:58 |
<_joe_> |
restarting hhvm on mw1114 to avoid memory exhaustion |
[production] |
| 05:54 |
<K4-713> |
updated payments to 944596744e0de23fee098 |
[production] |
| 03:34 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed Oct 15 03:34:50 UTC 2014 (duration 34m 49s) |
[production] |
| 02:28 |
<LocalisationUpdate> |
completed (1.25wmf3) at 2014-10-15 02:28:00+00:00 |
[production] |
| 02:15 |
<LocalisationUpdate> |
completed (1.25wmf2) at 2014-10-15 02:15:31+00:00 |
[production] |
|
2014-10-14
§
|
| 23:42 |
<catrope> |
Synchronized php-1.25wmf3/extensions/Collection: SWAT (duration: 00m 08s) |
[production] |
| 23:42 |
<catrope> |
Synchronized php-1.25wmf2/extensions/Collection: SWAT (duration: 00m 04s) |
[production] |
| 22:24 |
<hoo> |
Gracefulled apache on mw1075 |
[production] |
| 19:16 |
<reedy> |
Synchronized wmf-config/: (no message) (duration: 00m 17s) |
[production] |
| 19:07 |
<reedy> |
Synchronized images/: (no message) (duration: 00m 14s) |
[production] |
| 18:52 |
<Reedy> |
Purged php-1.24wmf18 from mediawiki-appservers |
[production] |
| 18:41 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.25wmf3 |
[production] |
| 18:20 |
<reedy> |
Purged l10n cache for 1.25wmf1 |
[production] |
| 18:15 |
<godog> |
stop diamond on virt1000 and zirconium to test |
[production] |
| 17:52 |
<godog> |
conntrack full on virt1000 and zirconium, suspected diamond collector runaway |
[production] |
| 16:33 |
<_joe_> |
repooling mw1114 |
[production] |
| 15:27 |
<_joe_> |
reimaging mw1114 with HHVM - first server in the API pool; depooling and reinstalling now. |
[production] |
| 15:22 |
<marktraceur> |
Synchronized php-1.25wmf3/resources/lib/oojs-ui/: [SWAT] [wmf3] OOjs UI: New pull-through to 837b2f733e to fix a missed dependency (duration: 00m 06s) |
[production] |
| 15:12 |
<marktraceur> |
Synchronized php-1.25wmf3/includes/api/ApiQueryBacklinks.php: [SWAT] [wmf3] API: Fix ApiQueryBacklinks redirlinks (duration: 00m 05s) |
[production] |
| 15:11 |
<marktraceur> |
Synchronized php-1.25wmf2/includes/api/ApiQueryBacklinks.php: [SWAT] [wmf2] API: Fix ApiQueryBacklinks redirlinks (duration: 00m 06s) |
[production] |
| 13:56 |
<godog> |
enable container sync on non-commons sharded containers |
[production] |
| 12:27 |
<hashar> |
Jenkins restarting |
[production] |
| 12:25 |
<hashar> |
Jenkins: upgrading Gearman plugin to fix jobs registrations ( cherry picked https://review.openstack.org/#/c/125755/ and compiled it via maven ). |
[production] |
| 10:38 |
<godog> |
enable container sync on non-sharded originals containers |
[production] |