|
2014-12-08
§
|
| 16:08 |
<demon> |
Synchronized php-1.25wmf11/extensions/VisualEditor: (no message) (duration: 00m 06s) |
[production] |
| 16:08 |
<demon> |
Synchronized php-1.25wmf10/extensions/VisualEditor: (no message) (duration: 00m 09s) |
[production] |
| 15:03 |
<hashar> |
Broke zuul-cloner by mistake |
[production] |
| 14:36 |
<godog> |
reboot graphite1001 for kernel upgrade |
[production] |
| 13:11 |
<hashar> |
Restarting zuul and zuul-merger on gallium |
[production] |
| 13:10 |
<hashar> |
Zuul: rebasing our fork to bring some upstream changes |
[production] |
| 10:41 |
<godog> |
upload diamond 3.5-2 to trusty-wikimedia |
[production] |
| 09:18 |
<andrewbogott> |
the failure looked like this: "Unexpected error in mod_passenger: Could not connect to the ApplicationPool server: Broken pipe (32)" |
[production] |
| 09:18 |
<andrewbogott> |
graceful'd apache on virt1000 -- resolving a mysterious puppetmaster outage |
[production] |
| 05:08 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1049, warm up (duration: 00m 06s) |
[production] |
| 04:41 |
<springle> |
upgrade db1049 trusty |
[production] |
| 04:17 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1049 (duration: 00m 06s) |
[production] |
| 04:16 |
<springle> |
also truncated puppet fact_values, see http://projects.puppetlabs.com/issues/9225 and https://tickets.puppetlabs.com/browse/PUP-1173 |
[production] |
| 04:11 |
<springle> |
puppet fact_values hit auto_inc limit. altered table to restart from 1 to get puppet running (seems safe, but needs checking, maybe also truncate) |
[production] |
| 03:42 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon Dec 8 03:42:28 UTC 2014 (duration 42m 27s) |
[production] |
| 02:15 |
<LocalisationUpdate> |
completed (1.25wmf11) at 2014-12-08 02:15:53+00:00 |
[production] |
| 02:15 |
<l10nupdate> |
Synchronized php-1.25wmf11/cache/l10n: (no message) (duration: 00m 01s) |
[production] |
| 02:10 |
<LocalisationUpdate> |
completed (1.25wmf10) at 2014-12-08 02:10:20+00:00 |
[production] |
| 02:10 |
<l10nupdate> |
Synchronized php-1.25wmf10/cache/l10n: (no message) (duration: 00m 03s) |
[production] |
|
2014-12-06
§
|
| 22:51 |
<ori> |
restarted apache on palladium |
[production] |
| 19:48 |
<Krinkle> |
Made trivial edit to Jenkins language config to purge the French invasion (default language: en-us -> en-US) |
[production] |
| 19:39 |
<Krinkle> |
Jenkins has been conquered by the French again |
[production] |
| 03:42 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sat Dec 6 03:42:37 UTC 2014 (duration 42m 36s) |
[production] |
| 02:18 |
<LocalisationUpdate> |
completed (1.25wmf11) at 2014-12-06 02:18:52+00:00 |
[production] |
| 02:18 |
<l10nupdate> |
Synchronized php-1.25wmf11/cache/l10n: (no message) (duration: 00m 01s) |
[production] |
| 02:13 |
<LocalisationUpdate> |
completed (1.25wmf10) at 2014-12-06 02:13:12+00:00 |
[production] |
| 02:13 |
<l10nupdate> |
Synchronized php-1.25wmf10/cache/l10n: (no message) (duration: 00m 01s) |
[production] |
| 01:00 |
<demon> |
Synchronized w/robots.php: better mtime (duration: 00m 06s) |
[production] |
| 00:49 |
<ori> |
Synchronized wmf-config/InitialiseSettings.php: Add preview log group (duration: 00m 06s) |
[production] |
|
2014-12-05
§
|
| 18:22 |
<YuviPanda> |
restart gitblit on antimony |
[production] |
| 18:03 |
<akosiaris> |
uploaded apertium-eo-en, apertium-id-ms to apt.wikimedia.org |
[production] |
| 16:44 |
<ottomata> |
rebooting analytics1021 |
[production] |
| 15:51 |
<mutante> |
hack-fixed http://noc.wikimedia.org/db.php |
[production] |
| 15:46 |
<_joe_> |
repooling all the servers |
[production] |
| 15:06 |
<_joe_> |
depooling mw1209-1220, enabling hyperthreading and upgrading |
[production] |
| 14:11 |
<paravoid> |
rebooting copper |
[production] |
| 13:01 |
<_joe_> |
repooling all appservers |
[production] |
| 12:32 |
<Krinkle> |
Reloading Zuul to deploy I9515542a1ac2ff |
[production] |
| 11:48 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1059, warm up (duration: 00m 07s) |
[production] |
| 11:46 |
<_joe_> |
repooled mw1161-mw1170, depooling mw1171-80 |
[production] |
| 10:58 |
<springle> |
upgrade db1059 trusty |
[production] |
| 10:56 |
<_joe_> |
depooling mw1161-mw1170 for enabling hyperthreading |
[production] |
| 10:43 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1059 (duration: 00m 06s) |
[production] |
| 10:24 |
<_joe_> |
repooling the appservers |
[production] |
| 09:21 |
<_joe_> |
depooling some appservers for maintenance/upgrades |
[production] |