|
2015-10-17
§
|
| 20:02 |
<godog> |
powercycle analytics1034, no console no ssh |
[production] |
| 14:05 |
<godog> |
reboot krypton, unable to ssh and no console (VM) iowait through the roof |
[production] |
| 06:27 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Sat Oct 17 06:27:04 UTC 2015 (duration 27m 3s) |
[production] |
| 03:02 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-17 03:02:58+00:00 |
[production] |
| 02:58 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 08m 14s) |
[production] |
| 02:35 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-17 02:35:14+00:00 |
[production] |
| 02:30 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 08m 09s) |
[production] |
|
2015-10-16
§
|
| 20:52 |
<hashar> |
Restarting Jenkins to remove potential dead locks before the week-end |
[production] |
| 19:29 |
<ori> |
deleted /var/lib/carbon/whisper/MediaWiki/MediaWiki on graphite1001 & graphite2001 per tgr's request |
[production] |
| 13:18 |
<ori@tin> |
Synchronized wmf-config/CommonSettings.php: I14ecd0ae87: Turn off UserDailyContribs extension (duration: 00m 18s) |
[production] |
| 06:25 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Oct 16 06:25:56 UTC 2015 (duration 25m 55s) |
[production] |
| 03:11 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-16 03:11:14+00:00 |
[production] |
| 03:06 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 08m 31s) |
[production] |
| 02:43 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-16 02:43:42+00:00 |
[production] |
| 02:38 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 08m 38s) |
[production] |
| 02:27 |
<jynus> |
repairing table and restarting replication on s7 from labsdb1002 |
[production] |
| 02:23 |
<jynus> |
repairing table and restarting replication on s5 from dbstore1002 (non-production host) |
[production] |
| 01:36 |
<Jamesofur> |
reset email address for User:INeverCry after identify verification |
[production] |
|
2015-10-15
§
|
| 22:09 |
<greg-g> |
don't worry, _joe_ was around and we approved Roan's last deploy as an exception :) |
[production] |
| 22:08 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.3/extensions/Flow/: Back out categories in sidebar feature (duration: 00m 20s) |
[production] |
| 20:30 |
<_joe_> |
rebooting ms-be1011 |
[production] |
| 09:54 |
<_joe_> |
restarted gitblit, unresponsive |
[production] |
| 05:41 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Oct 15 05:41:25 UTC 2015 (duration 41m 24s) |
[production] |
| 02:51 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-15 02:51:27+00:00 |
[production] |
| 02:49 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 05m 02s) |
[production] |
| 02:35 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-15 02:35:15+00:00 |
[production] |
| 02:31 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 06m 57s) |
[production] |
|
2015-10-14
§
|
| 23:46 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: Nevermind on skipping timed text, extension config is weird (duration: 00m 17s) |
[production] |
| 22:26 |
<akosiaris> |
restarted zotero on sca1002 |
[production] |
| 21:53 |
<akosiaris> |
restarted zotero on sca1001. complaining out of memory in logs |
[production] |
| 20:20 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: Also exclude timedtext ns from purges (duration: 00m 18s) |
[production] |
| 19:52 |
<robh> |
reenabled puppet agent on etherpad1001, was disabled for a few hours and no reason specified and no SAL entry |
[production] |
| 19:50 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Turn off the mw "warning" logging channel (duration: 00m 18s) |
[production] |
| 19:21 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: Tighten check on empty page purges (duration: 00m 18s) |
[production] |
| 19:11 |
<ori@tin> |
Synchronized wmf-config/CommonSettings.php: I1d7969a9d: Purge pages with blank content beyond the PP limit report, I38cba9d9b6a: Get strpos() parameters correct (duration: 00m 17s) |
[production] |
| 19:09 |
<ori@tin> |
Synchronized wmf-config/InitialiseSettings.php: I3a8a750bb3: Enable T115505 log channel for I1d7969a (duration: 00m 17s) |
[production] |
| 18:06 |
<demon@tin> |
Synchronized wmf-config: (no message) (duration: 00m 19s) |
[production] |
| 17:59 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 17s) |
[production] |
| 17:58 |
<demon@tin> |
Synchronized wmf-config/extension-list: (no message) (duration: 00m 17s) |
[production] |
| 15:31 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: SWAT: Split connection to source and target [[gerrit:246243]] (duration: 00m 18s) |
[production] |
| 15:19 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.2/extensions/UploadWizard/UploadWizard.config.php: SWAT: Remove default category for UploadWizard files [[gerrit:246225]] (duration: 00m 17s) |
[production] |
| 15:14 |
<ori> |
restarted navtiming and statsv services on hafnium |
[production] |
| 15:11 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.3/extensions/UploadWizard/UploadWizard.config.php: SWAT: Remove default category for UploadWizard files [[gerrit:246226]] (duration: 00m 18s) |
[production] |
| 15:05 |
<Krinkle> |
Statsv and eventlogging-navtiming seems to have gone down 7 hours ago |
[production] |
| 14:24 |
<ori> |
cleaned up tessera leftovers on graphite1001 |
[production] |
| 14:15 |
<mutante|1way> |
mw1157 - deleted puppet lock file, fix puppet run. ("already running" but didnt since 18h) |
[production] |
| 13:30 |
<ottomata> |
kafka-preferred-replica election after kafka1012 |
[production] |
| 13:12 |
<ottomata> |
restarted diamond, puppet didn't seem to after it removed the TcpConnStates from most hosts |
[production] |
| 12:55 |
<hashar> |
ERROR: Could not connect to SMTP host: polonium.wikimedia.org, port: 25 (from labs instances) |
[production] |
| 12:32 |
<krenair@tin> |
Synchronized README: testing https://gerrit.wikimedia.org/r/246206 (duration: 00m 17s) |
[production] |