2014-09-23
§
|
13:01 |
<manybubbles> |
Synchronized wmf-config/: Throttle cirrus jobs some more. (duration: 00m 04s) |
[production] |
12:24 |
<manybubbles> |
Synchronized wmf-config/: Some new cirrus config (duration: 00m 07s) |
[production] |
09:16 |
<godog> |
deployed codfw-prod swift ring to palladium |
[production] |
04:49 |
<tstarling> |
Synchronized php-1.24wmf21/languages/Language.php: profiling (duration: 00m 05s) |
[production] |
04:10 |
<tstarling> |
Synchronized php-1.24wmf21/languages/Language.php: profiling (duration: 00m 05s) |
[production] |
03:42 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue Sep 23 03:42:29 UTC 2014 (duration 42m 28s) |
[production] |
03:29 |
<tstarling> |
Synchronized wmf-config/CommonSettings.php: fix profiling (duration: 00m 07s) |
[production] |
02:43 |
<LocalisationUpdate> |
completed (1.24wmf22) at 2014-09-23 02:43:48+00:00 |
[production] |
02:30 |
<LocalisationUpdate> |
completed (1.24wmf21) at 2014-09-23 02:30:38+00:00 |
[production] |
02:17 |
<LocalisationUpdate> |
completed (1.24wmf20) at 2014-09-23 02:17:31+00:00 |
[production] |
00:26 |
<mutante> |
tridge - revoking puppet cert, deleting salt key, decom ... |
[production] |
2014-09-22
§
|
23:49 |
<ebernhardson> |
Synchronized php-1.24wmf22/extensions/LiquidThreads/: Bump LiquidThreads submodule in 1.24wmf22 (duration: 00m 06s) |
[production] |
23:48 |
<ebernhardson> |
Synchronized php-1.24wmf22/extensions/UploadWizard/: Bump UploadWizard submodule in 1.24wmf22 (duration: 00m 04s) |
[production] |
23:47 |
<ebernhardson> |
Synchronized php-1.24wmf21/extensions/LiquidThreads/: Bump LQT submodule in 1.24wmf21 (duration: 00m 04s) |
[production] |
23:36 |
<ebernhardson> |
Synchronized php-1.24wmf21/extensions/UploadWizard/: sync UploadWizard in 1.24wmf21 (duration: 00m 07s) |
[production] |
23:32 |
<ebernhardson> |
Synchronized php-1.24wmf21/includes/rcfeed/MachineReadableRCFeedFormatter.php: Use safe attribute accessor for RecentChange (duration: 00m 04s) |
[production] |
23:30 |
<ebernhardson> |
Synchronized php-1.24wmf21/extensions/UploadWizard/: Bump UploadWizard submodule in php-1.24wmf21 (duration: 00m 04s) |
[production] |
23:30 |
<ebernhardson> |
Synchronized php-1.24wmf21/extensions/Flow/: Bump flow submodule in php-1.24wmf21 (duration: 00m 06s) |
[production] |
23:17 |
<ebernhardson> |
Synchronized wmf-config/InitialiseSettings.php: Set wgUploadNavigationUrl for eowiki (duration: 00m 05s) |
[production] |
21:04 |
<bd808> |
production-logstash-eqiad healed by restarting elasticsearch on logstash1002 after OOM + split brain |
[production] |
20:54 |
<bd808> |
split brain on logstash1002 preceded by by java OOM for elasticsearch |
[production] |
20:52 |
<bd808> |
logstash1002 went split brain from rest of logstash elastic search cluster. restarting |
[production] |
20:24 |
<subbu> |
deployed Parsoid ff9476f9 |
[production] |
19:31 |
<hashar> |
Jenkins is broken for extensions patches proposed against the wmf branches {{bug|71133}} |
[production] |
18:32 |
<Krinkle> |
lanthanum tmpfs filled up again, purged manually (bug 71128) |
[production] |
17:22 |
<ori> |
updated HHVM on beta cluster to HHVM to 3.3.0-20140918+wmf1 |
[production] |
17:00 |
<demon> |
Synchronized wmf-config/InitialiseSettings.php: Push Cirrus' non-content enwiki shards apart (no-op) (duration: 00m 04s) |
[production] |
15:52 |
<godog> |
reboot ms-be2001 into PXE to test a re-install |
[production] |
15:07 |
<anomie> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable Graph extension on mediawiki.org [[gerrit:161908]] (duration: 00m 09s) |
[production] |
15:02 |
<anomie> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Add securepoll-create-poll right to sysop on testwiki [[gerrit:161653]] (duration: 00m 09s) |
[production] |
15:01 |
<anomie> |
Synchronized wmf-config/CommonSettings.php: SWAT: Add REL1_24 as branch in ExtensionDistributor [[gerrit:161666]] (duration: 00m 10s) |
[production] |
14:12 |
<hashar> |
Jenkins deleted job mediawiki-core-lint , replaced by mediawiki-core-phplint |
[production] |
12:10 |
<apergos> |
shutdown of db1050 to install trusty |
[production] |
10:04 |
<hashar> |
Jenkins back and fully operational |
[production] |
09:55 |
<hashar> |
restarting jenkins |
[production] |
09:37 |
<hashar_> |
Jenkins: deleting old mediawiki extensions jobs (<tt>rm -fR /var/lib/jenkins/jobs/*testextensions-master</tt>). They are no more triggered and superseded by the <tt>*-testextension</tt> jobs. |
[production] |
03:36 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon Sep 22 03:36:40 UTC 2014 (duration 36m 39s) |
[production] |
02:41 |
<LocalisationUpdate> |
completed (1.24wmf22) at 2014-09-22 02:41:29+00:00 |
[production] |
02:29 |
<LocalisationUpdate> |
completed (1.24wmf21) at 2014-09-22 02:29:09+00:00 |
[production] |
02:16 |
<LocalisationUpdate> |
completed (1.24wmf20) at 2014-09-22 02:16:20+00:00 |
[production] |
2014-09-21
§
|
22:43 |
<ori> |
ms-be1008 overloaded starting 18:00:24 UTC, syslog says "BUG: soft lockup - CPU#1 stuck for 22s! [kworker/1:1:2196]". machine became unresponsive at 21:35, coinciding with a spike of 5xxs, lasting until Coren powercycled it at 22:10. |
[production] |
03:37 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sun Sep 21 03:37:31 UTC 2014 (duration 37m 30s) |
[production] |
03:16 |
<springle> |
labsdb1001 mysqld restarted in gdb; crash loop with a labs user's table |
[production] |
02:46 |
<ori> |
Synchronized wmf-config/throttle.php: I7bb42b49a: Increase account creation throttle on enwiki for Cochrane colloquium. (duration: 00m 07s) |
[production] |
02:41 |
<LocalisationUpdate> |
completed (1.24wmf22) at 2014-09-21 02:41:36+00:00 |
[production] |
02:29 |
<LocalisationUpdate> |
completed (1.24wmf21) at 2014-09-21 02:29:51+00:00 |
[production] |
02:17 |
<LocalisationUpdate> |
completed (1.24wmf20) at 2014-09-21 02:16:56+00:00 |
[production] |