|
2015-04-14
§
|
| 19:48 |
<Krinkle> |
Jenkins configuration panel won't load ("Loading..." stays indefine, "Uncaught TypeError: Cannot convert to object at prototype.js:195") |
[releng] |
| 19:46 |
<Krinkle> |
Jenkins restarted. Relaunching Gearman |
[releng] |
| 19:42 |
<Krinkle> |
Jenkins still unable to obtain Gearman connection. (HTTP 503 error from /configure). Have to force restart Jenkins. |
[releng] |
| 19:42 |
<Krinkle> |
deployment-bastion jobs were stuck. marktraceur cancelled queue and relaunched slave. Now processing again. |
[releng] |
| 19:28 |
<legoktm> |
running updateUsersToRename.php (CentralAuth) |
[production] |
| 18:14 |
<ori> |
Synchronized wmf-config/CommonSettings.php: If7f77996b: Set $wgStatsdServer (duration: 00m 15s) |
[production] |
| 18:04 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group1 to 1.26wmf1 |
[production] |
| 17:41 |
<legoktm> |
running removeHHVMTag on testwiki |
[production] |
| 17:07 |
<legoktm> |
Synchronized wmf-config/InitialiseSettings.php: Add 'CentralAuthSULRename' log group (duration: 00m 14s) |
[production] |
| 17:06 |
<legoktm> |
^ was Set $wgCentralAuthCheckSULMigration = true |
[production] |
| 17:06 |
<legoktm> |
Synchronized wmf-config/CommonSettings.php: Set = true (duration: 00m 13s) |
[production] |
| 17:04 |
<legoktm> |
Finished scap: Updating CentralAuth (duration: 42m 28s) |
[production] |
| 16:53 |
<Reedy> |
Deleting oaiaudit entries that are pre 2015 |
[production] |
| 16:22 |
<legoktm> |
Started scap: Updating CentralAuth |
[production] |
| 15:48 |
<bd808> |
Restarted logstash on logstash1003.eqiad.wmnet; subbu reported missing parsoid log events |
[production] |
| 15:27 |
<Krinkle> |
puppetmaster: Re-apply I05c49e5248cb operations/puppet patch to re-fix T91524. Somehow the patch got lost. |
[releng] |
| 15:18 |
<anomie> |
Synchronized php-1.26wmf1/includes/page/Article.php: SWAT: Continued debugging of [[phab:T92046]] ([[gerrit:204050]]) (duration: 00m 11s) |
[production] |
| 13:59 |
<cmjohnson1> |
barium down for disk swap |
[production] |
| 12:02 |
<_joe_> |
restarting gitblit |
[production] |
| 09:00 |
<_joe_> |
restarting gitblit |
[production] |
| 08:49 |
<hoo> |
Attached Manfred Strumpf@enwiki to the global account of the same name |
[production] |
| 08:48 |
<hashar> |
Testing log bot |
[production] |
| 08:46 |
<hashar> |
does qa-morebots works ? |
[releng] |
|
2015-04-13
§
|
| 21:57 |
<mutante> |
restarting gitblot |
[production] |
| 20:20 |
<demon> |
Synchronized php-1.25wmf24/includes/media/XMP.php: rm useless debugging (duration: 00m 15s) |
[production] |
| 20:18 |
<demon> |
Synchronized php-1.25wmf24/includes/media/XMP.php: adhocdebug (duration: 00m 12s) |
[production] |
| 20:15 |
<springle> |
dbstore1001 s2 delayed replication resumed, T95426 |
[production] |
| 20:14 |
<Krinkle> |
Restarting Zuul, Jenkins and aborting all builds. Everything got stuck following NFS outage in lab |
[releng] |
| 17:20 |
<legoktm> |
running migratePass0 across all CentralAuth wikis |
[production] |
| 17:01 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/203858 |
[releng] |
| 16:48 |
<bblack> |
re-enabling puppet on caches |
[production] |
| 16:23 |
<bblack> |
disabling puppet on caches for cache.pp-split merge, will be restarting puppetmasters too... |
[production] |
| 16:16 |
<thcipriani> |
Finished scap: Morning swat for T94128 (duration: 41m 12s) |
[production] |
| 15:34 |
<thcipriani> |
Started scap: Morning swat for T94128 |
[production] |
| 15:25 |
<thcipriani> |
Synchronized wmf-config/flaggedrevs.php: Morning swat [[gerrit|203283]] (duration: 00m 14s) |
[production] |
| 15:17 |
<thcipriani> |
Synchronized wmf-config/InitialiseSettings.php: Morning swat [[gerrit|203279]] (duration: 00m 14s) |
[production] |
| 15:09 |
<thcipriani> |
Synchronized wmf-config/InitialiseSettings.php: Morning swat [[gerrit|202736]] (duration: 00m 11s) |
[production] |
| 15:06 |
<thcipriani> |
Synchronized wmf-config/InitialiseSettings.php: Morning swat [[gerrit|199927]] and [[gerrit|199923]] (duration: 00m 11s) |
[production] |
| 15:00 |
<_joe_> |
depooled mw1031 |
[production] |
| 13:56 |
<Krinkle> |
Delete old integration-slave1001...1004 (T94916) |
[releng] |
| 12:30 |
<godog> |
bounce statsite on graphite1001 |
[production] |
| 10:43 |
<hashar> |
reducing number of executors on Precise instances from 5 to 4 and on Trusty instances from 6 to 4. The Jenkins scheduler tends to assign the unified jobs to the same slave which overload a single slave while others are idling. |
[releng] |
| 10:43 |
<hashar> |
reducing number of executors from 5 to 4 |
[releng] |
| 10:37 |
<godog> |
ms-be101[678] object weight to 2250 |
[production] |
| 08:59 |
<godog> |
ms-be10[678] account/container weight to 100 |
[production] |
| 08:46 |
<hashar> |
jenkins removed #wikimedia-qa IRC channel from the global configuration |
[releng] |
| 08:42 |
<hashar> |
kill -9 jenkins causes it was stuck in some deadlock related to the IRC plugin :( |
[releng] |
| 08:34 |
<zeljkof> |
restarting stuck Jenkins |
[releng] |
| 08:34 |
<zeljkof> |
restarting stuck Jenkins |
[production] |
| 05:05 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon Apr 13 05:04:22 UTC 2015 (duration 4m 21s) |
[production] |