|
2014-04-09
§
|
| 23:22 |
<ebernhardson> |
synchronized php-1.23wmf21/extensions/Flow 'Backport fix DB-to-cache pipeline for 1.23wmd21' |
[production] |
| 23:05 |
<ebernhardson> |
synchronized wmf-config/InitialiseSettings-labs.php 'Enable math VE plugin on labs' |
[production] |
| 23:04 |
<Krinkle> |
Jenkins and Zuul are back up. Queues have not been preserved. |
[production] |
| 23:01 |
<^d> |
gerrit: reloaded bugzilla plugin to force it to log back in |
[production] |
| 23:00 |
<Krinkle> |
Restarting Jenkins because I have no clue what is going on and have no time to investigate yet another random clogging of all jobs. Restart ought to fix it. |
[production] |
| 22:54 |
<Krinkle> |
Zuul has lots of queued jobs for npm slaves, but neither Jenkins nor integration-slave1001.eqiad.wmflabs and 1002 themselves have anything queued. They're idle, responsive and waiting for jobs. |
[production] |
| 22:47 |
<Krinkle> |
Jenkins slaves in labs seem to be down. Zuul is stacking up jobs for hasNpm nodes (integration slaves in labs). Both slaves have 7/7 executors idle. |
[production] |
| 22:33 |
<hoo> |
Logged out all Bugzilla users by deleting all session cookie data from mysql |
[production] |
| 19:15 |
<csteipp> |
synchronized php-1.23wmf21/extensions/CentralAuth/maintenance |
[production] |
| 19:10 |
<yurik> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
| 17:39 |
<yurik> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
| 17:22 |
<manybubbles> |
regenerating Elasticsearch index from mediawiki for testwiki to soak up geo changes. |
[production] |
| 16:48 |
<maxsem> |
synchronized wmf-config/InitialiseSettings.php 'https://gerrit.wikimedia.org/r/124880' |
[production] |
| 16:41 |
<manybubbles> |
reindexed testwiki to soak up geo changes |
[production] |
| 16:37 |
<maxsem> |
synchronized wmf-config/InitialiseSettings.php 'https://gerrit.wikimedia.org/r/124876' |
[production] |
| 16:32 |
<maxsem> |
synchronized php-1.23wmf21/extensions/GeoData |
[production] |
| 16:28 |
<manybubbles> |
fiddling with Elasticsearch cluster balancing options trying to get enwiki better balanced |
[production] |
| 16:17 |
<aude> |
synchronized php-1.23wmf21/extensions/Wikidata 'Switch Wikidata back to previous version of Wikibase' |
[production] |
| 15:52 |
<mutante> |
ms6 - revoke puppet cert, salt key, remove from icinga |
[production] |
| 15:02 |
<ottomata> |
stopped puppet on emery to test sqstat on analytics1003 |
[production] |
| 14:48 |
<ottomata> |
disabling puppet to test sqstat on analytics1003 |
[production] |
| 14:14 |
<RobH> |
otrs back up, live hacked apache change, now working permanent puppet change (puppet is disabled on iodine at present) |
[production] |
| 14:02 |
<RobH> |
yes, otrs is totally ssl borked, robh is working on it |
[production] |
| 14:00 |
<mutante> |
adding filippo to ops/wmf LDAP groups |
[production] |
| 13:58 |
<RobH> |
updating otrs cert |
[production] |
| 09:19 |
<hashar> |
synchronized wmf-config/InitialiseSettings.php '[] = 'musees.cg70.fr'; {{gerrit|124754}} {{bug|63449}}' |
[production] |
| 08:39 |
<hashar> |
Gerrit Letting JenkinsBot submit changes on apps/android/* |
[production] |
| 03:33 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed Apr 9 03:33:25 UTC 2014 (duration 33m 24s) |
[production] |
| 02:43 |
<LocalisationUpdate> |
completed (1.23wmf21) at 2014-04-09 02:43:52+00:00 |
[production] |
| 02:19 |
<LocalisationUpdate> |
completed (1.23wmf20) at 2014-04-09 02:19:25+00:00 |
[production] |
| 01:25 |
<Krinkle> |
Bug 63579 is still happening occasionally. Leaving patch on gallium in place for now. |
[production] |
| 01:09 |
<ori> |
Debugging uWSGI init scripts on tungsten; expect some Graphite / Gdash flapping. |
[production] |
| 00:15 |
<ori> |
graphite webapp 502 caused by uwsgi's init script not restarting the service correctly |
[production] |
| 00:07 |
<Krinkle> |
graphite.wikimedia.org (e.g. https://graphite.wikimedia.org/render/?) is serving 502 Bad Gateway, ori is investigating |
[production] |
| 00:04 |
<Krinkle> |
To investigate bug 63579, manually patched "grunt-lib-phantomjs/phantomjs/main.js" in "/srv/deployment/integration/slave-scripts" on gallium |
[production] |
|
2014-04-08
§
|
| 23:34 |
<mwalker> |
synchronized php-1.23wmf21/extensions/MultimediaViewer/ 'Updating MultimediaViewer for {{gerrit|124510}}' |
[production] |
| 23:08 |
<csteipp> |
synchronized php-1.23wmf21/extensions/CentralAuth/maintenance 'Push maintenance script for token reset' |
[production] |
| 21:21 |
<bd808> |
Purged l10n cache for 1.23wmf19 |
[production] |
| 21:20 |
<bd808> |
Purged l10n cache for 1.23wmf18 |
[production] |
| 21:12 |
<bd808> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group1 to 1.23wmf21 |
[production] |
| 19:56 |
<manybubbles> |
upgraded all elasticsearch servers except elastic1008. that is coming now. |
[production] |
| 18:45 |
<ori> |
synchronized wmf-config/InitialiseSettings.php 'I4b18e4ce8: Change wgServer and wgCanonicalServer for arbcom wikis' |
[production] |
| 18:45 |
<ori> |
updated /a/common to {{Gerrit|I4b18e4ce8}}: Change wgServer and wgCanonicalServer for arbcom wikis |
[production] |
| 18:13 |
<bd808> |
Finished scap: group0 wikis to 1.23wmf21 (with patch for bug 63659) (duration: 03m 18s) |
[production] |
| 18:10 |
<bd808> |
Started scap: group0 wikis to 1.23wmf21 (with patch for bug 63659) |
[production] |
| 18:01 |
<hoo> |
synchronized wmf-config/InitialiseSettings.php 'Touch to clear config. cache' |
[production] |
| 17:56 |
<hoo> |
changed the Wikidata wb_changes_dispatch position of all wikiquote wikis to 118158153 |
[production] |
| 17:37 |
<hoo> |
synchronized php-1.23wmf20/extensions/Wikidata/extensions/Wikibase/lib/resources/wikibase.Site.js 'touch' |
[production] |
| 17:37 |
<aude> |
synchronized wmf-config/Wikibase.php 'bump wgCacheEpoch for wikidata after enabling wikiquote site links' |
[production] |
| 17:35 |
<ottomata> |
restarted gmetad on nickel to fix ganglia |
[production] |