|
2014-04-09
§
|
| 14:14 |
<RobH> |
otrs back up, live hacked apache change, now working permanent puppet change (puppet is disabled on iodine at present) |
[production] |
| 14:02 |
<RobH> |
yes, otrs is totally ssl borked, robh is working on it |
[production] |
| 14:00 |
<mutante> |
adding filippo to ops/wmf LDAP groups |
[production] |
| 13:58 |
<RobH> |
updating otrs cert |
[production] |
| 09:19 |
<hashar> |
synchronized wmf-config/InitialiseSettings.php '[] = 'musees.cg70.fr'; {{gerrit|124754}} {{bug|63449}}' |
[production] |
| 08:39 |
<hashar> |
Gerrit Letting JenkinsBot submit changes on apps/android/* |
[production] |
| 03:33 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed Apr 9 03:33:25 UTC 2014 (duration 33m 24s) |
[production] |
| 02:43 |
<LocalisationUpdate> |
completed (1.23wmf21) at 2014-04-09 02:43:52+00:00 |
[production] |
| 02:19 |
<LocalisationUpdate> |
completed (1.23wmf20) at 2014-04-09 02:19:25+00:00 |
[production] |
| 01:25 |
<Krinkle> |
Bug 63579 is still happening occasionally. Leaving patch on gallium in place for now. |
[production] |
| 01:09 |
<ori> |
Debugging uWSGI init scripts on tungsten; expect some Graphite / Gdash flapping. |
[production] |
| 00:15 |
<ori> |
graphite webapp 502 caused by uwsgi's init script not restarting the service correctly |
[production] |
| 00:07 |
<Krinkle> |
graphite.wikimedia.org (e.g. https://graphite.wikimedia.org/render/?) is serving 502 Bad Gateway, ori is investigating |
[production] |
| 00:04 |
<Krinkle> |
To investigate bug 63579, manually patched "grunt-lib-phantomjs/phantomjs/main.js" in "/srv/deployment/integration/slave-scripts" on gallium |
[production] |
|
2014-04-08
§
|
| 23:34 |
<mwalker> |
synchronized php-1.23wmf21/extensions/MultimediaViewer/ 'Updating MultimediaViewer for {{gerrit|124510}}' |
[production] |
| 23:08 |
<csteipp> |
synchronized php-1.23wmf21/extensions/CentralAuth/maintenance 'Push maintenance script for token reset' |
[production] |
| 21:21 |
<bd808> |
Purged l10n cache for 1.23wmf19 |
[production] |
| 21:20 |
<bd808> |
Purged l10n cache for 1.23wmf18 |
[production] |
| 21:12 |
<bd808> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group1 to 1.23wmf21 |
[production] |
| 19:56 |
<manybubbles> |
upgraded all elasticsearch servers except elastic1008. that is coming now. |
[production] |
| 18:45 |
<ori> |
synchronized wmf-config/InitialiseSettings.php 'I4b18e4ce8: Change wgServer and wgCanonicalServer for arbcom wikis' |
[production] |
| 18:45 |
<ori> |
updated /a/common to {{Gerrit|I4b18e4ce8}}: Change wgServer and wgCanonicalServer for arbcom wikis |
[production] |
| 18:13 |
<bd808> |
Finished scap: group0 wikis to 1.23wmf21 (with patch for bug 63659) (duration: 03m 18s) |
[production] |
| 18:10 |
<bd808> |
Started scap: group0 wikis to 1.23wmf21 (with patch for bug 63659) |
[production] |
| 18:01 |
<hoo> |
synchronized wmf-config/InitialiseSettings.php 'Touch to clear config. cache' |
[production] |
| 17:56 |
<hoo> |
changed the Wikidata wb_changes_dispatch position of all wikiquote wikis to 118158153 |
[production] |
| 17:37 |
<hoo> |
synchronized php-1.23wmf20/extensions/Wikidata/extensions/Wikibase/lib/resources/wikibase.Site.js 'touch' |
[production] |
| 17:37 |
<aude> |
synchronized wmf-config/Wikibase.php 'bump wgCacheEpoch for wikidata after enabling wikiquote site links' |
[production] |
| 17:35 |
<ottomata> |
restarted gmetad on nickel to fix ganglia |
[production] |
| 17:29 |
<aude> |
synchronized wikidataclient.dblist 'Enable Wikibase on Wikiquote' |
[production] |
| 17:29 |
<aude> |
synchronized wmf-config 'config changes to enable Wikibase on Wikiquote' |
[production] |
| 17:22 |
<aude> |
synchronized wmf-config/CirrusSearch-labs.php 'config change for beta, to enable highlighting' |
[production] |
| 17:16 |
<manybubbles> |
finished upgrading elastic1001-1006. starting on 1007. yay progress. |
[production] |
| 17:03 |
<aude> |
synchronized php-1.23wmf20/extensions/Wikidata 'Update Wikidata build, to allow populating sites table on wikiquote' |
[production] |
| 16:31 |
<aude> |
added sites and site_identifiers core tables on wikiquote |
[production] |
| 16:29 |
<hashar> |
Jenkins: killed jenkins-slave java process on gallium and repooled gallium slave. It was no more registered in Zuul :-/ |
[production] |
| 14:32 |
<manybubbles> |
no harm done, just lost time |
[production] |
| 14:32 |
<manybubbles> |
woops, just restarted elastic1002. silly me |
[production] |
| 14:31 |
<manybubbles> |
upgrading elastic1001 |
[production] |
| 13:54 |
<manybubbles> |
they'll pick it up during the rolling restart today to upgrade to 1.1.0 |
[production] |
| 13:53 |
<manybubbles> |
synced first Elasticsearch plugin to production Elasticsearch servers |
[production] |
| 13:46 |
<RobH> |
upgraded libssl on holmium |
[production] |
| 13:39 |
<Jeff_Green> |
update & reboot tellurium |
[production] |
| 13:39 |
<RobH> |
replacing the blog cert, if holmium crashes I didn't do it correctly. |
[production] |
| 13:37 |
<mutante> |
restarting gitblit |
[production] |
| 12:56 |
<reedy> |
updated /a/common to {{Gerrit|Id15ddc665}}: Revert "Group0 wikis to 1.23wmf21" |
[production] |
| 10:21 |
<Jeff_Green> |
update & reboot barium |
[production] |
| 10:15 |
<Jeff_Green> |
update & reboot samarium |
[production] |
| 07:47 |
<_joe|away> |
restarted nginx on cp1044 and cp1043 |
[production] |
| 05:47 |
<apergos> |
shot many old apache processes running as stats user from 2013, on stat1001 (restarting apache runs it as www-data user) |
[production] |