|
2015-12-19
§
|
| 15:14 |
<krenair@tin> |
Synchronized wmf-config/CommonSettings-labs.php: https://gerrit.wikimedia.org/r/#/c/259611/ - noop for prod, other than making icinga stop complaining (duration: 00m 31s) |
[production] |
| 10:07 |
<hashar> |
CI jobs for MediaWiki were broken because of cssjanus dependency. Should be fixed once mw/core https://gerrit.wikimedia.org/r/#/c/260169/ lands |
[production] |
| 10:02 |
<hashar> |
!log CI jobs for MediaWiki were broken because of cssjanus dependency. Should be fixed once mw/core https://gerrit.wikimedia.org/r/#/c/260169/ lands |
[] |
| 02:28 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Sat Dec 19 02:28:56 UTC 2015 (duration 6m 53s) |
[production] |
| 02:22 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.9) (duration: 08m 53s) |
[production] |
| 01:23 |
<bd808> |
Added Reedy as a projectadmin in the integration project |
[releng] |
| 01:09 |
<bd808> |
Cleared tmpfs on integration-slave-trusty-101[26] with variant of salt command from T120824 and marked as online again |
[releng] |
| 01:02 |
<Reedy> |
releng integration-slave-trusty-101[26] marked as offline due to chmod related errors |
[releng] |
| 01:01 |
<gwicke> |
entire restbase cluster: removed 5% root reserve from data partition with tune2fs -m 0 /dev/mapper/restbase$NODE--vg-{srv,var} |
[production] |
| 00:49 |
<gwicke> |
restbase1008: removed 5% root reserve from data partition with tune2fs -m 0 /dev/mapper/restbase1008--vg-srv |
[production] |
|
2015-12-18
§
|
| 22:57 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.9/resources/src/mediawiki/mediawiki.searchSuggest.js: allow override of suggestion type reported in event loggin (duration: 00m 29s) |
[production] |
| 22:56 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.9/extensions/CirrusSearch/resources/ext.cirrus.suggest.js: override suggestion type reported in event logging (duration: 00m 30s) |
[production] |
| 22:50 |
<aaron@tin> |
Synchronized php-1.27.0-wmf.9/includes/jobqueue/aggregator/JobQueueAggregatorRedis.php: 2c942ba1782c42ee68622278a5e0a77e9027945d (duration: 00m 30s) |
[production] |
| 22:39 |
<hashar> |
salt -v '*slave*' cmd.run 'find /mnt/home/jenkins-deploy/tmpfs -user www-data -delete' |
[releng] |
| 22:30 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.9/extensions/CirrusSearch/resources/ext.cirrus.suggest.js: override suggestion type reported in event logging (duration: 00m 30s) |
[production] |
| 22:20 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/260028 |
[releng] |
| 22:20 |
<aaron@tin> |
Synchronized php-1.27.0-wmf.9/includes/jobqueue/aggregator/JobQueueAggregator.php: 2c942ba1782c42ee68622278a5e0a77e9027945d (duration: 00m 31s) |
[production] |
| 21:30 |
<jzerebecki> |
salt --show-timeout '*slave*' cmd.run 'rm -fR /mnt/home/jenkins-deploy/tmpfs/jenkins-?/*' |
[releng] |
| 19:26 |
<aaron@tin> |
Synchronized wmf-config/jobqueue-eqiad.php: Adjust queue "maxPartitionsTry" and timeouts (duration: 00m 30s) |
[production] |
| 18:49 |
<mutante> |
disregard that, apache config only is enough |
[production] |
| 18:47 |
<mutante> |
gerrit will restart in a moment and be right back |
[production] |
| 18:44 |
<ori> |
ditto |
[production] |
| 18:43 |
<Krinkle> |
Created account "Krinkle" on collabwiki |
[production] |
| 16:43 |
<hashar> |
Nodepool: Image ci-jessie-wikimedia-1450456713 in wmflabs-eqiad is ready |
[releng] |
| 16:42 |
<hashar> |
Nodepool instances now have Zuul 2.1.0-60-g1cc37f7-wmf4jessie1 finally |
[releng] |
| 16:28 |
<twentyafterfour> |
restarted apache on iridium to deploy redirect script changes |
[production] |
| 16:20 |
<jynus> |
restarting and reconfiguring mysql on db1047 |
[production] |
| 16:15 |
<hashar> |
Image ci-jessie-wikimedia-1450455076 in wmflabs-eqiad is ready ( still has the wrong Zuul version grr) |
[releng] |
| 16:11 |
<hashar> |
Nodepool force refreshing image to make sure zuul is up to date (should be 2.1.0-60-g1cc37f7-wmf4jessie1 ) |
[releng] |
| 15:43 |
<hashar> |
salt '*slave*' cmd.run 'rm -fR /srv/deployment/integration/mediawiki-tools-codesniffer' https://phabricator.wikimedia.org/T66371 |
[releng] |
| 15:37 |
<hashar> |
Deleting mediawiki/tools/codesniffer.git branch wmf-deploy (was 358c2e7bdec269cec999af89e3412951bb463dc0 ) |
[releng] |
| 15:19 |
<hashar> |
Created Github repo https://github.com/wikimedia/thumbor-video-engine |
[releng] |
| 15:16 |
<andrewbogott> |
rebooting locked up host tools-exec-1409 |
[tools] |
| 14:57 |
<godog> |
stop compactions on restbase1008 |
[production] |
| 14:55 |
<jynus> |
SET GLOBAL query_cache_type = 0; on db1025 |
[production] |
| 14:54 |
<hashar> |
gallium: restarted apache2 , was deadlocked/unresponsive somehow |
[production] |
| 14:44 |
<godog> |
update privatesettings with swift codfw configuration |
[production] |
| 14:43 |
<godog> |
set temp-url-key for mw:media account in swift codfw |
[production] |
| 12:19 |
<paravoid> |
upgrading tor on radium, rebooting for kernel upgrade |
[production] |
| 12:18 |
<_joe_> |
disabled puppet on all lvs hosts for a potentially harmful change (should be a noop) |
[production] |
| 11:47 |
<_joe_> |
restarted hhvm on mw1107, stuck at startup |
[production] |
| 11:40 |
<hashar> |
logstash: reorganized list of dashboards per sections https://logstash.wikimedia.org/#/dashboard/elasticsearch/default |
[production] |
| 10:04 |
<hashar> |
rechecking mediawiki/core REL branches ( REL1_26 https://gerrit.wikimedia.org/r/#/c/247327/ ) ( REL1_25 https://gerrit.wikimedia.org/r/#/c/247337/ ) ( REL1_24 https://gerrit.wikimedia.org/r/#/c/179886/ ) ( https://gerrit.wikimedia.org/r/#/c/143591/ | REL1_23 ) |
[releng] |
| 09:43 |
<akosiaris> |
rebooting planet1001, memory exhaustion, OOM showed up |
[production] |
| 09:20 |
<hashar> |
Killed Zuul entirely, the queues were full / deadlocked. Patches need to be retriggered |
[production] |
| 09:18 |
<hashar> |
killing Zuul |
[releng] |
| 09:16 |
<hashar> |
mass cancelling jobs for changes that got force merged |
[releng] |
| 06:47 |
<gwicke> |
restbase1004: nodetool stop -- COMPACTION to avoid running out of disk space |
[production] |
| 03:07 |
<ori@tin> |
Synchronized php-1.27.0-wmf.9/includes/api/ApiStashEdit.php: ab32f4e740: Make ApiStashEdit use statsd metrics (duration: 00m 49s) |
[production] |
| 02:29 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Dec 18 02:29:10 UTC 2015 (duration 6m 55s) |
[production] |