|
2015-12-20
§
|
| 15:53 |
<reedy@tin> |
Synchronized README: noop (duration: 00m 32s) |
[production] |
| 15:50 |
<Reedy> |
reedy@tin Purged l10n cache for 1.27.0-wmf.6 (hanging due to mw1228 issue) |
[production] |
| 15:42 |
<Reedy> |
mw1228 reporting readonly fs |
[production] |
| 15:41 |
<reedy@tin> |
Purged l10n cache for 1.27.0-wmf.7 |
[production] |
| 12:48 |
<Luke081515> |
deployed new config for wiki-rcm at 2UTC |
[rcm] |
| 09:00 |
<godog> |
powercycle ms-be2019, xfs lockup |
[production] |
| 02:28 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Sun Dec 20 02:28:49 UTC 2015 (duration 6m 54s) |
[production] |
| 02:21 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.9) (duration: 08m 59s) |
[production] |
| 00:00 |
<YuviPanda> |
tools-worker-08 stuck again :| |
[tools] |
| 00:00 |
<YuviPanda> |
!log tools tools-worker-08 stuck again :| |
[] |
|
2015-12-19
§
|
| 22:18 |
<Krinkle> |
sudo rm -rf /mnt/home/jenkins-deploy/tmpfs/jenkins* on integration-slave-precise-1014 |
[releng] |
| 22:18 |
<Krinkle> |
sudo rm -rf /mnt/home/jenkins-deploy/tmpfs/jenkins* on integration-slave-precise-1012 |
[releng] |
| 22:04 |
<Krinkle> |
sudo rm -rf /mnt/home/jenkins-deploy/tmpfs/jenkins* on integration-slave-precise-1013 |
[releng] |
| 22:04 |
<Krinkle> |
sudo rm -rf /mnt/home/jenkins-deploy/tmpfs/jenkins* on integration-slave-precise-1011 |
[releng] |
| 21:55 |
<_joe_> |
restarted zotero on sca1001, various OOM messages |
[production] |
| 20:48 |
<gwicke> |
restbase1004: `systemctl mask cassandra` in preparation for the decommission finishing |
[production] |
| 19:49 |
<akosiaris> |
killed gmond on db2036. it was clearly misbehaving and running since Jan 02. db2036 was not listed on the ganglia web interface. killing the orphaned process and restarting seems to have fixed it |
[production] |
| 18:54 |
<akosiaris> |
scheduled maintenance of s3 slave lag on db2036, db2043, db2050, db2057 (all of db2018's family that pages) to effectively silence pages while debugging. Check is flapping since 15:00 UTC today |
[production] |
| 15:14 |
<krenair@tin> |
Synchronized wmf-config/CommonSettings-labs.php: https://gerrit.wikimedia.org/r/#/c/259611/ - noop for prod, other than making icinga stop complaining (duration: 00m 31s) |
[production] |
| 10:07 |
<hashar> |
CI jobs for MediaWiki were broken because of cssjanus dependency. Should be fixed once mw/core https://gerrit.wikimedia.org/r/#/c/260169/ lands |
[production] |
| 10:02 |
<hashar> |
!log CI jobs for MediaWiki were broken because of cssjanus dependency. Should be fixed once mw/core https://gerrit.wikimedia.org/r/#/c/260169/ lands |
[] |
| 02:28 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Sat Dec 19 02:28:56 UTC 2015 (duration 6m 53s) |
[production] |
| 02:22 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.9) (duration: 08m 53s) |
[production] |
| 01:23 |
<bd808> |
Added Reedy as a projectadmin in the integration project |
[releng] |
| 01:09 |
<bd808> |
Cleared tmpfs on integration-slave-trusty-101[26] with variant of salt command from T120824 and marked as online again |
[releng] |
| 01:02 |
<Reedy> |
releng integration-slave-trusty-101[26] marked as offline due to chmod related errors |
[releng] |
| 01:01 |
<gwicke> |
entire restbase cluster: removed 5% root reserve from data partition with tune2fs -m 0 /dev/mapper/restbase$NODE--vg-{srv,var} |
[production] |
| 00:49 |
<gwicke> |
restbase1008: removed 5% root reserve from data partition with tune2fs -m 0 /dev/mapper/restbase1008--vg-srv |
[production] |
|
2015-12-18
§
|
| 22:57 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.9/resources/src/mediawiki/mediawiki.searchSuggest.js: allow override of suggestion type reported in event loggin (duration: 00m 29s) |
[production] |
| 22:56 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.9/extensions/CirrusSearch/resources/ext.cirrus.suggest.js: override suggestion type reported in event logging (duration: 00m 30s) |
[production] |
| 22:50 |
<aaron@tin> |
Synchronized php-1.27.0-wmf.9/includes/jobqueue/aggregator/JobQueueAggregatorRedis.php: 2c942ba1782c42ee68622278a5e0a77e9027945d (duration: 00m 30s) |
[production] |
| 22:39 |
<hashar> |
salt -v '*slave*' cmd.run 'find /mnt/home/jenkins-deploy/tmpfs -user www-data -delete' |
[releng] |
| 22:30 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.9/extensions/CirrusSearch/resources/ext.cirrus.suggest.js: override suggestion type reported in event logging (duration: 00m 30s) |
[production] |
| 22:20 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/260028 |
[releng] |
| 22:20 |
<aaron@tin> |
Synchronized php-1.27.0-wmf.9/includes/jobqueue/aggregator/JobQueueAggregator.php: 2c942ba1782c42ee68622278a5e0a77e9027945d (duration: 00m 31s) |
[production] |
| 21:30 |
<jzerebecki> |
salt --show-timeout '*slave*' cmd.run 'rm -fR /mnt/home/jenkins-deploy/tmpfs/jenkins-?/*' |
[releng] |
| 19:26 |
<aaron@tin> |
Synchronized wmf-config/jobqueue-eqiad.php: Adjust queue "maxPartitionsTry" and timeouts (duration: 00m 30s) |
[production] |
| 18:49 |
<mutante> |
disregard that, apache config only is enough |
[production] |
| 18:47 |
<mutante> |
gerrit will restart in a moment and be right back |
[production] |
| 18:44 |
<ori> |
ditto |
[production] |
| 18:43 |
<Krinkle> |
Created account "Krinkle" on collabwiki |
[production] |
| 16:43 |
<hashar> |
Nodepool: Image ci-jessie-wikimedia-1450456713 in wmflabs-eqiad is ready |
[releng] |
| 16:42 |
<hashar> |
Nodepool instances now have Zuul 2.1.0-60-g1cc37f7-wmf4jessie1 finally |
[releng] |
| 16:28 |
<twentyafterfour> |
restarted apache on iridium to deploy redirect script changes |
[production] |
| 16:20 |
<jynus> |
restarting and reconfiguring mysql on db1047 |
[production] |
| 16:15 |
<hashar> |
Image ci-jessie-wikimedia-1450455076 in wmflabs-eqiad is ready ( still has the wrong Zuul version grr) |
[releng] |
| 16:11 |
<hashar> |
Nodepool force refreshing image to make sure zuul is up to date (should be 2.1.0-60-g1cc37f7-wmf4jessie1 ) |
[releng] |
| 15:43 |
<hashar> |
salt '*slave*' cmd.run 'rm -fR /srv/deployment/integration/mediawiki-tools-codesniffer' https://phabricator.wikimedia.org/T66371 |
[releng] |
| 15:37 |
<hashar> |
Deleting mediawiki/tools/codesniffer.git branch wmf-deploy (was 358c2e7bdec269cec999af89e3412951bb463dc0 ) |
[releng] |
| 15:19 |
<hashar> |
Created Github repo https://github.com/wikimedia/thumbor-video-engine |
[releng] |