|
2016-09-28
§
|
| 12:44 |
<hashar> |
Cant finish up the switch to deployment-tin, puppet still does not pass due to weird clone issues ... |
[releng] |
| 11:48 |
<hashar> |
Deleting deployment-tin Trusty instance and recreate one with same hostname as Jessie; Meant to replace deployment-tin02 T144006 |
[releng] |
| 10:44 |
<hashar> |
CI updating all mwext-Wikibase* jenkins jobs for https://gerrit.wikimedia.org/r/#/c/313056/ T142158 |
[releng] |
| 10:43 |
<hashar> |
Updating slave scripts for "Disable garbage collection for mw-phpunit.sh" https://gerrit.wikimedia.org/r/313051 T142158 |
[releng] |
| 08:31 |
<hashar> |
Reloading Zuul to deploy dc2ada37 |
[releng] |
| 08:15 |
<twentyafterfour> |
twentyafterfour@iridium:/srv/phab/phabricator$ sudo bin/search index --type PhabricatorProject --force |
[production] |
| 03:57 |
<bd808> |
Fixed puppet on striker-deploy03 and striker-uwsgi02; apparently busted by some refactoring that effected /etc/puppet/puppet.conf |
[striker] |
| 03:34 |
<eileen> |
tools upgrade from b0be0f9ca04191c4bab869bb81191c5c77c432ca to 5427a601ed64ecfe01ef84eda13f28c0dd08a3af |
[production] |
| 01:20 |
<eileen> |
updating CiviCRM from 26e5214e66f2e4b5de89c27dd5121dfde43269e2 to 88000acc826592e535491bde6a47f8976deaf07a |
[production] |
| 01:05 |
<eileen> |
civicrm upgrade from d30a5e454e6614214faef8354a3a23d71d573c7f to 26e5214e66f2e4b5de89c27dd5121dfde43269e2 |
[production] |
| 00:25 |
<bd808> |
Deployed changes from T144710 for testing |
[striker] |
|
2016-09-26
§
|
| 23:58 |
<bd808> |
Started udp2log-mw on deployment-fluorine02 for T146723 |
[releng] |
| 23:13 |
<Krenair> |
Rebooting deployment-aqs01 for T141673 |
[releng] |
| 19:37 |
<awight> |
enabling awight_test5 banner at 1% of nlwiki |
[production] |
| 18:09 |
<ejegg> |
rolled back paypal IPN listener to b4d77a991e100f97d98fcd72eaf03940a4e1845d |
[production] |
| 17:59 |
<ejegg> |
updated standalone paypal IPN listener from b4d77a991e100f97d98fcd72eaf03940a4e1845d to 21647c8f4b781b74ae2dc4377334410b4eed7e3c |
[production] |
| 17:47 |
<ejegg> |
rolled back paypal IPN listener to b4d77a991e100f97d98fcd72eaf03940a4e1845d |
[production] |
| 17:39 |
<ejegg> |
updated standalone paypal IPN listener from b4d77a991e100f97d98fcd72eaf03940a4e1845d to 21647c8f4b781b74ae2dc4377334410b4eed7e3c |
[production] |
| 13:52 |
<marostegui> |
phabricator is back in write mode - search is degraded. we are regenerating the indexes |
[production] |
| 13:52 |
<chasemp> |
iridium phab ./bin/search index --all |
[production] |
| 11:35 |
<hashar> |
deployment-salt02 : autoremoving a bunch of java related packages |
[releng] |
| 11:31 |
<hashar> |
rebooting deployment-salt02 has a kernel soft lock while hitting the disk |
[releng] |
| 11:24 |
<hashar> |
beta: mass upgrading all debian packages on all instances |
[releng] |
| 10:32 |
<hashar> |
beta: on deployment-pdf01 rm -fR /home/cscott/tmp/npm* |
[releng] |
| 10:29 |
<hashar> |
deployment-pdf01 apt-get upgrade / cleaning files left over etc |
[releng] |
| 10:28 |
<hashar> |
beta: on deployment-pdf01 rm -fR /home/cscott/.npm/ T145343 |
[releng] |
| 03:39 |
<cwdent_> |
disabled civicrm dedupe contacts job |
[production] |
|
2016-09-25
§
|
| 16:25 |
<Amir1> |
deploying 9cc2009 on ORES nodes (T146581) |
[production] |
| 16:03 |
<Amir1> |
deploying c2ba205 (T146581) |
[ores] |
| 15:59 |
<Amir1> |
c2ba205 going to staging |
[ores] |
| 15:27 |
<Krenair> |
restarted labs-logbot under tools.morebots |
[tools] |
| 15:26 |
<halfak> |
restarted precached and uwsgi-ores on ores-web-03 |
[ores] |
| 15:24 |
<elukey> |
executed https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Hadoop/Administration#Fixing_HDFS_mount_at_.2Fmnt.2Fhdfs on stat1002 (fusermount didn't succeed to umount though) |
[production] |
| 15:23 |
<halfak> |
restarted precached and uwsgi-ores on ores-web-03 |
[ores] |
| 14:39 |
<gehel> |
restarting blazegraph on wdqs1002 - T146576 |
[production] |
| 14:30 |
<gehel> |
putting wdqs1002 in maintenance mode, server looks unstable, investigating... - T146576 |
[production] |
| 14:28 |
<godog> |
temporarily redirect ores-celery-worker logs to /srv/log/celery/syslog.log and remove old daemon.log.1 to avoid scb100* filling up the / filesystem |
[production] |