2551-2600 of 10000 results (73ms)
2016-09-28 §
08:31 <hashar> Reloading Zuul to deploy dc2ada37 [releng]
08:15 <twentyafterfour> twentyafterfour@iridium:/srv/phab/phabricator$ sudo bin/search index --type PhabricatorProject --force [production]
03:57 <bd808> Fixed puppet on striker-deploy03 and striker-uwsgi02; apparently busted by some refactoring that effected /etc/puppet/puppet.conf [striker]
03:34 <eileen> tools upgrade from b0be0f9ca04191c4bab869bb81191c5c77c432ca to 5427a601ed64ecfe01ef84eda13f28c0dd08a3af [production]
01:20 <eileen> updating CiviCRM from 26e5214e66f2e4b5de89c27dd5121dfde43269e2 to 88000acc826592e535491bde6a47f8976deaf07a [production]
01:05 <eileen> civicrm upgrade from d30a5e454e6614214faef8354a3a23d71d573c7f to 26e5214e66f2e4b5de89c27dd5121dfde43269e2 [production]
00:25 <bd808> Deployed changes from T144710 for testing [striker]
2016-09-27 §
20:11 <hashar> Reloading Zuul to deploy 3c3289aa1a for T143938 and T146783 [releng]
16:29 <anomie> Cherry-picked https://gerrit.wikimedia.org/r/#/c/313035/ on deployment-puppetmaster [releng]
08:07 <chasemp> tools-bastion-03:~# chmod 640 /var/log/syslog [tools]
05:32 <_joe_> rebooting ms-be1002, stuck in a failed disk [production]
2016-09-26 §
23:58 <bd808> Started udp2log-mw on deployment-fluorine02 for T146723 [releng]
23:13 <Krenair> Rebooting deployment-aqs01 for T141673 [releng]
19:37 <awight> enabling awight_test5 banner at 1% of nlwiki [production]
18:09 <ejegg> rolled back paypal IPN listener to b4d77a991e100f97d98fcd72eaf03940a4e1845d [production]
17:59 <ejegg> updated standalone paypal IPN listener from b4d77a991e100f97d98fcd72eaf03940a4e1845d to 21647c8f4b781b74ae2dc4377334410b4eed7e3c [production]
17:47 <ejegg> rolled back paypal IPN listener to b4d77a991e100f97d98fcd72eaf03940a4e1845d [production]
17:39 <ejegg> updated standalone paypal IPN listener from b4d77a991e100f97d98fcd72eaf03940a4e1845d to 21647c8f4b781b74ae2dc4377334410b4eed7e3c [production]
13:52 <marostegui> phabricator is back in write mode - search is degraded. we are regenerating the indexes [production]
13:52 <chasemp> iridium phab ./bin/search index --all [production]
11:35 <hashar> deployment-salt02 : autoremoving a bunch of java related packages [releng]
11:31 <hashar> rebooting deployment-salt02 has a kernel soft lock while hitting the disk [releng]
11:24 <hashar> beta: mass upgrading all debian packages on all instances [releng]
10:32 <hashar> beta: on deployment-pdf01 rm -fR /home/cscott/tmp/npm* [releng]
10:29 <hashar> deployment-pdf01 apt-get upgrade / cleaning files left over etc [releng]
10:28 <hashar> beta: on deployment-pdf01 rm -fR /home/cscott/.npm/ T145343 [releng]
03:39 <cwdent_> disabled civicrm dedupe contacts job [production]
2016-09-25 §
16:25 <Amir1> deploying 9cc2009 on ORES nodes (T146581) [production]
16:03 <Amir1> deploying c2ba205 (T146581) [ores]
15:59 <Amir1> c2ba205 going to staging [ores]
15:27 <Krenair> restarted labs-logbot under tools.morebots [tools]
15:26 <halfak> restarted precached and uwsgi-ores on ores-web-03 [ores]
15:24 <elukey> executed https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Hadoop/Administration#Fixing_HDFS_mount_at_.2Fmnt.2Fhdfs on stat1002 (fusermount didn't succeed to umount though) [production]
15:23 <halfak> restarted precached and uwsgi-ores on ores-web-03 [ores]
14:39 <gehel> restarting blazegraph on wdqs1002 - T146576 [production]
14:30 <gehel> putting wdqs1002 in maintenance mode, server looks unstable, investigating... - T146576 [production]
14:28 <godog> temporarily redirect ores-celery-worker logs to /srv/log/celery/syslog.log and remove old daemon.log.1 to avoid scb100* filling up the / filesystem [production]
2016-09-24 §
20:08 <hashar> deployment-tin is shutdown. Replaced by Jessie deployment-tin02 [releng]
19:30 <ema> hhvm 1283-1290 rolling restart [production]
12:21 <godog> apply temporary cleanup of old (+20m) thumbor temporary files - T146262 [production]
10:47 <_joe_> systemctl restart thumbor-instances.service on thumbor1001 freed 3 GB of space [production]
02:44 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Sep 24 02:44:59 UTC 2016 (duration 5m 57s) [production]
02:39 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.20) (duration: 16m 49s) [production]
2016-09-23 §
22:05 <matt_flaschen> Deployed patch for T146425 [production]
21:42 <ebernhardson@tin> Synchronized php-1.28.0-wmf.20/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php: Additional logging to track down autocomplete timing regression (duration: 00m 50s) [production]
20:52 <gehel> cleaning up leftover system unit files on wdqs1* [production]
20:49 <halfak> restarted ores-uwsgi and precached services on ores-web-03 [ores]
20:41 <yuvipanda> add halfak as projectadmin [quarry]
20:21 <hashar> integration: salt -v '*trusty*' cmd.run 'service mysql start' [releng]
20:00 <hashar> rebooting all CI permanent slaves. Making sure nothing is left on /mnt (which is no more mounted) [releng]