48 results (13ms)
2016-05-25 §
19:33 <Amir1> running puppet agent manually in ores-web-03 [ores]
19:29 <Amir1> deploying 7992fd1 into web and worker nodes [ores]
2016-05-23 §
22:38 <Amir1> precaching brought back online [ores]
22:33 <Amir1> stopping precaching in ores-web-03 manually. Testing something [ores]
2016-05-18 §
16:48 <Amir1> running puppet agent on ores-lb-02 manually [ores]
2016-05-16 §
13:00 <Amir1> deploying e51c4f3 to celery and web nodes [ores]
2016-05-09 §
07:52 <Amir1> manually restarted nginx load balancer (ores-lb-02) It wasn't needed since puppet did it already. [ores]
2016-04-30 §
18:05 <Amir1> deployed d4f63a3 to web and worker nodes [ores]
17:49 <Amir1> deploy d4f63a3 to the staging [ores]
17:33 <Amir1> deploying 30ba552 to the staging [ores]
14:54 <Amir1> running puppet agent manually in ores-web-03 [ores]
14:52 <Amir1> added precaching role to ores-web-03 [ores]
2016-04-27 §
20:48 <halfak> deployed ores-wikimedia-config:6453fe5 [ores]
2016-04-23 §
15:25 <Amir1> sudden disruption due to an unexpected deploy [ores]
2016-04-07 §
14:32 <halfak> deployed ores-wikimedia-config:34ba0fa [ores]
2016-03-30 §
16:13 <halfak> deployed ores-wikimedia-config:58905c5 [ores]
2016-03-23 §
17:39 <halfak> deployed ores-wikimedia-config:39b622e [ores]
01:24 <halfak> deployed ores-wikimedia-config:8af4377 [ores]
2016-03-19 §
20:04 <halfak> ores-web-01/02 and ores-worker-01/02/03/04 deleted. ores-web-03/04/05 and ores-worker-05/06/07/08/09/10 started and configured as replacements. [ores]
16:43 <halfak> Manually ran `sudo apt-get install aspell-ar aspell-pl` across web and worker nodes [ores]
15:48 <halfak> Ran puppet and restarted uwsgi on web-01 with 28 forks rather than 32 [ores]
15:32 <halfak> workers_per_core 32 --> 28 [ores]
2016-03-18 §
01:17 <mutante> while doing that i noticed that ores-web-02 has an "Cannot allocate memory" problem [ores]
01:17 <mutante> but no class names have changed and confirmed no-op on every single instance [ores]
01:16 <mutante> merged https://gerrit.wikimedia.org/r/#/c/270102/ - role classes have been moved to modules/role and split into one file per class [ores]
01:07 <mutante> testing puppet on all instances before merging change that moves role classes to module [ores]
2016-03-05 §
17:58 <halfak> Shut down the uwsgi service and started up the uwsgi-ores-web service on web-01 and -02. [ores]
2016-03-04 §
22:54 <andrewbogott> migrating ores-worker-02 to labvirt1010 [ores]
2016-02-15 §
16:26 <halfak> restarted workers on ores-worker -02 and -03 [ores]
04:01 <halfak> Ammending last message -- Restarted the uwsgi-ores-web service on *ores-web-01*. The service on ores-web-02 was left alone. [ores]
03:59 <halfak> Restarted the uwsgi-ores-web service on ores-web-02 [ores]
2016-02-07 §
19:21 <halfak> Deployed ores-wikimedia-config:0be5afc [ores]
2016-01-14 §
19:50 <YuviPanda> add moritzm to project as projectadmin [ores]
2015-12-30 §
20:23 <halfak> Deployed with wb-vandalism:d940cea [ores]
20:22 <YuviPanda> create ores-cache-01 [ores]
2015-12-21 §
20:28 <YuviPanda> depool ores-web-01 from lb [ores]
2015-12-16 §
14:24 <YuviPanda> updated quota for instances to arbitrary number (40) [ores]
2015-12-08 §
17:34 <halfak> Deployed 1ad37c5 with ores:b745570, revscoring:, editquality:b41b7c1, wikiclass:bbfa9ce, and wb-vandalism:1075596 [ores]
2015-11-12 §
20:50 <halfak> Deployed 334b4b2 with ores:b745570, revscoring:, editquality:b41b7c1, wikiclass:bbfa9ce, and wb-vandalism:a09d026 [ores]
2015-10-28 §
21:05 <halfak> Deployed ores-wikimedia-config:c27c8f7, ores==0.5.4, wb-vandalism==0.1.5, revscoring==0.6.7 [ores]
2015-09-12 §
02:30 <halfak> Deployed ores-wikimedia-config:c852404, ores==0.5.0 and revscoring==0.6.1 [ores]
2015-09-11 §
14:51 <halfak> removed ores-web-02 from ores-lb-02 pool [ores]
03:31 <YuviPanda> restart redis server on ores-redis-02 to apply tcp-keepalive [ores]
2015-09-10 §
18:28 <YuviPanda> disabled restart crontab on ores-worker-01 under halfak's user, have set it to keep insane levels of logs to debug [ores]
2015-09-08 §
16:35 <halfak> deployed ores-wikimedia-config:ca10888, ores==0.4.0 and revscoring==0.5.0 [ores]
16:34 <valhallasw`cloud> should work now [ores]
16:30 <halfak> deployed ores-wikimedia-config:ca10888, ores==0.4.0 and revscoring==0.5.0 [ores]
2015-08-24 §
22:29 <andrewbogott> cold-migrating ores-web-02 to labvirt1004. [ores]