101-150 of 167 results (14ms)
2016-08-04 §
18:02 <halfak> rebooting ores-web-05 to address OOM [ores]
17:56 <halfak> reduced web workers per core from 28 to 16 [ores]
2016-07-29 §
00:19 <halfak> deployed ores-wmflabs-deploy:770d131 [ores]
2016-07-13 §
18:20 <Amir1> ladsgroup@ores-lb-02:~$ sudo service nginx restart [ores]
17:21 <Amir1> deploying to web again [ores]
17:14 <Amir1> ladsgroup@ores-web-05:~$ sudo puppet agent -tv [ores]
16:32 <halfak> terminated ores-web-05 [ores]
15:58 <halfak> repooled ores-web-04 [ores]
15:20 <halfak> deployed ores-wmflabs-deploy:e638f1b [ores]
2016-07-12 §
11:25 <Amir1> deploying aad92ac to web and worker nodes [ores]
11:18 <Amir1> aad92ac goes to staging [ores]
2016-07-08 §
20:20 <halfak> deployed ores-wmflabs-deploy:3f116cd [ores]
2016-06-10 §
20:25 <halfak> deleted 99-redis.yaml and restarted celery-ores-worker on all worker nodes [ores]
07:36 <Amir1> deploying 4efc5b7 into prod [ores]
2016-06-09 §
08:37 <Amir1> rebooting ores-compute-01 [ores]
2016-06-03 §
23:57 <Amir1> removing role role::labs::ores::flower from ores-web-03 [ores]
2016-05-27 §
13:31 <Amir1> adding role::deployment::server to ores project [ores]
2016-05-26 §
10:05 <Amir1> rebooting ores-web-04 [ores]
10:02 <Amir1> deploying 4dc6050 into web and worker nodes, updating to revscoring 1.2.6 [ores]
2016-05-25 §
19:33 <Amir1> running puppet agent manually in ores-web-03 [ores]
19:29 <Amir1> deploying 7992fd1 into web and worker nodes [ores]
2016-05-23 §
22:38 <Amir1> precaching brought back online [ores]
22:33 <Amir1> stopping precaching in ores-web-03 manually. Testing something [ores]
2016-05-18 §
16:48 <Amir1> running puppet agent on ores-lb-02 manually [ores]
2016-05-16 §
13:00 <Amir1> deploying e51c4f3 to celery and web nodes [ores]
2016-05-09 §
07:52 <Amir1> manually restarted nginx load balancer (ores-lb-02) It wasn't needed since puppet did it already. [ores]
2016-04-30 §
18:05 <Amir1> deployed d4f63a3 to web and worker nodes [ores]
17:49 <Amir1> deploy d4f63a3 to the staging [ores]
17:33 <Amir1> deploying 30ba552 to the staging [ores]
14:54 <Amir1> running puppet agent manually in ores-web-03 [ores]
14:52 <Amir1> added precaching role to ores-web-03 [ores]
2016-04-27 §
20:48 <halfak> deployed ores-wikimedia-config:6453fe5 [ores]
2016-04-23 §
15:25 <Amir1> sudden disruption due to an unexpected deploy [ores]
2016-04-07 §
14:32 <halfak> deployed ores-wikimedia-config:34ba0fa [ores]
2016-03-30 §
16:13 <halfak> deployed ores-wikimedia-config:58905c5 [ores]
2016-03-23 §
17:39 <halfak> deployed ores-wikimedia-config:39b622e [ores]
01:24 <halfak> deployed ores-wikimedia-config:8af4377 [ores]
2016-03-19 §
20:04 <halfak> ores-web-01/02 and ores-worker-01/02/03/04 deleted. ores-web-03/04/05 and ores-worker-05/06/07/08/09/10 started and configured as replacements. [ores]
16:43 <halfak> Manually ran `sudo apt-get install aspell-ar aspell-pl` across web and worker nodes [ores]
15:48 <halfak> Ran puppet and restarted uwsgi on web-01 with 28 forks rather than 32 [ores]
15:32 <halfak> workers_per_core 32 --> 28 [ores]
2016-03-18 §
01:17 <mutante> while doing that i noticed that ores-web-02 has an "Cannot allocate memory" problem [ores]
01:17 <mutante> but no class names have changed and confirmed no-op on every single instance [ores]
01:16 <mutante> merged https://gerrit.wikimedia.org/r/#/c/270102/ - role classes have been moved to modules/role and split into one file per class [ores]
01:07 <mutante> testing puppet on all instances before merging change that moves role classes to module [ores]
2016-03-05 §
17:58 <halfak> Shut down the uwsgi service and started up the uwsgi-ores-web service on web-01 and -02. [ores]
2016-03-04 §
22:54 <andrewbogott> migrating ores-worker-02 to labvirt1010 [ores]
2016-02-15 §
16:26 <halfak> restarted workers on ores-worker -02 and -03 [ores]
04:01 <halfak> Ammending last message -- Restarted the uwsgi-ores-web service on *ores-web-01*. The service on ores-web-02 was left alone. [ores]
03:59 <halfak> Restarted the uwsgi-ores-web service on ores-web-02 [ores]