Search

On or before date

go

2017-07-06 §
00:07	<bd808>	bd808's root key is rejected by ores-compute-01.ores.eqiad.wmflabs. Puppet busted there?	[ores]
2017-06-28 §
17:55	<halfak>	deleting mediawiki-ores and hashing-vector instances from ores-staging (unused)	[ores]
2017-06-22 §
00:03	<awight>	labs ores was down 17:13-17:22 due to maintenance.	[ores]
2017-06-16 §
21:37	<halfak>	deploying ores-wmflabs-deploy:e8f6932	[ores]
21:34	<halfak>	staging ores-wmflabs-deploy:e8f6932	[ores]
21:06	<halfak>	deploying ores-wmflabs-deploy:c952f57 (reverting due to issues)	[ores]
20:52	<halfak>	deploying ores-wmflabs-deploy:7529113	[ores]
20:26	<halfak>	staging ores-wmflabs-deploy:7529113	[ores]
2017-05-20 §
14:47	<halfak>	staging ores-wmflabs-deploy:9df7b5a	[ores]
14:44	<halfak>	staging ores-wmflabs-deploy:ed1991c	[ores]
2017-04-25 §
21:33	<halfak>	deployed ores-wmflabs-deploy:dc934e8	[ores]
21:30	<halfak>	staged ores-wmflabs-deploy:dc934e8	[ores]
2017-04-06 §
16:00	<halfak>	deploying ores-wmflabs-deploy:7061f0a	[ores]
15:56	<halfak>	staging ores-wmflabs-deploy:7061f0a	[ores]
2017-03-28 §
15:58	<halfak>	deployed ores-wmflabs-deploy:18beebf (T160638)	[ores]
15:57	<halfak>	deployed ores-wmflabs-deploy:18beebf	[ores]
15:48	<halfak>	staged ores-wmflabs-deploy:18beebf	[ores]
2017-03-26 §
07:39	<Amir1>	restart ores-web-03	[ores]
2017-03-15 §
19:26	<halfak>	deployed ores-wmflabs-deploy:0990b1d	[ores]
19:24	<halfak>	staged ores-wmflabs-deploy:0990b1d	[ores]
19:03	<halfak>	deployed ores-wmflabs-deploy:080418d	[ores]
17:36	<halfak>	deployed ores-wmflabs-deploy:080418d to staging	[ores]
2017-03-06 §
20:26	<halfak>	restarted precached and uwsgi-ores on ores-web-03	[ores]
2017-02-23 §
18:55	<halfak>	restarted uwsgi-ores and precached on ores-web-03 (memory issues)	[ores]
2017-02-21 §
03:40	<halfak>	restarted uwsgi and precached on ores-web-03	[ores]
2017-02-19 §
15:54	<Amir1>	(except redis ones)	[ores]
15:54	<Amir1>	rebooting all instances	[ores]
2017-02-11 §
18:12	<halfak>	deployed ores-wmflabs-deploy:f58d3fd	[ores]
18:09	<halfak>	staged ores-wmflabs-deploy:f58d3fd	[ores]
2017-02-01 §
23:39	<halfak>	deployed ores-wmflabs-deploy:ce8861d	[ores]
2017-01-25 §
21:20	<halfak>	deployed ores-wmflabs-deploy:0f90516	[ores]
2017-01-18 §
19:47	<halfak>	restarted precached and uwsgi-ores on ores-web-03. Memory usage issues.	[ores]
2017-01-15 §
03:03	<Amir1>	restarting ores-web-03	[ores]
2017-01-04 §
12:51	<halfak>	ran 'sudo service uwsgi-ores restart' on ores-web-03	[ores]
11:41	<Amir1>	stopping precaching in ores in labs to reduce load	[ores]
11:40	<Amir1>	reboot ores-lb-02	[ores]
2016-11-22 §
16:20	<mutante>	ores-web-03 has an issue (Socket timeout, CRIT)	[ores]
2016-11-07 §
20:45	<halfak>	restarted uwsgi-ores and precached on ores-web-03	[ores]
2016-11-03 §
17:36	<halfak>	manually ran "sudo mkdir /srv/log; sudo mkdir /srv/log/ores; sudo service celery-ores-worker restart" on ores-worker-(05|06|07|08|09|10)	[ores]
17:23	<halfak>	deployed ores-wmflabs-deploy:ffb5dbb	[ores]
17:16	<halfak>	deployed ores-wmflabs-deploy:ffb5dbb to staging (fixes logging bug)	[ores]
17:04	<halfak>	deployed ores-wmflabs-deploy:74699db to staging	[ores]
2016-09-25 §
16:03	<Amir1>	deploying c2ba205 (T146581)	[ores]
15:59	<Amir1>	c2ba205 going to staging	[ores]
15:26	<halfak>	restarted precached and uwsgi-ores on ores-web-03	[ores]
15:23	<halfak>	restarted precached and uwsgi-ores on ores-web-03	[ores]
2016-09-23 §
20:49	<halfak>	restarted ores-uwsgi and precached services on ores-web-03	[ores]
2016-09-13 §
03:03	<halfak>	deployed ores-wmflabs-deploy:022fb7d	[ores]
2016-09-12 §
13:47	<halfak>	restarted precached service on ores-web-03	[ores]
04:31	<halfak>	manually killed since "python" process consuming 80% of memory and restarted uwsgi-ores service on ores-web-03	[ores]