2751-2800 of 3208 results (29ms)
2016-09-05 §
16:27 <andrewbogott> rebooting tools-cron-01 because it is hanging all over the place [tools]
2016-09-01 §
05:19 <yuvipanda> restart maintain-kubeusers on tools-k8s-master-01, was stuck [tools]
2016-08-31 §
20:48 <madhuvishy> Reenabled puppet across tools hosts [tools]
20:45 <madhuvishy> Scratch migration complete on all grid exec nodes (T134896) [tools]
19:36 <madhuvishy> Scratch migration on all non exec/worker nodes complete (T134896) [tools]
18:18 <madhuvishy> Scratch migration complete for all k8s workers (T134896) [tools]
17:50 <madhuvishy> Reenabling puppet across tools hosts. [tools]
16:54 <madhuvishy> Rsync-ed over latest backup of /srv/scratch from labstore1001 to labstore1003 [tools]
2016-08-30 §
18:54 <valhallasw`cloud> edited /etc/shadow on a range of hosts to fix https://phabricator.wikimedia.org/T143191 [tools]
2016-08-29 §
23:38 <Krenair> added myself to the tools.admin service group earlier to try to figure out what was causing the outage, removed again now [tools]
23:13 <yuvipanda> bumped up worker_connections, restarted nginx [tools]
16:35 <yuvipanda> run chmod u+x /data/project/framabot [tools]
13:40 <chasemp> restart jouncebot [tools]
2016-08-28 §
05:34 <bd808> After git gc on web-static-02.tools:/srv/cdnjs: /dev/mapper/vd-cdnjs--disk 61G 54G 3.3G 95% /srv [tools]
05:25 <bd808> sudo git gc --aggressive on tools-web-static-01.tools:/srv/cdnjs [tools]
04:56 <bd808> sudo git gc --aggressive on tools-web-static-02.tools:/srv/cdnjs [tools]
2016-08-26 §
16:53 <yuvipanda> migrate tools-static-02 to labvirt1001 [tools]
2016-08-25 §
18:07 <yuvipanda> restart puppetmaster on tools-puppetmaster-01 [tools]
17:41 <yuvipanda> depooled tools-webgrid-1413 [tools]
01:16 <yuvipanda> restarted puppetmaster on tools-puppetmaster-01 [tools]
2016-08-24 §
23:03 <chasemp> reboot tools-exec-1217 [tools]
17:25 <yuvipanda> depool tools-exec-1217, it is dead/stuck/hung/io-starved [tools]
2016-08-23 §
07:08 <madhuvishy> Enabled puppet across tools after merging https://gerrit.wikimedia.org/r/#/c/305657/ (see T134896) [tools]
05:48 <yuvipanda> restarted nginx on tools-proxy-01, was out of connection slots [tools]
2016-08-22 §
22:07 <madhuvishy> Disabled puppet across tools hosts in preparation to merge https://gerrit.wikimedia.org/r/#/c/305657/ (see T134896) [tools]
22:01 <madhuvishy> Disabling puppet across tools hosts [tools]
2016-08-20 §
11:42 <valhallasw`cloud> rebooting tools-mail (hanging) [tools]
2016-08-19 §
14:52 <chasemp> reboot 82323ee4-762e-4b1f-87a7-d7aa7afa22f6 [tools]
2016-08-18 §
20:00 <yuvipanda> restarted maintain-kubeusers on tools-k8s-master-01 [tools]
2016-08-15 §
22:10 <yuvipanda> depool tools-exec-1211 and 1205, seem to be out of action [tools]
19:12 <yuvipanda> kill unused tools-merlbot-proxy [tools]
2016-08-12 §
20:39 <yuvipanda> delete tools-webgrid-lighttpd-1415, enough webservices have moved to k8s from that queue [tools]
20:37 <yuvipanda> delete tools-logs-01, going to recreate with a smaller image [tools]
20:36 <yuvipanda> delete tools-webgrid-generic-1405, enough things have moved to k8s from that queue! [tools]
20:10 <yuvipanda> migration of tools-grid-master to labvirt1013 complete [tools]
20:01 <yuvipanda> migrating tools-grid-master (currently inactive) to labvirt1013 away from crowded 1010 [tools]
12:40 <chasemp> tools.templatetransclusioncheck@tools-bastion-03:~$ webservice restart [tools]
2016-08-11 §
20:13 <yuvipanda> tools-grid-master finally stopped [tools]
20:05 <yuvipanda> disabled tools-webgrid-lighttpd-1202, is hung [tools]
17:23 <yuvipanda> instance being rebooted is tools-grid-master [tools]
17:22 <chasemp> reboot via nova master as it is stuck [tools]
2016-08-05 §
19:28 <paladox> adding tom29739 to lolrrit-wm project [tools]
2016-08-04 §
19:09 <yuvipanda> cleaned up nginx log files in tools-docker-registry-01 to fix free space warning [tools]
00:19 <yuvipanda> added Krenair as admin to help with T132225 and other issues. [tools]
2016-08-03 §
22:48 <yuvipanda> deleted tools-worker-1005 [tools]
22:08 <yuvipanda> depool & delete tools-worker-1007 and 1008 [tools]
21:34 <yuvipanda> rebooting tools-puppetmaster-01 to test a hypothesis [tools]
21:10 <yuvipanda> rebooting tools-puppetmaster-01 for kernel upgrade [tools]
00:20 <madhuvishy> Repooled nodes tools-worker 1012 and 1013 for T141126 [tools]
2016-08-02 §
22:49 <yuvipanda> depooled tools-worker-1014 as well for T141126 [tools]