1-50 of 539 results (13ms)
2016-11-01 §
21:54 <yuvipanda> stop gridengine-master on tools-grid-master in preparation for reboot [tools]
21:34 <yuvipanda> depool tools nodes on labvirt1012 [tools]
21:16 <yuvipanda> depool things in labvirt1011 [tools]
20:58 <yuvipanda> depool tools nodes on labvirt1010 [tools]
20:32 <yuvipanda> depool tools things on labvirt1005 and 1009 [tools]
20:08 <yuvipanda> depooled things on labvirt1006 and 1008 [tools]
19:51 <yuvipanda> move tools-elastic-03 to labvirt1010, -02 already in 09 [tools]
19:34 <yuvipanda> migrate tools-elastic-03 to labvirt1009 [tools]
19:10 <yuvipanda> depooled tools nodes from labvirt1004 and 1007 [tools]
17:57 <yuvipanda> depool exec nodes on labvirt1002 [tools]
13:27 <chasemp> reboot tools-exec-1404 post depool for test [tools]
2016-10-31 §
21:50 <yuvipanda> deleted cyberbot queue with qconf -dq cyberbot [tools]
21:44 <yuvipanda> restarted cron on tools-cron-01 [tools]
2016-10-30 §
02:25 <yuvipanda> restarted maintain-kubeusers [tools]
2016-10-29 §
17:21 <yuvipanda> depool tools-worker-1005 [tools]
2016-10-28 §
20:15 <chasemp> restart prometheus service on tools-prometheus-01 to see if that wakes it up [tools]
20:06 <yuvipanda> restart kube-apiserver again, ran into too many open file handles [tools]
15:58 <Yuvi[m]> restart k8s master, seems to have run out of fds [tools]
15:43 <chasemp> restart toolschecker service on 01 and 02 [tools]
2016-10-27 §
21:09 <godog> upgrade prometheus on tools-prometheus0[12] [tools]
18:49 <andrewbogott> rebooting tools-webgrid-lighttpd-1401 [tools]
13:51 <chasemp> reboot tools-webgrid-generic-1403 [tools]
13:50 <chasemp> reboot dockerbuilder-01 [tools]
2016-10-26 §
23:20 <madhuvishy> Disabling puppet on tools proxy hosts for applying proxy health check endpoint T143638 [tools]
23:17 <godog> upgrade prometheus on tools-prometheus-02 [tools]
16:52 <bd808> Deployed jobutils_1.16_all.deb on tools-mail (default jsub target to trusty) [tools]
16:50 <bd808> Deployed jobutils_1.16_all.deb on tools-precise-dev (default jsub target to trusty) [tools]
2016-10-25 §
04:19 <yuvipanda> reboot tools-flannel-etcd-01 for https://phabricator.wikimedia.org/T149072#2741012 [tools]
2016-10-24 §
03:45 <Krenair> reset host keys for tools-puppetmaster-02 on -01, looks like it was recreated 5-6 days ago [tools]
2016-10-20 §
16:55 <yuvipanda> killed bzip2 taking 100% CPU on tools-bastion-03 [tools]
2016-10-18 §
22:56 <Guest20046> flip tools-k8s-master-01 to tools-puppetmaster-02 [tools]
07:43 <yuvipanda> move all tools webgrid nodes to tools-puppetmaster-02 too [tools]
07:40 <yuvipanda> complete moving all general tools exec nodes to tools-puppetmaster-02 [tools]
07:33 <yuvipanda> restarted puppetmaster on tools-puppetmaster-01 [tools]
2016-10-17 §
14:37 <chasemp> remove bdsync-deb and bdsync-deb-2 errornously created in Tools and now defunct anyway [tools]
14:05 <chasemp> restart puppetmaster on tools-puppetmaster-01 (instances sticking on puppet runs for a long time) [tools]
14:01 <chasemp> reboot tools-exec-1215 and tools-exec-1410 as unresponsive [tools]
2016-10-14 §
16:19 <yuvipanda> repoooled tools-worker-1012, seems to have recovered?! [tools]
15:57 <yuvipanda> drain tools-worker-1012, seems stuck [tools]
2016-10-10 §
18:04 <valhallasw`vecto> sudo service bigbrother restart @ tools-services-02 [tools]
2016-10-09 §
18:33 <valhallasw`cloud> removed empty local crontabs for {yuvipanda, yuvipanda, tools.toolschecker} on {tools-webgrid-lighttpd-1404, tools-webgrid-lighttpd-1204, tools-checker-01}. No other local crontabs remaining. [tools]
2016-10-05 §
12:15 <chasemp> reboot tools-webgrid-generic-1404 as locked up [tools]
2016-10-01 §
10:03 <yuvipanda> re-enable puppet on tools-checker-02 [tools]
2016-09-29 §
18:10 <bd808> Investigating elasticsearch cluster issues effecting stashbot [tools]
2016-09-27 §
08:07 <chasemp> tools-bastion-03:~# chmod 640 /var/log/syslog [tools]
2016-09-25 §
15:27 <Krenair> restarted labs-logbot under tools.morebots [tools]
2016-09-21 §
18:56 <madhuvishy> Repooled tools-webgrid-lighttpd-1418 (T146212) after dns records cleanup [tools]
18:42 <madhuvishy> Repooled tools-webgrid-lighttpd-1416 (T146212) after dns records cleanup [tools]
16:57 <chasemp> reboot tools-webgrid-lighttpd-1407, tools-webgrid-lighttpd-1210, tools-webgrid-lighttpd-1414, and then tools-webgrid-lighttpd-1405 as the first 3 return [tools]
2016-09-20 §
23:24 <yuvipanda> depool tools-webgrid-lighttpd-1416 and 1418, they aren't in actual working order [tools]