2551-2600 of 2744 results (20ms)
2015-12-28 §
22:34 <chasemp> attempt to unmount nfs volumes on tools-redis-01 to debug but it hands (I am on console and see root at console hang on login) [tools]
22:31 <YuviPanda> disable NFS on tools-redis-1001 and 1002 [tools]
21:32 <YuviPanda> disable puppet on tools-redis-01 and -02 [tools]
21:27 <YuviPanda> created tools-redis-1001 [tools]
2015-12-23 §
21:21 <YuviPanda> deleted tools-worker-01 to -05, creating tools-worker-1001 to 1005 [tools]
21:19 <valhallasw`cloud> tools-proxy-01: umount /home /data/project /data/scratch /public/dumps [tools]
19:01 <valhallasw`cloud> ah, connections that are kept open. A new incognito window is routed correctly. [tools]
18:59 <valhallasw`cloud> switched to -02, worked correctly, switched back. Switching back does not seem to fully work?! [tools]
18:40 <valhallasw`cloud> scratch that, first going to eat dinner [tools]
18:38 <valhallasw`cloud> dynamicproxy ban system deployed on tools-proxy-02 working correctly for localhost; switching over users there by moving the external IP. [tools]
14:42 <valhallasw`cloud> toollabs homepage is unhappy because tools.xtools-articleinfo is using a lot of cpu on tools-webgrid-lighttpd-1409. Checking to see what's happening there. [tools]
10:46 <YuviPanda> migrate tools-worker-01 to 3.19 kernel [tools]
2015-12-22 §
18:30 <YuviPanda> rescheduling all webservices [tools]
18:17 <YuviPanda> failed over active proxy to proxy-01 [tools]
18:12 <YuviPanda> upgraded kernel and rebooted tools-proxy-01 [tools]
01:42 <YuviPanda> rebooting tools-worker-08 [tools]
2015-12-21 §
18:44 <YuviPanda> reboot tools-proxy-01 [tools]
18:31 <YuviPanda> failover proxy to tools-proxy-02 [tools]
2015-12-20 §
00:00 <YuviPanda> tools-worker-08 stuck again :| [tools]
2015-12-18 §
15:16 <andrewbogott> rebooting locked up host tools-exec-1409 [tools]
2015-12-16 §
23:14 <andrewbogott> rebooting tools-exec-1407, unresponsive [tools]
22:48 <YuviPanda> run qmod -c '*' to clear error state on gridengine [tools]
21:28 <andrewbogott> deleted tools-docker-registry-01 [tools]
16:24 <andrewbogott> rebooting tools-exec-1221 as it was in kernel lockup [tools]
08:38 <YuviPanda> reboot tools-bastion-01 [tools]
2015-12-12 §
10:08 <YuviPanda> restarted cron on tools-submit [tools]
2015-12-10 §
17:06 <valhallasw`cloud> revoked mjmbr membership of 'weather' tool; replaced with tools.admin [tools]
12:47 <valhallasw`cloud> broke tools-proxy-02 login (for valhallasw, root still works) by restarting nslcd. Restarting; current proxy is -01. [tools]
2015-12-07 §
13:46 <Coren> The new grid masters are happy, killing the old ones (-shadow, -master) [tools]
10:46 <YuviPanda> restarted nscd on tools-proxy-01 [tools]
2015-12-06 §
10:29 <YuviPanda> did webservice start on tool 'derivative', was missing service.manifest [tools]
2015-12-04 §
19:33 <Coren> switching master role to tools-grid-master [tools]
04:42 <YuviPanda> disabled puppet on tools-puppetmaster-01 because everything sucks [tools]
04:09 <bd808> Cherry-picked https://gerrit.wikimedia.org/r/#/c/256618 to tools-puppetmaster-01 [tools]
2015-12-02 §
18:29 <Coren> switching gridmaster activity to tools-grid-shadow [tools]
05:13 <YuviPanda> increased security groups quota to 50 because why not [tools]
2015-12-01 §
21:07 <YuviPanda> added bd808 as admin [tools]
21:01 <andrewbogott> deleted tool/service group tools.test300 [tools]
21:00 <andrewbogott> tool/service group tools.test300 [tools]
21:00 <andrewbogott> !log deleted tool/service group tools.test300 [tools]
07:27 <YuviPanda> pooled tools-worker-04 as a k8s worker node [tools]
2015-11-30 §
21:54 <valhallasw`cloud> trying to build tesseract-ocr, but I'm being dragged into the rabbithole: needs a newer leptonica which needs a newer libjpeg2 [tools]
21:15 <valhallasw`cloud> applying package_builder manifest on tools-packages [tools]
2015-11-25 §
15:42 <Coren> migrating tools-web-static-02 to labvirt1010 to free space on labvirt1002 [tools]
2015-11-20 §
22:01 <Coren> tools-webgrid-lighttpd-1412 tools-webgrid-lighttpd-1413 tools-webgrid-lighttpd-1414 tools-webgrid-lighttpd-1415 done and back in rotation. [tools]
21:45 <Coren> tools-webgrid-lighttpd-1411 tools-webgrid-lighttpd-1211 done and back in rotation. [tools]
21:30 <Coren> tools-webgrid-lighttpd-1410 tools-webgrid-lighttpd-1210 done and back in rotation. [tools]
21:25 <Coren> tools-webgrid-lighttpd-1409 tools-webgrid-lighttpd-1209 done and back in rotation. [tools]
21:13 <Coren> tools-webgrid-lighttpd-1408 tools-webgrid-lighttpd-1208 done and back in rotation. [tools]
20:58 <Coren> tools-webgrid-lighttpd-1407 tools-webgrid-lighttpd-1207 done and back in rotation. [tools]