551-600 of 735 results (6ms)
2015-12-23 §
18:38 <valhallasw`cloud> dynamicproxy ban system deployed on tools-proxy-02 working correctly for localhost; switching over users there by moving the external IP. [tools]
14:42 <valhallasw`cloud> toollabs homepage is unhappy because tools.xtools-articleinfo is using a lot of cpu on tools-webgrid-lighttpd-1409. Checking to see what's happening there. [tools]
10:46 <YuviPanda> migrate tools-worker-01 to 3.19 kernel [tools]
2015-12-22 §
18:30 <YuviPanda> rescheduling all webservices [tools]
18:17 <YuviPanda> failed over active proxy to proxy-01 [tools]
18:12 <YuviPanda> upgraded kernel and rebooted tools-proxy-01 [tools]
01:42 <YuviPanda> rebooting tools-worker-08 [tools]
2015-12-21 §
18:44 <YuviPanda> reboot tools-proxy-01 [tools]
18:31 <YuviPanda> failover proxy to tools-proxy-02 [tools]
2015-12-20 §
00:00 <YuviPanda> tools-worker-08 stuck again :| [tools]
2015-12-18 §
15:16 <andrewbogott> rebooting locked up host tools-exec-1409 [tools]
2015-12-16 §
23:14 <andrewbogott> rebooting tools-exec-1407, unresponsive [tools]
22:48 <YuviPanda> run qmod -c '*' to clear error state on gridengine [tools]
21:28 <andrewbogott> deleted tools-docker-registry-01 [tools]
16:24 <andrewbogott> rebooting tools-exec-1221 as it was in kernel lockup [tools]
08:38 <YuviPanda> reboot tools-bastion-01 [tools]
2015-12-12 §
10:08 <YuviPanda> restarted cron on tools-submit [tools]
2015-12-10 §
17:06 <valhallasw`cloud> revoked mjmbr membership of 'weather' tool; replaced with tools.admin [tools]
12:47 <valhallasw`cloud> broke tools-proxy-02 login (for valhallasw, root still works) by restarting nslcd. Restarting; current proxy is -01. [tools]
2015-12-07 §
13:46 <Coren> The new grid masters are happy, killing the old ones (-shadow, -master) [tools]
10:46 <YuviPanda> restarted nscd on tools-proxy-01 [tools]
2015-12-06 §
10:29 <YuviPanda> did webservice start on tool 'derivative', was missing service.manifest [tools]
2015-12-04 §
19:33 <Coren> switching master role to tools-grid-master [tools]
04:42 <YuviPanda> disabled puppet on tools-puppetmaster-01 because everything sucks [tools]
04:09 <bd808> Cherry-picked https://gerrit.wikimedia.org/r/#/c/256618 to tools-puppetmaster-01 [tools]
2015-12-02 §
18:29 <Coren> switching gridmaster activity to tools-grid-shadow [tools]
05:13 <YuviPanda> increased security groups quota to 50 because why not [tools]
2015-12-01 §
21:07 <YuviPanda> added bd808 as admin [tools]
21:01 <andrewbogott> deleted tool/service group tools.test300 [tools]
21:00 <andrewbogott> tool/service group tools.test300 [tools]
21:00 <andrewbogott> !log deleted tool/service group tools.test300 [tools]
07:27 <YuviPanda> pooled tools-worker-04 as a k8s worker node [tools]
2015-11-30 §
21:54 <valhallasw`cloud> trying to build tesseract-ocr, but I'm being dragged into the rabbithole: needs a newer leptonica which needs a newer libjpeg2 [tools]
21:15 <valhallasw`cloud> applying package_builder manifest on tools-packages [tools]
2015-11-25 §
15:42 <Coren> migrating tools-web-static-02 to labvirt1010 to free space on labvirt1002 [tools]
2015-11-20 §
22:01 <Coren> tools-webgrid-lighttpd-1412 tools-webgrid-lighttpd-1413 tools-webgrid-lighttpd-1414 tools-webgrid-lighttpd-1415 done and back in rotation. [tools]
21:45 <Coren> tools-webgrid-lighttpd-1411 tools-webgrid-lighttpd-1211 done and back in rotation. [tools]
21:30 <Coren> tools-webgrid-lighttpd-1410 tools-webgrid-lighttpd-1210 done and back in rotation. [tools]
21:25 <Coren> tools-webgrid-lighttpd-1409 tools-webgrid-lighttpd-1209 done and back in rotation. [tools]
21:13 <Coren> tools-webgrid-lighttpd-1408 tools-webgrid-lighttpd-1208 done and back in rotation. [tools]
20:58 <Coren> tools-webgrid-lighttpd-1407 tools-webgrid-lighttpd-1207 done and back in rotation. [tools]
20:53 <Coren> tools-webgrid-lighttpd-1406 tools-webgrid-lighttpd-1206 done and back in rotation. [tools]
20:41 <Coren> tools-webgrid-lighttpd-1405 tools-webgrid-lighttpd-1205 tools-webgrid-generic-1405 done and back in rotation. [tools]
20:28 <Coren> tools-webgrid-lighttpd-1404 tools-webgrid-lighttpd-1204 tools-webgrid-generic-1404 done and back in rotation. [tools]
19:49 <Coren> done, and putting back in rotation: tools-webgrid-lighttpd-1403 tools-webgrid-lighttpd-1203 tools-webgrid-generic-1403 [tools]
19:25 <Coren> -lighttpd-1403 wants a restart. [tools]
19:15 <Coren> done, and putting back in rotation: tools-webgrid-lighttpd-1402 tools-webgrid-lighttpd-1202 tools-webgrid-generic-1402 [tools]
18:55 <Coren> Putting -lighttpd-1401 -lighttpd-1201 -generic-1401 back in rotation, disabling the others. [tools]
18:24 <Coren> Beginning draining web nodes; -lighttpd-1401 -lighttpd-1201 -generic-1401 [tools]
18:10 <Coren> disabling puppet on the grid nodes listed at https://phabricator.wikimedia.org/P2337 so that the /tmp change in https://gerrit.wikimedia.org/r/#/c/252506/ do not apply early and break services [tools]