401-450 of 1146 results (11ms)
2017-04-01 §
15:28 <andrewbogott> added five new exec nodes, tools-exec-1425 through 1429 [tools]
14:26 <chasemp> up nfs thresholds https://gerrit.wikimedia.org/r/#/c/345975/ [tools]
14:00 <chasemp> disable puppet on tools-grid-msater [tools]
13:52 <chasemp> tools-grid-master tc-setup clean [tools]
13:40 <chasemp> restart nscd and nscld on tools-grid-master [tools]
13:31 <chasemp> reboot tools-exec-1420 [tools]
2017-03-31 §
22:25 <yuvipanda> apt-get update && apt-get install kubernetes-node on tools-proxy-01 to upgrade kube-proxy systemd service unit [tools]
2017-03-30 §
20:29 <chasemp> stop grid-master temporarily & umount -fl project nfs & remount & start grid-master [tools]
17:38 <chasemp> reboot tools-exec-1401 [tools]
17:30 <madhuvishy> Updating tools project hiera config to add role::labs::nfsclient::lookupcache: all via Horizon (T136712) [tools]
17:29 <madhuvishy> Disabled puppet across tools in prep for T136712 [tools]
2017-03-27 §
04:06 <andrewbogott> erasing random log files on tools-proxy-01 to avoid filling the disk [tools]
2017-03-23 §
20:38 <andrewbogott> migrating tools-exec-1401 to labvirt1001 [tools]
19:56 <andrewbogott> migrating tools-exec-1408 to labvirt1001 [tools]
19:01 <andrewbogott> migrating tools-exec-1407 to labvirt1001 [tools]
16:37 <andrewbogott> migrating tools-webgrid-lighttpd-1402 and 1407 to labvirt1001 (testing labvirt1001 and easing CPU load on labvirt1010) [tools]
2017-03-22 §
13:48 <andrewbogott> migrating tools-bastion-02 in 15 minutes [tools]
2017-03-21 §
17:06 <andrewbogott> moving tools-webgrid-lighttpd-1404 to labvirt1012 to ease pressure on labvirt1004 [tools]
16:19 <andrewbogott> moving tools-exec-1406 to labvirt1011 to ease CPU usage on labvirt1004 [tools]
2017-03-20 §
22:47 <yuvipanda> disable puppet on all k8s workers to test https://gerrit.wikimedia.org/r/#/c/343708/ [tools]
18:36 <bd808> Applied openstack::clientlib on tools-checker-02 and forced puppet run [tools]
18:03 <bd808> Applied openstack::clientlib on tools-checker-01 and forced puppet run [tools]
17:31 <andrewbogott> migrating tools-exec-1417 to labvirt1013 [tools]
17:05 <andrewbogott> migrating tools-webgrid-lighttpd-1410 to labvirt1012 to reduce load on labvirt1001 [tools]
16:42 <andrewbogott> migrating tools-webgrid-generic-1404 to labvirt1011 to reduce load on labvirt1001 [tools]
16:13 <andrewbogott> migrating tools-exec-1408 to labvirt1010 to reduce load on labvirt1001 [tools]
2017-03-17 §
17:24 <andrewbogott> moving tools-webgrid-lighttpd-1416 to labvirt1013 to reduce load on labvirt1004 [tools]
17:15 <andrewbogott> moving tools-exec-1424 to labvirt1012 to ease load on labvirt1004 [tools]
2017-03-15 §
19:21 <andrewbogott> added new exec nodes: tools-exec-1421 and tools-exec-1422 [tools]
17:42 <madhuvishy> Restarted stashbot [tools]
17:29 <chasemp> docker stop && rm -fR /var/lib/docker/* on worker-1001 [tools]
17:20 <chasemp> test of logging [tools]
16:11 <chasemp> k8s master 'for h in `kubectl get nodes | grep worker | grep -v NotReady | grep -v Disabled | awk '{print $1}'`; do echo $h && kubectl drain --delete-local-data --force $h && sleep 10 ; done' [tools]
16:08 <chasemp> stop puppet on k8s master and drain nodes [tools]
15:50 <chasemp> (late) kill what appears to be an android emulator? unsure but it's eating all IO [tools]
2017-03-14 §
21:24 <bd808> Deleted tools-precise-dev (T160466) [tools]
21:13 <bd808> Removed non-existent tools-submit.eqiad.wmflabs from submit hosts list [tools]
21:02 <bd808> Deleted tools-exec-gift (T160461) [tools]
20:45 <bd808> Deleted tools-webgrid-lighttpd-12* nodes (T160442) [tools]
20:29 <bd808> Deleted tools-exec-12* nodes (T160457) [tools]
20:27 <bd808> Disassociated floating IPs from tools-exec-12* nodes (T160457) [tools]
17:41 <madhuvishy> Hand fix tools-puppetmaster by removing the old mariadb submodule directory [tools]
17:23 <madhuvishy> Remove role::toollabs::precise_reminder from tools-bastion-03 [tools]
15:40 <bd808> Installing toollabs-webservice 0.36 across cluster using clush [tools]
15:36 <bd808> Upgraded toollabs-webservice to 0.36 on tools-bastion-02.tools [tools]
15:25 <bd808> Installing jobutils 1.21 across cluster using clush [tools]
15:23 <bd808> Installed jobutils 1.21 on tools-bastion-02 [tools]
15:03 <bd808> Shutting down webservices running on Precise job grid nodes [tools]
2017-03-13 §
21:12 <valhallasw`cloud> tools-bastion-03: killed heavy unzip operation from staeiou, and heavy (inadvertent large file opening?) vim operation from steenth, as the entire server was blocked due to high i/o [tools]
2017-03-07 §
17:59 <andrewbogott> depooling, migrating tools-exec-1416 as part of ongoing labvirt1001 issues [tools]