1-50 of 763 results (11ms)
2017-04-20 §
17:15 <bd808> Deleted shutdown VM tools-docker-builder-04; tools-docker-builder-05 is the new hotness [tools]
17:11 <bd808> kill -INT 19897 on tools-proxy-02 to stop a hung nginx child process left from the last graceful restart of nginx [tools]
2017-04-19 §
15:10 <bd808> apt-get install psmisc on tools-proxy-0[12] [tools]
13:23 <chasemp> stop docker on tools-proxy-01 [tools]
13:20 <chasemp> clean up disk space on tools-proxy-01 [tools]
2017-04-18 §
20:37 <bd808> Restarted bigbrother on tools-services-02 [tools]
04:23 <bd808> Shutdown tools-docker-builder-04; will wait a bit before deleting [tools]
04:04 <bd808> Built and pushed new Docker images based on 82a46b4 (Refactor apt-get actions in Dockerfiles) [tools]
03:42 <bd808> Made tools-docker-builder-05.tools.eqiad.wmflabs the active docker build host [tools]
01:01 <bd808> Built instance tools-package-builder-01 [tools]
2017-04-17 §
20:41 <bd808> Building tools-docker-builder-05 [tools]
19:35 <chasemp> add reedy to sudo all perms so he can admin things [tools]
17:21 <andrewbogott> adding 8 more exec nodes: tools-exec-1435 through 1442 [tools]
2017-04-11 §
16:46 <andrewbogott> added exec nodes tools-exec-1430, 31, 32, 33, 34. [tools]
14:15 <andrewbogott> emptied /srv/pbuilder to make space on tools-docker-04 [tools]
02:35 <bd808> Restarted maintain-kubeusers on tools-k8s-master-01 [tools]
2017-04-03 §
13:48 <chasemp> enable puppet on gridmaster [tools]
2017-04-01 §
15:28 <andrewbogott> added five new exec nodes, tools-exec-1425 through 1429 [tools]
14:26 <chasemp> up nfs thresholds https://gerrit.wikimedia.org/r/#/c/345975/ [tools]
14:00 <chasemp> disable puppet on tools-grid-msater [tools]
13:52 <chasemp> tools-grid-master tc-setup clean [tools]
13:40 <chasemp> restart nscd and nscld on tools-grid-master [tools]
13:31 <chasemp> reboot tools-exec-1420 [tools]
2017-03-31 §
22:25 <yuvipanda> apt-get update && apt-get install kubernetes-node on tools-proxy-01 to upgrade kube-proxy systemd service unit [tools]
2017-03-30 §
20:29 <chasemp> stop grid-master temporarily & umount -fl project nfs & remount & start grid-master [tools]
17:38 <chasemp> reboot tools-exec-1401 [tools]
17:30 <madhuvishy> Updating tools project hiera config to add role::labs::nfsclient::lookupcache: all via Horizon (T136712) [tools]
17:29 <madhuvishy> Disabled puppet across tools in prep for T136712 [tools]
2017-03-27 §
04:06 <andrewbogott> erasing random log files on tools-proxy-01 to avoid filling the disk [tools]
2017-03-23 §
20:38 <andrewbogott> migrating tools-exec-1401 to labvirt1001 [tools]
19:56 <andrewbogott> migrating tools-exec-1408 to labvirt1001 [tools]
19:01 <andrewbogott> migrating tools-exec-1407 to labvirt1001 [tools]
16:37 <andrewbogott> migrating tools-webgrid-lighttpd-1402 and 1407 to labvirt1001 (testing labvirt1001 and easing CPU load on labvirt1010) [tools]
2017-03-22 §
13:48 <andrewbogott> migrating tools-bastion-02 in 15 minutes [tools]
2017-03-21 §
17:06 <andrewbogott> moving tools-webgrid-lighttpd-1404 to labvirt1012 to ease pressure on labvirt1004 [tools]
16:19 <andrewbogott> moving tools-exec-1406 to labvirt1011 to ease CPU usage on labvirt1004 [tools]
2017-03-20 §
22:47 <yuvipanda> disable puppet on all k8s workers to test https://gerrit.wikimedia.org/r/#/c/343708/ [tools]
18:36 <bd808> Applied openstack::clientlib on tools-checker-02 and forced puppet run [tools]
18:03 <bd808> Applied openstack::clientlib on tools-checker-01 and forced puppet run [tools]
17:31 <andrewbogott> migrating tools-exec-1417 to labvirt1013 [tools]
17:05 <andrewbogott> migrating tools-webgrid-lighttpd-1410 to labvirt1012 to reduce load on labvirt1001 [tools]
16:42 <andrewbogott> migrating tools-webgrid-generic-1404 to labvirt1011 to reduce load on labvirt1001 [tools]
16:13 <andrewbogott> migrating tools-exec-1408 to labvirt1010 to reduce load on labvirt1001 [tools]
2017-03-17 §
17:24 <andrewbogott> moving tools-webgrid-lighttpd-1416 to labvirt1013 to reduce load on labvirt1004 [tools]
17:15 <andrewbogott> moving tools-exec-1424 to labvirt1012 to ease load on labvirt1004 [tools]
2017-03-15 §
19:21 <andrewbogott> added new exec nodes: tools-exec-1421 and tools-exec-1422 [tools]
17:42 <madhuvishy> Restarted stashbot [tools]
17:29 <chasemp> docker stop && rm -fR /var/lib/docker/* on worker-1001 [tools]
17:20 <chasemp> test of logging [tools]
16:11 <chasemp> k8s master 'for h in `kubectl get nodes | grep worker | grep -v NotReady | grep -v Disabled | awk '{print $1}'`; do echo $h && kubectl drain --delete-local-data --force $h && sleep 10 ; done' [tools]