2301-2350 of 3029 results (22ms)
2017-03-21 §
17:06 <andrewbogott> moving tools-webgrid-lighttpd-1404 to labvirt1012 to ease pressure on labvirt1004 [tools]
16:19 <andrewbogott> moving tools-exec-1406 to labvirt1011 to ease CPU usage on labvirt1004 [tools]
2017-03-20 §
22:47 <yuvipanda> disable puppet on all k8s workers to test https://gerrit.wikimedia.org/r/#/c/343708/ [tools]
18:36 <bd808> Applied openstack::clientlib on tools-checker-02 and forced puppet run [tools]
18:03 <bd808> Applied openstack::clientlib on tools-checker-01 and forced puppet run [tools]
17:31 <andrewbogott> migrating tools-exec-1417 to labvirt1013 [tools]
17:05 <andrewbogott> migrating tools-webgrid-lighttpd-1410 to labvirt1012 to reduce load on labvirt1001 [tools]
16:42 <andrewbogott> migrating tools-webgrid-generic-1404 to labvirt1011 to reduce load on labvirt1001 [tools]
16:13 <andrewbogott> migrating tools-exec-1408 to labvirt1010 to reduce load on labvirt1001 [tools]
2017-03-17 §
17:24 <andrewbogott> moving tools-webgrid-lighttpd-1416 to labvirt1013 to reduce load on labvirt1004 [tools]
17:15 <andrewbogott> moving tools-exec-1424 to labvirt1012 to ease load on labvirt1004 [tools]
2017-03-15 §
19:21 <andrewbogott> added new exec nodes: tools-exec-1421 and tools-exec-1422 [tools]
17:42 <madhuvishy> Restarted stashbot [tools]
17:29 <chasemp> docker stop && rm -fR /var/lib/docker/* on worker-1001 [tools]
17:20 <chasemp> test of logging [tools]
16:11 <chasemp> k8s master 'for h in `kubectl get nodes | grep worker | grep -v NotReady | grep -v Disabled | awk '{print $1}'`; do echo $h && kubectl drain --delete-local-data --force $h && sleep 10 ; done' [tools]
16:08 <chasemp> stop puppet on k8s master and drain nodes [tools]
15:50 <chasemp> (late) kill what appears to be an android emulator? unsure but it's eating all IO [tools]
2017-03-14 §
21:24 <bd808> Deleted tools-precise-dev (T160466) [tools]
21:13 <bd808> Removed non-existent tools-submit.eqiad.wmflabs from submit hosts list [tools]
21:02 <bd808> Deleted tools-exec-gift (T160461) [tools]
20:45 <bd808> Deleted tools-webgrid-lighttpd-12* nodes (T160442) [tools]
20:29 <bd808> Deleted tools-exec-12* nodes (T160457) [tools]
20:27 <bd808> Disassociated floating IPs from tools-exec-12* nodes (T160457) [tools]
17:41 <madhuvishy> Hand fix tools-puppetmaster by removing the old mariadb submodule directory [tools]
17:23 <madhuvishy> Remove role::toollabs::precise_reminder from tools-bastion-03 [tools]
15:40 <bd808> Installing toollabs-webservice 0.36 across cluster using clush [tools]
15:36 <bd808> Upgraded toollabs-webservice to 0.36 on tools-bastion-02.tools [tools]
15:25 <bd808> Installing jobutils 1.21 across cluster using clush [tools]
15:23 <bd808> Installed jobutils 1.21 on tools-bastion-02 [tools]
15:03 <bd808> Shutting down webservices running on Precise job grid nodes [tools]
2017-03-13 §
21:12 <valhallasw`cloud> tools-bastion-03: killed heavy unzip operation from staeiou, and heavy (inadvertent large file opening?) vim operation from steenth, as the entire server was blocked due to high i/o [tools]
2017-03-07 §
17:59 <andrewbogott> depooling, migrating tools-exec-1416 as part of ongoing labvirt1001 issues [tools]
17:21 <madhuvishy> tools-webgrid-lighttpd-1409 migrated to labvirt1011 and repooled [tools]
16:31 <madhuvishy> Depooled tools-webgrid-lighttpd-1409 for cold migrating to different labvirt [tools]
2017-03-06 §
22:52 <andrewbogott> migrating tools-webgrid-lighttpd-1411 to labvirt1011 to give labvirt1001 a break [tools]
19:03 <madhuvishy> Stopping webservice running on tool tree-of-life on author request [tools]
18:25 <yuvipanda> set complex_values slots=300,release=trusty for tools-exec-gift-trusty-01.tools.eqiad.wmflabs [tools]
2017-03-04 §
23:47 <madhuvishy> Added new k8s workers 1028, 1029 [tools]
2017-02-28 §
03:52 <scfc_de> Deployed jobtools and misctools 1.20/1.20~precise+1 (T158722). [tools]
2017-02-27 §
02:42 <scfc_de> Purged misctools from instances where not puppetized. [tools]
02:41 <scfc_de> Deployed jobtools and misctools 1.19/1.19~precise+1 (T155787, T156886). [tools]
2017-02-17 §
12:51 <chasemp> create tools-exec-gift-trusty-01 [tools]
12:40 <chasemp> create tools-exec-gift-trusty [tools]
12:24 <chasemp> mass apt-get clean and removal of some old .gz log files due to 30+ low space warnings [tools]
2017-02-15 §
18:45 <yuvipanda> clush a restart of nscd across all of tools [tools]
00:01 <bd808> Rebuilt python and python2 Docker images (T157744) [tools]
2017-02-08 §
06:22 <yuvipanda> drain tools-worker-1026 for docker upgrade [tools]
05:28 <yuvipanda> drain pods from tools-worker-1027.tools.eqiad.wmflabs for docker upgrade [tools]
05:28 <yuvipanda> disable puppet on all k8s nodes in preparation for docker upgrade [tools]