851-900 of 1565 results (13ms)
2017-03-15 §
17:20 <chasemp> test of logging [tools]
16:11 <chasemp> k8s master 'for h in `kubectl get nodes | grep worker | grep -v NotReady | grep -v Disabled | awk '{print $1}'`; do echo $h && kubectl drain --delete-local-data --force $h && sleep 10 ; done' [tools]
16:08 <chasemp> stop puppet on k8s master and drain nodes [tools]
15:50 <chasemp> (late) kill what appears to be an android emulator? unsure but it's eating all IO [tools]
2017-03-14 §
21:24 <bd808> Deleted tools-precise-dev (T160466) [tools]
21:13 <bd808> Removed non-existent tools-submit.eqiad.wmflabs from submit hosts list [tools]
21:02 <bd808> Deleted tools-exec-gift (T160461) [tools]
20:45 <bd808> Deleted tools-webgrid-lighttpd-12* nodes (T160442) [tools]
20:29 <bd808> Deleted tools-exec-12* nodes (T160457) [tools]
20:27 <bd808> Disassociated floating IPs from tools-exec-12* nodes (T160457) [tools]
17:41 <madhuvishy> Hand fix tools-puppetmaster by removing the old mariadb submodule directory [tools]
17:23 <madhuvishy> Remove role::toollabs::precise_reminder from tools-bastion-03 [tools]
15:40 <bd808> Installing toollabs-webservice 0.36 across cluster using clush [tools]
15:36 <bd808> Upgraded toollabs-webservice to 0.36 on tools-bastion-02.tools [tools]
15:25 <bd808> Installing jobutils 1.21 across cluster using clush [tools]
15:23 <bd808> Installed jobutils 1.21 on tools-bastion-02 [tools]
15:03 <bd808> Shutting down webservices running on Precise job grid nodes [tools]
2017-03-13 §
21:12 <valhallasw`cloud> tools-bastion-03: killed heavy unzip operation from staeiou, and heavy (inadvertent large file opening?) vim operation from steenth, as the entire server was blocked due to high i/o [tools]
2017-03-07 §
17:59 <andrewbogott> depooling, migrating tools-exec-1416 as part of ongoing labvirt1001 issues [tools]
17:21 <madhuvishy> tools-webgrid-lighttpd-1409 migrated to labvirt1011 and repooled [tools]
16:31 <madhuvishy> Depooled tools-webgrid-lighttpd-1409 for cold migrating to different labvirt [tools]
2017-03-06 §
22:52 <andrewbogott> migrating tools-webgrid-lighttpd-1411 to labvirt1011 to give labvirt1001 a break [tools]
19:03 <madhuvishy> Stopping webservice running on tool tree-of-life on author request [tools]
18:25 <yuvipanda> set complex_values slots=300,release=trusty for tools-exec-gift-trusty-01.tools.eqiad.wmflabs [tools]
2017-03-04 §
23:47 <madhuvishy> Added new k8s workers 1028, 1029 [tools]
2017-02-28 §
03:52 <scfc_de> Deployed jobtools and misctools 1.20/1.20~precise+1 (T158722). [tools]
2017-02-27 §
02:42 <scfc_de> Purged misctools from instances where not puppetized. [tools]
02:41 <scfc_de> Deployed jobtools and misctools 1.19/1.19~precise+1 (T155787, T156886). [tools]
2017-02-17 §
12:51 <chasemp> create tools-exec-gift-trusty-01 [tools]
12:40 <chasemp> create tools-exec-gift-trusty [tools]
12:24 <chasemp> mass apt-get clean and removal of some old .gz log files due to 30+ low space warnings [tools]
2017-02-15 §
18:45 <yuvipanda> clush a restart of nscd across all of tools [tools]
00:01 <bd808> Rebuilt python and python2 Docker images (T157744) [tools]
2017-02-08 §
06:22 <yuvipanda> drain tools-worker-1026 for docker upgrade [tools]
05:28 <yuvipanda> drain pods from tools-worker-1027.tools.eqiad.wmflabs for docker upgrade [tools]
05:28 <yuvipanda> disable puppet on all k8s nodes in preparation for docker upgrade [tools]
2017-02-07 §
13:49 <scfc_de> Deployed toollabs-webservice_0.33_all.deb (T156605, T156626). [tools]
13:49 <scfc_de> Deployed tools-manifest_0.11_all.deb. [tools]
2017-02-04 §
02:13 <yuvipanda> launch tools-worker-1027 to see if puppet works fine on first run! [tools]
02:13 <yuvipanda> reboot tools-worker-1026 to see if it comes up fine [tools]
01:46 <yuvipanda> launch tools-worker-1026 [tools]
2017-02-03 §
21:34 <madhuvishy> Migrated over precise tools to trusty for user multichill (catbot, family, locator, multichill, nlwikibots, railways, wlmtrafo, wikidata-janitor) [tools]
21:13 <chasemp> reboot tools-bastion-03 as unresponsive [tools]
2017-02-02 §
20:39 <yuvipanda> import docker-engine 1.11.2 (currently running version) and 1.12.6 (latest version) into aptly [tools]
00:06 <madhuvishy> Remove user maximilianklein from tools.cite-o-meter (on request) [tools]
2017-01-30 §
20:25 <yuvipanda> sudo ln -s /usr/bin/kubectl /usr/local/bin/kubectl to temporarily fix webservice shell not working [tools]
2017-01-27 §
19:22 <chasemp> reboot tools-bastion-02 as it is having issues [tools]
02:01 <madhuvishy> Reenabled puppet on tools-checker-01 [tools]
00:29 <madhuvishy> Disabling puppet on tools-checker instances to test https://gerrit.wikimedia.org/r/#/c/334433/ [tools]
2017-01-26 §
23:37 <madhuvishy> reenabled puppet on tools-checker [tools]