2151-2200 of 2543 results (9ms)
2016-07-29 §
21:48 <YuviPanda> deleted tools-worker-1006 after depooling+draining [tools]
21:45 <YuviPanda> repool new tools-worker-1003 with direct-lvm docker storage backend [tools]
21:30 <YuviPanda> depool tools-worker-1003 to be recreated with new docker config, picking this because it's on a non-ssd host [tools]
21:17 <YuviPanda> depooled tools-worker-1020/21 after fixing them up [tools]
20:41 <YuviPanda> delete tools-worker-1001 [tools]
20:29 <YuviPanda> depool tools-worker-1001, going to recreate with to test new puppet deploying-first-run [tools]
20:26 <YuviPanda> built new worker nodes tools-worker-1020 and 21 with direct-lvm storage backend [tools]
17:48 <YuviPanda> disable puppet on all tools k8s worker nodes [tools]
2016-07-25 §
14:17 <chasemp> nova reboot 64f01f90-c805-4a2e-9ed5-f523b909094e (grid master) [tools]
2016-07-23 §
23:21 <YuviPanda> restart maintain-kubeusers on tools-k8s-master-01, was stuck on connecting to seaborgium preventing new tool creation [tools]
01:56 <YuviPanda> deploy kubernetes v1.3.3wmf1 [tools]
2016-07-22 §
17:30 <YuviPanda> repool tools-worker-1018 [tools]
14:04 <chasemp> reboot tools-worker-1015 as stuck w/ high iowait warning seconds ago. I cannot ssh in as root. [tools]
2016-07-21 §
22:42 <chasemp> reboot tools-worker-1018 as stuck T141017 [tools]
2016-07-20 §
21:26 <andrewbogott> rebooting tools-k8s-etcd-01 [tools]
11:14 <Guest9334> rebooted tools-worker-1004 [tools]
2016-07-19 §
01:06 <bd808> Upgraded Elasticsearch on tools-elastic-* to 2.3.4 [tools]
2016-07-18 §
21:50 <YuviPanda> force downgrade hhvm on tools-webgrid-lighttpd-1408 to fix puppet issues [tools]
21:40 <YuviPanda> bind mount and kill files in /var/lib/docker that were monuted over by proper mount on lvm on tools-worker-1004 [tools]
21:40 <YuviPanda> bind mount and kill files in /var/lib/docker that were monuted over by proper mount on lvm [tools]
21:37 <YuviPanda> killed tools-pastion-01, no longer in use [tools]
20:59 <bd808> Disabled puppet on tools-elastic-0[123]. Elasticsearch needs to be upgraded. [tools]
15:15 <YuviPanda> kill 8807036 for Luke081515 [tools]
12:48 <YuviPanda> reboot tools-flannel-etcd-03 for T140256 [tools]
12:41 <YuviPanda> reboot tools-k8s-etcd-02 for T140256 [tools]
2016-07-15 §
10:24 <yuvipanda> depool tools-exec-1402 for T138447 [tools]
10:24 <yuvipanda> reboot tools-exec-1402 for T138447 [tools]
10:16 <yuvipanda> depooling tools-webgrid-lighttpd-1402 and -1412 since they seem to be suffering from T138447 [tools]
10:08 <yuvipanda> reboot tools-webgrid-lighttpd-1402 and 1412 [tools]
2016-07-14 §
23:12 <bd808> Added Madhuvishy to project "roots" sudoer list [tools]
22:58 <bd808> Added Madhuvishy as projectadmin [tools]
21:25 <chasemp> change perms for tools.readmore to correct bot [tools]
2016-07-13 §
11:40 <yuvipanda> cold-migrate tools-worker-1014 off labvirt1010 to see if that improves the ksoftirqd situation [tools]
11:19 <yuvipanda> drained tools-worker-1004 - high ksoftirqd usage even with no load [tools]
11:13 <yuvipanda> depool tools-worker-1014 - unusable, totally in iowait [tools]
11:13 <yuvipanda> reboot tools-worker-1004, was unresponsive [tools]
2016-07-12 §
18:07 <yuvipanda> reboot tools-worker-1012, it seems to have failed LDAP connectivity :| [tools]
2016-07-08 §
12:38 <yuvipanda> starting up tools-web-static-02 again [tools]
2016-07-07 §
12:45 <yuvipanda> start deployment of k8s 1.3.0wmf4 for T139259 [tools]
2016-07-06 §
13:09 <yuvipanda> associated a floating IP with tools-k8s-master-01 for T139461 [tools]
11:47 <yuvipanda> moved tools-checker-0[12] to use tools-puppetmaster-01 as puppetmaster so they get appropriate CA for use when talking to kubernetes API [tools]
2016-07-04 §
11:13 <yuvipanda> delete tools-prometheus-01 to free up resources on labvirt1010 [tools]
11:11 <yuvipanda> actually deleted instance tools-cron-02 to free up resources on labvirt1010 - was large and not currently used, and failover process takes a while anyway, so we can recreate if needed [tools]
11:10 <yuvipanda> stopped instance tools-cron-02 to free up some resources on labvirt1010 [tools]
2016-07-03 §
17:09 <yuvipanda> run qstat -u '*' | grep 'dr ' | awk '{ print $1;}' | xargs -L1 qdel -f to clean out jobs stuck in dr state [tools]
16:58 <yuvipanda> migrate tools-web-static-02 to labvirt1011 to provide more breathing room [tools]
16:56 <yuvipanda> delete temp-test-trusty-package to provide more breathing room on labvirt1010 [tools]
13:49 <yuvipanda> reboot tools-exec-1219 [tools]
13:37 <yuvipanda> migrating tools-exec-1216 to labvirt1011 [tools]
13:07 <yuvipanda> delete tools-bastion-01 which was shut down anyway [tools]