201-250 of 943 results (17ms)
|
2020-01-06
§
|
| 18:49 |
<bstorm_> |
edited /etc/fstab to remove NFS and rebooted to clear stale mounts on tools-k8s-haproxy-2 T241908 |
[tools] |
| 18:24 |
<bd808> |
Deleted shutdown instance tools-worker-1029 (was an SSSD testing instance) |
[tools] |
|
2020-01-04
§
|
| 18:11 |
<bd808> |
Shutdown tools-worker-1029 |
[tools] |
| 18:10 |
<bd808> |
kubectl delete node tools-worker-1029.tools.eqiad.wmflabs |
[tools] |
| 18:06 |
<bd808> |
Removed tools-worker-1029.tools.eqiad.wmflabs from k8s::worker_hosts hiera in preparation for decom |
[tools] |
| 16:16 |
<bd808> |
Draining tools-worker-10{05,12,28} due to hardware errors (T241884) |
[tools] |
|
2020-01-03
§
|
| 03:04 |
<bd808> |
Really rebuilding all {jessie,stretch,buster}-sssd images. Last time I forgot to actually update the git clone. |
[tools] |
| 00:11 |
<bd808> |
Rebuiliding all stretch-ssd Docker images to pick up busybox |
[tools] |
|
2020-01-02
§
|
| 23:54 |
<bd808> |
Rebuiliding all buster-ssd Docker images to pick up busybox |
[tools] |
|
2019-12-30
§
|
| 04:49 |
<andrewbogott> |
draining and rebooting tools-worker-1031, its drive is full |
[tools] |
|
2019-12-29
§
|
| 01:38 |
<Krenair> |
Cordoned tools-worker-1012 and deleted pods associated with dplbot and dewikigreetbot as well as my own testing one, host seems to be under heavy load - T241523 |
[tools] |
|
2019-12-22
§
|
| 20:13 |
<bd808> |
Enabled Puppet on tools-proxy-06.tools.eqiad.wmflabs after nginx config test (T241310) |
[tools] |
| 18:52 |
<bd808> |
Disabled Puppet on tools-proxy-06.tools.eqiad.wmflabs to test nginx config change (T241310) |
[tools] |
|
2019-12-20
§
|
| 22:28 |
<bd808> |
Re-enabled Puppet on tools-sgebastion-09. Reason for disable was "arturo raising systemd limits" |
[tools] |
|
2019-12-17
§
|
| 20:25 |
<bd808> |
Fixed https://tools.wmflabs.org/ to redirect to https://tools.wmflabs.org/admin/ |
[tools] |
| 16:50 |
<bstorm_> |
updated the maintain-kubeusers docker image for beta and tools |
[tools] |
|
2019-12-16
§
|
| 22:04 |
<bd808> |
Added 'ALLOW IPv4 25/tcp from 0.0.0.0/0' to "MTA" security group applied to tools-mail-02 |
[tools] |
|
2019-12-13
§
|
| 18:46 |
<bstorm_> |
updated tools-k8s-control-2 and 3 to the new config as well |
[tools] |
|
2019-12-12
§
|
| 08:34 |
<arturo> |
reboot tools-worker-1033/1034 and tools-sgebastion-08 to try to correct NFS mount issues |
[tools] |
|
2019-12-11
§
|
| 18:13 |
<bd808> |
Restarted maintain-dbusers on labstore1004. Process had not logged any account creations since 2019-12-01T22:45:45. |
[tools] |
| 17:24 |
<andrewbogott> |
deleted and/or truncated a bunch of logfiles on tools-worker-1031 |
[tools] |
|
2019-12-04
§
|
| 13:45 |
<arturo> |
drop puppet prefix `tools-cron`, deprecated and no longer in use |
[tools] |
|
2019-11-26
§
|
| 23:25 |
<bstorm_> |
rebuilding docker images to include the new webservice 0.52 in all versions instead of just the stretch ones T236202 |
[tools] |
| 22:57 |
<bstorm_> |
push upgraded webservice 0.52 to the buster and jessie repos for container rebuilds T236202 |
[tools] |
|
2019-11-22
§
|
| 13:32 |
<arturo> |
created security group `tools-new-k8s-full-connectivity` and add new k8s VMs to it (T238654) |
[tools] |
|
2019-11-10
§
|
| 02:17 |
<bd808> |
Building new Docker images for T237836 (retrying after cleaning out old images on tools-docker-builder-06) |
[tools] |
| 02:15 |
<bd808> |
Cleaned up old images on tools-docker-builder-06 using instructions from https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Building_toolforge_specific_images |
[tools] |
| 02:10 |
<bd808> |
Building new Docker images for T237836 |
[tools] |
| 01:45 |
<bstorm_> |
deploying bugfix for webservice in tools and toolsbeta T237836 |
[tools] |
|
2019-11-08
§
|
| 18:36 |
<bstorm_> |
pushed buster-sssd images to the docker repo |
[tools] |
| 17:15 |
<phamhi> |
pushed new buster images with the prefix name "toolforge" |
[tools] |
|
2019-11-07
§
|
| 13:27 |
<arturo> |
deployed registry-admission-webhook and ingress-admission-controller into the new k8s cluster (T236826) |
[tools] |
| 13:01 |
<arturo> |
creating puppet prefix `tools-k8s-worker` and a couple of VMs `tools-k8s-worker-[1,2]` T236826 |
[tools] |
|
2019-11-06
§
|
| 21:33 |
<bstorm_> |
docker images needed for kubernetes cluster upgrade deployed T215531 |
[tools] |
| 20:26 |
<bstorm_> |
building and pushing docker images needed for kubernetes cluster upgrade |
[tools] |
|
2019-11-05
§
|
| 23:08 |
<Krenair> |
Dropped 59a77a3, 3830802, and 83df61f from tools-puppetmaster-01:/var/lib/git/labs/private cherry-picks as these are no longer required T206235 |
[tools] |
| 17:38 |
<phamhi> |
restarted lighttpd based webservice pods on tools-worker-103x and 1040 (T233347) |
[tools] |
|
2019-11-04
§
|
| 14:45 |
<phamhi> |
Built and pushed ruby25 docker image based on buster (T230961) |
[tools] |
| 14:45 |
<phamhi> |
Built and pushed golang111 docker image based on buster (T230961) |
[tools] |
| 14:45 |
<phamhi> |
Built and pushed jdk11 docker image based on buster (T230961) |
[tools] |
| 14:45 |
<phamhi> |
Built and pushed php73 docker image based on buster (T230961) |
[tools] |
| 11:10 |
<phamhi> |
Built and pushed python37 docker image based on buster (T230961) |
[tools] |
|
2019-10-31
§
|
| 18:46 |
<andrewbogott> |
deleted and/or truncated a bunch of logfiles on tools-worker-1001. Runaway logfiles filled up the drive which prevented puppet from running. If puppet had run, it would have prevented the runaway logfiles. |
[tools] |
| 10:15 |
<arturo> |
SSL cert replacement for tools-docker-registry and tools-k8s-master went fine apparently (T236962) |
[tools] |
| 10:02 |
<arturo> |
icinga downtime toolschecker for 1h for replacing SSL certs in tools-docker-registry and tools-k8s-master (T236962) |
[tools] |
|
2019-10-28
§
|
| 16:06 |
<arturo> |
delete VM instance `tools-test-proxy-01` and the puppet prefix `tools-test-proxy` |
[tools] |
| 15:26 |
<bd808> |
Killed all processes owned by jem on tools-sgebastion-08 |
[tools] |
| 15:11 |
<bd808> |
Killed ircbot.php processes started by jem on tools-sgebastion-08 per request on irc |
[tools] |
| 14:58 |
<arturo> |
added `webproxy` security group to tools-proxy-05 and tools-proxy-06 (T235627) |
[tools] |
| 14:45 |
<arturo> |
created VMs tools-proxy-05 and tools-proxy-06 (T235627) |
[tools] |