51-100 of 2651 results (6ms)
2020-05-04 §
16:46 <arturo> removing the now unused `/etc/apt/preferences.d/toolforge_k8s_kubeadmrepo*` files (T250866) [tools]
16:43 <arturo> removing the now unused `/etc/apt/sources.list.d/toolforge-k8s-kubeadmrepo.list` file (T250866) [tools]
2020-04-29 §
22:13 <bstorm_> running a fixup script after fixing a bug T247455 [tools]
21:28 <bstorm_> running the rewrite-psp-preset.sh script across all tools T247455 [tools]
16:54 <bstorm_> deleted the maintain-kubeusers pod to start running the new image T247455 [tools]
16:52 <bstorm_> tagged docker-registry.tools.wmflabs.org/maintain-kubeusers:beta to latest to deploy to toolforge T247455 [tools]
2020-04-28 §
22:58 <bstorm_> rebuilding docker-registry.tools.wmflabs.org/maintain-kubeusers:beta T247455 [tools]
2020-04-23 §
19:22 <bd808> Increased Kubernetes services quota for bd808-test tool. [tools]
2020-04-21 §
23:06 <bstorm_> repooled tools-k8s-worker-38/52, tools-sgewebgrid-lighttpd-0918/9 and tools-sgeexec-0901 T250869 [tools]
22:09 <bstorm_> depooling tools-sgewebgrid-lighttpd-0918/9 and tools-sgeexec-0901 T250869 [tools]
22:02 <bstorm_> draining tools-k8s-worker-38 and tools-k8s-worker-52 as they are on the crashed host T250869 [tools]
2020-04-20 §
15:31 <bd808> Rebuilding Docker containers to pick up tools-webservice v0.68 (T250625) [tools]
14:47 <arturo> added joakino to tools.admin LDAP group [tools]
13:28 <jeh> shutdown elasticsearch v5 cluster running Jessie T236606 [tools]
12:46 <arturo> uploading tools-webservice v0.68 to aptly stretch-tools and update it on relevant servers (T250625) [tools]
12:06 <arturo> uploaded tools-webservice v0.68 to stretch-toolsbeta for testing [tools]
11:59 <arturo> `root@tools-sge-services-03:~# aptly db cleanup` removed 340 unreferenced packages, and 2 unreferenced files [tools]
2020-04-15 §
23:20 <bd808> Building ruby25-sssd/base and children (T141388, T250118) [tools]
20:09 <jeh> update default security group to allow prometheus01.metricsinfra.eqiad.wmflabs TCP 9100 T250206 [tools]
2020-04-14 §
18:26 <bstorm_> Deployed new code and RBAC for maintain-kubeusers T246123 [tools]
18:19 <bstorm_> updating the maintain-kubeusers:latest image T246123 [tools]
17:32 <bstorm_> updating the maintain-kubeusers:beta image on tools-docker-imagebuilder-01 T246123 [tools]
2020-04-10 §
21:33 <bd808> Rebuilding all Docker images for the Kubernetes cluster (T249843) [tools]
21:27 <bd808> Rebuilding all Docker images for the Kubernetes cluster (T249843) [tools]
19:36 <bstorm_> after testing deploying toollabs-webservice 0.67 to tools repos T249843 [tools]
14:53 <arturo> live-hacking tools-puppetmaster-02 with https://gerrit.wikimedia.org/r/c/operations/puppet/+/587991 for T249837 [tools]
2020-04-09 §
15:13 <bd808> Rebuilding all stretch and buster Docker images. Jessie is broken at the moment due to package version mismatches [tools]
11:18 <arturo> bump nproc limit in bastions https://gerrit.wikimedia.org/r/c/operations/puppet/+/587715 (T219070) [tools]
04:29 <bd808> Running rebuild_all for Docker images to pick up toollabs-webservice v0.66 [try #2] (T154504, T234617) [tools]
04:18 <bd808> python3 build.py --image-prefix toolforge --tag latest --no-cache --push --single jessie-sssd [tools]
00:20 <bd808> Docker rebuild failed in toolforge-python2-sssd-base: "zlib1g-dev : Depends: zlib1g (= 1:1.2.8.dfsg-2+b1) but 1:1.2.8.dfsg-2+deb8u1 is to be installed" [tools]
2020-04-08 §
23:49 <bd808> Running rebuild_all for Docker images to pick up toollabs-webservice v0.66 (T154504, T234617) [tools]
23:35 <bstorm_> deploy toollabs-webservice v0.66 T154504 T234617 [tools]
2020-04-07 §
20:06 <andrewbogott> sss_cache -E on tools-sgebastion-08 and tools-sgebastion-09 [tools]
20:00 <andrewbogott> sss_cache -E on tools-sgebastion-07 [tools]
2020-04-06 §
19:16 <bstorm_> deleted tools-redis-1001/2 T248929 [tools]
2020-04-03 §
22:40 <bstorm_> shut down tools-redis-1001/2 T248929 [tools]
22:32 <bstorm_> switch tools-redis-1003 to the active redis server T248929 [tools]
20:41 <bstorm_> deleting tools-redis-1003/4 to attach them to an anti-affinity group T248929 [tools]
18:53 <bstorm_> spin up tools-redis-1004 on stretch and connect to cluster T248929 [tools]
18:23 <bstorm_> spin up tools-redis-1003 on stretch and connect to the cluster T248929 [tools]
16:50 <bstorm_> launching tools-redis-03 (Buster) to see what happens [tools]
2020-03-30 §
18:28 <bstorm_> Beginning rolling depool, remount, repool of k8s workers for T248702 [tools]
18:22 <bstorm_> disabled puppet across tools-k8s-worker-[1-55].tools.eqiad.wmflabs T248702 [tools]
16:56 <arturo> dropping `_psl.toolforge.org` TXT record (T168677) [tools]
2020-03-27 §
21:22 <bstorm_> removed puppet prefix tools-docker-builder T248703 [tools]
21:15 <bstorm_> deleted tools-docker-builder-06 T248703 [tools]
18:54 <bstorm_> launching tools-docker-imagebuilder-01 T248703 [tools]
12:52 <arturo> install python3-pykube on tools-k8s-control-3 for some tests interaction with the API from python [tools]
2020-03-24 §
11:44 <arturo> trying to solve a rebase/merge conflict in labs/private.git in tools-puppetmaster-02 [tools]