46 results (12ms)
2024-02-05 §
20:02 <taavi> upgrade docker on upgrader-06 to fix building the worker image [library-upgrader]
17:21 <taavi> add James_F, Amir1, Reedy and myself to labs-libraryupgrader Gerrit group T345930 [library-upgrader]
2024-02-03 §
11:26 <taavi> cleanup /srv/data/cache on upgrader-06.library-upgrader, freed up 75% of that 60G disk [library-upgrader]
11:25 <taavi> raise trove quota to 30G T356560 [library-upgrader]
2024-01-30 §
22:21 <bd808> Restarted libup-db02 instance via Horizon to try to fix "Instance 7d785002-371c-4a72-973f-629a6a4f3084 is not currently available for an action to be performed (instance status was ACTIVE)." [library-upgrader]
2023-01-26 §
06:35 <legoktm> libup@upgrader-06:/srv/libraryupgrader$ pip install -U wikimediaci-utils hotfix [library-upgrader]
2022-10-06 §
01:44 <legoktm> deleted stuff from upgrader-06 because it ran out of disk space oops [library-upgrader]
2022-10-05 §
04:51 <legoktm> rebooting libup-db02, unsure what's wrong [library-upgrader]
04:47 <legoktm> rebooting libup-web02 after I fixed the full root partition :/ [library-upgrader]
2021-11-08 §
05:20 <legoktm> deleting libup-db01, replaced by trove [library-upgrader]
2021-11-06 §
22:03 <legoktm> deleting libup-web01 instance [library-upgrader]
22:03 <legoktm> disabled libup-web unit on `upgrader-06` instance [library-upgrader]
22:00 <legoktm> https://libraryupgrader2.wmcloud.org/ now points to libup-web02, which is fully containerized and auto-deployed via the deployment pipeline [library-upgrader]
21:35 <legoktm> launching libup-web02 (bullseye) to replace libup-web01 [library-upgrader]
21:26 <legoktm> shutting down libup-db01, will delete in a few days [library-upgrader]
20:57 <legoktm> launching libup-db02 via trove to replace libup-db01 [library-upgrader]
2021-10-25 §
17:00 <legoktm> temporarily stopped libup-celery service to test new monitoring/alerting [library-upgrader]
2021-08-25 §
08:26 <legoktm> restarted failed libup-push systemd unit and cleared queue to avoid pushing really old patches [library-upgrader]
2021-04-15 §
09:44 <arturo> bumping quota: 16->20GB RAM, 8->10 CPUs (T280103) [library-upgrader]
2021-04-09 §
08:12 <legoktm> importing mysql database on libup-db01 [library-upgrader]
07:34 <legoktm> creating libup-db01 instance [library-upgrader]
07:32 <legoktm> deleting libup-diff01 experiment and upgrader-07 (puppet tests) instances [library-upgrader]
2021-03-05 §
05:01 <legoktm> sudo systemctl enable libup-push [library-upgrader]
04:11 <legoktm> added SSH key to ssh-agent [library-upgrader]
2020-10-26 §
23:51 <legoktm> added key to ssh-agent and started libup-celery [library-upgrader]
2020-09-03 §
21:50 <legoktm> added libraryupgrader2.wmcloud.org DNS proxy and remove wmflabs.org one for automatic redirect (T261995) [library-upgrader]
2020-06-23 §
02:52 <legoktm> created libup-diff01 instance [library-upgrader]
02:41 <legoktm> deleted upgrader-05 instace, which has been shutoff for a while now [library-upgrader]
2020-03-24 §
06:33 <legoktm> building fresh docker image [library-upgrader]
2020-01-10 §
09:34 <legoktm> shutdown upgrader-05 instance [library-upgrader]
07:52 <legoktm> switched over libraryupgrader2.wmflabs.org to point to upgrader06 [library-upgrader]
06:59 <legoktm> upgrader06: adduser libup && adduser libup docker [library-upgrader]
06:59 <legoktm> upgrader06: enabling buster-wikimedia/thirdparty/kubeadm-k8s apt repo and installing docker-ce [library-upgrader]
06:53 <legoktm> disabling all services on upgrader-05 [library-upgrader]
06:33 <legoktm> creating upgrader-06 instance, large flavor this time [library-upgrader]
2019-12-28 §
23:49 <legoktm> deleting upgrader-04 instance (T236559) [library-upgrader]
2019-12-20 §
01:14 <legoktm> moved a lot of old logs into /srv/data/archive/ [library-upgrader]
2019-12-14 §
22:56 <legoktm> dropped concurrency down to 1 [library-upgrader]
22:52 <legoktm> restarted libup-celery now that gerrit-replica has been restarted [library-upgrader]
20:06 <legoktm> systemctl stop libup-celery # because of T240763 [library-upgrader]
11:47 <legoktm> temporarily bump concurrency to 2 to clear backlog [library-upgrader]
2019-10-13 §
22:45 <legoktm> rebooting upgrader-05 because of DNS failures when run in docker [library-upgrader]
2019-07-31 §
04:15 <legoktm> added ssh key to libraryupgrader Gerrit account that lives on upgrader-05 [library-upgrader]
2019-06-21 §
04:49 <legoktm> set up new upgrader-05 stretch instance (using docker from upstream docker's repo :((), using run.py as a stress test [library-upgrader]
2019-06-11 §
15:03 <legoktm> -04 has a full disk, and is broked. oops. [library-upgrader]
2018-11-14 §
15:09 <andrewbogott> migrating project to eqiad1-r [library-upgrader]