1-50 of 88 results (24ms)
2023-07-04 §
12:32 <taavi> configure DKIM signing for wmflabs.org and wmcloud.org on mx-out servers T208281 [cloudinfra]
2023-06-19 §
08:39 <arturo> update delegation for codfw1dev.wmcloud.org. to point to ns0/ns1 T307357 [cloudinfra]
2023-06-12 §
15:56 <arturo> live-hacking cloudinfra-internal-puppetmaster-02 with https://gerrit.wikimedia.org/r/c/operations/puppet/+/929357 [cloudinfra]
10:40 <arturo> update codfw1dev.wmcloud.org NS records to point to ns.openstack.wikimediacloud.org (T307357) [cloudinfra]
2023-06-08 §
08:05 <taavi> [codfw1dev] start mariadb.service on cloudinfra-db-01 [cloudinfra]
2023-06-01 §
13:27 <dhinus> cloud-cumin-04 successfully restored from backup (T332734) [cloudinfra]
13:09 <dhinus> shutting down cloud-cumin-04 and restoring from backup, to test backups are working (T332734) [cloudinfra]
2023-05-10 §
17:16 <wm-bot2> Increased quotas by 8 cores, 16384 ram (T336423) - cookbook ran by taavi@runko [cloudinfra]
2023-04-17 §
15:05 <taavi> add firewall rules allowing public (authenticated) access to the enc api - T317478 [cloudinfra]
2023-02-16 §
15:49 <arturo> aborrero@cloud-cumin-03:~$ sudo keyholder arm (password in pw) [cloudinfra]
2023-02-14 §
08:09 <taavi> arm keyholder on enc-2 T329589 [cloudinfra]
00:18 <bd808> enc-2.cloudinfra.eqiad1.wikimedia.cloud: `shutdown -r now` (T329589) [cloudinfra]
00:13 <bd808> enc-2.cloudinfra.eqiad1.wikimedia.cloud: `service puppet-enc-git-worker restart` (T329589) [cloudinfra]
2023-02-13 §
23:59 <bd808> enc-1.cloudinfra.eqiad1.wikimedia.cloud: `service uwsgi-puppet-enc restart` (T329589) [cloudinfra]
2023-01-03 §
15:17 <taavi> enc: create git update sql tables for https://gerrit.wikimedia.org/r/c/operations/puppet/+/871298 [cloudinfra]
2022-12-21 §
13:58 <taavi> re-enable puppet on cloud-cumin-03 [cloudinfra]
2022-10-14 §
14:07 <wm-bot2> Increased quotas by 1 instances - cookbook ran by dcaro@vulcanus [cloudinfra]
2022-07-20 §
07:03 <dcaro> manually running fsck through costole on puppetmaster-03 do to disk errors (T313380) [cloudinfra]
06:54 <dcaro> rebooting puppetmaster-03 do to disk errors [cloudinfra]
2022-02-16 §
14:44 <taavi> delete old cloudinfra-db instances (cloudinfra-db01 cloudinfra-db02) [cloudinfra]
12:10 <taavi> enable gtid (master_use_gtid=current_pos) on cloudinfra-db04 [cloudinfra]
2022-02-13 §
17:14 <taavi> encapi db switchover: cloudinfra-db01 -> cloudinfra-db03 [cloudinfra]
11:38 <taavi> generate new profile::mariadb::grants::cloudinfra::repl_pass, previous one seems to have been lost in the 2020-06-04 labs/private incident [cloudinfra]
10:48 <taavi> shutdown and delete ntp-01 and ntp-02 running stretch, replaced by -03 and -04 [cloudinfra]
2022-02-11 §
15:41 <taavi> switch floating ip 185.15.56.3 from ntp-01 to ntp-03 [cloudinfra]
15:18 <taavi> switch floating ip 185.15.56.27 from ntp-02 to ntp-04 [cloudinfra]
2022-02-09 §
18:33 <taavi> deleted cloud-cumin-01 T255980 [cloudinfra]
18:31 <taavi> deleted cloud-cumin-02 T255980 [cloudinfra]
2022-01-06 §
13:18 <taavi> shut down cloud-cumin-02 T255980 [cloudinfra]
2021-11-11 §
10:50 <arturo> add user `srv-networktests` as project user (T294955) [cloudinfra]
2021-11-04 §
16:42 <majavah> provisioning cloud-cumin-03 as bullseye [cloudinfra]
2021-10-06 §
09:47 <dcaro> upgraded cloudmetrics to grafana 7.5 (T292614) [cloudinfra]
2021-07-19 §
22:49 <bstorm> fixed rebase conflicts in labs-private [cloudinfra]
22:43 <bstorm> disabling puppet on entire project before meddling with labs-private rebase [cloudinfra]
2021-05-05 §
14:33 <arturo> delete also old VMs mx-out01/02 [cloudinfra]
14:33 <arturo> delete zones 'mx-out01.wmflabs.org' and 'mx-out02.wmflabs.org' [cloudinfra]
2021-05-04 §
15:58 <arturo> shutoff mx-out01 and mx-out02 (migrated to mx-out03/mx-out04) [cloudinfra]
15:56 <arturo> relocate floating IPs 185.15.56.18 and .19 from mx-out01/mx-out02 to mx-out03/mx-out04 [cloudinfra]
15:33 <arturo> created VMs mx-out03/mx-out04 as debian buster [cloudinfra]
15:31 <arturo> bump instance quota from 12 to 14 [cloudinfra]
15:28 <arturo> created anti-affinity server group 'mx' [cloudinfra]
2021-03-01 §
10:37 <dcaro> rebooting cloudinfra-acme-chief-01 to ensure hostname stability (T276041) [cloudinfra]
2021-02-26 §
20:46 <andrewbogott> rebooting all hosts [cloudinfra]
2021-01-08 §
09:04 <dcaro> manually testing patch https://gerrit.wikimedia.org/r/c/operations/puppet/+/655019 to the puppetmaster to test (T271509) [cloudinfra]
2021-01-07 §
09:49 <dcaro> Added recordset for mx-out02.wmflabs.org (T271322) [cloudinfra]
09:46 <dcaro> Added recordset for mx-out01.wmflabs.org (T271322) [cloudinfra]
2021-01-05 §
14:11 <dcaro> finished ssl tests for enc, cleaned up cloud-puppetmaster-03 (T268877) [cloudinfra]
13:07 <dcaro> adding custom nginx config for labspuppetbackend on cloud-puppetmaster-03 to test ssl (T268877) [cloudinfra]
12:41 <arturo> live-hacking cloudinfra-internal-puppetmaster02 with https://gerrit.wikimedia.org/r/c/operations/puppet/+/654415 (T260834) [cloudinfra]
12:31 <arturo> refresh acme-chief config for mx certs https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/instance-puppet/+/949f1b4e81f3a1c6d4f4825292343f1ee17c48a1%5E%21/ (T260834) [cloudinfra]