251-300 of 10000 results (64ms)
2019-11-09 §
18:30 <Krenair> Drop internal-puppetmaster old cherry-pick of https://gerrit.wikimedia.org/r/c/operations/puppet/+/545567 which was preventing rebase and blocking cloud-puppetmaster machines from getting puppet commits themselves - new version of that change will have appeared there in the rebase [cloudinfra]
02:39 <volker-e@deploy1001> Finished deploy [design/style-guide@d2bfc09]: Deploy design/style-guide: (duration: 00m 07s) [production]
02:39 <volker-e@deploy1001> Started deploy [design/style-guide@d2bfc09]: Deploy design/style-guide: [production]
01:07 <volker-e@deploy1001> Finished deploy [design/style-guide@ef82b69]: Deploy design/style-guide: (duration: 00m 07s) [production]
01:07 <volker-e@deploy1001> Started deploy [design/style-guide@ef82b69]: Deploy design/style-guide: [production]
01:06 <volker-e@deploy1001> Finished deploy [design/style-guide@97fb3ee]: Deploy design/style-guide: (duration: 00m 09s) [production]
01:06 <volker-e@deploy1001> Started deploy [design/style-guide@97fb3ee]: Deploy design/style-guide: [production]
2019-11-08 §
22:47 <bstorm_> adding rsync::server::wrap_with_stunnel: false to the tools-docker-registry-03/4 servers to unbreak puppet [tools]
20:34 <bstorm_> Added 10G to RAM quota to allow spinning up a bigmem instance T237354 [language]
20:26 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: MachineVision: Delay annotation request jobs by 5 mins for testing (duration: 00m 52s) [production]
19:36 <bstorm_> rebooted the proxy server just in case that fixes something. [toolsbeta]
18:40 <bstorm_> pushed new webservice package to the bastions T230961 [tools]
18:37 <bstorm_> pushed new webservice package supporting buster containers to repo T230961 [tools]
18:36 <bstorm_> pushed buster-sssd images to the docker repo [tools]
17:46 <MaxSem> Upgraded php7.2 on deployment-mwmaint01, was too old for MW [deployment-prep]
17:46 <MaxSem> Upgraded php7.2 on deployment-mwmaint01, was too old for MW [releng]
17:22 <wm-bot> <lucaswerkmeister> deployed 32bb3fcae6 (silence bs4 warning) [tools.quickcategories]
17:15 <phamhi> pushed new buster images with the prefix name "toolforge" [tools]
16:54 <jeh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:52 <jeh@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:19 <jeh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:15 <jeh@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:15 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Revert "MachineVision: Enable testers-only mode on testcommonswiki for debugging" (duration: 00m 54s) [production]
15:57 <jynus@cumin1001> dbctl commit (dc=all): 'Pool db1118, db1106 at 100%', diff saved to https://phabricator.wikimedia.org/P9582 and previous config saved to /var/cache/conftool/dbconfig/20191108-155700-jynus.json [production]
15:50 <James_F> Zuul: Add BlueSpiceBookshelf and BlueSpiceBookshelfUI [releng]
15:37 <herron> beginning rolling service restarts on logstash hosts for java security updates [production]
15:13 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: MachineVision: Enable testers-only mode on testcommonswiki for debugging (duration: 00m 52s) [production]
14:56 <volans@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
14:55 <volans@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:50 <jynus@cumin1001> dbctl commit (dc=all): 'Pool db1118 at 50%', diff saved to https://phabricator.wikimedia.org/P9581 and previous config saved to /var/cache/conftool/dbconfig/20191108-145028-jynus.json [production]
14:42 <volans@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:40 <volans@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:40 <jynus> stop and upgrade percona-server on test host db1114 [production]
13:27 <elukey@cumin1001> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) [production]
13:21 <arturo> syncing puppet facts from tools-puppetmaster-01.eqiad.wmflabs [puppet-diffs]
13:18 <arturo> syncing puppet facts from puppetmaster1001.eqiad.wmnet [puppet-diffs]
13:12 <jynus@cumin1001> dbctl commit (dc=all): 'Pool db1118 at 20%', diff saved to https://phabricator.wikimedia.org/P9580 and previous config saved to /var/cache/conftool/dbconfig/20191108-131257-jynus.json [production]
13:09 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: ee2027c: Change the language of Votewiki back to English (en) (T230614) (duration: 00m 54s) [production]
12:58 <paladox> rebuilding gerrit-test6 as gerrit-test7 [git]
12:34 <elukey> roll restart cassandra on aqs to pick up new openjdk upgrades [analytics]
12:34 <elukey@cumin1001> START - Cookbook sre.cassandra.roll-restart [production]
12:22 <elukey> restart oozie and hive daemons on an-coord1001 [analytics]
12:14 <jynus@cumin1001> dbctl commit (dc=all): 'Pool db1118 at 10%', diff saved to https://phabricator.wikimedia.org/P9578 and previous config saved to /var/cache/conftool/dbconfig/20191108-121444-jynus.json [production]
12:02 <jynus> update and restart db1118 [production]
12:01 <jynus@cumin1001> dbctl commit (dc=all): 'Depool db1118 fully', diff saved to https://phabricator.wikimedia.org/P9577 and previous config saved to /var/cache/conftool/dbconfig/20191108-120138-jynus.json [production]
11:58 <arturo> adding `profile::toolforge::bastion::nproc: 100` to puppet prefix `toolsbeta-sgebastion` (T236202) [toolsbeta]
11:55 <jynus@cumin1001> dbctl commit (dc=all): 'Pool db1118 at 20%', diff saved to https://phabricator.wikimedia.org/P9576 and previous config saved to /var/cache/conftool/dbconfig/20191108-115553-jynus.json [production]
11:38 <arturo> new k8s: refresh deployment for nginx-ingress with latest changes from puppet [toolsbeta]
11:27 <jynus@cumin1001> dbctl commit (dc=all): 'Pool db1118 at 50%', diff saved to https://phabricator.wikimedia.org/P9575 and previous config saved to /var/cache/conftool/dbconfig/20191108-112733-jynus.json [production]
11:25 <jynus@cumin1001> dbctl commit (dc=all): 'repool db2130', diff saved to https://phabricator.wikimedia.org/P9574 and previous config saved to /var/cache/conftool/dbconfig/20191108-112503-jynus.json [production]