501-550 of 10000 results (25ms)
2020-09-30 §
06:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2085:3318', diff saved to https://phabricator.wikimedia.org/P12846 and previous config saved to /var/cache/conftool/dbconfig/20200930-060705-marostegui.json [production]
05:43 <marostegui> Remove es2019 from tendril and zarcillo T264063 [production]
05:40 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
05:36 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
05:29 <marostegui> Reduce busy-time from 3600 to 1800 on labsdb1010 [production]
02:30 <eileen> process-control config revision is 646817a2c0 [production]
00:41 <tgr@deploy1001> Synchronized php-1.36.0-wmf.11/extensions/GrowthExperiments/: Backport: [[gerrit:630801|Ensure variant A homepage sidebar is always at least 300px (T263905)]] (duration: 01m 01s) [production]
2020-09-29 §
23:35 <mutante> created testvm3001.esams.wmnet to test install3001 [production]
23:30 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
23:24 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable Echo app push on all Wikipedias (T262936) (duration: 00m 59s) [production]
23:20 <Urbanecm> Evening B&C window completed [production]
23:19 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 68d7af9cb38de09b4cb8655f0b095b60d470fbbc: Enable watchlist expiry feature (wikisource; T260461) (duration: 00m 58s) [production]
23:18 <eileen> process-control config revision is 8b39770e93 [production]
23:13 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: bc6dda2885906b2561c757b4ac54c90c052b8df0: Enable watchlist expiry feature (T260461) (duration: 00m 58s) [production]
23:03 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
22:52 <eileen> process-control config revision is 16a6dcafd6 [production]
22:49 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
22:48 <eileen> civicrm revision changed from 035ad1c351 to 06a5289d1a, config revision is 2622fd2c09 [production]
22:45 <eileen> process-control config revision is 2622fd2c09 jobs disabled [production]
22:33 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
22:26 <mutante> phab1001 - re-enabled puppet and running it [production]
22:24 <ejegg> CiviCRM rolled back from 4aa0aeccd1 to 035ad1c351 [production]
22:16 <eileen> civicrm revision changed from 035ad1c351 to 4aa0aeccd1, config revision is b9120969bf [production]
21:59 <mutante> temp. disabled puppet on phab1001 [production]
21:49 <mutante> restarted aphlict service on aphlict1001 [production]
21:47 <twentyafterfour@deploy1001> Finished scap: testwikis wikis to 1.36.0-wmf.10 (duration: 13m 45s) [production]
21:34 <twentyafterfour@deploy1001> Started scap: testwikis wikis to 1.36.0-wmf.10 [production]
21:30 <mutante> started DHCP service on install2003 again [production]
21:22 <mutante> temp stopping DHCP service on install2003 for a test [production]
21:09 <mutante> rebooting testvm5001 for install test after switching DHCP/TFTP in eqsin to new dedicated VM [production]
21:02 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:00 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:55 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:55 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:54 <cdanis@cumin1001> dbctl commit (dc=all): 'depool db2125', diff saved to https://phabricator.wikimedia.org/P12843 and previous config saved to /var/cache/conftool/dbconfig/20200929-205453-cdanis.json [production]
20:51 <mutante> DHCP server for EQSIN switched from bast5001 to install5001 (T252526) [production]
20:45 <twentyafterfour@deploy1001> Finished scap: testwikis to 1.36.0-wmf.11 refs T263177 (duration: 69m 57s) [production]
19:44 <andrewbogott> apt-get update && apt-get upgrade on wikitech-static [production]
19:40 <mutante> temp. disabling puppet on ms-fe (swift-proxy) hosts, applying puppet refactoring change carefully [production]
19:35 <twentyafterfour@deploy1001> Started scap: testwikis to 1.36.0-wmf.11 refs T263177 [production]
19:29 <twentyafterfour> Checked out mediawiki 1.36.0-wmf.11 on deploy1001 see T263177 [production]
17:30 <hnowlan> ported cassandra-tools-wmf to wikimedia-buster [production]
17:12 <jbond42> update libdbi-perl on dbmonitor1001 and helium [production]
17:02 <jbond42> re-enable puppet to post deploy puppetdb change [production]
16:57 <jbond42> disable puppet to deploy puppetdb change [production]
16:34 <chaomodus> deploying eqsin automated DNS [production]
15:51 <ppchelko@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
15:48 <hnowlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
15:47 <hnowlan@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
15:47 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]