3701-3750 of 10000 results (33ms)
2020-09-30 §
07:01 <elukey@deploy1001> Finished deploy [analytics/superset/deploy@7bdc414]: Upgrade to 0.37.2 (duration: 00m 49s) [production]
07:00 <elukey@deploy1001> Started deploy [analytics/superset/deploy@7bdc414]: Upgrade to 0.37.2 [production]
06:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool es2016 T264156', diff saved to https://phabricator.wikimedia.org/P12850 and previous config saved to /var/cache/conftool/dbconfig/20200930-065838-marostegui.json [production]
06:21 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.init-hadoop-workers (exit_code=0) [production]
06:19 <elukey@cumin1001> START - Cookbook sre.hadoop.init-hadoop-workers [production]
06:10 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2082', diff saved to https://phabricator.wikimedia.org/P12849 and previous config saved to /var/cache/conftool/dbconfig/20200930-061036-marostegui.json [production]
06:10 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2082', diff saved to https://phabricator.wikimedia.org/P12848 and previous config saved to /var/cache/conftool/dbconfig/20200930-061005-marostegui.json [production]
06:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2085:3318', diff saved to https://phabricator.wikimedia.org/P12847 and previous config saved to /var/cache/conftool/dbconfig/20200930-060754-marostegui.json [production]
06:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2085:3318', diff saved to https://phabricator.wikimedia.org/P12846 and previous config saved to /var/cache/conftool/dbconfig/20200930-060705-marostegui.json [production]
05:43 <marostegui> Remove es2019 from tendril and zarcillo T264063 [production]
05:40 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
05:36 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
05:29 <marostegui> Reduce busy-time from 3600 to 1800 on labsdb1010 [production]
02:30 <eileen> process-control config revision is 646817a2c0 [production]
00:41 <tgr@deploy1001> Synchronized php-1.36.0-wmf.11/extensions/GrowthExperiments/: Backport: [[gerrit:630801|Ensure variant A homepage sidebar is always at least 300px (T263905)]] (duration: 01m 01s) [production]
2020-09-29 §
23:35 <mutante> created testvm3001.esams.wmnet to test install3001 [production]
23:30 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
23:24 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable Echo app push on all Wikipedias (T262936) (duration: 00m 59s) [production]
23:20 <Urbanecm> Evening B&C window completed [production]
23:19 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 68d7af9cb38de09b4cb8655f0b095b60d470fbbc: Enable watchlist expiry feature (wikisource; T260461) (duration: 00m 58s) [production]
23:18 <eileen> process-control config revision is 8b39770e93 [production]
23:13 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: bc6dda2885906b2561c757b4ac54c90c052b8df0: Enable watchlist expiry feature (T260461) (duration: 00m 58s) [production]
23:03 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
22:52 <eileen> process-control config revision is 16a6dcafd6 [production]
22:49 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
22:48 <eileen> civicrm revision changed from 035ad1c351 to 06a5289d1a, config revision is 2622fd2c09 [production]
22:45 <eileen> process-control config revision is 2622fd2c09 jobs disabled [production]
22:33 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
22:26 <mutante> phab1001 - re-enabled puppet and running it [production]
22:24 <ejegg> CiviCRM rolled back from 4aa0aeccd1 to 035ad1c351 [production]
22:16 <eileen> civicrm revision changed from 035ad1c351 to 4aa0aeccd1, config revision is b9120969bf [production]
21:59 <mutante> temp. disabled puppet on phab1001 [production]
21:49 <mutante> restarted aphlict service on aphlict1001 [production]
21:47 <twentyafterfour@deploy1001> Finished scap: testwikis wikis to 1.36.0-wmf.10 (duration: 13m 45s) [production]
21:34 <twentyafterfour@deploy1001> Started scap: testwikis wikis to 1.36.0-wmf.10 [production]
21:30 <mutante> started DHCP service on install2003 again [production]
21:22 <mutante> temp stopping DHCP service on install2003 for a test [production]
21:09 <mutante> rebooting testvm5001 for install test after switching DHCP/TFTP in eqsin to new dedicated VM [production]
21:02 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:00 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:55 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:55 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:54 <cdanis@cumin1001> dbctl commit (dc=all): 'depool db2125', diff saved to https://phabricator.wikimedia.org/P12843 and previous config saved to /var/cache/conftool/dbconfig/20200929-205453-cdanis.json [production]
20:51 <mutante> DHCP server for EQSIN switched from bast5001 to install5001 (T252526) [production]
20:45 <twentyafterfour@deploy1001> Finished scap: testwikis to 1.36.0-wmf.11 refs T263177 (duration: 69m 57s) [production]
19:44 <andrewbogott> apt-get update && apt-get upgrade on wikitech-static [production]
19:40 <mutante> temp. disabling puppet on ms-fe (swift-proxy) hosts, applying puppet refactoring change carefully [production]
19:35 <twentyafterfour@deploy1001> Started scap: testwikis to 1.36.0-wmf.11 refs T263177 [production]
19:29 <twentyafterfour> Checked out mediawiki 1.36.0-wmf.11 on deploy1001 see T263177 [production]
17:30 <hnowlan> ported cassandra-tools-wmf to wikimedia-buster [production]