4551-4600 of 10000 results (41ms)
2021-05-04 ยง
23:28 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 5b4c516a1d0461065e27cacec5d2b1cb315a2c07: Enable Growth team features in dark mode on bgwiki (T280824; 1/3) (duration: 01m 09s) [production]
23:26 <Urbanecm> Create tables for GrowthExperiments extension on enwiki (T281896) [production]
23:24 <Urbanecm> Create tables for GrowthExperiments extension on bgwiki (T280824) [production]
23:22 <urbanecm@deploy1002> Synchronized wmf-config/CommonSettings.php: a3c24f322b754c9a94c260ee5df4b5ae4de27f22: Avoid using User::getGroups() and ::getEffectiveGroups() (T281823) (duration: 01m 10s) [production]
23:13 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: e467d92e5e257a3d2f9b05692db9accdd86ddb00: Add extendedconfirmed on ptwiki (T281926) (duration: 01m 10s) [production]
23:06 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 012d6138741ea76c985453428111aeddfdec2271: Add extendedconfirmed on azwiki (T281860) (duration: 01m 10s) [production]
22:49 <bblack@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on cp5016.eqsin.wmnet with reason: REIMAGE [production]
22:47 <bblack@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on cp5015.eqsin.wmnet with reason: REIMAGE [production]
22:46 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp5014.eqsin.wmnet with reason: REIMAGE [production]
22:44 <bblack@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp5016.eqsin.wmnet with reason: REIMAGE [production]
22:44 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp5013.eqsin.wmnet with reason: REIMAGE [production]
22:42 <bblack@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp5015.eqsin.wmnet with reason: REIMAGE [production]
22:42 <bblack@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp5014.eqsin.wmnet with reason: REIMAGE [production]
22:42 <bblack@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp5013.eqsin.wmnet with reason: REIMAGE [production]
21:30 <eileen> civicrm revision changed from 33a63d5789 to 94e321dbe0, config revision is a212d6ab23 [production]
21:17 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@06a4a3e]: Bump glent to 0.2.4 (duration: 03m 55s) [production]
21:13 <ebernhardson@deploy1002> Started deploy [wikimedia/discovery/analytics@06a4a3e]: Bump glent to 0.2.4 [production]
20:13 <pt1979@cumin2001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:10 <pt1979@cumin2001> START - Cookbook sre.dns.netbox [production]
20:09 <joal@deploy1002> Finished deploy [analytics/refinery@0dc3ae7] (hadoop-test): Regular analytics weekly train HADOOP-TEST [analytics/refinery@0dc3ae7] (duration: 05m 16s) [production]
20:04 <joal@deploy1002> Started deploy [analytics/refinery@0dc3ae7] (hadoop-test): Regular analytics weekly train HADOOP-TEST [analytics/refinery@0dc3ae7] [production]
20:03 <joal@deploy1002> Finished deploy [analytics/refinery@0dc3ae7] (thin): Regular analytics weekly train THIN [analytics/refinery@0dc3ae7] (duration: 00m 07s) [production]
20:03 <joal@deploy1002> Started deploy [analytics/refinery@0dc3ae7] (thin): Regular analytics weekly train THIN [analytics/refinery@0dc3ae7] [production]
20:03 <joal@deploy1002> Finished deploy [analytics/refinery@0dc3ae7]: Regular analytics weekly train [analytics/refinery@0dc3ae7] (duration: 17m 15s) [production]
19:46 <joal@deploy1002> Started deploy [analytics/refinery@0dc3ae7]: Regular analytics weekly train [analytics/refinery@0dc3ae7] [production]
19:38 <dancy@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.37.0-wmf.4 [production]
17:58 <dancy@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.4 (duration: 42m 33s) [production]
17:26 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@0c4538f]: Increase convert_to_esbulk memory overhead (duration: 01m 46s) [production]
17:24 <ebernhardson@deploy1002> Started deploy [wikimedia/discovery/analytics@0c4538f]: Increase convert_to_esbulk memory overhead [production]
17:16 <dancy@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.4 [production]
17:02 <brennen> 1.37.0-wmf.4 was branched at f069fd8b5a6c817f4860fa68ae2f56b71a139f4a for T281145 [production]
17:00 <volans> uploaded spicerack_0.0.51 to apt.wikimedia.org bullseye-wikimedia [production]
16:26 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@e6ae572]: Increase convert_to_esbulk memory overhead (duration: 01m 54s) [production]
16:25 <ebernhardson@deploy1002> Started deploy [wikimedia/discovery/analytics@e6ae572]: Increase convert_to_esbulk memory overhead [production]
16:16 <dzahn@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
16:15 <dzahn@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
16:13 <mutante> k8s: upgrading release=namespaces, helmfile apply to create miscweb namespace T281538 [production]
16:13 <dzahn@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
16:12 <hnowlan@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
16:12 <hnowlan@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
16:12 <dzahn@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
16:07 <hnowlan@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
16:07 <hnowlan@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
15:59 <hnowlan@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
15:59 <hnowlan@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
14:41 <jmm@cumin2001> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) [production]
13:46 <moritzm> installing exim security updates on buster [production]
13:39 <marostegui@cumin1001> dbctl commit (dc=all): 'db1137 (re)pooling @ 100%: Repool db1137 after mysql upgrade', diff saved to https://phabricator.wikimedia.org/P15721 and previous config saved to /var/cache/conftool/dbconfig/20210504-133950-root.json [production]
13:24 <marostegui@cumin1001> dbctl commit (dc=all): 'db1137 (re)pooling @ 75%: Repool db1137 after mysql upgrade', diff saved to https://phabricator.wikimedia.org/P15720 and previous config saved to /var/cache/conftool/dbconfig/20210504-132446-root.json [production]
13:14 <moritzm> upgrading linux-libc-dev on buster hosts (to version introduced by 10.9 point release) [production]