6451-6500 of 10000 results (34ms)
2020-11-08 §
06:31 <elukey> truncate huge log file on an-worker1103 for app id application_1601916545561_147041 [analytics]
2020-11-07 §
11:41 <Jayprakash12345> Deploying T267473 T267471 [tools.indic-wscontest]
10:37 <Jayprakash12345> Fixed T267465 in production [tools.indic-wscontest]
00:16 <dpifke> Cherry-picking https://gerrit.wikimedia.org/r/c/operations/puppet/+/639885 and https://gerrit.wikimedia.org/r/c/performance/arc-lamp/+/639886 in beta. Should only affect deployment-webperf12. [releng]
2020-11-06 §
23:44 <bstorm> toolsbeta k8s cluster fully upgraded to 1.17.13 T263284 [toolsbeta]
23:38 <dwisehaupt> frdata1001 upgraded to buster [production]
22:40 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@bfaac0f]: Update to master, primarily updates for ores weekly predictions handling (duration: 01m 08s) [production]
22:39 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@bfaac0f]: Update to master, primarily updates for ores weekly predictions handling [production]
22:29 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@dc63e7e]: Update to master, primarily updates for ores weekly predictions handling (duration: 00m 26s) [production]
22:29 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@dc63e7e]: Update to master, primarily updates for ores weekly predictions handling [production]
21:23 <bstorm> upgrading toolsbeta-test-k8s-control-1 to k8s 1.17.13 T263284 [toolsbeta]
20:57 <reedy@deploy1001> Synchronized php-1.36.0-wmf.16/skins/CologneBlue/: T267278 (duration: 01m 05s) [production]
20:56 <reedy@deploy1001> Synchronized php-1.36.0-wmf.14/skins/CologneBlue/: T267278 (duration: 01m 10s) [production]
20:07 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:05 <robh@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:00 <mforns> launched backfilling of data quality stats for os_family_entropy_by_access_method [analytics]
18:54 <cwhite@cumin1001> conftool action : set/pooled=no; selector: name=mw1379.eqiad.wmnet [production]
17:02 <dwisehaupt> rolled out new thank_you_mail_send process_control scripts to utilize frmx hosts [production]
16:45 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:44 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:44 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:44 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:44 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:44 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:20 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: dc=codfw,cluster=maps,service=kartotherian,name=maps2005.codfw.wmnet [production]
15:56 <dcaro> Deleting instances proxy-1 and proxy-2, that will finish the proxy rebuild (T267140) [toolsbeta]
15:53 <dcaro> Removing proxy-1 and proxy-3 from hiera, proxy-3 stays as active and proxy-4 as backup (T267140) [toolsbeta]
14:46 <moritzm> installing wireshark security updates [production]
14:36 <hnowlan> resyncing database on maps1001 [production]
14:25 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:24 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:05 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:03 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:01 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:01 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:18 <dcaro> bringin up a new proxy-4 instance as slave (T267140) [toolsbeta]
13:18 <dcaro> bringin up a new proxy-4 instance as slave [toolsbeta]
13:05 <hnowlan> started cassandra bootstrap of maps2005 [production]
11:52 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:50 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:49 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:47 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:30 <hnowlan> joining maps2005 to cassandra cluster [production]
11:24 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:22 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:20 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:19 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:09 <moritzm> uploaded openjdk-8 8u272-b10-1~deb10u1 to buster-wikimedia/component/jdk [production]
10:54 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
10:52 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]