6401-6450 of 10000 results (39ms)
2020-05-07 ยง
14:51 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:50 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:50 <moritzm> imported component/puppet5 for stretch-wikimedia into "main" [production]
14:49 <jayme@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . [production]
14:47 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:42 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
14:41 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:40 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
14:39 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:38 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:37 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:36 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:30 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
14:17 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
14:07 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
14:06 <moritzm> imported component/facter3 for jessie-wikimedia into "main" [production]
13:33 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:30 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:30 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:28 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:21 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:19 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:12 <hashar@deploy1001> rebuilt and synchronized wikiversions files: (no justification provided) [production]
13:04 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:04 <jynus> disabling puppet on all db hosts to control deployment of new paging alert T172489 [production]
13:02 <zpapierski@deploy1001> Finished deploy [wdqs/wdqs@94906d0]: Deploy WDQS 0.3.28 + GUI - new servers (duration: 02m 43s) [production]
13:01 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:59 <zpapierski@deploy1001> Started deploy [wdqs/wdqs@94906d0]: Deploy WDQS 0.3.28 + GUI - new servers [production]
12:50 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
12:48 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:43 <zpapierski@deploy1001> Finished deploy [wdqs/wdqs@94906d0]: Deploy WDQS 0.3.28 + GUI (duration: 16m 20s) [production]
12:27 <zpapierski@deploy1001> Started deploy [wdqs/wdqs@94906d0]: Deploy WDQS 0.3.28 + GUI [production]
12:13 <addshore@deploy1001> Synchronized php-1.35.0-wmf.31/extensions/Wikibase: [[gerrit:594920]] T252079 Revert "Move prefetching-term-lookup-callback service wiring" (duration: 01m 12s) [production]
12:12 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
12:10 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:55 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
11:53 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:33 <moritzm> imported component/puppet5 for jessie-wikimedia into "main" [production]
11:31 <jbond42> enable ferm-status script https://gerrit.wikimedia.org/r/c/operations/puppet/+/576102 [production]
11:10 <matthiasmullie> EU swat done [production]
11:07 <mlitn@deploy1001> Synchronized php-1.35.0-wmf.31/extensions/WikibaseMediaInfo/: [MediaInfo] Add dummy concept chips without thumbnail (duration: 01m 09s) [production]
10:07 <moritzm> installing Java security updates on restbase/sessionstore [production]
09:11 <elukey> roll restart cassandra on aqs1005 to pick up new openjdk upgrades (canary) [production]
08:32 <moritzm> upgrading restbase-dev to latest OpenJDK security update [production]
08:06 <jynus> setting pc2007, pc2009 as read-write [production]
07:44 <godog> further decrease weight for ms-be10[678] - T252008 [production]
05:49 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
05:45 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
05:33 <elukey> restart hadoop yarn nodemanager on analytics1071 [production]
05:22 <marostegui> Reimage db2078 [production]