1201-1250 of 10000 results (28ms)
2020-07-23 §
21:29 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:27 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:21 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@c99c626]: airflow: centralize installation specific airflow Variables (duration: 00m 34s) [production]
21:20 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@c99c626]: airflow: centralize installation specific airflow Variables [production]
21:02 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:00 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:59 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:58 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
20:58 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
20:58 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
20:58 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
20:58 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:58 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:58 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:58 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:58 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:13 <mholloway-shell@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
19:11 <mholloway-shell@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
19:09 <mholloway-shell@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . [production]
18:51 <ryankemper> restarted blazegraph on codfw wdqs2001 [production]
18:44 <ryankemper> Restarted blazegraph on following codfw wdqs nodes: 2007, 2003, and 2002 [production]
18:39 <Amir1> BACC is done [production]
18:29 <ladsgroup@deploy1001> Synchronized wmf-config/Wikibase.php: [[gerrit:613235|Load WikibaseClient from extension.json file instead of php one (T257437 T256228 T88258)]] (duration: 01m 05s) [production]
18:21 <mutante> testreduce1001 - rm -rf /srv/testreduce and run puppet to re-clone testreduce to it from the scandium branch (T257906) [production]
18:13 <ryankemper> restarted blazegraph on 2001 [production]
17:59 <ryankemper> sudo -E cumin -b 10 'A:wdqs-all and not A:wdqs-test and not P{wdqs1003.eqiad.wmnet} and not P{wdqs2001.codfw.wmnet}' 'sudo systemctl restart wdqs-blazegraph.service' [production]
17:53 <cdanis> ❌cdanis@cumin1001.eqiad.wmnet ~ 🕑☕ sudo cumin -b10 'wdqs*' "run-puppet-agent --unless-version 1a4ae81" [production]
17:52 <cdanis@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=wdqs.*,name=codfw [production]
17:35 <cdanis@cumin1001> conftool action : set/pooled=false; selector: dnsdisc=wdqs.*,name=codfw [production]
17:22 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-reload [production]
16:57 <ryankemper@cumin1001> END (ERROR) - Cookbook sre.wdqs.data-reload (exit_code=97) [production]
16:56 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-reload [production]
15:36 <urbanecm@deploy1001> Synchronized private/PrivateSettings.php: Update T250887 mitigations (duration: 01m 05s) [production]
13:49 <akosiaris@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=helm-charts,name=.* [production]
12:29 <marostegui> Decrease labsdb1009 weight a bit, as it is lagging again. [production]
12:23 <XioNoX> remove bogus lo0 IPs from cr3-knams [production]
12:21 <Urbanecm> Stagging at mwdebug1001 ended, run scap pull to clean changes [production]
12:17 <Urbanecm> Stagging at mwdebug1001 again [production]
12:02 <Urbanecm> Stagging at mwdebug1001 ended, run scap pull to clean changes [production]
12:00 <Urbanecm> Stagging at mwdebug1001 [production]
11:49 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: 745ff20f53e4914cf6e1717c963419e74b68e693: Log ClosedWikiProviders start with info level (T258695) (duration: 01m 05s) [production]
11:48 <marostegui> Deploy MCR schema change on db1145:3314 [production]
11:36 <dcausse> European mid-day backport window done [production]
11:31 <dcausse@deploy1001> Synchronized php-1.36.0-wmf.1/extensions/Wikibase: T258507: Fix bug that causes wrong prefixes in RDF output (duration: 01m 11s) [production]
11:18 <akosiaris> depool scb in mobileapps/eqiad. T218733 [production]
11:17 <akosiaris@cumin1001> conftool action : set/pooled=no; selector: dc=eqiad,service=mobileapps,name=scb.* [production]
11:13 <dcausse@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T258474: [sdoc] fix entity source base URIs (duration: 01m 07s) [production]
10:27 <akosiaris@cumin1001> conftool action : set/weight=1; selector: dc=eqiad,service=mobileapps,name=scb.* [production]
10:27 <akosiaris@cumin1001> conftool action : set/weight=1; selector: dc=eqiad,service=mobileapps,name=scb* [production]
10:25 <akosiaris@cumin1001> conftool action : set/pooled=no; selector: dc=eqiad,service=mobileapps,name=scb1002.* [production]