501-550 of 10000 results (609ms)
2019-10-24 ยง
12:14 <bblack> depool esams in geodns [production]
12:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2092 after analyze table', diff saved to https://phabricator.wikimedia.org/P9468 and previous config saved to /var/cache/conftool/dbconfig/20191024-120812-marostegui.json [production]
12:06 <XioNoX> shutdown cr1-esams - cr2-knams link [production]
12:00 <XioNoX> shutdown transit BGP sessions on cr2-knams [production]
11:40 <Urbanecm> EU SWAT done [production]
11:35 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 3a5cb68: Permission changes of move-rootuserpages assignment at commonswiki (T236359) (duration: 01m 00s) [production]
11:33 <ema@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
11:31 <ema@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:30 <Urbanecm> Run mwscript namespaceDupes.php --wiki=commonswiki --add-prefix=FIXME --fix (T236352) [production]
11:28 <vgutierrez@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
11:26 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:26 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: e079956: Add CAT as alias for NS_CATEGORY at commonswiki (T236352) (duration: 01m 00s) [production]
11:22 <urbanecm@deploy1001> Synchronized dblists/commonsuploads.dblist: SWAT: 2d66deb: Restrict uploads on azwiki (T236307) (duration: 01m 03s) [production]
11:15 <mlitn@deploy1001> Synchronized php-1.35.0-wmf.3/extensions/WikibaseMediaInfo: Also use custom PrefetchingTermLookup in SingleEntitySourceServices (duration: 01m 01s) [production]
11:13 <mlitn@deploy1001> Synchronized php-1.35.0-wmf.3/extensions/Wikibase: Allow defining entity-type-specific PrefetchingTermLookup (duration: 01m 06s) [production]
11:08 <aborrero@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
11:08 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:08 <aborrero@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
11:08 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:00 <vgutierrez@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
10:58 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:56 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:56 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:56 <aborrero@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
10:56 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:56 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:56 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:56 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:56 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:56 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:56 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:56 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:56 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:55 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:55 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:55 <ema@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
10:52 <ema@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:18 <marostegui@cumin1001> dbctl commit (dc=all): 'Adjust s6 weights for db1093 and db1085', diff saved to https://phabricator.wikimedia.org/P9466 and previous config saved to /var/cache/conftool/dbconfig/20191024-101810-marostegui.json [production]
09:59 <hashar> Converting CI jobs to use the new PostBuildScript plugin config | https://gerrit.wikimedia.org/r/#/c/integration/config/+/544907/ | T188398 [production]
09:57 <hashar> Restarting CI Jenkins [production]
09:35 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:33 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:14 <vgutierrez@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
09:12 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:12 <gilles@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T234853 Re-enable performance perception survey on ruwiki (duration: 01m 04s) [production]
08:39 <vgutierrez@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
08:37 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:36 <godog> roll restart rsyslog in codfw/eqiad to pick up new kafka partitions [production]
08:18 <godog> roll restart rsyslog in ulsfo/esams/eqsin to pick up new kafka partitions [production]
08:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2092 for analyze table', diff saved to https://phabricator.wikimedia.org/P9465 and previous config saved to /var/cache/conftool/dbconfig/20191024-081519-marostegui.json [production]