501-550 of 10000 results (28ms)
2020-07-01 ยง
20:27 <eileen> tools revision changed from 6f38c14fe3 to 806e2b4412 - [production]
20:17 <longma> Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/c/integration/config/+/608500 [releng]
20:11 <eileen> tools revision changed from aab96444df to 6f38c14fe3 [production]
19:38 <mutante> creating instance relic-buster to eventually replace the existing relic-stretch (deprecated image) [toolserver-legacy]
19:23 <twentyafterfour> 1.35.0-wmf.39 is now deployed to group2 wikis, everything appears to be normal. refs T254176 [production]
19:18 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: group2 wikis to 1.35.0-wmf.39 refs T254176 [production]
19:14 <hashar> Pooling back integration-agent-docker-1003 , got disconnected by maintenance-disconnect-full-disks # 191095 [releng]
19:04 <joal> Kill/restart webrequest-load-bundle for mobile-pageview update [analytics]
18:59 <joal> kill/restart pageview-druid jobs (hourly, daily, monthly) for in_content_namespace field update [analytics]
18:57 <joal> kill/restart mediawiki-wikitext-history-coord and mediawiki-wikitext-current-coord for bz2 codec update [analytics]
18:55 <joal> kill/restart mediawiki-history-denormalize-coord after skewed-join strategy update [analytics]
18:52 <joal> Kill/Restart unique_devices-per_project_family-monthly-coord after fix [analytics]
18:43 <addshore@deploy1001> Synchronized wmf-config: REVERT T254315 Wikidata client wikis: Define entity sources configuration [[gerrit:569259]] (duration: 01m 04s) [production]
18:41 <addshore@deploy1001> sync-file aborted: T254315 Wikidata client wikis: Define entity sources configuration [[gerrit:569259]] (duration: 00m 38s) [production]
18:41 <joal> deploy refinery to HDFS [analytics]
18:38 <joal@deploy1001> Finished deploy [analytics/refinery@8b7bddf] (thin): Regular analytics weekly train THIN [analytics/refinery@8b7bddf] (duration: 02m 19s) [production]
18:36 <joal@deploy1001> Started deploy [analytics/refinery@8b7bddf] (thin): Regular analytics weekly train THIN [analytics/refinery@8b7bddf] [production]
18:35 <joal@deploy1001> Finished deploy [analytics/refinery@8b7bddf]: Regular analytics weekly train [analytics/refinery@8b7bddf] (duration: 08m 09s) [production]
18:28 <joal> Deploy refinery using scap after hotfix [analytics]
18:27 <joal@deploy1001> Started deploy [analytics/refinery@8b7bddf]: Regular analytics weekly train [analytics/refinery@8b7bddf] [production]
18:25 <joal@deploy1001> Finished deploy [analytics/refinery@114bfed]: Regular analytics weekly train [analytics/refinery@114bfed] (duration: 03m 41s) [production]
18:21 <joal@deploy1001> Started deploy [analytics/refinery@114bfed]: Regular analytics weekly train [analytics/refinery@114bfed] [production]
18:20 <joal> Deploy refinery using scap [analytics]
18:18 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: Enable kafka purges on wikitech gerrit:607590 IS-labs.php (duration: 01m 03s) [production]
18:07 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Deploy MediaModeration on all production wikis gerrit:608753 (duration: 01m 07s) [production]
17:57 <James_F> Zuul: Add CI for mediawiki/extensions/WikiLambda [releng]
17:14 <XioNoX> set flex-flow-sizing to cr2-eqsin - T248394 [production]
16:58 <joal> trying to release refinery-source 0.0.129 to archiva, version 3 [analytics]
16:57 <XioNoX> restart cr2-eqsin for software upgrade - T243080 [production]
16:51 <elukey> remove /etc/maven/settings.xml from all analytics nodes that have it [analytics]
16:39 <James_F> Manually re-set zuul's checkout of labs/libraryupgrader's git repo on contint2001 so we can merge things again [releng]
16:00 <XioNoX> updating eqsin LVS BGP neighbors IPs - T255766 [production]
15:16 <XioNoX> re0.cr1-eqsin> request system power-off both-routing-engines - T255766 [production]
15:15 <XioNoX> disable BGP to pybal on cr1-eqsin - T255766 [production]
15:13 <XioNoX> disable cr1-eqsin transit/peering BGP - T255766 [production]
15:09 <XioNoX> bump eqsin-codfw ospf link cost - T255766 [production]
15:03 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:03 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:03 <XioNoX> move vrrp master to cr2-eqsin - T255766 [production]
15:00 <XioNoX> depool eqsin for routers work - T255766 [production]
14:28 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:28 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:04 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:04 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:37 <hashar> contint1001 stopped zuul-merger for a test. started it again [production]
13:35 <hashar> Restarting zuul-merger on contint2001 # T252310 [production]
13:30 <hashar@deploy1001> Finished deploy [zuul/deploy@00f69b3]: (no justification provided) (duration: 00m 08s) [production]
13:30 <hashar@deploy1001> Started deploy [zuul/deploy@00f69b3]: (no justification provided) [production]
13:29 <hashar@deploy1001> Finished deploy [zuul/deploy@00f69b3]: (no justification provided) (duration: 00m 32s) [production]
13:28 <hashar@deploy1001> Started deploy [zuul/deploy@00f69b3]: (no justification provided) [production]