4651-4700 of 10000 results (68ms)
2019-05-25 §
12:21 <godog> bounce thumbor on thumbor1002 [production]
11:48 <_joe_> restarted tumbor-instances on thumbor1001 [production]
09:20 <mobrovac> decommission restbase1011-b - T223976 [production]
04:56 <ariel@deploy1001> Finished deploy [dumps/dumps@61114e0]: add namespaces param only once for abstracts with lang variants (duration: 00m 07s) [production]
04:56 <ariel@deploy1001> Started deploy [dumps/dumps@61114e0]: add namespaces param only once for abstracts with lang variants [production]
00:30 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.6/extensions/VisualEditor/modules/ve-mw/init/ve.init.mw.ArticleTarget.js: Hot-deploy T224319 for VisualEditor switching and auto-restore (duration: 00m 50s) [production]
2019-05-24 §
21:56 <urandom> decommissioning restbase1011-a -- T223976 [production]
16:34 <XioNoX> add routinator package to reprepro/APT - T220669 [production]
15:44 <urandom> decommissioning restbase1010-c -- T223976 [production]
15:30 <XioNoX> disable bgp to telia on cr1-codfw for X-connect investigation - T222967 [production]
15:01 <jbond42> upload python{,3}-statsd.3.2.1-2 to jessie-wikimedia [production]
14:55 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.6/includes/libs/objectcache/: d262078b1 / T220470 (duration: 01m 06s) [production]
11:45 <hoo> Updated the Wikidata property suggester with data from the 2019-05-13 JSON dump and applied the T132839 workarounds [production]
11:32 <jbond42> [actully] rebooting prometheous1004 now [production]
11:32 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:32 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:25 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:25 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:23 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:23 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:23 <jbond@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
11:23 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:23 <jbond42> rebooting prometheous1004 [production]
10:56 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:56 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:56 <jbond42> rebooting prometheous2003 [production]
10:25 <jbond42> rebooting prometheous2004 [production]
10:25 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:25 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:09 <mobrovac> decommission restbase1010-b - T223976 [production]
07:33 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:33 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
07:32 <moritzm> rebooting labweb* for kernel security update [production]
07:05 <mobrovac> restbase-dev1006 force-stop the cassandra instances, fsync exception during decomm - T224260 [production]
06:47 <moritzm> bounced ferm on mw2286, wasn't correctly started after reboot [production]
06:45 <mobrovac> restbase-dev1006 decommission cass-b - T224260 [production]
06:43 <_joe_> disable notifications in icinga for restbase-dev1006 T224260 [production]
06:40 <mobrovac> restbase-dev1006 decommission cass-a - T224260 [production]
06:39 <mobrovac> restbase-dev1006 stop restbase - T224260 [production]
06:38 <mobrovac> restbase-dev1006 puppet disabled - T224260 [production]
06:26 <mobrovac@deploy1001> Finished deploy [restbase/deploy@b153f5d] (dev-cluster): Remove Parsoid fallback and rate-limit stashing (duration: 05m 41s) [production]
06:20 <mobrovac@deploy1001> Started deploy [restbase/deploy@b153f5d] (dev-cluster): Remove Parsoid fallback and rate-limit stashing [production]
06:20 <mobrovac@deploy1001> Finished deploy [restbase/deploy@b153f5d]: Remove Parsoid fallback and rate-limit stashing - T215956 T224055 (duration: 21m 30s) [production]
06:17 <marostegui> Stop MySQL on db2078:m1 to clone db2062 - T220170 [production]
06:08 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to new hosts T220170 (duration: 00m 48s) [production]
05:58 <mobrovac@deploy1001> Started deploy [restbase/deploy@b153f5d]: Remove Parsoid fallback and rate-limit stashing - T215956 T224055 [production]
05:35 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db2062 from config T220170 (duration: 00m 48s) [production]
05:34 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db2062 from config T220170 (duration: 00m 49s) [production]
05:30 <marostegui> Reload haproxy on dbproxy1010 to repool labsdb1011 [production]
00:31 <XioNoX> remove lvs1001-5 bgp sessions from cr1/2-eqiad - T224223 [production]