401-450 of 10000 results (35ms)
2019-05-29 §
09:18 <gehel@cumin1001> START - Cookbook sre.elasticsearch.rolling-reboot [production]
08:51 <moritzm> draining ganeti2002 for eventual reboot to pick up MDS-enabled kernel [production]
08:31 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:31 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
08:31 <moritzm> draining ganeti2001 for eventual reboot to pick up MDS-enabled kernel [production]
07:42 <mobrovac> decommission restbase1015-b -- T223976 [production]
07:40 <godog> ms-be2043 start sdd rebuild - T222654 [production]
07:03 <jijiki> restarting pdfrender on scb1003 [production]
2019-05-28 §
23:19 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.7/extensions/TimedMediaHandler/includes/ApiTimedText.php: T224522 Fix fatal in ApiTimedText following redirect pages (duration: 00m 56s) [production]
23:17 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.7/extensions/TimedMediaHandler/includes/handlers/TextHandler/TextHandler.php: T224367 Fix regression in subtitles for non-English sites on Commons videos (duration: 00m 57s) [production]
23:17 <bstorm_> T221339 completed view updates on labsdb1009 without depooling [production]
23:15 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.6/extensions/TimedMediaHandler/includes/handlers/TextHandler/TextHandler.php: T224367 Fix regression in subtitles for non-English sites on Commons videos (duration: 00m 56s) [production]
23:14 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.6/extensions/TimedMediaHandler/includes/ApiTimedText.php: T224522 Fix fatal in ApiTimedText following redirect pages (duration: 00m 58s) [production]
23:11 <jforrester@deploy1001> Synchronized wmf-config/flaggedrevs.php: FlaggedRevisions: Copy in rest of the config, for static registration I77d70519f Id0cd2e18c (duration: 00m 56s) [production]
23:10 <bstorm_> T221339 repooled labsdb1011 [production]
23:06 <jforrester@deploy1001> Synchronized wmf-config/throttle.php: Remove expired throttle rules I4ba3d489 (duration: 00m 55s) [production]
23:06 <bstorm_> T221339 depooled labsdb1011 and updated views [production]
23:02 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT T55652 Enable wgSpecialSearchFormOptions on testwikidata (duration: 00m 56s) [production]
22:49 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT Fix order of edit tabs for multi-tabs on SET wikis T223793 (duration: 00m 57s) [production]
22:28 <cstone_> Re-enabled fundraising thank you mail job [production]
22:25 <mutante> cp3034 - sudo -i varnish-backend-restart [production]
22:18 <cstone_> Updated fundraising civicrm from 21afd001b6 to bb4acf3d8a [production]
22:14 <mutante> cp3035 - varnish-backend-restart [production]
22:13 <bstorm_> repooled labsdb1010 [production]
22:09 <mutante> cp3034 - restart varnish backend [production]
22:09 <XioNoX> restart varnish backend on cp3039 [production]
22:02 <cstone_> Disabled fundraising thank you mail job [production]
21:46 <bstorm_> depool labsdb1010 for view updates [production]
21:38 <smalyshev@deploy1001> Finished deploy [wdqs/wdqs@5a69072]: Deploy GUI & Blazegraph update (duration: 14m 37s) [production]
21:35 <urandom> decommissioning restbase1015-a -- T223976 [production]
21:24 <smalyshev@deploy1001> Started deploy [wdqs/wdqs@5a69072]: Deploy GUI & Blazegraph update [production]
21:23 <ebernhardson> restart elasticsearch on cloudelastic1001 to test sanely sized readahead on /dev/dm-0 [production]
21:11 <gehel@cumin2001> END (PASS) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=0) [production]
20:57 <mutante> phab1003 / phab2001 - removing 'apache restart' from root's crontab (gerrit:512977) (T187790) [production]
20:28 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: WikimediaEditorTasks: Update caption edit target counts (duration: 00m 57s) [production]
19:17 <gehel@cumin2001> START - Cookbook sre.elasticsearch.rolling-reboot [production]
19:15 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db1064 from config as it will be decommissioned T223217 (duration: 00m 55s) [production]
19:14 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db1064 from config as it will be decommissioned T223217 (duration: 00m 56s) [production]
19:02 <marostegui> Reboot db2091 for full OS and MySQL upgrade - T224393 [production]
18:55 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Stop setting wgMediaInfoEnableFilePageDepicts, no longer read (duration: 00m 57s) [production]
18:51 <jforrester@deploy1001> Synchronized wmf-config/Wikibase.php: Add forwards-compatibility for dataCdnMaxAge (duration: 01m 00s) [production]
18:11 <marostegui> Start mysql for s2 and s4 on db2091 T224393 [production]
17:57 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
17:57 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
17:52 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
17:52 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
17:48 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
17:48 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
17:42 <moritzm> rebooting yubiauth* servers for kernel update [production]
17:41 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]