751-800 of 10000 results (31ms)
2017-12-13 §
12:53 <marostegui> Deploy alter table on s4 db1064 (sanitarium master) with replication, this will generate lag on labs replicas - T174569 [production]
12:53 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1103:3314 - T174569 (duration: 01m 36s) [production]
12:19 <moritzm> uploaded prometheus-ircd-exporter and prometheus-pdns-rec-exporter to apt.wikimedia.org [production]
11:59 <elukey> forced remount of /mnt/hdfs after OOM event on stat1005 [production]
11:41 <akosiaris> empty ganeti1006 for reimage after ltpstress and bios upgrades T181121 [production]
11:16 <mobrovac@tin> Finished deploy [graphoid/deploy@7979a40]: Update to service-template-node v0.5.4 (duration: 03m 56s) [production]
11:12 <mobrovac@tin> Started deploy [graphoid/deploy@7979a40]: Update to service-template-node v0.5.4 [production]
10:19 <mobrovac@tin> Finished deploy [recommendation-api/deploy@ac66089]: Update to service-template-node v0.5.4 (duration: 02m 20s) [production]
10:17 <mobrovac@tin> Started deploy [recommendation-api/deploy@ac66089]: Update to service-template-node v0.5.4 [production]
09:41 <godog> upload prometheus-elasticsearch-exporter to jessie-wikimedia - T181627 [production]
08:38 <jynus> migrate away from ganeti1008 [production]
06:26 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1103:3314 - T174569 (duration: 01m 11s) [production]
06:25 <marostegui> Deploy schema change on db1103:3314 - T174569 [production]
06:12 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1097:3314 - T174569 (duration: 01m 08s) [production]
02:26 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.11) (duration: 07m 02s) [production]
00:49 <ebernhardson@tin> Synchronized php-1.31.0-wmf.11/extensions/WikimediaEvents/: SWAT: T182616: turn on second mlr ab test for hewiki (duration: 01m 08s) [production]
00:44 <ebernhardson@tin> Synchronized php-1.31.0-wmf.12/extensions/WikimediaEvents/: SWAT: T182616: turn on second mlr ab test for hewiki (duration: 01m 08s) [production]
00:40 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: Turn on cirrus MLR for most wikis with >1% of search traffic (duration: 01m 08s) [production]
00:35 <mholloway-shell@tin> Finished deploy [mobileapps/deploy@5832a8c]: Update mobileapps to bfc3588 (duration: 04m 48s) [production]
00:32 <brion> restarted requeueTranscodes.php on terbium for mp3 audio generation backfill (had dropped DB connection) [production]
00:31 <mholloway-shell@tin> Started deploy [mobileapps/deploy@5832a8c]: Update mobileapps to bfc3588 [production]
00:05 <ebernhardson@tin> Synchronized wmf-config/: SWAT: T182616: Setup MLR AB test for hewiki (duration: 01m 10s) [production]
2017-12-12 §
22:30 <mholloway-shell@tin> Finished deploy [mobileapps/deploy@ea8f05d]: Update mobileapps to 94f267b (duration: 05m 10s) [production]
22:24 <mholloway-shell@tin> Started deploy [mobileapps/deploy@ea8f05d]: Update mobileapps to 94f267b [production]
22:02 <urandom> setting compaction throughput to 5 MB/s, restbase1010 [production]
21:31 <mutante> releases1001 - rm mediawiki core repo and let puppet try to recreate it (follow-up issue after gerrit:397891) [production]
21:28 <mobrovac@tin> Finished deploy [restbase/deploy@dceab2e]: Switch to Parsoid content v1.6.0 and switch to Cassandra 3 storage - T179417 (duration: 04m 16s) [production]
21:27 <demon@tin> Synchronized php-1.31.0-wmf.12/extensions/GlobalBlocking/: (no justification provided) (duration: 01m 07s) [production]
21:26 <mholloway-shell@tin> Finished deploy [mobileapps/deploy@28bfda3]: Update mobileapps to d0ee651 (duration: 01m 45s) [production]
21:24 <demon@tin> Synchronized php-1.31.0-wmf.11/extensions/GlobalBlocking/: (no justification provided) (duration: 01m 08s) [production]
21:24 <mholloway-shell@tin> Started deploy [mobileapps/deploy@28bfda3]: Update mobileapps to d0ee651 [production]
21:24 <mholloway-shell@tin> Finished deploy [mobileapps/deploy@b2d5b8e]: Update mobileapps to 172abc7 (duration: 00m 30s) [production]
21:24 <mholloway-shell@tin> Started deploy [mobileapps/deploy@b2d5b8e]: Update mobileapps to 172abc7 [production]
21:23 <mobrovac@tin> Started deploy [restbase/deploy@dceab2e]: Switch to Parsoid content v1.6.0 and switch to Cassandra 3 storage - T179417 [production]
21:21 <ppchelko@tin> Finished deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries, take 4 (duration: 02m 45s) [production]
21:18 <ppchelko@tin> Started deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries, take 4 [production]
21:15 <ppchelko@tin> Finished deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries, take 3 (duration: 02m 04s) [production]
21:13 <ppchelko@tin> Started deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries, take 3 [production]
21:13 <ppchelko@tin> Finished deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries, take 2 after failed content rerender (duration: 05m 05s) [production]
21:12 <mobrovac@tin> Started restart [electron-render/deploy@94d27d7]: Electron hanging - T174916 [production]
21:08 <ppchelko@tin> Started deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries, take 2 after failed content rerender [production]
21:08 <ppchelko@tin> Finished deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries (duration: 05m 51s) [production]
21:02 <ppchelko@tin> Started deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries [production]
20:55 <ppchelko@tin> Finished deploy [restbase/deploy@d3ca789]: Revert deployment for using MCS for summaries (duration: 01m 36s) [production]
20:53 <ppchelko@tin> Started deploy [restbase/deploy@d3ca789]: Revert deployment for using MCS for summaries [production]
20:53 <demon@tin> rebuilt and synchronized wikiversions files: group0 to wmf.12 [production]
20:51 <ppchelko@tin> Finished deploy [restbase/deploy@506047c]: Update expected Parsoid version, switched summary to MCS (duration: 03m 30s) [production]
20:48 <ppchelko@tin> Started deploy [restbase/deploy@506047c]: Update expected Parsoid version, switched summary to MCS [production]
20:44 <mholloway-shell@tin> Finished deploy [mobileapps/deploy@b2d5b8e]: Update mobileapps to 172abc7 (duration: 04m 48s) [production]
20:39 <mholloway-shell@tin> Started deploy [mobileapps/deploy@b2d5b8e]: Update mobileapps to 172abc7 [production]