2301-2350 of 10000 results (41ms)
2017-12-13 §
15:34 <akosiaris@tin> Started deploy [ores/deploy@b4f2b02]: (no justification provided) [production]
15:21 <chasemp> remove and purge vblade-persist and runit from labstore1004 T182781 [production]
15:02 <jynus> upgrade and restart db1067 [production]
15:02 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1067 (duration: 01m 07s) [production]
14:43 <zeljkof> EU SWAT finished [production]
14:38 <zfilipin@tin> Synchronized portals: SWAT: [[gerrit:398045|Bumping portals to master (T128546)]] (duration: 01m 09s) [production]
14:37 <zfilipin@tin> Synchronized portals/prod/wikipedia.org/assets: SWAT: [[gerrit:398045|Bumping portals to master (T128546)]] (duration: 01m 08s) [production]
14:29 <dcausse@tin> Synchronized php-1.31.0-wmf.12/extensions/Wikibase: T182293 Extract names of search fields as constants (duration: 02m 05s) [production]
14:22 <dcausse@tin> Synchronized wmf-config/InitialiseSettings.php: T182293 [cirrus] tune wikidata similarity configuration 2/2 (duration: 01m 07s) [production]
14:20 <dcausse@tin> Synchronized wmf-config/Wikibase.php: T182293 [cirrus] tune wikidata similarity configuration 1/2 (duration: 01m 12s) [production]
14:03 <akosiaris> gnt-node remove ganeti1006 T181121 [production]
14:01 <elukey> restart Yarn nodemanagers on analytics102[8,9] to apply new settings - T182276 [production]
13:21 <moritzm> uploaded prometheus-pdns-rec-exporter 0.2-1 to apt.wikimedia.org [production]
13:10 <marostegui> Deploy schema change on s4 - dbstore1002 - T174569 [production]
12:53 <marostegui> Deploy alter table on s4 db1064 (sanitarium master) with replication, this will generate lag on labs replicas - T174569 [production]
12:53 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1103:3314 - T174569 (duration: 01m 36s) [production]
12:19 <moritzm> uploaded prometheus-ircd-exporter and prometheus-pdns-rec-exporter to apt.wikimedia.org [production]
11:59 <elukey> forced remount of /mnt/hdfs after OOM event on stat1005 [production]
11:41 <akosiaris> empty ganeti1006 for reimage after ltpstress and bios upgrades T181121 [production]
11:16 <mobrovac@tin> Finished deploy [graphoid/deploy@7979a40]: Update to service-template-node v0.5.4 (duration: 03m 56s) [production]
11:12 <mobrovac@tin> Started deploy [graphoid/deploy@7979a40]: Update to service-template-node v0.5.4 [production]
10:19 <mobrovac@tin> Finished deploy [recommendation-api/deploy@ac66089]: Update to service-template-node v0.5.4 (duration: 02m 20s) [production]
10:17 <mobrovac@tin> Started deploy [recommendation-api/deploy@ac66089]: Update to service-template-node v0.5.4 [production]
09:41 <godog> upload prometheus-elasticsearch-exporter to jessie-wikimedia - T181627 [production]
08:38 <jynus> migrate away from ganeti1008 [production]
06:26 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1103:3314 - T174569 (duration: 01m 11s) [production]
06:25 <marostegui> Deploy schema change on db1103:3314 - T174569 [production]
06:12 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1097:3314 - T174569 (duration: 01m 08s) [production]
02:26 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.11) (duration: 07m 02s) [production]
01:29 <Zppix> Deploying [[Gerrit:397992]] [tools.zppixbot]
01:26 <Zppix> Restart due to config change [tools.zppixbot]
01:06 <Zppix> Created a main bot channel #ZppixBot [tools.zppixbot]
00:59 <madhuvishy> Cordon and Drain tools-worker-1016 [tools]
00:49 <ebernhardson@tin> Synchronized php-1.31.0-wmf.11/extensions/WikimediaEvents/: SWAT: T182616: turn on second mlr ab test for hewiki (duration: 01m 08s) [production]
00:47 <madhuvishy> Drain + Cordon, Reboot, Uncordon tools-workers-1018-1023, 1025-1027 [tools]
00:44 <ebernhardson@tin> Synchronized php-1.31.0-wmf.12/extensions/WikimediaEvents/: SWAT: T182616: turn on second mlr ab test for hewiki (duration: 01m 08s) [production]
00:40 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: Turn on cirrus MLR for most wikis with >1% of search traffic (duration: 01m 08s) [production]
00:38 <mdholloway> deployed mobileapps@bfc3588 to BC [releng]
00:35 <mholloway-shell@tin> Finished deploy [mobileapps/deploy@5832a8c]: Update mobileapps to bfc3588 (duration: 04m 48s) [production]
00:34 <madhuvishy> Drain + Cordon, Reboot, Uncordon tools-workers-1011, 1013-1015, 1017 [tools]
00:32 <brion> restarted requeueTranscodes.php on terbium for mp3 audio generation backfill (had dropped DB connection) [production]
00:31 <mholloway-shell@tin> Started deploy [mobileapps/deploy@5832a8c]: Update mobileapps to bfc3588 [production]
00:28 <madhuvishy> Drain + Cordon, Reboot, Uncordon tools-workers-1006-1010 [tools]
00:11 <madhuvishy> Drain + Cordon, Reboot, Uncordon tools-workers-1002-1005 [tools]
00:05 <ebernhardson@tin> Synchronized wmf-config/: SWAT: T182616: Setup MLR AB test for hewiki (duration: 01m 10s) [production]
2017-12-12 §
23:29 <madhuvishy> rebooting tools-worker-1012 [tools]
22:40 <bd808> Restarted webservice; Some pages failing with DNS errors [tools.magnustools]
22:30 <mholloway-shell@tin> Finished deploy [mobileapps/deploy@ea8f05d]: Update mobileapps to 94f267b (duration: 05m 10s) [production]
22:24 <mholloway-shell@tin> Started deploy [mobileapps/deploy@ea8f05d]: Update mobileapps to 94f267b [production]
22:02 <urandom> setting compaction throughput to 5 MB/s, restbase1010 [production]