251-300 of 10000 results (50ms)
2018-12-18 §
14:40 <zfilipin@deploy1001> rebuilt and synchronized wikiversions files: group0 to 1.33.0-wmf.9 [production]
14:26 <akosiaris> restart ircecho, seems to have croaked with Dec 17 19:39:52 icinga1001 ircecho[861]: UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 174: ordinal not in range(128) [production]
14:25 <zfilipin@deploy1001> Finished scap: testwiki to php-1.33.0-wmf.9 and rebuild l10n cache (duration: 34m 11s) [production]
14:15 <akosiaris> restart pybal on lvs1016, lvs2006 for blubberoid LVS deployment. T205919 [production]
13:51 <zfilipin@deploy1001> Started scap: testwiki to php-1.33.0-wmf.9 and rebuild l10n cache [production]
13:48 <zfilipin@deploy1001> Pruned MediaWiki: 1.33.0-wmf.4 (duration: 11m 13s) [production]
13:12 <addshore@deploy1001> Synchronized php-1.33.0-wmf.8/extensions/Wikibase/lib/includes/Formatters/ControlledFallbackEntityIdFormatter.php: T201930 ControlledFallbackEntityIdFormatter, track unique value formats (duration: 00m 46s) [production]
12:52 <Amir1> deployed a patch on wmf.8 for T207814 [production]
12:41 <filippo@deploy1001> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 45s) [production]
12:17 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478630|Perform even more PHP constraint checks before falling back (T209504)]] (duration: 00m 46s) [production]
12:16 <moritzm> installing fuse updates from stretch point release [production]
11:41 <moritzm> installing remaining libgd2 security updates [production]
09:38 <godog> swift eqiad-prod: initial weights for ms-be10[44-50].eqiad.wmnet - T209618 [production]
08:44 <marostegui> Enable GTID on s7 codfw master (db2040) - T211973 [production]
08:26 <marostegui> Enable GTID on es3 - T211973 [production]
08:23 <marostegui> Enable GTID on es2 - T211973 [production]
07:57 <elukey> restart cassandra-{a,b} on aqs1004 for openjdk upgrades [production]
07:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1078 T86338 T202167 (duration: 00m 45s) [production]
07:49 <marostegui> Deploy schema change on db1075 (s3 master) T86338 T202167 [production]
06:07 <marostegui> Deploy schema change on db1078 T86338 T202167 [production]
06:07 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1078 T86338 T202167 (duration: 00m 45s) [production]
06:03 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2038 after mysql and kernel upgrade (duration: 00m 47s) [production]
00:13 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:479997|Disable MediaViewer thumbnail URL guessing for private wikis (T212099)]] (duration: 00m 45s) [production]
2018-12-17 §
23:21 <tgr> deployed security patch per T207750#4829275 [production]
23:17 <chasemp> launch gpg jobs for files on stat1004 [production]
23:17 <chasemp> launch gpg jobs for files on labstore1007 [production]
22:00 <mutante> puppetmaster - signed cert for doc1001 (ganeti VM), initial puppet run [production]
21:58 <chasemp> stat1004:/var/log# mkfs.exfat /dev/sde && mkdir /mnt/T211327 && mount /dev/sde /mnt/T211327/ [production]
21:55 <arlolra> Updated Parsoid to 4eba44e (T204622, T211941) [production]
21:42 <arlolra@deploy1001> Finished deploy [parsoid/deploy@1bf4dab]: Updating Parsoid to 4eba44e (duration: 08m 55s) [production]
21:33 <arlolra@deploy1001> Started deploy [parsoid/deploy@1bf4dab]: Updating Parsoid to 4eba44e [production]
21:20 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@92fdf43]: Update mobileapps to d244439 (duration: 04m 31s) [production]
21:15 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@92fdf43]: Update mobileapps to d244439 [production]
20:25 <ppchelko@deploy1001> Finished deploy [recommendation-api/deploy@c1b6b32]: Rollback to c1b6b324015bd565 until the checks are fixed (duration: 01m 56s) [production]
20:23 <ppchelko@deploy1001> Started deploy [recommendation-api/deploy@c1b6b32]: Rollback to c1b6b324015bd565 until the checks are fixed [production]
20:17 <mutante> creating new ganeti VM doc1001.eqiad.wmnet for doc.wikimedia.org - specs as requested by hashar on T211974 [production]
20:05 <XioNoX> remove sandbox-out4 from all routers - T212155 [production]
20:02 <XioNoX> remove sandbox-out4 from ulsfo - T212155 [production]
19:47 <ppchelko@deploy1001> Finished deploy [recommendation-api/deploy@f183af7]: Update to 657a515. All hosts (duration: 10m 45s) [production]
19:36 <ppchelko@deploy1001> Started deploy [recommendation-api/deploy@f183af7]: Update to 657a515. All hosts [production]
19:33 <ppchelko@deploy1001> Finished deploy [recommendation-api/deploy@f183af7]: Update to 657a515. Canary on scb2001 (duration: 00m 18s) [production]
19:32 <ppchelko@deploy1001> Started deploy [recommendation-api/deploy@f183af7]: Update to 657a515. Canary on scb2001 [production]
19:29 <raynor> Morning SWAT finished [production]
19:27 <pmiazga@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:480127 | Page issues treatment enabled on all wikis except enwiki(T210553)]] (duration: 00m 45s) [production]
18:58 <ppchelko@deploy1001> Finished deploy [recommendation-api/deploy@8036f9b]: Update to 2991db1. Canary on scb2001 (duration: 00m 51s) [production]
18:57 <ppchelko@deploy1001> Started deploy [recommendation-api/deploy@8036f9b]: Update to 2991db1. Canary on scb2001 [production]
18:42 <herron> manually restarting pybal on lvs2003 to add kibana service T205850 [production]
18:34 <herron@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=logstash,service=kibana,name=logstash2006.codfw.wmnet [production]
18:34 <herron@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=logstash,service=kibana,name=logstash2005.codfw.wmnet [production]
18:34 <mobrovac@deploy1001> Finished deploy [proton/deploy@ff7c8a2]: Config: Use extdomain and add printable=yes to the req query - T210793 (duration: 01m 32s) [production]