2751-2800 of 10000 results (61ms)
2018-07-19 ยง
14:17 <elukey> roll restart kafka on kafka-jumbo* and kafka main-codfw (kafka2*) to pick up new Xmx/Xms settings (1g -> 2g) [production]
14:15 <volans> upgrading cumin/debdeploy/reimage and other tools on neodymium - T187773 [production]
13:57 <elukey> restart kafka on kafka-jumbo1001 to raise Xmx/Xms jvm settings (1g -> 2g) [production]
13:43 <marostegui> Deploy schema change on db1103:3312 T144010 T51190 T199368 [production]
13:43 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 for alter table (duration: 00m 54s) [production]
13:38 <volans> reimaging mw2225 to test py3 reimage with new cumin, conftool and apache test - T187773 [production]
13:34 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1103:3314 (duration: 00m 53s) [production]
13:25 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) [production]
13:22 <moritzm> installing python-pysaml2 security updates [production]
13:05 <moritzm> installing ffmpeg security updates [production]
12:48 <moritzm> installing xerces-c security updates [production]
12:38 <moritzm> uploaded debdeploy 0.0.99.5 to apt.wikimedia.org [production]
11:49 <zeljkof> EU SWAT finished [production]
11:46 <zfilipin@deploy1001> Synchronized dblists/categories-rdf.dblist: SWAT: [[gerrit:445720|Remove labs wikis from the categories-rdf list, dont need them (T198356)]] (duration: 00m 55s) [production]
11:44 <moritzm> installing reportbug update from stretch point release to test py3-based debdeploy [production]
11:40 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:446613|Enable Special:Block Feedback Request (T199919)]] (duration: 00m 55s) [production]
11:33 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable Structured Discussions beta feature on orwiki (T199971) (duration: 00m 55s) [production]
11:22 <volans> testing reimage of californium (spare host) with the upgraded cumin [production]
11:20 <chasemp> maintain-views --all-databases --replace-all --table ores_classification --debug (labsdb) [production]
11:19 <chasemp> maintain-views --all-databases --replace-all --table ores_model --debug (labsdb) [production]
11:18 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: enable TemplateStyles on enwiki, frwiki, zhwiki T197603 T191452 T189022 (duration: 00m 55s) [production]
10:59 <volans> upgrading cumin on sarin - T187773 [production]
10:52 <legoktm> made myself a crat on test2wiki [production]
10:06 <moritzm> installing file/libmagic security updates [production]
09:55 <moritzm> installing check-postgres update from stretch 9.5 point release [production]
09:49 <aaron@deploy1001> Synchronized php-1.32.0-wmf.13/includes/libs/objectcache/MultiWriteBagOStuff.php: 2cee0ab7085a74d35bc192ec8bc9cf461b286695 (duration: 00m 55s) [production]
09:35 <volans> cumin upgrade on labpuppetmaster* hosts completed - T187773 [production]
09:33 <moritzm> installing openssl security updates [production]
09:33 <volans> removed leftover cumin installation from labtestpuppetmaster2001 - T187773 [production]
09:27 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) [production]
09:27 <godog> run xfs_repair on filesystems reporting negative space available on ms-be1040 - T199198 [production]
09:24 <moritzm> installing tomcat7 security updates [production]
09:23 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool es1019 with low load (duration: 00m 54s) [production]
09:21 <moritzm> installing ant security updates [production]
09:14 <moritzm> uploaded jenkins 2.121.2 to apt.wikimedia.org (T199448) [production]
08:46 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) [production]
08:39 <volans> start upgrade of cumin to 3.0.1-1 on labpuppetmaster* - T187773 [production]
08:32 <marostegui> Deploy schema change on dbstore1002:s2 T144010 T51190 T199368 [production]
08:31 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) [production]
08:08 <elukey> restart eventstreams on scb2* hosts to pick up new Kafka settings (pointing it to main-codfw) - T199813 [production]
08:04 <kartik@deploy1001> Finished deploy [cxserver/deploy@fe0d521]: Update cxserver to 92e3d2e (T199380, T199885) (duration: 03m 58s) [production]
08:00 <kartik@deploy1001> Started deploy [cxserver/deploy@fe0d521]: Update cxserver to 92e3d2e (T199380, T199885) [production]
07:58 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) [production]
07:54 <marostegui> Deploy schema change on s2 codfw masters (db2035) this will generate lag on s2 codfw T144010 T51190 T199368 [production]
07:50 <jynus> stop es1019 and reimage it [production]
07:48 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool es1019 (duration: 00m 54s) [production]
07:43 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3312 after MySQL upgrade (duration: 00m 55s) [production]
07:26 <moritzm> removing cdrom and sr_mod (related module) kernel modules across the fleet (following the blacklisting of the kernel module via puppet) [production]
06:00 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3312 after MySQL upgrade (duration: 00m 54s) [production]
05:44 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3312 after MySQL upgrade (duration: 00m 55s) [production]