251-300 of 10000 results (26ms)
2018-02-12 ยง
16:16 <andrew@tin> Finished deploy [horizon/deploy@de72527]: scap debugging run (duration: 00m 24s) [production]
16:16 <andrew@tin> Started deploy [horizon/deploy@de72527]: scap debugging run [production]
15:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 - T162807 (duration: 00m 55s) [production]
15:35 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1105:3311 - T162807 (duration: 00m 55s) [production]
15:28 <marostegui> Stop replication in sync on db1089 and db1105:3311 - T162807 [production]
15:23 <moritzm> installing libtasn security updates [production]
15:02 <reedy@tin> Synchronized php-1.31.0-wmf.20/extensions/AbuseFilter/maintenance/: Fix maintenance scripts (duration: 00m 56s) [production]
15:00 <godog> roll-upgrade thumbor to 1.12 - T186500 T186594 T186492 [production]
14:54 <elukey> upload prometheus-burrow-exporter 0.0.4 on jessie/stretch-wikimedia [production]
14:51 <ottomata> emitting IP field from varnishkafka-eventlogging instance T186833 [production]
14:51 <zeljkof> EU SWAT finished [production]
14:47 <filippo@neodymium> conftool action : set/pooled=no; selector: name=mw1227.eqiad.wmnet [production]
14:44 <addshore@tin> Finished scap: T186612 [[gerrit:409063]] TwoColConflict wmf.20 (Remove hint and link from twoColConflict-beta-feature-description) (duration: 19m 56s) [production]
14:44 <andrew@tin> Finished deploy [horizon/deploy@de72527]: just checking that this still doesn't work (duration: 00m 04s) [production]
14:44 <andrew@tin> Started deploy [horizon/deploy@de72527]: just checking that this still doesn't work [production]
14:38 <moritzm> uploading cassandra 3.11.0-wmf5 to component/cassandra311 for stretch-wikimedia/apt.wikimedia.org (T186619) [production]
14:24 <addshore@tin> Started scap: T186612 [[gerrit:409063]] TwoColConflict wmf.20 (Remove hint and link from twoColConflict-beta-feature-description) [production]
14:22 <otto@tin> Finished deploy [eventlogging/analytics@01d5761]: T186833 (duration: 00m 04s) [production]
14:22 <otto@tin> Started deploy [eventlogging/analytics@01d5761]: T186833 [production]
14:20 <godog> grant group write for wikidev on tin on /srv/mediawiki-staging/php-1.31.0-wmf.20/.git [production]
13:42 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1105:3311 - T162807 (duration: 01m 06s) [production]
13:11 <marostegui> Deploy schema change on db2084 and db2075 - T185128 T153182 [production]
12:03 <moritzm> upgrading jessie-based servers in deployment-prep/beta to the HHVM build using ICU 57 (component/icu57) [production]
11:15 <jdrewniak@tin> Synchronized portals: Wikimedia Portals Update: [[gerrit:402805|Bumping portals to master (T128546)]] (duration: 00m 58s) [production]
11:14 <jdrewniak@tin> Synchronized portals/prod/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:402805|Bumping portals to master (T128546)]] (duration: 00m 57s) [production]
10:36 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1066 - T162807 (duration: 00m 55s) [production]
10:07 <marostegui> Stop replication in sync on db1089 and db1066 - T162807 [production]
10:06 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1066 - T162807 (duration: 00m 55s) [production]
09:57 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1067 - T162807 (duration: 00m 55s) [production]
09:51 <elukey> reboot mw1302 (hhvm defunct processes, hungs registered in dmesg, very high load) [production]
09:46 <marostegui> Stop replication in sync on db1089 and db1067 - T162807 [production]
09:46 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1067 - T162807 (duration: 00m 56s) [production]
09:29 <moritzm> installing libdatetime-timezone-perl SUA update [production]
09:25 <godog> install swift stretch updates on ms-be eqiad - T177739 [production]
09:19 <marostegui> Deploy schema change on s5 - T185128 T153182 [production]
09:05 <marostegui> Stop replication in sync on db1089 and db2048 - T162807 [production]
09:05 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089 - T162807 (duration: 00m 55s) [production]
08:57 <moritzm> installing glibc security updates on trusty (harmless in our environment; CVE-2018-1000001 is non-exploitable due to disabled unprivileged user name spaces) [production]
08:50 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1087 - T184599 (duration: 00m 55s) [production]
08:36 <marostegui> Reboot db1087 to pick new kernel [production]
08:34 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1092, depool db1087 - T184599 (duration: 00m 55s) [production]
08:25 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1099:3318, depool db1092 - T184599 (duration: 00m 55s) [production]
08:14 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1101:3318, depool db1099:3318 - T184599 (duration: 00m 55s) [production]
08:05 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1104, depool db1101:3318 - T184599 (duration: 00m 55s) [production]
08:01 <hashar> Upgrading CI Jenkins plugins [production]
07:49 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1109, depool db1104 - T184599 (duration: 00m 55s) [production]
07:46 <moritzm> installing exim security updates on remaining hosts [production]
07:35 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1109 - T184599 (duration: 00m 55s) [production]
07:20 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1109 - T184599 (duration: 00m 55s) [production]
07:05 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1109 - T184599 (duration: 00m 55s) [production]