7001-7050 of 10000 results (60ms)
2018-09-03 ยง
17:03 <gehel@deploy1001> Finished deploy [wdqs/wdqs@68d9cab]: new version of wdqs GUI (wdqs1009 only) (duration: 00m 33s) [production]
17:02 <gehel@deploy1001> Started deploy [wdqs/wdqs@68d9cab]: new version of wdqs GUI (wdqs1009 only) [production]
16:41 <moritzm> depooling mw1310-mw1311 for reboot to address kernel security updates once pending transcoding jobs have been completed [production]
16:32 <moritzm> powercycling mw1300, stuck in reboot [production]
16:08 <marostegui> Deploy schema change on db1086 [production]
15:59 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1086 (duration: 00m 48s) [production]
15:57 <moritzm> rebooting mw2200-mw2239 for kernel security updates [production]
15:52 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1098:3317 (duration: 00m 50s) [production]
15:51 <ejegg> updated civicrm (back) to ea690851f0, but rolled back queue server settings [production]
15:48 <ejegg> rolled back civicrm to 863ed3f1a2 [production]
15:45 <ejegg> updated civicrm from from 863ed3f1a2 to ea690851f0 [production]
15:44 <ejegg> updated payments-wiki from 763e14b6df to e749025c1a [production]
15:27 <reedy@deploy1001> Pruned MediaWiki: 1.32.0-wmf.16 [keeping static files] (duration: 01m 48s) [production]
15:24 <reedy@deploy1001> Pruned MediaWiki: 1.32.0-wmf.15 [keeping static files] (duration: 03m 44s) [production]
15:20 <reedy@deploy1001> Pruned MediaWiki: 1.32.0-wmf.14 [keeping static files] (duration: 02m 13s) [production]
15:19 <moritzm> rebooting mw2190-mw2219 for kernel security updates [production]
15:13 <moritzm> depooling mw1300-mw1309 for reboot to address kernel security updates once pending transcoding jobs have been completed [production]
14:48 <jynus> running basic mw warmup script on codfw as a test [production]
14:26 <ema> lvs1016: re-enable puppet [production]
14:23 <godog> switch swift thumbnails active/active - T201858 T199073 [production]
13:39 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1098:3317 (duration: 00m 49s) [production]
13:33 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1101:3317 (duration: 00m 56s) [production]
12:03 <akosiaris> repool eqiad mathoid for kubernetes upgrade [production]
11:38 <zeljkof> EU SWAT finished [production]
11:38 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:457419|Add high-density logos for Commons (T203342)]] (duration: 00m 49s) [production]
11:34 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:457418|Add high-density logos for the Russian Wikisource (T203343)]] (duration: 00m 50s) [production]
11:27 <zfilipin@deploy1001> Synchronized static/images/project-logos: SWAT: [[gerrit:457084|Add high-density logos for Commons (T203342)]] (duration: 00m 49s) [production]
11:23 <zfilipin@deploy1001> Synchronized static/images/project-logos: SWAT: [[gerrit:457081|Add high-density logos for the Russian Wikisource (T203343)]] (duration: 00m 50s) [production]
11:21 <akosiaris> depool eqiad mathoid for kubernetes upgrade [production]
11:21 <akosiaris> repool codfw mathoid. Kubernetes cluster upgraded to 1.10.6 [production]
11:15 <moritzm> installing libcgroup security updates [production]
10:57 <moritzm> installing libx11 security updates on jessie [production]
10:39 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:457414|Bumping portals to master (T128546)]] (duration: 00m 49s) [production]
10:39 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:457414|Bumping portals to master (T128546)]] (duration: 00m 51s) [production]
10:30 <moritzm> installing ruby2.1 security updates [production]
10:12 <moritzm> installing tomcat8 security updates [production]
10:00 <akosiaris> depool codfw mathoid for kubernetes upgrade [production]
09:38 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1121 (duration: 01m 55s) [production]
09:33 <moritzm> rebooting mw2135-mw2147 for kernel security updates [production]
09:12 <moritzm> upgrading mw1339-mw1348 to wikidiff 1.7.3 [production]
09:08 <moritzm> depooling mw1334-mw1338 for reboot to address kernel security updates once pending transcoding jobs have been completed [production]
09:00 <gehel> starting rolling restart of elasticsearch / cirrus / codfw for various updates and data directory migration - T198351 [production]
08:32 <godog> fix xfs on ms-be1041 sde - T199198 [production]
08:27 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1101:3317 (duration: 00m 52s) [production]
08:21 <marostegui> Deploy schema change on s7 codfw master (this will generate lag on s7 codfw) [production]
08:18 <moritzm> rebooting mw2163-mw2189 for kernel security updates [production]
08:07 <moritzm> depooling mw1293-mw1296,mw1299,mw1318 for reboot to address L1TF once pending transcoding jobs have been completed [production]
08:01 <volans> restarted pdfrender on scb1004 and repooled it [production]
07:56 <volans> restarted pdfrender on scb1003 [production]
07:55 <godog> roll restart thumbor to apply latest config changes - T203135 T20871 [production]