551-600 of 10000 results (37ms)
2018-02-27 ยง
23:38 <krinkle@tin> Synchronized dblists/: remove pp_stage1_raw.dblist (duration: 01m 14s) [production]
21:29 <Hauskatze> ALL global renames failing [production]
21:23 <thcipriani@tin> Synchronized php-1.31.0-wmf.23/includes/user/User.php: [[gerrit:415101|Add a missing check of $wgActorTableSchemaMigrationStage]] T188437 (duration: 01m 14s) [production]
20:42 <ppchelko@tin> Finished deploy [eventstreams/deploy@14e0b03]: Set correct CSP headers, forgot to git pull (duration: 02m 29s) [production]
20:39 <ppchelko@tin> Started deploy [eventstreams/deploy@14e0b03]: Set correct CSP headers, forgot to git pull [production]
20:37 <ppchelko@tin> Finished deploy [eventstreams/deploy@8f2eec4]: Set correct CSP headers (duration: 00m 25s) [production]
20:36 <ppchelko@tin> Started deploy [eventstreams/deploy@8f2eec4]: Set correct CSP headers [production]
20:31 <thcipriani@tin> rebuilt and synchronized wikiversions files: Group0 to 1.31.0-wmf.23 [production]
20:08 <herron> eqiad puppet master reboots finished -- re-enabling puppet agents [production]
20:02 <herron> temporarily disabling puppet agents and rebooting eqiad puppet masters for kernel update [production]
20:02 <thcipriani@tin> Finished scap: testwiki to php-1.31.0-wmf.23 and rebuild l10n cache (duration: 32m 10s) [production]
19:30 <thcipriani@tin> Started scap: testwiki to php-1.31.0-wmf.23 and rebuild l10n cache [production]
19:08 <otto@tin> Finished deploy [eventstreams/deploy@8f2eec4]: Publish page change related streams: T187241 (duration: 04m 16s) [production]
19:03 <otto@tin> Started deploy [eventstreams/deploy@8f2eec4]: Publish page change related streams: T187241 [production]
19:03 <otto@tin> Finished deploy [eventstreams/deploy@8f2eec4]: Publish page change related streams: T187241 (scb2002 only) (duration: 00m 22s) [production]
19:03 <otto@tin> Started deploy [eventstreams/deploy@8f2eec4]: Publish page change related streams: T187241 (scb2002 only) [production]
18:32 <otto@tin> Started restart [eventstreams/deploy@7629e16]: service restart to publish page change related streams: T187241 (scb2001 only) [production]
18:32 <otto@tin> Finished deploy [eventstreams/deploy@7629e16]: Config deploy to publish page change related streams: T187241 (scb2001 only) (duration: 00m 03s) [production]
18:32 <otto@tin> Started deploy [eventstreams/deploy@7629e16]: Config deploy to publish page change related streams: T187241 (scb2001 only) [production]
18:02 <moritzm> rebooting kubernetes workers in eqiad for kernel security update [production]
17:46 <moritzm> rebooting kubernetes workers in codfw for kernel security update [production]
17:41 <jynus> restarting ferm on db2049, seems failed one day ago [production]
17:38 <gehel> restarting wdqs-updater on wdqs1004 - T188045 [production]
17:32 <thcipriani> starting branch cut for 1.31.0-wmf.23 T183962 [production]
17:14 <godog> upload puppetdb 2.3.8-1~wmf1+stretch to stretch-wikimedia - T184562 [production]
17:10 <urandom> restarting Cassandra, restbase1007-a to test jmx_exporter [production]
16:53 <elukey> restart cassandra-a on aqs1004 to test the prometheus jmx agent before complete rollout - T184795 [production]
16:52 <anomie@tin> Synchronized wmf-config/InitialiseSettings.php: Setting wgCommentTableSchemaMigrationStage = MIGRATION_WRITE_BOTH everywhere (duration: 00m 56s) [production]
16:50 <ema> lvs1010: retpoline kernel/libs upgrade T188092 [production]
16:46 <ema> cp1008: retpoline kernel/libs upgrade T188092 [production]
16:42 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1081 (duration: 02m 04s) [production]
16:29 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1081 (duration: 00m 55s) [production]
16:26 <moritzm> rebooting mw1293-mw1298 for kernel security update [production]
16:20 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1081 (duration: 00m 56s) [production]
16:10 <thcipriani> restarting jenkins for plugin update [production]
16:08 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1081 (duration: 00m 56s) [production]
16:06 <moritzm> rebooting restbase-dev for kernel security update [production]
15:49 <awight> Restarting ORES celery workers, changing from 35 -> 45 workers per node. [production]
15:47 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1081 - T186321 (duration: 00m 56s) [production]
15:37 <marostegui> Stop MySQL and reboot db1081 for kernel ugprade, mariadb upgrade and binlog format change - T186321 [production]
15:37 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1081 - T186321 (duration: 00m 55s) [production]
15:33 <moritzm> installing squid security updates [production]
15:20 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2049 - T187534 (duration: 00m 57s) [production]
15:20 <moritzm> powercycling thumbor1004, stuck during reboot [production]
15:19 <ottomata> beginning migration of varnishkafka webrequest upload from Kafka analytics to kafka jumbo [production]
15:11 <ema> upgrade cache_text@esams to varnish 5 T184448 [production]
15:02 <gilles> EU SWAT finished [production]
15:02 <gilles@tin> Synchronized private/PrivateSettings.php.example: Thumbor private wiki support deployment: [[gerrit:414965| Set up separate Thumbor Swit user for private containers (T187822)]] (duration: 00m 55s) [production]
15:00 <gilles@tin> Synchronized wmf-config/filebackend.php: Thumbor private wiki support deployment: [[gerrit:414965| (T187822)]] (duration: 00m 56s) [production]
14:52 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:414993|Fix: Add missed line in wgLogo (T185977)]] (duration: 00m 56s) [production]