5551-5600 of 10000 results (65ms)
2018-02-28 §
11:18 <moritzm> powercycling restbase2001, stuck in reboot [production]
11:10 <godog> rollout thumbor 1.15 to codfw/eqiad [production]
10:59 <godog> upload python-thumbor-wikimedia 1.15 - T187822 T187350 [production]
10:59 <oblivian@puppetmaster1001> conftool action : set/pooled=yes; selector: name=mw1261.eqiad.wmnet [production]
10:54 <moritzm> draining restbase2001 for eventual reboot for kernel security update [production]
10:43 <moritzm> rebooting remaining mediawiki app servers in eqiad [production]
09:27 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2083, db2082 and db2081 after kernel upgrade (duration: 00m 57s) [production]
09:25 <ema> upgrade cache_text@codfw to varnish 5 [production]
09:06 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2083, db2082 and db2081 for kernel upgrade (duration: 00m 56s) [production]
09:06 <marostegui> Reboot db2083, db2082 and db2081 for kernel and mariadb upgrade [production]
08:55 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2069 - T162807 (duration: 00m 57s) [production]
08:42 <filippo@neodymium> conftool action : set/pooled=yes; selector: name=neodymium.eqiad.wmnet [production]
08:42 <filippo@neodymium> conftool action : set/pooled=no; selector: name=neodymium.eqiad.wmnet [production]
08:34 <marostegui> Reboot db2069 for kernel upgrade [production]
08:33 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2069 - T162807 (duration: 00m 57s) [production]
08:23 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2062 - T162807 (duration: 00m 57s) [production]
08:10 <moritzm> rebooting remaining mediawiki API servers in eqiad [production]
07:51 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2062 - T162807 (duration: 00m 57s) [production]
07:51 <marostegui> Reboot db2062 for mariadb and kernel upgrade [production]
07:36 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2085 (duration: 00m 57s) [production]
07:15 <marostegui> Upgrade kernel and mariadb on db2085 [production]
07:15 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2085 for mariadb and kernel upgrade (duration: 01m 00s) [production]
06:32 <marostegui> Deploy schema change on db1060 (with replication) - this will cause lag on labs servers - T187089 T185128 T153182 [production]
06:31 <kart_> (Re)Starting CLL preference migration script on terbium (T187677) [production]
06:31 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1060 for alter table (duration: 00m 57s) [production]
06:24 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1060 for alter table (duration: 00m 57s) [production]
05:43 <demon@tin> rebuilt and synchronized wikiversions files: (no justification provided) [production]
04:55 <krinkle@tin> Synchronized wmf-config/profiler.php: Iba417de75a and Ied984daecd3f5f6 (duration: 01m 06s) [production]
03:01 <kart_> Starting CLL preference migration script on terbium (T187677) [production]
02:25 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.22) (duration: 06m 21s) [production]
00:55 <demon@tin> Synchronized scap/plugins/wmfbetaautoupdate.py: no-op (duration: 01m 14s) [production]
00:24 <papaul> OS install on wdqs200[4-6] [production]
00:03 <thcipriani@tin> Synchronized php-1.31.0-wmf.22/extensions/CentralAuth/includes/LocalRenameJob/LocalRenameUserJob.php: [[gerrit:414972|LocalRenameUserJob: escape backreferences in replacement title]] T188171 (duration: 01m 13s) [production]
2018-02-27 §
23:38 <krinkle@tin> Synchronized dblists/: remove pp_stage1_raw.dblist (duration: 01m 14s) [production]
21:29 <Hauskatze> ALL global renames failing [production]
21:23 <thcipriani@tin> Synchronized php-1.31.0-wmf.23/includes/user/User.php: [[gerrit:415101|Add a missing check of $wgActorTableSchemaMigrationStage]] T188437 (duration: 01m 14s) [production]
20:42 <ppchelko@tin> Finished deploy [eventstreams/deploy@14e0b03]: Set correct CSP headers, forgot to git pull (duration: 02m 29s) [production]
20:39 <ppchelko@tin> Started deploy [eventstreams/deploy@14e0b03]: Set correct CSP headers, forgot to git pull [production]
20:37 <ppchelko@tin> Finished deploy [eventstreams/deploy@8f2eec4]: Set correct CSP headers (duration: 00m 25s) [production]
20:36 <ppchelko@tin> Started deploy [eventstreams/deploy@8f2eec4]: Set correct CSP headers [production]
20:31 <thcipriani@tin> rebuilt and synchronized wikiversions files: Group0 to 1.31.0-wmf.23 [production]
20:08 <herron> eqiad puppet master reboots finished -- re-enabling puppet agents [production]
20:02 <herron> temporarily disabling puppet agents and rebooting eqiad puppet masters for kernel update [production]
20:02 <thcipriani@tin> Finished scap: testwiki to php-1.31.0-wmf.23 and rebuild l10n cache (duration: 32m 10s) [production]
19:30 <thcipriani@tin> Started scap: testwiki to php-1.31.0-wmf.23 and rebuild l10n cache [production]
19:08 <otto@tin> Finished deploy [eventstreams/deploy@8f2eec4]: Publish page change related streams: T187241 (duration: 04m 16s) [production]
19:03 <otto@tin> Started deploy [eventstreams/deploy@8f2eec4]: Publish page change related streams: T187241 [production]
19:03 <otto@tin> Finished deploy [eventstreams/deploy@8f2eec4]: Publish page change related streams: T187241 (scb2002 only) (duration: 00m 22s) [production]
19:03 <otto@tin> Started deploy [eventstreams/deploy@8f2eec4]: Publish page change related streams: T187241 (scb2002 only) [production]
18:32 <otto@tin> Started restart [eventstreams/deploy@7629e16]: service restart to publish page change related streams: T187241 (scb2001 only) [production]