201-250 of 10000 results (14ms)
2017-03-28 §
19:17 <thcipriani@tin> Started scap: testwiki to php-1.29.0-wmf.18 and rebuild l10n cache [production]
18:45 <urandom> T111113: Restarting Cassandra instances, codfw row 'd' [production]
18:44 <urandom> T111113: Restarting Cassandra instances, codfw row 'c' {{done}} [production]
18:18 <ppchelko@tin> Finished deploy [changeprop/deploy@1689d86]: Rename event field in logs (duration: 00m 52s) [production]
18:18 <ppchelko@tin> Started deploy [changeprop/deploy@1689d86]: Rename event field in logs [production]
17:53 <urandom> T111113: Restarting Cassandra instances, codfw row 'c' [production]
17:22 <thcipriani> starting branch cut for 1.29.0-wmf.18 [production]
17:07 <godog> swift codfw-prod: bump ms-be2028 ms-be2039 object weight to 3000 - T158337 [production]
17:06 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic2021.codfw.wmnet [production]
16:39 <urandom> T111113: Restarting remaining Cassandra instances, rack 'b', codfw (restbase20{02,07,10}) [production]
16:19 <urandom> T111113: Restarting Cassandra on restbase2001 to apply mandatory client encryption (canary) [production]
15:56 <gehel> banning elastic2021 to run same tests as elastic2020 - T149006 [production]
14:41 <elukey@puppetmaster1001> conftool action : set/pooled=yes; selector: name=mw2256.codfw.wmnet [production]
14:40 <marostegui> Convert dewiki UNIQUE keys into PK on db1091 (commonswiki) - T17441 [production]
14:38 <ppchelko@tin> Finished deploy [changeprop/deploy@bfbaa17]: Increase log level for processinng failures (duration: 01m 07s) [production]
14:38 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1091 - T17441 (duration: 00m 43s) [production]
14:38 <elukey> ran restart-hhvm on mw1242, hhvm threads stuck (dump debug in /tmp/hhvm.9008.bt.) - HHVM 3.12 [production]
14:37 <ppchelko@tin> Started deploy [changeprop/deploy@bfbaa17]: Increase log level for processinng failures [production]
13:54 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1092 - T17441 (duration: 00m 43s) [production]
13:44 <elukey> started hhvm on mw1261 (still depooled) - no hhvm process running [production]
13:29 <RoanKattouw> Ran initUserPreference.php -s ores-enabled -t rcenhancedfilters and -s ores-enabled -t oresHighlight on plwiki and ptwiki [production]
13:22 <catrope@tin> Synchronized wmf-config/InitialiseSettings.php: Enable RCFilters beta feature on plwiki and ptwiki T158336 (duration: 00m 43s) [production]
12:58 <moritzm> depooled mw1261 [production]
10:39 <ema> upgrading twisted to 16.2.0 on lvs3001 and lvs3002 (esams primaries) T160433 [production]
10:36 <ema> upgrading twisted to 16.2.0 on lvs3003 and lvs3004 (esams secondaries) T160433 [production]
10:27 <marostegui> Convert dewiki UNIQUE keys into PK on db1092 - https://phabricator.wikimedia.org/T17441 [production]
10:14 <elukey> Switching hue.w.o's backend (cache misc) from anaytics1027 to thorium - T159527 [production]
10:10 <moritzm> upgraded mw1262 to HHVM 3.18 [production]
08:48 <marostegui> Convert wikidatawiki UNIQUE keys into PK on db1092 - T17441 [production]
08:48 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1092 - T17441 (duration: 00m 44s) [production]
08:29 <akosiaris> enable IGMP snooping on all VLANs on asw2-d-eqiad. T133387 [production]
07:19 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 - T17441 (duration: 00m 43s) [production]
07:18 <moritzm> installing eject security updates on trusty hosts [production]
06:11 <marostegui> Keep converting unique keys into PK on db1089 - T17441 [production]
06:01 <marostegui> Deploy schema change on s2.enwiktionary.templatelinks - on codfw master, this will generate lag on codfw slaves (which have been silenced) - T154097 [production]
05:52 <marostegui> Run pt-table-checksum on es2 - T161510 [production]
02:39 <l10nupdate@tin> ResourceLoader cache refresh completed at Tue Mar 28 02:39:53 UTC 2017 (duration 5m 28s) [production]
02:34 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.17) (duration: 12m 37s) [production]
00:36 <reedy@tin> Synchronized private: Remove mwblocker.log (duration: 00m 44s) [production]
00:34 <reedy@tin> Synchronized wmf-config/CommonSettings.php: Remove $wgProxyList (duration: 00m 43s) [production]
2017-03-27 §
23:06 <ebernhardson@tin> Synchronized php-1.29.0-wmf.17/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: SWAT T160006, turning off cirrussearch AB test for sistersearch (duration: 00m 44s) [production]
22:00 <bawolff> deployed patch T151735 [production]
21:27 <andrewbogott> disabling puppet on labvirt* and labcontrol* to stagger roll out of https://gerrit.wikimedia.org/r/#/c/344689/ [production]
20:29 <arlolra> Updated Parsoid to 6eaad376 (T160599, T161178, T133267) [production]
20:21 <arlolra@tin> Finished deploy [parsoid/deploy@371ba4f]: Updating Parsoid to 6eaad376 (duration: 07m 06s) [production]
20:14 <arlolra@tin> Started deploy [parsoid/deploy@371ba4f]: Updating Parsoid to 6eaad376 [production]
19:57 <mutante> ruthenium/varnish misc - remove parsoid-tests.wikimedia.org server_name / backend - replaced by parsoid-rt-test and parsoid-vd-tests [production]
19:56 <legoktm@tin> Synchronized wmf-config/InitialiseSettings.php: Linter: whitelist parsoid canaries too - https://gerrit.wikimedia.org/r/#/c/344998/ - T160573 (duration: 00m 44s) [production]
18:08 <mobrovac@tin> Finished deploy [mobileapps/deploy@92f693c]: Remove the proxy from the config, deploying to scb2004 (duration: 00m 43s) [production]
18:07 <mobrovac@tin> Started deploy [mobileapps/deploy@92f693c]: Remove the proxy from the config, deploying to scb2004 [production]