3401-3450 of 10000 results (37ms)
2016-02-03 ยง
19:48 <robh> halting puppet on carbon for a few minutes to livehack a partition recipe change in netboot.cfg [production]
19:45 <hashar> https://phabricator.wikimedia.org/T125672 blocking wmf.12 "Notice: Undefined variable: wgMFQueryPropModules in /srv/mediawiki/wmf-config/Wikibase.php on line 120" [production]
19:39 <akosiaris> hot patch OTRS installation with https://github.com/OTRS/otrs/commit/c7ea6d64e02518e166fbac02f42f25dacad54342 [production]
19:35 <hashar> mira: manually fixed /php and /w/static/current symlinks to point back to .10 (wikiversions migrated them to .11 which we skip) [production]
19:30 <moritzm> repooling restbase1002 [production]
19:29 <hashar> Create patches to update wikiversions.json [production]
19:24 <hashar> Applying security patches on mira [production]
19:24 <hashar> starting train deployment of 1.27.0-wmf.12 [production]
19:09 <csteipp> deployed patch for T125684 [production]
19:08 <moritzm> depooling restbase1002 for kernel/Java update [production]
18:38 <bd808@mira> Synchronized wmf-config/InitialiseSettings-labs.php: Experiment one: Labs stripping HTML in beta (360e5af) (duration: 01m 19s) [production]
18:34 <moritzm> rebooting californium for kernel update [production]
18:16 <bblack> restarting pybal on lvs1001 [production]
18:04 <jynus> previous announcement was for db2011, not db2010 [production]
18:02 <jynus> starting slave IO thread on db2010 [production]
17:32 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Repool db1060 after maintenance (duration: 01m 20s) [production]
17:22 <mobrovac> restbase restarting rb1001 [production]
17:03 <mdholloway> mobileapps deployed 68e38ec [production]
17:02 <bblack> restarting pybal on lvs1004 (not 1003!) T125397 [production]
17:02 <bblack> restarting pybal on lvs1003 T125397 [production]
16:57 <hashar> mira: updating /srv/mediawiki-staging/php-1.27.0-wmf.12 (prep deployment train) [production]
16:55 <thcipriani@mira> Synchronized wmf-config/CirrusSearch-production.php: SWAT: Return more like search queries to codfw [[gerrit:268097]] (duration: 01m 17s) [production]
16:45 <thcipriani@mira> Synchronized wmf-config/CommonSettings.php: SWAT: Remove unused/no longer existing item-create oauth grant [[gerrit:265447]] (duration: 01m 18s) [production]
16:39 <thcipriani@mira> Synchronized wmf-config: SWAT: Enable math data type on test wikidata + test wikipedias [[gerrit:268086]] (duration: 01m 18s) [production]
16:32 <thcipriani@mira> Synchronized wmf-config/mobile.php: SWAT: Remove section collapsing config [[gerrit:267776]] (duration: 01m 18s) [production]
16:28 <akosiaris> OTRS migration to 4.0 completed, starting upgrade to 5.0 [production]
16:24 <thcipriani@mira> Synchronized wmf-config/CommonSettings.php: SWAT: MW parsoid URLs: s/parsoidcache/parsoid/ [[gerrit:267234]] (duration: 01m 18s) [production]
16:18 <thcipriani@mira> Synchronized wmf-config/InitialiseSettings.php: SWAT: Add 2 sites to $wgCopyUploadsDomains [[gerrit:262893]] (duration: 01m 18s) [production]
16:13 <thcipriani@mira> Synchronized wmf-config/InitialiseSettings.php: SWAT: Just use the default MobileFrontend specified page actions. Part II [[gerrit:267807]] (duration: 01m 18s) [production]
16:11 <thcipriani@mira> Synchronized wmf-config/mobile.php: SWAT: Just use the default MobileFrontend specified page actions. Part I [[gerrit:267807]] (duration: 02m 14s) [production]
15:41 <hashar> mira symlink pointing to current version got changed to wmf.11 by the checkoutMediaWiki script. Manually changed to proper wmf.10 https://phabricator.wikimedia.org/T125475#1994078 [production]
15:32 <jynus> restart and reconfigure mysql in db1060 [production]
15:30 <hashar> MediaWiki 1.27.0-wmf.12, from 1.27.0-wmf.12, successfully checked out. [production]
15:23 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Depool db1060 (duration: 00m 43s) [production]
15:21 <hashar> mira: cloning 1.27.0-wmf.12 (no link updates) [production]
15:15 <bblack> rebooting cp1060 (depooled/downtimed) [production]
15:11 <bblack> depooling cp1060 temporarily from cache_mobile varnish backends [production]
14:55 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Repool db1054 with low weight, repool db1067 with original weight (duration: 01m 22s) [production]
14:50 <bblack> rebooting cp1008 for kernel [production]
14:28 <godog> investigating uwsgi processes for graphite-web not coming up after reboot [production]
14:10 <moritzm> rebooting graphite1001 for kernel update [production]
13:41 <godog> powercycle ms-be2015 [production]
13:39 <jynus> restarting and reconfiguring mysql at db1054 [production]
13:27 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Repool db1067 at low weight; depool db1054 (duration: 01m 16s) [production]
11:45 <jynus> restarting and reconfiguring mysql at db1067 [production]
11:11 <moritzm> repooling restbase1001 [production]
11:04 <akosiaris> OTRS database upgraded to 3.3, moving on with 4.0 [production]
11:00 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Repool db1063 at 100% load; depool db1067 for maintenance (duration: 01m 16s) [production]
10:48 <moritzm> depooling restbase1001 for kernel/Java update [production]
10:37 <_joe_> ending the load test on the eqiad apaches [production]