751-800 of 10000 results (33ms)
2016-02-03 §
17:32 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Repool db1060 after maintenance (duration: 01m 20s) [production]
17:22 <mobrovac> restbase restarting rb1001 [production]
17:03 <mdholloway> mobileapps deployed 68e38ec [production]
17:02 <bblack> restarting pybal on lvs1004 (not 1003!) T125397 [production]
17:02 <bblack> restarting pybal on lvs1003 T125397 [production]
16:57 <hashar> mira: updating /srv/mediawiki-staging/php-1.27.0-wmf.12 (prep deployment train) [production]
16:55 <thcipriani@mira> Synchronized wmf-config/CirrusSearch-production.php: SWAT: Return more like search queries to codfw [[gerrit:268097]] (duration: 01m 17s) [production]
16:45 <thcipriani@mira> Synchronized wmf-config/CommonSettings.php: SWAT: Remove unused/no longer existing item-create oauth grant [[gerrit:265447]] (duration: 01m 18s) [production]
16:39 <thcipriani@mira> Synchronized wmf-config: SWAT: Enable math data type on test wikidata + test wikipedias [[gerrit:268086]] (duration: 01m 18s) [production]
16:32 <thcipriani@mira> Synchronized wmf-config/mobile.php: SWAT: Remove section collapsing config [[gerrit:267776]] (duration: 01m 18s) [production]
16:28 <akosiaris> OTRS migration to 4.0 completed, starting upgrade to 5.0 [production]
16:24 <thcipriani@mira> Synchronized wmf-config/CommonSettings.php: SWAT: MW parsoid URLs: s/parsoidcache/parsoid/ [[gerrit:267234]] (duration: 01m 18s) [production]
16:18 <thcipriani@mira> Synchronized wmf-config/InitialiseSettings.php: SWAT: Add 2 sites to $wgCopyUploadsDomains [[gerrit:262893]] (duration: 01m 18s) [production]
16:13 <thcipriani@mira> Synchronized wmf-config/InitialiseSettings.php: SWAT: Just use the default MobileFrontend specified page actions. Part II [[gerrit:267807]] (duration: 01m 18s) [production]
16:11 <thcipriani@mira> Synchronized wmf-config/mobile.php: SWAT: Just use the default MobileFrontend specified page actions. Part I [[gerrit:267807]] (duration: 02m 14s) [production]
15:41 <hashar> mira symlink pointing to current version got changed to wmf.11 by the checkoutMediaWiki script. Manually changed to proper wmf.10 https://phabricator.wikimedia.org/T125475#1994078 [production]
15:32 <jynus> restart and reconfigure mysql in db1060 [production]
15:30 <hashar> MediaWiki 1.27.0-wmf.12, from 1.27.0-wmf.12, successfully checked out. [production]
15:23 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Depool db1060 (duration: 00m 43s) [production]
15:21 <hashar> mira: cloning 1.27.0-wmf.12 (no link updates) [production]
15:15 <bblack> rebooting cp1060 (depooled/downtimed) [production]
15:11 <bblack> depooling cp1060 temporarily from cache_mobile varnish backends [production]
14:55 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Repool db1054 with low weight, repool db1067 with original weight (duration: 01m 22s) [production]
14:50 <bblack> rebooting cp1008 for kernel [production]
14:28 <godog> investigating uwsgi processes for graphite-web not coming up after reboot [production]
14:10 <moritzm> rebooting graphite1001 for kernel update [production]
13:41 <godog> powercycle ms-be2015 [production]
13:39 <jynus> restarting and reconfiguring mysql at db1054 [production]
13:27 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Repool db1067 at low weight; depool db1054 (duration: 01m 16s) [production]
11:45 <jynus> restarting and reconfiguring mysql at db1067 [production]
11:11 <moritzm> repooling restbase1001 [production]
11:04 <akosiaris> OTRS database upgraded to 3.3, moving on with 4.0 [production]
11:00 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Repool db1063 at 100% load; depool db1067 for maintenance (duration: 01m 16s) [production]
10:48 <moritzm> depooling restbase1001 for kernel/Java update [production]
10:37 <_joe_> ending the load test on the eqiad apaches [production]
10:11 <moritzm> reboot francium for kernel update [production]
09:53 <jynus> m2 backup finished on /srv/backups/2016-02-03_08-51-06, filename 'db1020-bin.000842', position 220103947 [production]
09:50 <moritzm> restarting neodymium for kernel update [production]
09:49 <_joe_> doing some basic load test on appservers in eqiad [production]
08:52 <akosiaris> stop otrs-daemon on mendelevium [production]
08:51 <jynus> starting mysql backup on db1020 (/srv/backups) [production]
08:44 <akosiaris> stop slave on db2011, db1020's (m2-master) slave, for OTRS migration. DO NOT ENABLE [production]
08:40 <akosiaris> stop exim4, cron, apache2 on iodine, mendelevium [production]
08:39 <akosiaris> disabling puppet on iodine, mendelevium, OTRS migration [production]
08:24 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Repool db1063 with low weight (duration: 01m 20s) [production]
2016-02-02 §
23:13 <demon@mira> Finished scap: everything re-sync one more time for good measure (duration: 17m 04s) [production]
22:56 <demon@mira> Started scap: everything re-sync one more time for good measure [production]
22:50 <bblack> repooling scap proxies: mw10033, mw1070, mw1097, mw1216 [production]
22:45 <chasemp> restart hhvm & apache2 on mw1235.eqiad.wmnet [production]
22:44 <_joe_> restarted hhvm on mw1231, stat_cache again [production]