401-450 of 10000 results (59ms)
2019-08-01 §
06:18 <_joe_> depooling mw1348 while moving it to no hhvm support. [production]
00:33 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.16/resources/Resources.php: acfff6751f3b8f7650 (duration: 00m 54s) [production]
00:32 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.16/includes/specials/SpecialJavaScriptTest.php: acfff6751f3b8f7650 (duration: 00m 54s) [production]
00:30 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.16/includes/resourceloader/ResourceLoader.php: acfff6751f3b8f7650 (duration: 00m 55s) [production]
00:28 <krinkle@deploy1001> sync-file aborted: composer.json composer.lock dblists debug.json docroot errorpages fc-list fonts images langlist langlist-labs multiversion php php-1.34.0-wmf.13 php-1.34.0-wmf.14 php-1.34.0-wmf.15 php-1.34.0-wmf.16 phpcs.xml phpunit.xml portals private README requirements.txt robots.txt rpc scap setup.py src static test-requirements.txt tests tox.ini typos vendor w wikiversions.json wikiversions-labs.js [production]
2019-07-31 §
23:34 <eileen> civicrm revision changed from 218328b29d to 857dcc9461, config revision is 84b785d41c [production]
23:22 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@db795ec]: Update mobileapps to b8c4166 (duration: 04m 21s) [production]
23:17 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@db795ec]: Update mobileapps to b8c4166 [production]
23:14 <Urbanecm> Evening SWAT done [production]
23:12 <urbanecm@deploy1001> Synchronized wmf-config/: SWAT: Add kask session storage configuration. Use only on testwiki, (ede989e, 862df8d, T222099) (duration: 00m 56s) [production]
21:56 <ejegg> updated fundraising python tools from 2a56e5e283 to 493a38f9e0 [production]
21:32 <XioNoX> set cr1-eqiad's netflow target port to 2100 (nfacctd) [production]
20:58 <brennen@deploy1001> Synchronized php: Revert group1 back to 1.34.0-wmf.15 (duration: 00m 53s) [production]
20:55 <brennen@deploy1001> rebuilt and synchronized wikiversions files: Revert group1 back to 1.34.0-wmf.15 [production]
20:48 <brennen@deploy1001> Synchronized php: group1 wikis to 1.34.0-wmf.16 (duration: 00m 54s) [production]
20:47 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.34.0-wmf.16 [production]
20:37 <brennen@deploy1001> Synchronized php-1.34.0-wmf.16/skins/MinervaNeue/includes/MinervaHooks.php: [[gerrit:526754|Limit Recent Changes disable-table mode to Minerva skin]] T228280 (duration: 00m 56s) [production]
20:32 <mdholloway> mobileapps deploy failed, investigating [production]
20:32 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@7c6ce69]: Update mobileapps to 5eb9068 (duration: 01m 39s) [production]
20:30 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@7c6ce69]: Update mobileapps to 5eb9068 [production]
20:01 <mbsantos@deploy1001> Finished deploy [proton/deploy@ed6ebd8]: Update chromium-renderer to 529c493 (T227124) (duration: 01m 43s) [production]
19:59 <mbsantos@deploy1001> Started deploy [proton/deploy@ed6ebd8]: Update chromium-renderer to 529c493 (T227124) [production]
19:55 <ejegg> updated payments-wiki from 70b432d309 to 9533f70fab [production]
18:49 <mutante> phab1003 - manually running project_changes.sh to create mail to phabricator-reports@lists (T228575) [production]
17:46 <cdanis@deploy1001> Synchronized wmf-config/etcd.php: I45b705c8 disable dbctl on half of canary hosts (duration: 00m 57s) [production]
17:21 <volans@deploy1001> Synchronized wmf-config/db-codfw.php: depool db2058, I/O error, T229449 (duration: 00m 54s) [production]
17:15 <volans@cumin1001> dbctl commit of MediaWiki config (dc=codfw), diff saved to 'https://phabricator.wikimedia.org/P8841', previous config saved to /var/cache/conftool/dbconfig/20190731-171536-volans.json [production]
16:52 <Urbanecm> Morning SWAT done [production]
16:39 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[:gerrit:526691|Enable MobileWebUIActionsTracking schema with 50% sampling rate]] (T220016) (duration: 00m 58s) [production]
16:37 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.15/extensions/WikimediaEvents/: SWAT: [[:gerrit:526688|Improved MobileUIActions tracking schema]] (T220016) (duration: 00m 54s) [production]
16:26 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.16/extensions/GrowthExperiments/: SWAT: [[:gerrit:526610|Only set relevant title on mobile skin]] (T229263, T225659) (duration: 00m 51s) [production]
16:25 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.15/extensions/GrowthExperiments/: SWAT: [[:gerrit:526612|Only set relevant title on mobile skin]] (T229263, T225659) (duration: 00m 56s) [production]
16:14 <bblack> deploying VCL for H/2 coalesce 421 responses - T207340 [production]
16:12 <marostegui> Poweroff pc2010 for on-site maintenance T227552 [production]
15:52 <mforns@deploy1001> Finished deploy [analytics/refinery@eb2d9b0]: deploying analytics-refinery up to eb2d9b005b26f6dddab2b59f1ba591f1758ec99f (duration: 13m 09s) [production]
15:45 <bstorm_> restarting nfs service on labstore1004 [production]
15:39 <mforns@deploy1001> Started deploy [analytics/refinery@eb2d9b0]: deploying analytics-refinery up to eb2d9b005b26f6dddab2b59f1ba591f1758ec99f [production]
15:24 <thcipriani> restarting jenkins for update [production]
15:22 <ema> cp-ats: upgrade fifo-log-demux to 0.4 and restart atsmtail@backend.service T229414 [production]
15:17 <brennen@deploy1001> rebuilt and synchronized wikiversions files: Group0 to 1.34.0-wmf.16 [production]
15:15 <ema> upload fifo-log-demux 0.4 to stretch-wikimedia T229414 [production]
15:03 <XioNoX> power down re1:cr1-codfw (backup) - T226422 [production]
14:57 <godog> ms-be2018 disablepd 1I:1:1 - T225630 [production]
14:47 <marostegui@cumin1001> dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8838', previous config saved to /var/cache/conftool/dbconfig/20190731-144731-marostegui.json [production]
14:45 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1112 (duration: 00m 46s) [production]
14:29 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1078 after upgrade and alter (duration: 00m 47s) [production]
14:28 <herron> beginning rolling reboots of codfw logstash hosts for security updates [production]
14:28 <marostegui@cumin1001> dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8837', previous config saved to /var/cache/conftool/dbconfig/20190731-142814-marostegui.json [production]
14:18 <cdanis@deploy1001> Synchronized wmf-config/etcd.php: I02d66736 expand dbctl to 25% of the fleet (duration: 00m 46s) [production]
14:04 <elukey@cumin1001> END (PASS) - Cookbook sre.zookeeper.roll-restart-zookeeper (exit_code=0) [production]