201-250 of 10000 results (57ms)
2019-08-07 §
07:31 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
07:28 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Provision db2130 into s1 T228969 (duration: 00m 56s) [production]
07:27 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Provision db2130 into s1 T228969 (duration: 00m 55s) [production]
05:57 <marostegui> Stop MySQL on db1071 - T229381 [production]
05:55 <marostegui> Remove db1071 from tendril and zarcillo - T229381 [production]
05:51 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db1071 from config T229381 (duration: 00m 55s) [production]
05:50 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db1071 from config T229381 (duration: 00m 57s) [production]
05:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1100 after on-site maintenance', diff saved to https://phabricator.wikimedia.org/P8875 and previous config saved to /var/cache/conftool/dbconfig/20190807-053903-marostegui.json [production]
00:48 <mutante> restarting gerrit to apply config change 528276 to exclude some projects from github replication [production]
00:21 <mutante> gerrit2001 - restarting gerrit to apply 528276 [production]
2019-08-06 §
23:51 <catrope@deploy1001> Synchronized static/images/project-logos/: Update HD logos for enwikisource and sourceswiki (T229769) (duration: 00m 56s) [production]
23:50 <catrope@deploy1001> Synchronized php-1.34.0-wmf.17/extensions/Flow/includes/Import/OptInController.php: Unbreak disabling of Flow beta feature (T229795) (duration: 00m 55s) [production]
23:49 <catrope@deploy1001> Synchronized php-1.34.0-wmf.16/extensions/Flow/includes/Import/OptInController.php: Unbreak disabling of Flow beta feature (T229795) (duration: 00m 56s) [production]
23:36 <mutante> phabricator - added ssingh to acl*sre-team (group 29), WMF-NDA-requests (group 974) and WMF-NDA (group 61) (T229860) [production]
23:25 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Update HD logos for enwikisource and sourceswiki (T229769) (duration: 00m 55s) [production]
23:24 <catrope@deploy1001> Synchronized static/images/project-logos/: Update HD logos for enwikisource and sourceswiki (T229769) (duration: 00m 56s) [production]
23:19 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Switch updateBetaFeaturesUserCounts job to eventgate (T228705) (duration: 00m 57s) [production]
23:12 <eileen> civicrm revision changed from 2e03f9bb1e to 727a2c193b, config revision is 84b785d41c [production]
22:33 <ebernhardson> restart mjolnir-kafka-daemon across all elasticsearch servers [production]
22:25 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@9e95ab4]: Deploy latest mjolnir daemon to handle bulk imports via swift (duration: 05m 35s) [production]
22:19 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@9e95ab4]: Deploy latest mjolnir daemon to handle bulk imports via swift [production]
21:53 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@8e513f6]: Deploy latest mjolnir daemon to handle bulk imports via swift (duration: 16m 35s) [production]
21:36 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@8e513f6]: Deploy latest mjolnir daemon to handle bulk imports via swift [production]
21:35 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@860fb33]: Deploy latest mjolnir daemon to handle bulk imports via swift (duration: 01m 50s) [production]
21:34 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@860fb33]: Deploy latest mjolnir daemon to handle bulk imports via swift [production]
21:28 <@> helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . [production]
20:17 <subbu> repooled wtp2019 ( after papaul finished upgrade as part of T221572 ) [production]
19:52 <papaul> shutting down wtp2019 for firmware upgrade [production]
19:50 <herron> disabling puppet on logstash collectors for rolling deploy of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/528306/ T166107 [production]
19:42 <subbu> depooled wtp2019 ( to assist papaul with T221572 ) [production]
19:22 <thcipriani> gerrit restart on cobalt [production]
19:12 <brennen@deploy1001> rebuilt and synchronized wikiversions files: Group0 to 1.34.0-wmf.17 [production]
18:38 <brennen@deploy1001> Finished scap: testwiki to php-1.34.0-wmf.17 and rebuild l10n cache (duration: 19m 02s) [production]
18:19 <brennen@deploy1001> Started scap: testwiki to php-1.34.0-wmf.17 and rebuild l10n cache [production]
18:13 <brennen@deploy1001> Pruned MediaWiki: 1.34.0-wmf.14 [keeping static files] (duration: 08m 28s) [production]
17:37 <accraze@deploy1001> Finished deploy [ores/deploy@d08fa62]: T229848 (duration: 17m 21s) [production]
17:20 <accraze@deploy1001> Started deploy [ores/deploy@d08fa62]: T229848 [production]
17:14 <volans> uploaded spicerack_0.0.26-1_amd64.deb to apt.wikimedia.org stretch-wikimedia [production]
16:54 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=mathoid,name=codfw [production]
16:52 <@> helmfile [CODFW] Ran 'sync' command on namespace 'mathoid' for release 'production' . [production]
16:50 <brennen> cutting branch for 1.34.0-wmf.17 [production]
16:50 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=citoid,name=codfw [production]
16:50 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=eventgate-analytics,name=codfw [production]
16:48 <@> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics' for release 'analytics' . [production]
16:47 <akosiaris@puppetmaster1001> conftool action : set/pooled=false; selector: dnsdisc=mathoid,name=codfw [production]
16:43 <akosiaris@puppetmaster1001> conftool action : set/pooled=false; selector: dnsdisc=eventgate-analytics,name=codfw [production]
16:40 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T220625: Re-sync enable group1 on cloudelastic, job runners are claiming its not enabled while app servers are sending jobs (duration: 00m 47s) [production]
16:39 <@> helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
16:37 <@> helmfile [CODFW] Ran 'apply' command on namespace 'blubberoid' for release 'production' . [production]
16:36 <@> helmfile [CODFW] Ran 'sync' command on namespace 'citoid' for release 'production' . [production]