1201-1250 of 10000 results (71ms)
2019-08-07 §
13:55 <marostegui> Remove labsdb1004 and labsdb1005 from zarcillo database, as those hosts were decommissioned months ago [production]
13:48 <marostegui> Apply grants for dbproxy1003 on m3 - T202367 [production]
13:22 <elukey> roll restart aqs on aqs100[4-9] to pick up new Druid backend settings [production]
11:48 <Amir1> EU SWAT is done [production]
11:37 <kart_> Updated cxserver to 2019-08-06-100812-production (T227571) [production]
11:33 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:527087|Switch property terms migration to WRITE_NEW on client wikis (T225053)]] (duration: 00m 56s) [production]
11:29 <@> helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
11:26 <pmiazga@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:528458|Enable AMC on all wikipedias (T228916)]] (duration: 00m 55s) [production]
11:26 <@> helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
11:22 <@> helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . [production]
11:09 <marostegui> Restart gerrit [production]
10:11 <moritzm> deleting poolcounter1001, poolcounter1003, poolcounter2001, poolcounter2002 in Ganeti (T224572) [production]
10:03 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
10:03 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
09:14 <marostegui> Drop math table from s6 - T196055 [production]
08:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Provision db2131 into x1 T228969 (duration: 00m 55s) [production]
08:48 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Provision db2131 into x1 T228969 (duration: 00m 56s) [production]
08:37 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
08:37 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
08:01 <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db2130 into s1 - T228969', diff saved to https://phabricator.wikimedia.org/P8877 and previous config saved to /var/cache/conftool/dbconfig/20190807-080059-marostegui.json [production]
07:36 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
07:36 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
07:33 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1100 after on-site maintenance', diff saved to https://phabricator.wikimedia.org/P8876 and previous config saved to /var/cache/conftool/dbconfig/20190807-073349-marostegui.json [production]
07:32 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
07:31 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
07:28 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Provision db2130 into s1 T228969 (duration: 00m 56s) [production]
07:27 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Provision db2130 into s1 T228969 (duration: 00m 55s) [production]
05:57 <marostegui> Stop MySQL on db1071 - T229381 [production]
05:55 <marostegui> Remove db1071 from tendril and zarcillo - T229381 [production]
05:51 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db1071 from config T229381 (duration: 00m 55s) [production]
05:50 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db1071 from config T229381 (duration: 00m 57s) [production]
05:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1100 after on-site maintenance', diff saved to https://phabricator.wikimedia.org/P8875 and previous config saved to /var/cache/conftool/dbconfig/20190807-053903-marostegui.json [production]
00:48 <mutante> restarting gerrit to apply config change 528276 to exclude some projects from github replication [production]
00:21 <mutante> gerrit2001 - restarting gerrit to apply 528276 [production]
2019-08-06 §
23:51 <catrope@deploy1001> Synchronized static/images/project-logos/: Update HD logos for enwikisource and sourceswiki (T229769) (duration: 00m 56s) [production]
23:50 <catrope@deploy1001> Synchronized php-1.34.0-wmf.17/extensions/Flow/includes/Import/OptInController.php: Unbreak disabling of Flow beta feature (T229795) (duration: 00m 55s) [production]
23:49 <catrope@deploy1001> Synchronized php-1.34.0-wmf.16/extensions/Flow/includes/Import/OptInController.php: Unbreak disabling of Flow beta feature (T229795) (duration: 00m 56s) [production]
23:36 <mutante> phabricator - added ssingh to acl*sre-team (group 29), WMF-NDA-requests (group 974) and WMF-NDA (group 61) (T229860) [production]
23:25 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Update HD logos for enwikisource and sourceswiki (T229769) (duration: 00m 55s) [production]
23:24 <catrope@deploy1001> Synchronized static/images/project-logos/: Update HD logos for enwikisource and sourceswiki (T229769) (duration: 00m 56s) [production]
23:19 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Switch updateBetaFeaturesUserCounts job to eventgate (T228705) (duration: 00m 57s) [production]
23:12 <eileen> civicrm revision changed from 2e03f9bb1e to 727a2c193b, config revision is 84b785d41c [production]
22:33 <ebernhardson> restart mjolnir-kafka-daemon across all elasticsearch servers [production]
22:25 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@9e95ab4]: Deploy latest mjolnir daemon to handle bulk imports via swift (duration: 05m 35s) [production]
22:19 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@9e95ab4]: Deploy latest mjolnir daemon to handle bulk imports via swift [production]
21:53 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@8e513f6]: Deploy latest mjolnir daemon to handle bulk imports via swift (duration: 16m 35s) [production]
21:36 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@8e513f6]: Deploy latest mjolnir daemon to handle bulk imports via swift [production]
21:35 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@860fb33]: Deploy latest mjolnir daemon to handle bulk imports via swift (duration: 01m 50s) [production]
21:34 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@860fb33]: Deploy latest mjolnir daemon to handle bulk imports via swift [production]
21:28 <@> helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . [production]