3451-3500 of 10000 results (55ms)
2019-08-07 §
11:26 <pmiazga@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:528458|Enable AMC on all wikipedias (T228916)]] (duration: 00m 55s) [production]
11:26 <@> helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
11:22 <@> helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . [production]
11:09 <marostegui> Restart gerrit [production]
10:11 <moritzm> deleting poolcounter1001, poolcounter1003, poolcounter2001, poolcounter2002 in Ganeti (T224572) [production]
10:03 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
10:03 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
09:14 <marostegui> Drop math table from s6 - T196055 [production]
08:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Provision db2131 into x1 T228969 (duration: 00m 55s) [production]
08:48 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Provision db2131 into x1 T228969 (duration: 00m 56s) [production]
08:37 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
08:37 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
08:01 <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db2130 into s1 - T228969', diff saved to https://phabricator.wikimedia.org/P8877 and previous config saved to /var/cache/conftool/dbconfig/20190807-080059-marostegui.json [production]
07:36 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
07:36 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
07:33 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1100 after on-site maintenance', diff saved to https://phabricator.wikimedia.org/P8876 and previous config saved to /var/cache/conftool/dbconfig/20190807-073349-marostegui.json [production]
07:32 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
07:31 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
07:28 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Provision db2130 into s1 T228969 (duration: 00m 56s) [production]
07:27 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Provision db2130 into s1 T228969 (duration: 00m 55s) [production]
05:57 <marostegui> Stop MySQL on db1071 - T229381 [production]
05:55 <marostegui> Remove db1071 from tendril and zarcillo - T229381 [production]
05:51 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db1071 from config T229381 (duration: 00m 55s) [production]
05:50 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db1071 from config T229381 (duration: 00m 57s) [production]
05:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1100 after on-site maintenance', diff saved to https://phabricator.wikimedia.org/P8875 and previous config saved to /var/cache/conftool/dbconfig/20190807-053903-marostegui.json [production]
00:48 <mutante> restarting gerrit to apply config change 528276 to exclude some projects from github replication [production]
00:21 <mutante> gerrit2001 - restarting gerrit to apply 528276 [production]
2019-08-06 §
23:51 <catrope@deploy1001> Synchronized static/images/project-logos/: Update HD logos for enwikisource and sourceswiki (T229769) (duration: 00m 56s) [production]
23:50 <catrope@deploy1001> Synchronized php-1.34.0-wmf.17/extensions/Flow/includes/Import/OptInController.php: Unbreak disabling of Flow beta feature (T229795) (duration: 00m 55s) [production]
23:49 <catrope@deploy1001> Synchronized php-1.34.0-wmf.16/extensions/Flow/includes/Import/OptInController.php: Unbreak disabling of Flow beta feature (T229795) (duration: 00m 56s) [production]
23:36 <mutante> phabricator - added ssingh to acl*sre-team (group 29), WMF-NDA-requests (group 974) and WMF-NDA (group 61) (T229860) [production]
23:25 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Update HD logos for enwikisource and sourceswiki (T229769) (duration: 00m 55s) [production]
23:24 <catrope@deploy1001> Synchronized static/images/project-logos/: Update HD logos for enwikisource and sourceswiki (T229769) (duration: 00m 56s) [production]
23:19 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Switch updateBetaFeaturesUserCounts job to eventgate (T228705) (duration: 00m 57s) [production]
23:12 <eileen> civicrm revision changed from 2e03f9bb1e to 727a2c193b, config revision is 84b785d41c [production]
22:33 <ebernhardson> restart mjolnir-kafka-daemon across all elasticsearch servers [production]
22:25 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@9e95ab4]: Deploy latest mjolnir daemon to handle bulk imports via swift (duration: 05m 35s) [production]
22:19 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@9e95ab4]: Deploy latest mjolnir daemon to handle bulk imports via swift [production]
21:53 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@8e513f6]: Deploy latest mjolnir daemon to handle bulk imports via swift (duration: 16m 35s) [production]
21:36 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@8e513f6]: Deploy latest mjolnir daemon to handle bulk imports via swift [production]
21:35 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@860fb33]: Deploy latest mjolnir daemon to handle bulk imports via swift (duration: 01m 50s) [production]
21:34 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@860fb33]: Deploy latest mjolnir daemon to handle bulk imports via swift [production]
21:28 <@> helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . [production]
20:17 <subbu> repooled wtp2019 ( after papaul finished upgrade as part of T221572 ) [production]
19:52 <papaul> shutting down wtp2019 for firmware upgrade [production]
19:50 <herron> disabling puppet on logstash collectors for rolling deploy of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/528306/ T166107 [production]
19:42 <subbu> depooled wtp2019 ( to assist papaul with T221572 ) [production]
19:22 <thcipriani> gerrit restart on cobalt [production]
19:12 <brennen@deploy1001> rebuilt and synchronized wikiversions files: Group0 to 1.34.0-wmf.17 [production]
18:38 <brennen@deploy1001> Finished scap: testwiki to php-1.34.0-wmf.17 and rebuild l10n cache (duration: 19m 02s) [production]