1801-1850 of 10000 results (66ms)
2020-04-07 ยง
09:49 <volans@deploy1001> Started deploy [homer/deploy@887544c]: Release v0.2.0 (take 2) [production]
09:38 <marostegui> Deploy schema change on db1119 [production]
09:38 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1119 for schema change', diff saved to https://phabricator.wikimedia.org/P10926 and previous config saved to /var/cache/conftool/dbconfig/20200407-093820-marostegui.json [production]
09:36 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1134 after schema change', diff saved to https://phabricator.wikimedia.org/P10925 and previous config saved to /var/cache/conftool/dbconfig/20200407-093638-marostegui.json [production]
09:31 <volans@deploy1001> Finished deploy [homer/deploy@b4522ad]: Release v0.2.0 (duration: 00m 16s) [production]
09:31 <volans@deploy1001> Started deploy [homer/deploy@b4522ad]: Release v0.2.0 [production]
09:29 <volans@deploy1001> Finished deploy [homer/deploy@ac7a818]: Inject plugins (take 3) (duration: 03m 03s) [production]
09:26 <volans@deploy1001> Started deploy [homer/deploy@ac7a818]: Inject plugins (take 3) [production]
09:19 <marostegui> Deploy schema change on db1134 [production]
09:18 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1134 for schema change', diff saved to https://phabricator.wikimedia.org/P10924 and previous config saved to /var/cache/conftool/dbconfig/20200407-091847-marostegui.json [production]
09:17 <volans@deploy1001> Finished deploy [homer/deploy@a03d7cd]: Inject plugins (take 2) (duration: 00m 29s) [production]
09:16 <volans@deploy1001> Started deploy [homer/deploy@a03d7cd]: Inject plugins (take 2) [production]
09:04 <vgutierrez> testing ATS 8.0.6-1wm6 on cp4026 and cp4032 [production]
08:58 <volans@deploy1001> Finished deploy [homer/deploy@a03d7cd]: Inject plugins (duration: 04m 59s) [production]
08:53 <volans@deploy1001> Started deploy [homer/deploy@a03d7cd]: Inject plugins [production]
08:46 <XioNoX> enable uRPF loose mode (log only) on cr3-ulsfo v4 uplinks - T244147 [production]
08:44 <XioNoX> enable uRPF loose mode (log only) on cr3-ulsfo v6 uplinks - T244147 [production]
08:42 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
08:37 <mutante> decom ganeti VM miscweb1001 (stretch) - kept backup of old racktables files and db dump in /root/racktables on miscweb1002 (T247648) [production]
08:33 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
08:31 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
08:30 <mutante> decom ganeti VM miscweb2001 (stretch) [production]
08:30 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
08:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1106 after schema change', diff saved to https://phabricator.wikimedia.org/P10923 and previous config saved to /var/cache/conftool/dbconfig/20200407-082607-marostegui.json [production]
08:17 <moritzm> installing php5 security updates [production]
08:06 <marostegui> Deploy schema change on db1106 (this will generate lag on s1 labs) [production]
08:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1106 for schema change', diff saved to https://phabricator.wikimedia.org/P10922 and previous config saved to /var/cache/conftool/dbconfig/20200407-080533-marostegui.json [production]
08:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1080 after schema change', diff saved to https://phabricator.wikimedia.org/P10921 and previous config saved to /var/cache/conftool/dbconfig/20200407-080443-marostegui.json [production]
07:52 <_joe_> disabling puppet on mwdebug1002 [production]
07:47 <marostegui> Failover dbproxy1011 to dbproxy1019 - T231520) [production]
07:43 <marostegui> Deploy schema change on db1080 [production]
07:43 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1080 for schema change', diff saved to https://phabricator.wikimedia.org/P10920 and previous config saved to /var/cache/conftool/dbconfig/20200407-074321-marostegui.json [production]
07:41 <dcausse@deploy1001> Finished deploy [wdqs/wdqs@23495ae]: deploying wdqs 0.3.17 to wdqs2002: T249196 (duration: 01m 28s) [production]
07:40 <dcausse@deploy1001> Started deploy [wdqs/wdqs@23495ae]: deploying wdqs 0.3.17 to wdqs2002: T249196 [production]
07:39 <_joe_> depooling wtp1025, used for debugging [production]
07:31 <vgutierrez> enable parent proxies in ats-tls - T249335 [production]
07:19 <jynus> restarting s3 on db1095 [production]
07:02 <moritzm> updating linux-image-4.9.0-11-amd64 where applicable [production]
06:55 <elukey@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
06:53 <elukey@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
06:52 <elukey@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
06:37 <moritzm> installing ruby2.1 security updates [production]
06:32 <jynus> stopping slave (s3) on db1095 [production]
05:38 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:586488|Fix database name for repo in testwikidata (T249533)]], take II (duration: 00m 58s) [production]
05:37 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:586488|Fix database name for repo in testwikidata (T249533)]] (duration: 01m 00s) [production]
05:26 <elukey@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
01:08 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.26/maintenance/: T157651 Remove sql.php from maintenance/ (duration: 00m 58s) [production]
01:06 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.26/autoload.php: T157651 Remove sql.php from autoloader (duration: 00m 58s) [production]
01:05 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.26/extensions/Wikibase/repo/includes/Store/Sql/DatabaseSchemaUpdater.php: T208425 T249565 Follow-up a956c655: Only avoid dropping wb_items_per_site so prod can be merged (duration: 00m 58s) [production]
00:01 <addshore@deploy1001> Synchronized php-1.35.0-wmf.26/extensions/Wikibase/repo/includes/Store/Sql/DatabaseSchemaUpdater.php: Do not try to drop things when theres no wb_terms table T208425 T249565 cache bust (duration: 01m 01s) [production]