1401-1450 of 10000 results (47ms)
2020-01-07 §
07:42 <elukey> restart Hue after applying a new kerberos setting (hue_principal, was not specified before) [analytics]
07:42 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool es1019', diff saved to https://phabricator.wikimedia.org/P10055 and previous config saved to /var/cache/conftool/dbconfig/20200107-074159-marostegui.json [production]
07:40 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool es1019 for upgrade', diff saved to https://phabricator.wikimedia.org/P10054 and previous config saved to /var/cache/conftool/dbconfig/20200107-074035-marostegui.json [production]
07:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool es1013', diff saved to https://phabricator.wikimedia.org/P10053 and previous config saved to /var/cache/conftool/dbconfig/20200107-073922-marostegui.json [production]
07:35 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool es1013 for upgrade', diff saved to https://phabricator.wikimedia.org/P10052 and previous config saved to /var/cache/conftool/dbconfig/20200107-073543-marostegui.json [production]
07:35 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool es1018', diff saved to https://phabricator.wikimedia.org/P10051 and previous config saved to /var/cache/conftool/dbconfig/20200107-073508-marostegui.json [production]
07:29 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool es1018 for upgrade', diff saved to https://phabricator.wikimedia.org/P10050 and previous config saved to /var/cache/conftool/dbconfig/20200107-072930-marostegui.json [production]
07:15 <marostegui> Remove partitions from s5: db2084:3315 T239453 [production]
07:12 <marostegui> Remove partitions from revision table on s6: db1098 T239453 [production]
07:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1098:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10049 and previous config saved to /var/cache/conftool/dbconfig/20200107-070850-marostegui.json [production]
07:05 <marostegui> Depool labsdb1011 [production]
07:03 <marostegui> Deploy schema change on s8 codfw (this will generate lag on s8 codfw) - T234052 [production]
06:48 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2089:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10048 and previous config saved to /var/cache/conftool/dbconfig/20200107-064846-marostegui.json [production]
05:28 <bd808> Creating tools-k8s-worker-[6-14] (again) [tools]
05:20 <bd808> Deleting busted tools-k8s-worker-[6-14] [tools]
05:02 <bd808> Creating tools-k8s-worker-[6-14] [tools]
01:20 <Krenair> Restarted webservice https://en.wikipedia.org/wiki/User_talk:Krenair#Citation_bot [tools.citations]
01:17 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
01:15 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: InitialiseSettings - clean up groupOverrides layout / spacing (sync again) (duration: 00m 53s) [production]
01:14 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: InitialiseSettings - clean up groupOverrides layout / spacing (duration: 00m 54s) [production]
01:12 <mutante> ganeti - creating urldownloader2002.wikimedia.org in codfw_B with 1 CPU, 1 GB RAM, 10 GB disk, public IP (T241979) [production]
01:12 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
01:09 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
01:04 <mutante> ganeti - creating urldownloader2001.wikimedia.org in codfw_A with 1 CPU, 1 GB RAM, 10 GB disk, public IP (T241979) [production]
01:04 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
01:03 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Revert: "cirrus: Shift more_like to codfw cirrus cluster" (duration: 00m 54s) [production]
01:02 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
00:59 <mutante> ganeti - creating urldownloader1002.wikimedia.org in eqiad_C with 1 CPU, 1 GB RAM, 10 GB disk, public IP (T241979) [production]
00:58 <mutante> ganeti - creating urldownloader1001.wikimedia.org in eqiad_A with 1 CPU, 1 GB RAM, 10 GB disk, public IP (T241979) [production]
00:57 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
00:57 <ebernhardson@deploy1001> Synchronized wmf-config/CirrusSearch-common.php: Revert "reduce query load on cirrus elastic clusters" (duration: 00m 54s) [production]
00:57 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
00:56 <ebernhardson@deploy1001> sync-file aborted: Revery (duration: 00m 00s) [production]
00:52 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
00:46 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:561927|GrowthExperiments: use local search in production (T235717)]] (duration: 00m 54s) [production]
00:45 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:561927|GrowthExperiments: use local search in production (T235717)]] (duration: 00m 58s) [production]
00:27 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562359|Enable Partial Blocks on every wiki excluding those that have opted-out (T218626)]] (duration: 00m 55s) [production]
00:26 <bstorm_> repooled tools-sgewebgrid-lighttpd-0919 [tools]
00:17 <bstorm_> repooled tools-sgewebgrid-lighttpd-0918 [tools]
00:15 <bstorm_> moving tools-sgewebgrid-lighttpd-0918 and -0919 to cloudvirt1004 from cloudvirt1029 to rebalance load [tools]
00:02 <bstorm_> depooled tools-sgewebgrid-lighttpd-0918 and 0919 to move to cloudvirt1004 to improve spread [tools]
2020-01-06 §
23:49 <ejegg> updated payments-wiki from 827e3235dc to c3ca3ad6a7 [production]
23:40 <bd808> Deleted tools-sgewebgrid-lighttpd-09{0[1-9],10} [tools]
23:36 <bd808> Shutdown tools-sgewebgrid-lighttpd-09{0[1-9],10} [tools]
23:34 <bd808> Decommissioned tools-sgewebgrid-lighttpd-09{0[1-9],10} [tools]
23:13 <bstorm_> Repooled tools-sgeexec-0922 because I don't know why it was depooled [tools]
23:12 <mutante> mailman - running /usr/local/sbin/rename_list wikimediamy wikimedia-my (T241988) [production]
23:01 <bd808> Depooled tools-sgewebgrid-lighttpd-0910.tools.eqiad.wmflabs [tools]
22:58 <bd808> Depooling tools-sgewebgrid-lighttpd-090[2-9] [tools]
22:57 <bd808> Disabling queues on tools-sgewebgrid-lighttpd-090[2-9] [tools]