4301-4350 of 10000 results (31ms)
2020-05-27 ยง
14:56 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:56 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
14:54 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
14:52 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
14:51 <cdanis> cumin1001: upgrading python3-conftool and python3-conftool-dbctl [production]
14:50 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
14:50 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
14:46 <cdanis> cumin2001: upgrading python3-conftool and python3-conftool-dbctl [production]
14:43 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
14:43 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
14:40 <cdanis> reprepro: upload conftool_1.3.1-1{,+deb10u1} to {stretch,buster}-wikimedia [production]
14:36 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:36 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
14:32 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
14:32 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
14:30 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
14:16 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1146:3312, db1146:3314 and db1103:3312, db1103:3314', diff saved to https://phabricator.wikimedia.org/P11318 and previous config saved to /var/cache/conftool/dbconfig/20200527-141635-marostegui.json [production]
14:13 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
14:13 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
14:07 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:07 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
14:04 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
14:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1146:3312, db1146:3314 and db1103:3312, db1103:3314', diff saved to https://phabricator.wikimedia.org/P11317 and previous config saved to /var/cache/conftool/dbconfig/20200527-140442-marostegui.json [production]
14:03 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
14:03 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
13:58 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
13:51 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
13:51 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
13:48 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
13:47 <dzahn@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) [production]
13:47 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
13:47 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1146:3312, db1146:3314 and db1103:3312, db1103:3314', diff saved to https://phabricator.wikimedia.org/P11316 and previous config saved to /var/cache/conftool/dbconfig/20200527-134704-marostegui.json [production]
13:45 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
13:42 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
13:36 <gehel@cumin1001> START - Cookbook sre.postgresql.postgres-init [production]
13:34 <gehel@cumin1001> END (FAIL) - Cookbook sre.postgresql.postgres-init (exit_code=99) [production]
13:34 <gehel@cumin1001> START - Cookbook sre.postgresql.postgres-init [production]
13:21 <gehel> repool maps2004 / depool maps2003 [production]
13:21 <ema> cp: upgrade purged to 0.14 [production]
13:18 <marostegui> Kill /usr/local/bin/mwscriptwikiset updateSpecialPages.php s8.dblist --override --only=Fewestrevisions T238199 [production]
13:16 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
13:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1146:3312, db1146:3314 and db1103:3312, db1103:3314', diff saved to https://phabricator.wikimedia.org/P11313 and previous config saved to /var/cache/conftool/dbconfig/20200527-131515-marostegui.json [production]
13:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1146:3312 and db1146:3314 to dbctl T252512', diff saved to https://phabricator.wikimedia.org/P11312 and previous config saved to /var/cache/conftool/dbconfig/20200527-130820-marostegui.json [production]
13:06 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
11:34 <Urbanecm> EU SWAT done [production]
11:28 <urbanecm@deploy1001> Synchronized php-1.35.0-wmf.34/extensions/GrowthExperiments/: SWAT: 983eda5: Mentorship dialog: Swap panel to ask-help on open (T253692) (duration: 01m 06s) [production]
11:18 <ema> cp2027: upgrade purged to 0.14 [production]
11:17 <ema> purged 0.14 uploaded to buster-wikimedia [production]
11:09 <kartik@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|598678|Enable ContentTranslation in Galician Wikipedia as a default tool (T250355)]] (duration: 01m 18s) [production]
10:15 <hashar> contint2001: starting zuul [production]