301-350 of 10000 results (20ms)
2020-05-23 §
18:05 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.31/includes/filerepo/: I31a9bb6672 (duration: 01m 10s) [production]
15:44 <krinkle@deploy1001> Synchronized wmf-config/mc.php: I5ad8fe96b9098a8 - Disable coalesceKeys on commonswiki (duration: 01m 09s) [production]
14:58 <Krinkle> scap-pull to reset state on mwdebug1002 [production]
14:50 <Krinkle> Testing mc.php changes on mwdebug1002 [production]
08:04 <elukey> powercycle an-presto1004 - unresponsive, racadm getsel shows CPU overheating alerts [production]
2020-05-22 §
22:42 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.31/includes/filerepo/: Ie19613ef7643a (duration: 01m 06s) [production]
22:40 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.32/includes/filerepo/: Ie19613ef7643a (duration: 01m 08s) [production]
15:58 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
15:58 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
15:57 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
15:53 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
15:47 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
15:45 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
15:45 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
15:30 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
15:25 <cdanis> fixing prometheus-nic-firmware-textfile.service wherever it is broken T253374 [production]
15:25 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
15:24 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]
15:06 <marostegui> Decrease tendril_purge_global_status_log_5m storing rows time from 2 days to 1 day T252331 [production]
15:01 <kormat@cumin1001> dbctl commit (dc=all): 'Pool db2137 into s4+s5 T252985', diff saved to https://phabricator.wikimedia.org/P11292 and previous config saved to /var/cache/conftool/dbconfig/20200522-150120-kormat.json [production]
14:53 <reedy@deploy1001> Synchronized php-1.35.0-wmf.31/maintenance/blockUsers.php: (no justification provided) (duration: 01m 08s) [production]
14:51 <reedy@deploy1001> Synchronized php-1.35.0-wmf.32/maintenance/blockUsers.php: (no justification provided) (duration: 01m 09s) [production]
14:35 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1144:331[45] and db1097:331[45]', diff saved to https://phabricator.wikimedia.org/P11290 and previous config saved to /var/cache/conftool/dbconfig/20200522-143541-marostegui.json [production]
14:24 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
14:22 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1144:331[45] and db1097:331[45]', diff saved to https://phabricator.wikimedia.org/P11289 and previous config saved to /var/cache/conftool/dbconfig/20200522-141513-marostegui.json [production]
14:13 <sukhe> upload dnsdist_1.4.0-1~deb10u1 to apt.wm.o (buster) - T252132 [production]
14:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1144:331[45] and db1097:331[45]', diff saved to https://phabricator.wikimedia.org/P11288 and previous config saved to /var/cache/conftool/dbconfig/20200522-140847-marostegui.json [production]
13:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1144:331[45] and db1097:331[45]', diff saved to https://phabricator.wikimedia.org/P11286 and previous config saved to /var/cache/conftool/dbconfig/20200522-131452-marostegui.json [production]
13:10 <jayme@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'termbox' for release 'production' . [production]
13:10 <jayme@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'termbox' for release 'production' . [production]
13:09 <jayme@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'staging' . [production]
13:08 <jayme@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'test' . [production]
13:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1144:3314 and db1144:3315 to the list of hosts', diff saved to https://phabricator.wikimedia.org/P11284 and previous config saved to /var/cache/conftool/dbconfig/20200522-130707-marostegui.json [production]
12:56 <vgutierrez> depool cp4032 for some ats tests [production]
12:13 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
12:12 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
12:06 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
12:04 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
12:03 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
12:03 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
10:48 <marostegui> Stop MySQL on db1097:3314, db1097:3315 to clone db1144 - T252512 [production]
10:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1097:3314, db1097:3315 - T252512', diff saved to https://phabricator.wikimedia.org/P11281 and previous config saved to /var/cache/conftool/dbconfig/20200522-104437-marostegui.json [production]
10:37 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
10:35 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
10:34 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
10:32 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
10:10 <marostegui> Stop event_scheduler on db1115 - T252331 [production]
10:09 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
10:05 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]