|
2021-12-21
§
|
| 11:02 |
<volans@cumin1001> |
START - Cookbook sre.hosts.provision for host elastic1086.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 11:00 |
<jynus> |
reenabled puppet on mx1001 T298038 |
[production] |
| 10:59 |
<volans@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host elastic1084.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 10:53 |
<volans@cumin1001> |
START - Cookbook sre.hosts.provision for host elastic1084.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 10:35 |
<volans@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host elastic1085.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 10:29 |
<volans@cumin1001> |
START - Cookbook sre.hosts.provision for host elastic1085.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 10:28 |
<volans@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 10:23 |
<volans@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 10:13 |
<jynus> |
disabling puppet on mx1001 T298038 |
[production] |
| 10:03 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2007.codfw.wmnet |
[production] |
| 09:59 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host ganeti2007.codfw.wmnet |
[production] |
| 09:38 |
<oblivian@deploy1002> |
helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 09:38 |
<oblivian@deploy1002> |
helmfile [staging-eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 09:37 |
<oblivian@deploy1002> |
helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 09:37 |
<oblivian@deploy1002> |
helmfile [staging-eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 09:34 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti2007.codfw.wmnet with OS buster |
[production] |
| 09:07 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reimage for host ganeti2007.codfw.wmnet with OS buster |
[production] |
| 08:50 |
<ema> |
cp3051: pool with single backend experiment reverted T288106 |
[production] |
| 08:45 |
<ema> |
cp3051: depool to revert single backend experiment T288106 |
[production] |
| 08:29 |
<ema> |
cp4021: pool with single backend experiment reverted T288106 |
[production] |
| 08:14 |
<ema> |
cp4021: depool to revert single backend experiment T288106 |
[production] |
| 02:33 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 02:32 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 02:29 |
<legoktm> |
depooling mw1450 |
[production] |
| 02:27 |
<legoktm> |
repooling mw1312 |
[production] |
| 02:08 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 02:04 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 01:06 |
<legoktm> |
depooling mw1312 for benchmarking |
[production] |
| 00:35 |
<ejegg> |
updated fundraising CiviCRM from 2826afc3 to e1ffa75a |
[production] |
|
2021-12-20
§
|
| 23:38 |
<ryankemper> |
[WCQS Deploy] Deploy complete of version `0.3.97` |
[production] |
| 23:27 |
<ejegg> |
updated fundraising CiviCRM from 07efd9fb to 2826afc3 |
[production] |
| 23:26 |
<bking@deploy1002> |
Finished deploy [wdqs/wdqs@81ee634] (wcqs): Deploy 0.3.97 to WCQS (duration: 02m 46s) |
[production] |
| 23:23 |
<bking@deploy1002> |
Started deploy [wdqs/wdqs@81ee634] (wcqs): Deploy 0.3.97 to WCQS |
[production] |
| 23:23 |
<ejegg> |
updated SmashPig standalone (IPN listener) from 235a261b to 5a7d0c2c |
[production] |
| 23:04 |
<inflatador> |
[WDQS Deploy] Restarting `wdqs-categories` across lvs-managed hosts, one node at a time: `sudo -E cumin -b 1 'A:wdqs-all and not A:wdqs-test' 'depool && sleep 45 && systemctl restart wdqs-categories && sleep 45 && pool'` |
[production] |
| 23:04 |
<ryankemper> |
[WDQS] `ryankemper@wdqs1006:~$ sudo depool` (catching up on ~14.5 hours of lag) |
[production] |
| 23:04 |
<inflatador> |
[WDQS Deploy] Restarted `wdqs-categories` across all test hosts simultaneously: `sudo -E cumin 'A:wdqs-test' 'systemctl restart wdqs-categories'` |
[production] |
| 23:03 |
<inflatador> |
[WDQS Deploy] Restarted `wdqs-updater` across all hosts, 4 hosts at a time: `sudo -E cumin -b 4 'A:wdqs-all' 'systemctl restart wdqs-updater'` |
[production] |
| 22:50 |
<bking@deploy1002> |
Finished deploy [wdqs/wdqs@81ee634]: 0.3.97 (duration: 09m 22s) |
[production] |
| 22:48 |
<inflatador> |
[WDQS Deploy] Tests passing following deploy of `0.3.97` on canary `wdqs1003`; proceeding to rest of fleet |
[production] |
| 22:41 |
<bking@deploy1002> |
Started deploy [wdqs/wdqs@81ee634]: 0.3.97 |
[production] |
| 22:39 |
<inflatador> |
[WDQS Deploy] Gearing up for deploy of wdqs `0.3.97`. Pre-deploy tests passing on canary `wdqs1003` |
[production] |
| 21:47 |
<andrewbogott> |
deleting the 'exported' rackspace container in IAD -- pretty sure this is left over from wikitech-static DC migration |
[production] |
| 20:12 |
<mforns@deploy1002> |
Finished deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) (duration: 00m 03s) |
[production] |
| 20:12 |
<mforns@deploy1002> |
Started deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) |
[production] |
| 20:11 |
<otto@deploy1002> |
Finished deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) (duration: 00m 07s) |
[production] |
| 20:11 |
<otto@deploy1002> |
Started deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) |
[production] |
| 20:06 |
<otto@deploy1002> |
Finished deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) (duration: 00m 30s) |
[production] |
| 20:06 |
<otto@deploy1002> |
Started deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) |
[production] |
| 20:06 |
<otto@deploy1002> |
Finished deploy [airflow-dags/analytics@febf1c5]: (no justification provided) (duration: 00m 06s) |
[production] |