|
2021-12-20
ยง
|
| 23:23 |
<bking@deploy1002> |
Started deploy [wdqs/wdqs@81ee634] (wcqs): Deploy 0.3.97 to WCQS |
[production] |
| 23:23 |
<ejegg> |
updated SmashPig standalone (IPN listener) from 235a261b to 5a7d0c2c |
[production] |
| 23:04 |
<inflatador> |
[WDQS Deploy] Restarting `wdqs-categories` across lvs-managed hosts, one node at a time: `sudo -E cumin -b 1 'A:wdqs-all and not A:wdqs-test' 'depool && sleep 45 && systemctl restart wdqs-categories && sleep 45 && pool'` |
[production] |
| 23:04 |
<ryankemper> |
[WDQS] `ryankemper@wdqs1006:~$ sudo depool` (catching up on ~14.5 hours of lag) |
[production] |
| 23:04 |
<inflatador> |
[WDQS Deploy] Restarted `wdqs-categories` across all test hosts simultaneously: `sudo -E cumin 'A:wdqs-test' 'systemctl restart wdqs-categories'` |
[production] |
| 23:03 |
<inflatador> |
[WDQS Deploy] Restarted `wdqs-updater` across all hosts, 4 hosts at a time: `sudo -E cumin -b 4 'A:wdqs-all' 'systemctl restart wdqs-updater'` |
[production] |
| 22:50 |
<bking@deploy1002> |
Finished deploy [wdqs/wdqs@81ee634]: 0.3.97 (duration: 09m 22s) |
[production] |
| 22:48 |
<inflatador> |
[WDQS Deploy] Tests passing following deploy of `0.3.97` on canary `wdqs1003`; proceeding to rest of fleet |
[production] |
| 22:41 |
<bking@deploy1002> |
Started deploy [wdqs/wdqs@81ee634]: 0.3.97 |
[production] |
| 22:39 |
<inflatador> |
[WDQS Deploy] Gearing up for deploy of wdqs `0.3.97`. Pre-deploy tests passing on canary `wdqs1003` |
[production] |
| 21:47 |
<andrewbogott> |
deleting the 'exported' rackspace container in IAD -- pretty sure this is left over from wikitech-static DC migration |
[production] |
| 20:12 |
<mforns@deploy1002> |
Finished deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) (duration: 00m 03s) |
[production] |
| 20:12 |
<mforns@deploy1002> |
Started deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) |
[production] |
| 20:11 |
<otto@deploy1002> |
Finished deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) (duration: 00m 07s) |
[production] |
| 20:11 |
<otto@deploy1002> |
Started deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) |
[production] |
| 20:06 |
<otto@deploy1002> |
Finished deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) (duration: 00m 30s) |
[production] |
| 20:06 |
<otto@deploy1002> |
Started deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) |
[production] |
| 20:06 |
<otto@deploy1002> |
Finished deploy [airflow-dags/analytics@febf1c5]: (no justification provided) (duration: 00m 06s) |
[production] |
| 20:06 |
<otto@deploy1002> |
Started deploy [airflow-dags/analytics@febf1c5]: (no justification provided) |
[production] |
| 20:04 |
<mforns@deploy1002> |
Finished deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) (duration: 00m 11s) |
[production] |
| 20:04 |
<mforns@deploy1002> |
Started deploy [airflow-dags/analytics@febf1c5] (hadoop-test): (no justification provided) |
[production] |
| 20:02 |
<rzl> |
rzl@apt1001:~$ sudo -i reprepro -C main include buster-wikimedia /home/rzl/python3-imagecatalog/imagecatalog_0.0.3-1_amd64.changes |
[production] |
| 19:48 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 19:44 |
<legoktm@deploy1002> |
Synchronized wmf-config/CommonSettings.php: Expand $wgLocalVirtualHosts, enable $wgLocalHTTPProxy on Kubernetes (duration: 00m 57s) |
[production] |
| 19:44 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 19:37 |
<otto@deploy1002> |
Finished deploy [analytics/refinery@e29c9f0] (hadoop-test): (no justification provided) (duration: 05m 07s) |
[production] |
| 19:33 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 19:32 |
<otto@deploy1002> |
Started deploy [analytics/refinery@e29c9f0] (hadoop-test): (no justification provided) |
[production] |
| 19:31 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 19:31 |
<otto@deploy1002> |
Finished deploy [analytics/refinery@e29c9f0] (hadoop-test): (no justification provided) (duration: 00m 22s) |
[production] |
| 19:30 |
<otto@deploy1002> |
Started deploy [analytics/refinery@e29c9f0] (hadoop-test): (no justification provided) |
[production] |
| 19:26 |
<mforns@deploy1002> |
Finished deploy [analytics/refinery@e29c9f0] (hadoop-test): Add anomaly detection queries TEST [analytics/refinery@e29c9f0] (duration: 00m 04s) |
[production] |
| 19:26 |
<mforns@deploy1002> |
Started deploy [analytics/refinery@e29c9f0] (hadoop-test): Add anomaly detection queries TEST [analytics/refinery@e29c9f0] |
[production] |
| 19:25 |
<mforns@deploy1002> |
Finished deploy [analytics/refinery@e29c9f0] (hadoop-test): Add anomaly detection queries TEST [analytics/refinery@e29c9f0] (duration: 00m 05s) |
[production] |
| 19:24 |
<mforns@deploy1002> |
Started deploy [analytics/refinery@e29c9f0] (hadoop-test): Add anomaly detection queries TEST [analytics/refinery@e29c9f0] |
[production] |
| 19:18 |
<mforns@deploy1002> |
Finished deploy [analytics/refinery@e29c9f0] (hadoop-test): Add anomaly detection queries TEST [analytics/refinery@e29c9f0] (duration: 00m 09s) |
[production] |
| 19:18 |
<mforns@deploy1002> |
Started deploy [analytics/refinery@e29c9f0] (hadoop-test): Add anomaly detection queries TEST [analytics/refinery@e29c9f0] |
[production] |
| 18:47 |
<jynus> |
reenabling puppet on mx servers T298038 |
[production] |
| 18:46 |
<mforns@deploy1002> |
Started deploy [analytics/refinery@e29c9f0] (hadoop-test): Add anomaly detection queries TEST [analytics/refinery@e29c9f0] |
[production] |
| 18:43 |
<mforns@deploy1002> |
Started deploy [analytics/refinery@e29c9f0] (hadoop-test): Add anomaly detection queries TEST [analytics/refinery@e29c9f0] |
[production] |
| 18:43 |
<mforns@deploy1002> |
Finished deploy [analytics/refinery@e29c9f0] (thin): Add anomaly detection queries THIN [analytics/refinery@e29c9f0] (duration: 00m 07s) |
[production] |
| 18:43 |
<mforns@deploy1002> |
Started deploy [analytics/refinery@e29c9f0] (thin): Add anomaly detection queries THIN [analytics/refinery@e29c9f0] |
[production] |
| 18:42 |
<mforns@deploy1002> |
Finished deploy [analytics/refinery@e29c9f0]: Add anomaly detection queries [analytics/refinery@e29c9f0] (duration: 23m 07s) |
[production] |
| 18:38 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 18:38 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 18:19 |
<mforns@deploy1002> |
Started deploy [analytics/refinery@e29c9f0]: Add anomaly detection queries [analytics/refinery@e29c9f0] |
[production] |
| 17:58 |
<jynus> |
reloading exim configuration with extra rule on mx2001 T298038 |
[production] |
| 17:46 |
<jynus> |
disabling puppet on mail servers T298038 |
[production] |
| 17:14 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mc2040.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 17:06 |
<pt1979@cumin2002> |
START - Cookbook sre.hosts.provision for host mc2040.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |