2024-12-10
§
|
21:00 |
<mforns> |
re-ran commons_impact_metrics_monthly 2024-11 and cleared dependent DAGs which had timed out |
[analytics] |
20:56 |
<mforns> |
deployed airflow-analytics to fix the commons impact metrics pipeline |
[analytics] |
20:50 |
<mforns> |
finished deployment of refinery to fix Commons Impact Metrics job |
[analytics] |
20:31 |
<mforns> |
starting deployment of refinery to fix Commons Impact Metrics job |
[analytics] |
17:03 |
<ottomata> |
restarting eventgate-analytics to pick up stream config changes for T381322 |
[analytics] |
09:55 |
<joal> |
rerun latest hdfs_usage job to pick up correct data sizes |
[analytics] |
09:46 |
<joal> |
Deploying refinery onto HDFS for backfill |
[analytics] |
09:40 |
<joal> |
Deploying refinery for backfill using scap |
[analytics] |
05:14 |
<joal> |
Releasing new refinery-source v0.2.54 to archiva |
[analytics] |
2024-10-30
§
|
13:57 |
<joal> |
Scap deploy analytics airflow dags |
[analytics] |
13:36 |
<joal> |
Unpause webrequest_actor jobs after successful webrequest refinement |
[analytics] |
12:21 |
<joal> |
unpause webrequest refine airflow jobs |
[analytics] |
12:13 |
<joal> |
deploying refinery onto HDFS (prod + test) |
[analytics] |
12:10 |
<joal> |
pause webrequest_actor jobs (3) to wait for webrequest success before trying new code |
[analytics] |
12:06 |
<joal> |
Alter wmf.webrequest table adding new is_redirect_to_pageview field to the test cluster |
[analytics] |
11:56 |
<joal> |
Alter tables wmf.webrequest_actor_metrics_hourly, wmf.webrequest_actor_metrics_rollup_hourly, wmf.webrequest_actor_label_hourly adding 2 new fields - NOTE: needed to be done in 2 steps with Hive to have the field correctly inserted in the middle of the tables |
[analytics] |
11:53 |
<joal> |
Create new table wmf_raw.mediawiki_private_cu_log to handle newly sqooped data |
[analytics] |