1-50 of 6182 results (32ms)
2025-02-12 §
15:18 <stevemunene> reimaging dse-k8s-worker1002 [analytics]
15:13 <stevemunene> draining dse-k8s-worker1002 ready for reimage to bookworm and containerd for T377875 [analytics]
13:09 <btullis> deploying conda-analytics 0.0.38 to the cluster for T383284 and T380477 [analytics]
12:40 <btullis> reimaging dse-k8s-worker1001 [analytics]
12:27 <btullis> draining dse-k8s-worker1001 ready for reimage to bookworm and containerd for T377875 [analytics]
2025-01-29 §
19:08 <xcollazo> Ran the following to get rid of old data under wmf_dumps: T358375#10506036 [analytics]
18:45 <xcollazo> Deploying latest DAGs to the analytics Airflow instance. T358375. [analytics]
2025-01-28 §
21:56 <aqu> About to deploy analytics/refinery [analytics]
21:56 <aqu> Deployed refinery-source using jenkins [analytics]
21:32 <xcollazo> Running `sudo systemctl restart airflow-scheduler@analytics` to try and clear an SSL error. [analytics]
2025-01-24 §
21:20 <mforns> [data lake temp accounts] deployment of data lake temp accounts changes is complete [analytics]
18:02 <mforns> [data lake temp accounts] re-ran druid loading task in mediawiki_history_reduced for 2024-12 [analytics]
2025-01-23 §
21:29 <mforns> [data lake temp accounts] re-ran DAG druid_load_edit_hourly for 2024-12 [analytics]
20:12 <mforns> [data lake temp accounts] re-ran DAG edit_hourly for 2024-12 [analytics]
19:30 <mforns> [data lake temp accounts] re-ran DAG mediawiki_history_reduced for 2024-12 [analytics]
15:12 <mforns> [data lake temp accounts] re-ran DAG mediawiki_history_check_denormalized for 2024-12 [analytics]
2025-01-22 §
22:36 <mforns> [data lake temp accounts] re-ran DAG mediawiki_history_denormalized for 2024-12 [analytics]
20:33 <mforns> [data lake temp accounts] finished refinery deployment [analytics]
20:11 <mforns> [data lake temp accounts] starting refinery deployment [analytics]
20:06 <mforns> [data lake temp accounts] deployed refinery source [analytics]
19:23 <mforns> [data lake temp accounts] stopped DAGs [analytics]
18:54 <mforns> starting deployment of data lake temp accounts changes [analytics]
2025-01-21 §
13:24 <btullis> stopped airflow services on an-launcher1002 for T380619 [analytics]
11:00 <btullis> paused all un-paused DAGs on airflow-analaytics, prior to the migration. [analytics]
10:59 <btullis> disabled gobblin timers on the analytics-airflow instance [analytics]
2025-01-17 §
17:13 <xcollazo> Deployed latest DAGs for 'analytics' Airflow instance. T366542. [analytics]
2025-01-15 §
14:40 <aqu> Deployed refinery using scap, then deployed onto hdfs [analytics]
14:32 <aqu> Deploying analytics/refinery [analytics]
14:30 <aqu> Deployed refinery-source using jenkins [analytics]
2025-01-14 §
15:56 <ottomata> deleteling decommed eventlogging hive table location directories - T259163 [analytics]
15:47 <ottomata> drop decommed eventlogging hive tables - T238230 [analytics]
15:36 <ottomata> deleteing decomissioned eventlogging_ topics from kafka jumbo - T238230 [analytics]
2025-01-13 §
14:40 <ottomata> deploying refinery to analytics test cluster, and then to an-launcher1002 for gobblin eventlogging_legacy - use EventStreamConfig to pull topics (1109477) as part of T238230 Decommission EventLogging backend components by migrating to MEP [analytics]
2024-12-20 §
19:46 <btullis> restarted the hadoop-hdfs-namenode service on an-master1004 to pick up the new settins as well. [analytics]
19:46 <btullis> failed over the hadoop namenode services from an-master1004 to an-master1003. [analytics]
16:48 <xcollazo> Deploying latest analytics Airflow instance DAGs. T377852. [analytics]
14:41 <btullis> Started the namenode service on an-master1003 after crash [analytics]
14:04 <btullis> roll-restarting hadoop nameservers to pick up https://gerrit.wikimedia.org/r/c/operations/puppet/+/1105893 [analytics]
11:05 <btullis> restarted hadoop-mapreduce-historyserver.service on an-master1003 for T382575 [analytics]
2024-12-19 §
13:43 <joal> Purging data rentained for more than 90 days after backfill is done [analytics]
2024-12-16 §
19:31 <joal> Deploy analytics-airflow for pageview-hourly backfill [analytics]
11:02 <joal> 2024_12-Backfill Launch jobs dependent on pageview_actor from Airflow (8 jobs) [analytics]
09:41 <joal> Replace pageview_actor data by backfilled correction [analytics]
2024-12-10 §
21:00 <mforns> re-ran commons_impact_metrics_monthly 2024-11 and cleared dependent DAGs which had timed out [analytics]
20:56 <mforns> deployed airflow-analytics to fix the commons impact metrics pipeline [analytics]
20:50 <mforns> finished deployment of refinery to fix Commons Impact Metrics job [analytics]
20:31 <mforns> starting deployment of refinery to fix Commons Impact Metrics job [analytics]
17:03 <ottomata> restarting eventgate-analytics to pick up stream config changes for T381322 [analytics]
09:55 <joal> rerun latest hdfs_usage job to pick up correct data sizes [analytics]
09:46 <joal> Deploying refinery onto HDFS for backfill [analytics]