1-50 of 6166 results (20ms)
2025-01-22 §
22:36 <mforns> [data lake temp accounts] re-ran DAG mediawiki_history_denormalized for 2024-12 [analytics]
20:33 <mforns> [data lake temp accounts] finished refinery deployment [analytics]
20:11 <mforns> [data lake temp accounts] starting refinery deployment [analytics]
20:06 <mforns> [data lake temp accounts] deployed refinery source [analytics]
19:23 <mforns> [data lake temp accounts] stopped DAGs [analytics]
18:54 <mforns> starting deployment of data lake temp accounts changes [analytics]
2025-01-21 §
13:24 <btullis> stopped airflow services on an-launcher1002 for T380619 [analytics]
11:00 <btullis> paused all un-paused DAGs on airflow-analaytics, prior to the migration. [analytics]
10:59 <btullis> disabled gobblin timers on the analytics-airflow instance [analytics]
2025-01-17 §
17:13 <xcollazo> Deployed latest DAGs for 'analytics' Airflow instance. T366542. [analytics]
2025-01-15 §
14:40 <aqu> Deployed refinery using scap, then deployed onto hdfs [analytics]
14:32 <aqu> Deploying analytics/refinery [analytics]
14:30 <aqu> Deployed refinery-source using jenkins [analytics]
2025-01-14 §
15:56 <ottomata> deleteling decommed eventlogging hive table location directories - T259163 [analytics]
15:47 <ottomata> drop decommed eventlogging hive tables - T238230 [analytics]
15:36 <ottomata> deleteing decomissioned eventlogging_ topics from kafka jumbo - T238230 [analytics]
2025-01-13 §
14:40 <ottomata> deploying refinery to analytics test cluster, and then to an-launcher1002 for gobblin eventlogging_legacy - use EventStreamConfig to pull topics (1109477) as part of T238230 Decommission EventLogging backend components by migrating to MEP [analytics]
2024-12-20 §
19:46 <btullis> restarted the hadoop-hdfs-namenode service on an-master1004 to pick up the new settins as well. [analytics]
19:46 <btullis> failed over the hadoop namenode services from an-master1004 to an-master1003. [analytics]
16:48 <xcollazo> Deploying latest analytics Airflow instance DAGs. T377852. [analytics]
14:41 <btullis> Started the namenode service on an-master1003 after crash [analytics]
14:04 <btullis> roll-restarting hadoop nameservers to pick up https://gerrit.wikimedia.org/r/c/operations/puppet/+/1105893 [analytics]
11:05 <btullis> restarted hadoop-mapreduce-historyserver.service on an-master1003 for T382575 [analytics]
2024-12-19 §
13:43 <joal> Purging data rentained for more than 90 days after backfill is done [analytics]
2024-12-16 §
19:31 <joal> Deploy analytics-airflow for pageview-hourly backfill [analytics]
11:02 <joal> 2024_12-Backfill Launch jobs dependent on pageview_actor from Airflow (8 jobs) [analytics]
09:41 <joal> Replace pageview_actor data by backfilled correction [analytics]
2024-12-10 §
21:00 <mforns> re-ran commons_impact_metrics_monthly 2024-11 and cleared dependent DAGs which had timed out [analytics]
20:56 <mforns> deployed airflow-analytics to fix the commons impact metrics pipeline [analytics]
20:50 <mforns> finished deployment of refinery to fix Commons Impact Metrics job [analytics]
20:31 <mforns> starting deployment of refinery to fix Commons Impact Metrics job [analytics]
17:03 <ottomata> restarting eventgate-analytics to pick up stream config changes for T381322 [analytics]
09:55 <joal> rerun latest hdfs_usage job to pick up correct data sizes [analytics]
09:46 <joal> Deploying refinery onto HDFS for backfill [analytics]
09:40 <joal> Deploying refinery for backfill using scap [analytics]
05:14 <joal> Releasing new refinery-source v0.2.54 to archiva [analytics]
2024-12-09 §
16:07 <brouberol> kubectl uncordon dse-k8s-worker1005.eqiad.wmnet [analytics]
15:46 <brouberol> kubectl cordon dse-k8s-worker1005.eqiad.wmnet [analytics]
2024-12-04 §
19:39 <joal> deploy Airflow [analytics]
19:07 <joal> Recompute 1 day of webrequest_actor_metrics for rollup to work as expected [analytics]
19:07 <joal> Alter webrequest_actor 3 tables adding actor_signature_per_project_family field for automated-traffic detection heuristic changeb [analytics]
19:06 <joal> Alter wmf_raw.mediawiki_user adding user_is_temp field for temp_account project [analytics]
17:59 <joal> Rerun cassandra_load_pageview_top_articles_monthly after refinery patch deployed [analytics]
17:56 <joal> Deploying refinery onto HDFS [analytics]
17:50 <joal> Deploying refinery with scap [analytics]
2024-11-30 §
12:02 <joal> Rerunning failed webrequest-actor-rollup airflow task [analytics]
12:01 <joal> Deployed airflow-analytics to hotfix webrequest-actor-rollup [analytics]
2024-11-27 §
19:39 <mforns> re-ran wikidata_wikitext_history for 2024-08 [analytics]
19:20 <mforns> deployed airflow analytics as part of the regular deployment train [analytics]
2024-11-26 §
07:38 <joal> deploy refinery onto HDFS [analytics]