OpenLineage provides a standard API for collecting pipeline lineage across Airflow, Spark, Flink, and dbt.
Feature stores like Feast now support streaming feature views from Kafka and Kinesis alongside batch pipelines.
MLflow 3 extends observability from classic ML experiments to GenAI tracing and data pipeline lineage.
LanceDB and Apache Iceberg serve complementary roles in a multimodal AI lakehouse. Learn when to use Lance for embeddings and random access, and Iceberg.