@AMdatalakehouse

Alex Merced is a Lakehouse and AI evangelist and author of multiple books with O’Reilly, Manning and Packt.

alexmerced.com
Joined January 2022
  • Tweets1.6K
  • Following1.7K
  • Followers1.3K
--APACHE ICEBERG OVERVIEW-- - What is a table format? - What is Apache Iceberg? - How does it work? - What makes it unique? - Apache Iceberg's Ecosystem - Much more! Scan links in presentations for easy tutorials to get hands on with Apache Iceberg! #DataEngineering #DataLake #DataLakehouse #DataAnalytics #DataScience #DataWarehouse #BigData #ApacheIceberg
10
49
3,153
I feel with a little bit of guidance pretty much any model can do fantastic work, and even more amazing when paired with the right harness. Now we are just fighting over which model can be the most magical with as little guidance as possible. #ai #agenticai
31
Upcoming Webinars #datalakehouse #dataengineering #agenticai
49
Blog from The Data Lakehouse Hub Title: Serving Iceberg Tables From Two Regions Read Here: datalakehousehub.com/blog/ic…

Serving Iceberg Tables From Two Regions

Three multi-region topologies that work and one that mostly does not, what an Iceberg commit costs across regions, and where the catalog has to live.

datalakehousehub.com
57
Blog from The Data Lakehouse Hub Title: The 2026 Iceberg REST Catalog Compatibility Report Read Here: datalakehousehub.com/blog/ic…

The 2026 Iceberg REST Catalog Compatibility Report

A repeatable test of what Iceberg REST catalogs actually serve, a scoring scheme that separates design choices from breakage, and 2026 results for 7 catalogs.

datalakehousehub.com
71
NEW BLOGS: Apache Polaris Events and Audit Logging: A Production Guide Read Here -> dremio.com/blog/apache-polar…

Apache Polaris Events and Audit Logging: A Production Guide | Dremio

Configure Polaris event listeners and audit logging, choose event fields, protect sensitive data, export records, and build security and operations alerts.

dremio.com
1
79
#dataengineering #datalakehouse #opensource
62
#dataengineering #datalakehouse #opensource
60
Blog from The Data Lakehouse Hub Title: What to Assert When You Test an Iceberg Pipeline Read Here: datalakehousehub.com/blog/ic…

What to Assert When You Test an Iceberg Pipeline

Fixtures, in-memory catalogs, and golden metadata: the assertions that catch wrong rows, unsafe reruns, schema drift, and concurrent-write corruption in CI.

datalakehousehub.com
1
1
67
NEW BLOGS: Running Apache Polaris in Production with Kubernetes, Helm, and PostgreSQL Read Here -> dremio.com/blog/running-apac…

Running Apache Polaris in Production with Kubernetes, Helm, and PostgreSQL | Dremio

Deploy Apache Polaris with Helm and PostgreSQL, then configure secrets, probes, scaling, ingress, migrations, backups, upgrades, and observability.

dremio.com
43
Blog from The Data Lakehouse Hub Title: Partition Statistics Files in Apache Iceberg Read Here: datalakehousehub.com/blog/ic…

Partition Statistics Files in Apache Iceberg

The underused Iceberg metadata for planning: what the partition statistics file holds, what the spec guarantees, how to write one, and when it earns its slot.

datalakehousehub.com
1
101
NEW BLOGS: How to Measure Data Lakehouse Vendor Lock-In with the Exit Cost Test Read Here -> dremio.com/blog/how-to-measu…

How to Measure Data Lakehouse Vendor Lock-In with the Exit Cost Test | Dremio

Use a repeatable exit cost test to measure lakehouse vendor lock-in across data, metadata, identity, SQL, operations, egress, and migration time.

dremio.com
50
Blog from The Data Lakehouse Hub Title: Running an Iceberg Lakehouse on Kubernetes Read Here: datalakehousehub.com/blog/ic…

Running an Iceberg Lakehouse on Kubernetes

Catalog, maintenance, and compaction as Kubernetes workloads: scheduling classes, job structure, credential flow, and the failures that come from the interaction.

datalakehousehub.com
69
NEW BLOGS: Apache Iceberg v3 Engine Support Matrix for 2026 Read Here -> dremio.com/blog/apache-icebe…

Apache Iceberg v3 Engine Support Matrix for 2026 | Dremio

Compare current Iceberg v3 read and write support across Spark, Flink, Trino, Dremio, AWS Glue, PyIceberg, DuckDB, and iceberg-rust.

dremio.com
2
123
Blog from The Data Lakehouse Hub Title: What Iceberg Table Maintenance Actually Costs Read Here: datalakehousehub.com/blog/ic…

What Iceberg Table Maintenance Actually Costs

A cost model for compaction, snapshot expiry, orphan cleanup, and manifest rewriting: what each operation spends, on which meter, and how to set a schedule.

datalakehousehub.com
63
NEW BLOGS: Migrating AWS Glue and S3 Tables Catalogs to Apache Polaris Read Here -> dremio.com/blog/migrating-aw…

Migrating AWS Glue and S3 Tables Catalogs to Apache Polaris | Dremio

Plan and execute a migration from AWS Glue Data Catalog or Amazon S3 Tables to Apache Polaris with inventory, dual validation, cutover, and rollback.

dremio.com
82
Blog from The Data Lakehouse Hub Title: Migrating Into Iceberg Without Moving Data Read Here: datalakehousehub.com/blog/ic…

Migrating Into Iceberg Without Moving Data

add_files, snapshot, and migrate compared: the three in-place paths into Iceberg, the reconciliation each requires, the layout traps, and the rollback story.

datalakehousehub.com
58
NEW BLOGS: Streaming into Apache Iceberg with Kafka Connect and Apache Polaris Read Here -> dremio.com/blog/streaming-in…

Streaming into Apache Iceberg with Kafka Connect and Apache Polaris | Dremio

Configure an Iceberg Kafka Connect sink with Apache Polaris, map topics to tables, manage OAuth and credentials, and operate commits and maintenance.

dremio.com
69
Blog from The Data Lakehouse Hub Title: Guardrails for AI on Company Data Read Here: datalakehousehub.com/blog/gu…

Guardrails for AI on Company Data

The control surfaces that actually contain damage once an agent is fooled: identity, permissions, audit trails, and prompt injection at the query layer.

datalakehousehub.com
1
69
NEW BLOGS: Apache Polaris with DuckDB and iceberg-rust: Native Iceberg Clients Read Here -> dremio.com/blog/apache-polar…

Apache Polaris with DuckDB and iceberg-rust: Native Iceberg Clients | Dremio

Use DuckDB and iceberg-rust with Apache Polaris through the Iceberg REST catalog, including OAuth, credentials, read and write support, and caveats.

dremio.com
1
90
Blog from The Data Lakehouse Hub Title: Context Engineering for Data Agents Read Here: datalakehousehub.com/blog/co…

Context Engineering for Data Agents

Why text-to-SQL accuracy collapses on enterprise schemas, the five kinds of context an agent needs, where each one hides, and how to make the semantics legible.

datalakehousehub.com
64
Load more