Data Culpa (@DataCulpa) header
Data Culpa (@DataCulpa) profile picture

We make data observability fast and easy for any data pipeline, warehouse, or lake or file system. #dataobservability #dataengineering #dataquality

Boston
Joined June 2019
Photo by Data Culpa (@DataCulpa)Photo by Data Culpa (@DataCulpa)Photo by Data Culpa (@DataCulpa)Photo by Data Culpa (@DataCulpa)
To monitor #dataquality effectively, you need to see how data is changing over time. That's usually more important than whether or not rigid unit tests are raising errors. Here's why: dataculpa.com/blog/effective…
Data Culpa retweeted
Seems to be 2 main headwinds in software currently: 1) new bookings slowing due to macro 2) Optimizations (everything from lowering AWS / Azure / GCP, Snow, DataDog, etc bills, to cutting / consolidating vendors) 1 will last until macro turns around. But how about 2?
21
23
4
207
172,393
Optimizing cloud expenses helps free money for new investments in AI and other IT ventures. Another reason to adopt #FinOps. #AI #cloud #strategy streamliner.biz/blog/how-fin…
32
Here are a few trends I am observing, from talking to a few people: - Optimize cloud spending bill: understand where things can be cut down, identify waste - Optimize logging provider spend. Basically: stop logging stuff that doesn't matter - Review pricing of eg pager systems
23
21
15
349
711,746
Looking for help with #FinOps and cloud cost-cutting? Our new Streamliner service can help. #cloud #cloudops #dataengineering #datawarehouses #snowflakedb dataculpa.com/blog/streamlin…
For data teams to deliver #dataproducts that meet the needs of their customers according to #datacontracts, they need to consider context. Here's why. #data #dataengineering #datascience #enterpriseIT dataculpa.com/blog/data-cont…
Data teams expect a lot of their data. In fact, it's possible to even identify a #dataquality hierarchy of needs. #dataengineering #datamanagement #datascience dataculpa.com/blog/the-data-…
1
To make #datacontracts work, you need to agree on what's really important in a #datapipeline. Keeping track of #datacontext can help. #dataengineering #datascience dataculpa.com/blog/data-cont…
Data mesh architectures are on the rise, but they create special challenges for #dataquality #monitoring. Is your data team ready to address them? #data #dataengineering #datamesh #datascience #observability dataculpa.com/blog/data-mesh…
1
1
The best #dataquality monitoring for busy data teams relies on relative baselines, not rigid unit tests. Here's why. #AI #BI #dataengineering #datascience #MLOPs #observability dataculpa.com/blog/effective…
Data Culpa retweeted
Bad quality data is worse than no data: ML models will do wrong predictions. Dashboards will show wrong metrics. Still data quality, monitoring and observability are not treated as priorities in many companies. #DataScience
13
15
Explained in class today that delta means a small positive number you choose and epsilon means a small positive number your enemy chooses.
57
492
56
5,110
THEY'RE CALLED DATA CONTRACTS THEY'RE API-LIKE AGREEMENTS BETWEEN THE SOFTWARE ENGINEERS WHO OWN THE SERVICES AND THE DATA CONSUMERS THAT RELY ON THEM. IT'LL ALLOW THE SWES TO WORRY LESS ABOUT BREAKING PRODUCTION DATA PIPELINES AND HELP THE DATA TEAM MOVE AWAY FROM FIXING IN SQL
3
15
1
110
Want to monitor data without getting deluged with meaningless alerts? Try monitoring against a relative baseline. dataculpa.com/blog/effective… #AI #data #dataengineering #datamonitoring #dataops #dataquality #datascience #MLOps
1
Just a tiny schema change…
3
8
2
78
Data Culpa receives a patent for monitoring data quality in data pipelines and databases. Here's our announcement. dataculpa.com/blog/data-culp… #AI #BI #data #databases #dataengineering #dataquality #datascience #patent #observability
1
1
Data Culpa receives our first issued patent for monitoring data quality in data pipelines and databases. Here's our announcement. dataculpa.com/blog/data-culp… #AI #BI #data #databases #dataengineering #dataquality #datascience #patent #observability
We love MongoDB's flexibility and ease of use. But that flexibility can create challenges with data schemas. Here's a look at the problem and how to fix it. dataculpa.com/blog/mongodbs-… #data #dataengineering #dataquality #datascience #mongodb
1
1