
We make data observability fast and easy for any data pipeline, warehouse, or lake or file system. #dataobservability #dataengineering #dataquality
Boston
Joined June 2019
- Tweets168
- Following308
- Followers90
- Likes320
Pinned Tweet
To monitor #dataquality effectively, you need to see how data is changing over time. That's usually more important than whether or not rigid unit tests are raising errors. Here's why:
dataculpa.com/blog/effective…
Data Culpa retweeted
Seems to be 2 main headwinds in software currently:
1) new bookings slowing due to macro
2) Optimizations (everything from lowering AWS / Azure / GCP, Snow, DataDog, etc bills, to cutting / consolidating vendors)
1 will last until macro turns around. But how about 2?
Optimizing cloud expenses helps free money for new investments in AI and other IT ventures. Another reason to adopt #FinOps.
#AI #cloud #strategy
streamliner.biz/blog/how-fin…
32
Data Culpa retweeted
Here are a few trends I am observing, from talking to a few people:
- Optimize cloud spending bill: understand where things can be cut down, identify waste
- Optimize logging provider spend. Basically: stop logging stuff that doesn't matter
- Review pricing of eg pager systems
Most data observability products fall short. Here's why.
#data #dataengineering #datamonitoring #observability
dataculpa.com/blog/where-mos…
Looking for help with #FinOps and cloud cost-cutting? Our new Streamliner service can help.
#cloud #cloudops #dataengineering #datawarehouses #snowflakedb
dataculpa.com/blog/streamlin…
For data teams to deliver #dataproducts that meet the needs of their customers according to #datacontracts, they need to consider context. Here's why.
#data #dataengineering #datascience #enterpriseIT
dataculpa.com/blog/data-cont…
Data teams expect a lot of their data. In fact, it's possible to even identify a #dataquality hierarchy of needs.
#dataengineering #datamanagement #datascience
dataculpa.com/blog/the-data-…
1
To make #datacontracts work, you need to agree on what's really important in a #datapipeline. Keeping track of #datacontext can help.
#dataengineering #datascience
dataculpa.com/blog/data-cont…
Data mesh architectures are on the rise, but they create special challenges for #dataquality #monitoring. Is your data team ready to address them?
#data #dataengineering #datamesh #datascience #observability
dataculpa.com/blog/data-mesh…
The best #dataquality monitoring for busy data teams relies on relative baselines, not rigid unit tests. Here's why.
#AI #BI #dataengineering #datascience #MLOPs #observability
dataculpa.com/blog/effective…
Data Culpa retweeted
Bad quality data is worse than no data:
ML models will do wrong predictions.
Dashboards will show wrong metrics.
Still data quality, monitoring and observability are not treated as priorities in many companies.
#DataScience
Data Culpa retweeted
Explained in class today that delta means a small positive number you choose and epsilon means a small positive number your enemy chooses.
Data Culpa retweeted
THEY'RE CALLED DATA CONTRACTS THEY'RE API-LIKE AGREEMENTS BETWEEN THE SOFTWARE ENGINEERS WHO OWN THE SERVICES AND THE DATA CONSUMERS THAT RELY ON THEM. IT'LL ALLOW THE SWES TO WORRY LESS ABOUT BREAKING PRODUCTION DATA PIPELINES AND HELP THE DATA TEAM MOVE AWAY FROM FIXING IN SQL
Want to monitor data without getting deluged with meaningless alerts? Try monitoring against a relative baseline. dataculpa.com/blog/effective… #AI #data #dataengineering #datamonitoring #dataops #dataquality #datascience #MLOps
1
Data Culpa receives a patent for monitoring data quality in data pipelines and databases. Here's our announcement.
dataculpa.com/blog/data-culp…
#AI #BI #data #databases #dataengineering #dataquality #datascience #patent #observability
Data Culpa receives our first issued patent for monitoring data quality in data pipelines and databases. Here's our announcement.
dataculpa.com/blog/data-culp…
#AI #BI #data #databases #dataengineering #dataquality #datascience #patent #observability
Data meshes create new challenges for #dataquality monitoring and #observability
#dataengineering #datamesh #datapipeline #datawarehouse
dataculpa.com/blog/data-mesh…
1
We love MongoDB's flexibility and ease of use. But that flexibility can create challenges with data schemas. Here's a look at the problem and how to fix it.
dataculpa.com/blog/mongodbs-…
#data #dataengineering #dataquality #datascience #mongodb







