@WorkflowEasy

Apache DolphinScheduler PMC & Committer

Joined February 2014
  • Tweets73
  • Following61
  • Followers59
9Media
🌊 Discover the power of Apache SeaTunnel! Dive into its evolution, from modular design to rich connectors, tackling data silos efficiently. Perfect for seamless trillion-scale data sync. 🚀 Curious? [Link](apacheseatunnel.medium.com/b…). #DataIntegration #BigData

Building a Trillion-Scale Data Sync System: The Untold Story of Apache SeaTunnel

“How challenging is it to design a system supporting trillion-level data synchronization? Let me tell you a from-scratch story…”

apacheseatunnel.medium.com
1
3
94
I just published Optimizing Data Operations with Apache SeaTunnel at JP Morgan link.medium.com/fYaYLqfTIEb

Optimizing Data Operations with Apache SeaTunnel at JP Morgan

Background

link.medium.com
1
4
237
🚀 Just 1 day left! Dive deep into the powerful integration of #ClearML + #ApacheDolphinScheduler and redefine your #MLOps experience. Exciting demos, expert insights, and much more await! See you tomorrow! ⏰ #MachineLearning #Meetup meetup.com/opensourcecommuni… #Meetup via @Meetup

Unveiling the Power of ClearML and DolphinScheduler in MLOps 🚀, Mon, Aug 28, 2023, 10:00 AM |...

📢 Announcing the Apache DolphinScheduler Meetup: Unveiling the Power of ClearML and DolphinScheduler in MLOps 🚀 Dear Apache DolphinScheduler Community, We are elated 🎉

meetup.com
1
3
240
Apache SeaTunnel is listed on the #GitHub Trending open source project this month, again!🎊🎊🎊 🔗🔗Visit the SeaTunnel GitHub repo now: github.com/apache/seatunnel ##OpenSource #FOSS #OpenSourceCommunity #OpenData #CommunityDriven #Collaboration #OpenInnovation #BigData
1
3
8
739
🚀 Exciting news! #ApacheDolphinScheduler 3.0.6 is out with important bug fixes! 🐬🎉 This release may be the last in the 3.0.x series. github.com/apache/dolphinsch… #Release ##OpenSource #FOSS #OpenSourceCommunity #GitHub #BigData #DataAnalytics #DataScience #CloudComputing

Release 3.0.6 · apache/dolphinscheduler

[fix-#14086]The subprocess type node is always in the ready stop state #14087 [Fix-13913][Master] syncMasterNodes does not make current slot correctly after zookeeper reconnect #14014

github.com
1
2
103
Apache DolphinScheduler 3.0.5 is now available at bit.ly/3ZMbQzz. #DolphinScheduler is a distributed and easy-to-extend visual workflow scheduler system dedicated to solving complex task dependencies in #dataprocessing. #opensource
1
4
27
6,883
🥰Apache SeaTunnel Chengdu Station Offline Meetup Successfully Held! Technical elites gather to share a new chapter in big data link.medium.com/6tkwdcL78yb

Apache SeaTunnel Chengdu Station Offline Meetup Successfully Held!

On April 15, 2023, a unique big data event was successfully concluded in the spring sunshine of Chengdu. Co-hosted by the Apache…

link.medium.com
2
5
209
🥁🥁PyDolphinScheduler 4.0.3 was released to fix the problem that files fail to be submitted to the resource center. #Python #opensource #DolphinScheduler 📔📔Release Notes: github.com/apache/dolphinsch… medium.com/@ApacheDolphinSch…

Release 4.0.2 · apache/dolphinscheduler-sdk-python

This release mainly fix pydolphinschsduler 4.0.1 can submit workflow to apache/dolphinscheduler 3.1.4, in which we missed some PRs for Java gateway changed, see more in #79 What's Changed fix:...

github.com
2
4
167
❓❔To make the users and enthusiasts of #Apache DolphinScheduler get timely and quick answers to the questions about the project, the community specially launched this [Weekly FAQ] column, hoping to solve your problems in practice. #opensource medium.com/@ApacheDolphinSch…

[Weekly FAQ] Issue 1 | Answer your questions about Apache DolphinScheduler

To make the users and enthusiasts of Apache DolphinScheduler get timely and quick answers to the questions about the project, the community…

medium.com
1
3
282
David Zollo retweeted
InfoQ@InfoQ21 Nov 2022
Learn about data pipeline & workflow scheduler Apache DolphinScheduler and how ML tasks are performed by Apache DolphinScheduler using Jupyter and MLflow components. #InfoQ article by Zhou Jieguang: bit.ly/3TIfh83 @dolphinschedule #ML #ApacheDolphinScheduler #MLOps
4
5
David Zollo retweeted
Eric Gao@ChufengGao11 Oct 2022
Replying to @dolphinschedule
@dolphinschedule After fully removing the usage of `Powermock`, we have started to migrate all the unit test cases from jUnit4 to jUnit5 in the whole project, hope things go smoothly : ) github.com/apache/dolphinsch…

[Migration][Test] jUnit4 -> jUnit5 UT cases migration · Issue #12301 · apache/dolphinscheduler

Search before asking I had searched in the issues and found no similar feature requirement. Description This is part of DSIP-10 #10573 By this moment, we have added jUnit 5 dependencies #11332 and ...

github.com
1
3
💥💥💥DS's newly released 3.0.1 version supports PyDolphinScheduler. This is Python API for Apache DolphinScheduler, and it allows you to define your workflow by Python code, aka workflow-as-codes. #DolphinScheduler #apche #bigdata #opensource
1
4
In #MLOps, DolphinScheduler adds various ML task plugins to efficiently help data analysts and data scientists use it. Efficiency is improved for: 📌The machine learning lifecycle 📌Machine learning systems to connect with other systems #bigdata #machinelearning #opensource
1
1
4
DolphinScheduler engineer Zhong Jiajie will deliver a speech elaborating on the newly released 3.0 version and its ecology at @awscloud China #DevDay. Register to enjoy the technology sharing.💥💥
Wu Sheng 吴晟@wusheng11089 Oct 2022
Welcome to join the @awscloud #China #DevDay I built the #OpenSource #DataFlow track, speakers are from @Tetrateio @dolphinschedule @Sphere_Ex @API7ai and #AWS Don't hesitate to join us online! Scan the QR code to register
1
4
A warm welcome to our new committers Lizong Wen and Di Jie. Thanks to their brilliant work to SeaTunnel, making the SeaTunnel engine decouple from the Connectors and product servitization, etc. 👍👍👍 #BigData #DataScience #seatunnel #Apache
2
6
1
10
The ASF Weekly Roundup has landed! 🗞️ Thank you to everyone that attended ApacheCon & making it such a successful event. See you next year! 👏 Last week’s new releases included: Apache Kafka, Apache SeaTunnel (Incubating), and Apache Tika, and more. news.apache.org/foundation/e…
Weekly Roundup: 243 Apache Committers and 653 contributors changed 3,675,673 lines of code over 3,418 commits. Top five contributors, in order, are: Gary Gregory, Jean-Baptiste Onofré, Mark Thomas, Harikrishna Patnala, and Sebastian Rühl.

ALT Weekly Roundup: 243 Apache Committers and 653 contributors changed 3,675,673 lines of code over 3,418 commits. Top five contributors, in order, are: Gary Gregory, Jean-Baptiste Onofré, Mark Thomas, Harikrishna Patnala, and Sebastian Rühl.

1
2
8
SeaTunnel 2.1.3 released! Introducing in Assert Sink connector and NullRate, Nulltf Transform #SeaTunnel #OpenSource #apache 📒Release Note: github.com/apache/incubator-… ✅Download: seatunnel.apache.org/downloa… seatunnel.medium.com/seatunn…
1
2
A great topic on Apache DolphinScheduler's integration with K8s was shared at ApacheCon Asia 2022, enjoy it!👇👇 #kubernetes #apachecon #OpenSource #BigData youtu.be/j9AjU3T8TJk
1
1
7
On 24th July, Apache Doris @doris_apache and Apache SeaTunnel(incubating) community will jointly host the online Meetup themed "From Data Integration to Data Analysis Practice", click the link to join🔗🔗 slidestalk.com/m/996/tuite11… #BigData #seatunnel #OpenSource
1
2
1
6
Using Flink SQL in SeaTunnel, the data synchronization can be simpler and faster🚀🚀Tao Kelu, a big data engineer from ByteDance, introduced how to use Flink SQL to simplify data synchronization in SeaTunnel 👇👇#opensource #SeaTunnel #BigData #FlinkSQL seatunnel.medium.com/how-to-…

How to simplify data synchronization using Flink SQL in Apache SeaTunnel (Incubating)?

As an ultra-high-performance distributed data integration platform, SeaTunnel is known for supporting massive data synchronization in…

apacheseatunnel.medium.com
3
3
Load more