Apache Spark (@ApacheSpark) header
Apache Spark (@ApacheSpark) profile picture

Lightning-fast unified analytics engine

Joined June 2013
Photo by Apache Spark (@ApacheSpark)Photo by Apache Spark (@ApacheSpark)Photo by Apache Spark (@ApacheSpark)Photo by Apache Spark (@ApacheSpark)Photo by Apache Spark (@ApacheSpark)Photo by Apache Spark (@ApacheSpark)Photo by Apache Spark (@ApacheSpark)Photo by Apache Spark (@ApacheSpark)Photo by Apache Spark (@ApacheSpark)Photo by Apache Spark (@ApacheSpark)
Apache Spark retweeted
🚀 Massive data, mission‑critical pipelines, zero excuses. “Scaling @ApacheSpark at @OpenAI” with Chao Sun shows how to make Apache Spark™ reliable at scale. 🔹 Cluster management, job submission, access control 🔹 Dynamic scaling for spiky, multi‑tenant loads 🔹 How Apache Spark™ + Delta Lake powering large‑scale pipelines Two tracks. One epic afternoon. Open Lakehouse + AI Mini Summit. 🙌 📍 Mountain View 🗓️ Nov 13 🔗 Register → lu.ma/OLMS-1113 #OpenLakehouse #ApacheSpark #DeltaLake #OpenAI
2
8
1,438
Apache Spark retweeted
The open source and data community is coming together in Mountain View, CA! 💥 Join us Nov 13 (12–4:30PM PT) for the 𝗢𝗽𝗲𝗻 𝗟𝗮𝗸𝗲𝗵𝗼𝘂𝘀𝗲 + 𝗔𝗜 𝗠𝗶𝗻𝗶 𝗦𝘂𝗺𝗺𝗶𝘁, featuring two tracks packed with insights on AI infrastructure, context engineering, and the future of interoperable data systems. Lunch, swag, and great conversations included! Stick around for the @ApacheSpark Happy Hour (5–6:30PM PT) — the perfect way to wrap up a day of learning and community. 😎 🎟️ RSVP here: luma.com/OLMS-1113 #opensource #oss #unitycatalog #apachespark #deltalake #apacheiceberg #ai
3
9
1,033
Very excited that @ApacheSpark won the SIGMOD System Award this year. Congrats to the whole community behind the project!
sigmod.org/2022-sigmod-award… 2022 ACM SIGMOD Awards Edgar F. Codd Innovations Award goes to Dan Suciu. Contributions Award goes to Christian S. Jensen. Test-of-Time Award goes to “NoDB: Efficient Query Execution on Raw Data Files”. Systems Award goes to “Apache Spark”. Congrats!
5
24
204
How does Apache Spark handle task retries in #StructuredStreaming? That's the question I tried to answer in the new blog post 👉 waitingforcode.com/apache-sp…
1
5
1
28
Due to COVID19, we decided to make #SparkAISummit virtual and also *free* for anyone to attend this year! We still have the same great program with over 200 talks and keynotes from @NateSilver538, @jenniferchayes, @apaszke and more. Tune in for the largest data & AI summit ever.
We can’t wait to solve the world’s toughest problems — and it starts with #SparkAISummit, the world’s largest data and machine learning conference. As a global virtual event, we'll converge to shape the future of big data, analytics and AI. Join us: dbricks.co/SAISSF20RegTW
10
151
12
351
We’re excited to share the agenda for #SparkAISummit in San Francisco! Join over 7,000 engineers, scientists, developers, analysts and leaders at this year’s conference. Explore what you can learn: dbricks.co/SAISSF20Agenda
9
5
16
The Apache Software Foundation Celebrates 20 Years of Community-led Development "The Apache Way" s.apache.org/ASF20thAnnivers… #Apache #Open #Innovation #Community #Leadership #TheApacheWay #ASF20
11
112
19
183
In 2 weeks, top developers, data scientists, researchers and business executives in the #ApacheSpark ecosystem will be gathering at #SparkAISummit in SF. Register now to spend 3 days connecting with and learning from them, June 4-6! databricks.com/sparkaisummit
5
5
Apache Spark retweeted
The CFP for #SparkAISummit closes in 4 days, submit your talk today to join us in London: ow.ly/PqjT30jLCuV
1
7
16
We are pleased to announce the initial agenda for #SparkAISummit. Check it out: ssum.it/2C8wpA1
7
9
Apache Spark retweeted
AWS hypervisor updates in response to Meltdown & Spectre seem to have reduced performance by 3 to 5% for @ApacheSpark workloads. databricks.com/blog/2018/01/…
Today is the day! The CFP closes at midnight PST tonight! Submit now: ssum.it/2D9jL1i
4
12
Apache Spark retweeted
Apache Spark 2.0.2 is released. Update if you are on any 2.0.x version. spark.apache.org/downloads.h…
Apache Spark retweeted
Apache Spark 1.6.3 released! spark.apache.org/downloads.h… Upgrade to 1.6.3 if you are still on the 1.6.x line. Even better, upgrade to 2.0.x!
1
28
1
27
Missed one of the talks at Spark Summit? The videos and slides are now available at ssum.it/28NoTNz
1
77
6
103
Share your #ApacheSpark expertise onstage at #SparkSummit. CFP now open for the EU event, Oct 25-27 in Brussels ssum.it/1Q8dA1B