Are you planning on running @ApacheSpark streaming pipelines in @googlecloud via Dataproc or @databricks?
Today we released a Spark Structured Streaming connector for Pub/Sub Lite, a new exceptionally low-cost scalable messaging service.
Details in blog:
cloud.google.com/blog/produc…
You can now use Dataflow Flex Templates in @GCPcloud to turn any streaming or batch Dataflow pipeline into a reusable template that anyone can run.
cloud.google.com/blog/produc…
Another excellent video using math to explain the world from @3blue1brown today, this time #coronavirus "Exponential growth and epidemics" edition. Cases outside China are growing 10x every 16 days and 1 billion people could be infected by May 26.
youtube.com/watch?v=Kas0tIxD…
If you run #Hadoop in Google Cloud, you'll want to upgrade to the new GCS Connector 2.0. This blog covers the improvements we added, in collaboration with @TwitterEng.
cloud.google.com/blog/produc…
Want to learn the latest about #BigQuery, #DataWarehousing best practices in @googlecloud, & BigQuery ML?
Tomorrow (May 15) at 9am PDT, I'll be hosting a free, half-day BigQuery event online.
Sign up here:
cloudonair.withgoogle.com/ev…
Want to learn how Twitter is implementing one of the largest #Hadoop data migrations on the planet? Join us at #GoogleNext19 next week when @twitterhadoop's strategy and lots of new technical details will be revealed...
Join @lohitvijayarenu @vrushalivc and I at our #GoogleNext19 panel moderated by @blueplastic April 9 15:40h in San Francisco → cloud.withgoogle.com/next/sf…
Ask us questions ahead of time, during, or after the panel on Twitter with #GoogleNext19Twitter
Sameer Farooqui retweeted
My daughter overcoming her fear in real time (wait for it). I might have been more nervous than she was.
👧🏼🛹⬇️ – at Encinitas, CA
The Makali'i was Hawaii's first research submarine. Fabricated in 1966, it was used to harvest corals in the 70s and to visit the site of the first hydrogen bomb crater at Eniwetok Atoll in the 80s. Now on display at @MauiOceanCenter
Google worked with NOAA to train a neural network (CNN) to identify humpback whale songs in170,000 hours of underwater audio recordings from the Pacific Ocean. Anyone wanna take a crack at decoding their language next?
blog.google/technology/ai/ta…
ai.google/research/pubs/pub4…
Twitter just released a 363 GB dataset of 10 million tweets from 4,611 Russian/Iranian accounts. "Independent analysis of this activity by researchers is a key step toward promoting shared understanding of these threats."
about.twitter.com/en_us/valu…
Sameer Farooqui retweeted
Appreciate the conversation today. This reflects a lot of our thinking. We’ve changed Twitter a lot over time, but one thing we haven’t touched is what the service implicitly incentivizes people to do. That’s the level we need to reconsider.
Jack Dorsey says he’s rethinking the core of how Twitter works wapo.st/2Mv0MVW
In case you missed it at #GoogleNext18, the video for "How @TwitterHadoop Chose Google Cloud" to migrate their #Hadoop clusters (>500K cores & >300PB) is now online:
youtube.com/watch?v=4FLFcWgZ…
Inception^2:
Sitting in the @Google office, on my @Twitter laptop, launched Google Chrome, to get to Twitter's webpage and tweet about a Google Conference (where @twitterhadoop engineers are talking about @googlecloud), and the tweet eventually ends up on Google hard disks.
If you're going to be at #GoogleNext18, don't miss @TwitterHadoop's talk on Wed, July 25 @ 11am on why #Twitter choose @googlecloud to migrate 300 PB of their #Hadoop data into the cloud. Speakers: @dajobe, @derekalyon and @milesward
cloud.withgoogle.com/next18/…
Fun/Interesting read about the early days of Google and its culture... "from the very beginning, the mission for Google was not to use A.I. to make their search better, but to use search to make an A.I."
vanityfair.com/news/2018/07/…













