At CDE, our focus is on training and developing prospective data engineers to meet the rising demand for skilled professionals in the data engineering field
Berlin, Germany
Joined March 2024
- Tweets929
- Following14
- Followers945
- Likes109
✨ CDE BOOTCAMP 3.0 — AMAZON WEB SERVICES (AWS)
Another week of learning, building, and expanding our understanding of cloud technologies!
This week, our participants continued their Data Engineering journey by exploring key AWS services and concepts,
A big thank you to @akinyele_mayowa for guiding our participants through these concepts and making the sessions practical and engaging.
We also appreciate our Teaching Assistants, Ayodeji Ajayi & Abdulhakeem Salaudeen, for their support & guidance throughout the learning process
We’re not done yet, as our participants will be exploring more about AWS in the coming sessions.
💬 CDE 3.0 participants, over to you!
What has been your biggest takeaway from this week’s AWS sessions? Share with us in the comments! 👇
#CDEBootcamp3.0 #CoreDataEngineers ##AWS
Building a data pipeline involves several tasks that must run in the right order, at the right time, and with the right dependencies.
As a Data Engineer, understanding how to coordinate these processes is essential to building reliable and manageable data workflows.
That’s where Apache Airflow comes in.
Airflow helps Data Engineers schedule, coordinate, and monitor workflows, making it easier to manage complex pipeline executions.
Swipe through the post as we explore data pipeline orchestration, how Apache Airflow works, its key components, and its role in modern Data Engineering.
Happy reading!
#CoreDataEngineers #CDEBootcamp3.0 #DataEngineering #ApacheAirflow #DataOrchestration
In AWS, Data Engineers need to understand how applications securely & services and resources without exposing sensitive credentials.
An application running on an EC2 instance needs permission to read from an S3
bucket. What is the recommended way to grant permissions?
50%Store access keys in code
50%Attach an IAM role to EC2
0%Use the AWS root account
0%Create an IAM user
2 votes • 5 hoursSometimes, the progress you’re making may not be obvious. You might still be learning, figuring things out, making mistakes, or working towards a goal that feels far away.
But every time you show up, practise a new skill, or try again after a setback, you’re making progress.
In Data Engineering, growth takes time. Every concept you learn, every pipeline you build, and every challenge you overcome adds to your experience.
Don’t be discouraged by how far you still have to go. Focus on how far you’ve come, keep putting in the work,
Welcome to November!
A new month brings another opportunity to learn something new, strengthen your skills, and make progress towards your goals.
As you continue your Data Engineering journey, remember that growth comes from showing up, staying curious, practising consistently
and being willing to learn from every experience.
This month, keep building, keep exploring, and keep taking those intentional steps forward. Every bit of progress counts!
Here’s to a productive November filled with new knowledge, meaningful growth, and exciting opportunities.
Happy New Month from all of us at Core Data Engineers! 💚
#CoreDataEngineers #HappyNewMonth #DataEngineering #CDEBootcamp3.0
📩 THE LATEST CDE NEWSLETTER IS OUT!
Our latest edition is ready, and we can’t wait for you to read it!
We’ve put together practical Data Engineering insights, industry updates, useful learning resources, and career growth opportunities to keep you informed and inspired.
If you’re subscribed, kindly check your email inbox. Your next read from CDE is waiting for you!
You can also read the latest edition here:
open.substack.com/pub/coreda…
Not subscribed yet? Subscribe today and get future editions delivered to your inbox.
#CDE #CDENewsletter
✨ CDE BOOTCAMP 3.0 — APACHE AIRFLOW
Another week of learning, building, and getting deeper into the practical side of Data Engineering!
Having explored the fundamentals of Apache Airflow in our previous sessions, this week, our participants took things further
configuration values, and connects to external systems.
A big thank you to @najeebsulaiman_ for taking our participants deeper into Apache Airflow through practical demonstrations and hands-on exercises.
We also appreciate our Teaching Assistants, @NancyAmandi
& Sanyaolu,
for their continued support and guidance throughout the sessions.
💬 CDE 3.0 participants, over to you!
What was your biggest takeaway from this week’s sessions?
Share your experience in the comments! 👇
#CDEBootcamp3.0 #CoreDataEngineers #DataEngineering #ApacheAirflow