Core Data Engineers (@CoreDataEngr) header
Core Data Engineers (@CoreDataEngr) profile picture

At CDE, our focus is on training and developing prospective data engineers to meet the rising demand for skilled professionals in the data engineering field

Berlin, Germany
Joined March 2024
Photo by Core Data Engineers (@CoreDataEngr)Photo by Core Data Engineers (@CoreDataEngr)Photo by Core Data Engineers (@CoreDataEngr)Photo by Core Data Engineers (@CoreDataEngr)Photo by Core Data Engineers (@CoreDataEngr)Photo by Core Data Engineers (@CoreDataEngr)Photo by Core Data Engineers (@CoreDataEngr)Photo by Core Data Engineers (@CoreDataEngr)Photo by Core Data Engineers (@CoreDataEngr)Photo by Core Data Engineers (@CoreDataEngr)
We’re not done yet, as our participants will be exploring more about AWS in the coming sessions. 💬 CDE 3.0 participants, over to you! What has been your biggest takeaway from this week’s AWS sessions? Share with us in the comments! 👇 #CDEBootcamp3.0 #CoreDataEngineers ##AWS
11
A big thank you to @akinyele_mayowa for guiding our participants through these concepts and making the sessions practical and engaging. We also appreciate our Teaching Assistants, Ayodeji Ajayi & Abdulhakeem Salaudeen, for their support & guidance throughout the learning process
1
8
computing ➜ Exploring the process of launching and managing instances ➜ And much more! Through these sessions, participants are building a stronger foundation in AWS and gaining practical experience in managing access, configuring cloud networks, and working with resources.
1
11
resources ➜ Understanding Amazon Virtual Private Cloud (VPC) ➜ VPC configuration and networking fundamentals ➜ Subnets, Internet Gateways, NAT Gateways, and Route tables ➜ Security Groups and Network Access Control Lists (NACLs) ➜ Introduction to EC2 and its role in cloud
1
7
gaining practical knowledge of how cloud infrastructure is configured, secured, and managed. Here are some of the concepts we explored: ➜ Understanding IAM and its role in AWS security ➜ Users, groups, roles, and policies ➜ Managing permissions and controlling access to AWS
1
9
✨ CDE BOOTCAMP 3.0 — AMAZON WEB SERVICES (AWS) Another week of learning, building, and expanding our understanding of cloud technologies! This week, our participants continued their Data Engineering journey by exploring key AWS services and concepts,
1
1
1
72
Swipe through the post as we explore data pipeline orchestration, how Apache Airflow works, its key components, and its role in modern Data Engineering. Happy reading! #CoreDataEngineers #CDEBootcamp3.0 #DataEngineering #ApacheAirflow #DataOrchestration
9
That’s where Apache Airflow comes in. Airflow helps Data Engineers schedule, coordinate, and monitor workflows, making it easier to manage complex pipeline executions.
1
12
Building a data pipeline involves several tasks that must run in the right order, at the right time, and with the right dependencies. As a Data Engineer, understanding how to coordinate these processes is essential to building reliable and manageable data workflows.
1
1
4
74
In AWS, Data Engineers need to understand how applications securely & services and resources without exposing sensitive credentials. An application running on an EC2 instance needs permission to read from an S3 bucket. What is the recommended way to grant permissions?
50%Store access keys in code
50%Attach an IAM role to EC2
0%Use the AWS root account
0%Create an IAM user
2 votes • 4 hours
1
1
3
97
and trust that consistency will make a difference. Keep learning. Keep building. Keep becoming. Happy Monday, Data Engineers!
7
In Data Engineering, growth takes time. Every concept you learn, every pipeline you build, and every challenge you overcome adds to your experience. Don’t be discouraged by how far you still have to go. Focus on how far you’ve come, keep putting in the work,
1
12
Sometimes, the progress you’re making may not be obvious. You might still be learning, figuring things out, making mistakes, or working towards a goal that feels far away. But every time you show up, practise a new skill, or try again after a setback, you’re making progress.
1
1
2
104
Happy New Month from all of us at Core Data Engineers! 💚 #CoreDataEngineers #HappyNewMonth #DataEngineering #CDEBootcamp3.0
8
and being willing to learn from every experience. This month, keep building, keep exploring, and keep taking those intentional steps forward. Every bit of progress counts! Here’s to a productive November filled with new knowledge, meaningful growth, and exciting opportunities.
1
9
Welcome to November! A new month brings another opportunity to learn something new, strengthen your skills, and make progress towards your goals. As you continue your Data Engineering journey, remember that growth comes from showing up, staying curious, practising consistently
1
2
118
If you’re subscribed, kindly check your email inbox. Your next read from CDE is waiting for you! You can also read the latest edition here: open.substack.com/pub/coreda… Not subscribed yet? Subscribe today and get future editions delivered to your inbox. #CDE #CDENewsletter
7
📩 THE LATEST CDE NEWSLETTER IS OUT! Our latest edition is ready, and we can’t wait for you to read it! We’ve put together practical Data Engineering insights, industry updates, useful learning resources, and career growth opportunities to keep you informed and inspired.
1
1
122
for their continued support and guidance throughout the sessions. 💬 CDE 3.0 participants, over to you! What was your biggest takeaway from this week’s sessions? Share your experience in the comments! 👇 #CDEBootcamp3.0 #CoreDataEngineers #DataEngineering #ApacheAirflow
8
configuration values, and connects to external systems. A big thank you to @najeebsulaiman_ for taking our participants deeper into Apache Airflow through practical demonstrations and hands-on exercises. We also appreciate our Teaching Assistants, @NancyAmandi & Sanyaolu,
1
19