About the role
Salary: Competitive
We're on the lookout for strong and enthusiastic Data Engineers for an exciting opportunity with one of our fantastic clients. This is your chance to join a thriving organization that's at the forefront of data innovation, where you'll be working alongside a team of experienced and talented professionals. If you're passionate about building cutting-edge data solutions and want to take the next step in your career, this could be the perfect role for you.
Our client offers an environment that encourages growth, creativity, and collaboration, providing you with the tools and support to make a real impact. Whether it's working with the latest cloud technologies or solving complex data challenges, this is a great opportunity to elevate your skills and be part of something truly transformative.
If you’re a dedicated data engineer ready for your next challenge, we'd love to have a chat!
The Role:
As a Senior Data Engineer, you will play a pivotal role in designing, developing, and maintaining our cloud-based data infrastructure. Your main focus will be on leveraging Azure technologies to build robust data architectures that support the needs of various business units. You will work closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure our data is reliable, secure, and scalable.
Key Responsibilities:
Design and implement end-to-end data pipelines on Microsoft Azure.
Develop, optimize, and maintain Azure Data Lake, Azure Synapse, Azure Databricks, and other cloud-based data platforms.
Implement data transformation processes using Azure Data Factory and Databricks to support analytics and business intelligence needs.
Ensure high performance, availability, and scalability of our data pipelines and systems.
Collaborate with data scientists, analysts, and other stakeholders to deliver clean, reliable, and accessible data.
Manage and monitor cloud resources, ensuring security, compliance, and best practices in data governance.
Automate workflows and optimize data processes to minimize manual intervention and improve efficiency.
Lead data engineering initiatives, mentoring junior team members, and sharing best practices in data architecture and development.
Required Skills and Experience:
5+ years of experience in data engineering, with a focus on cloud-based solutions.
Strong expertise in Microsoft Azure services such as Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks, and Azure SQL.
Proficiency in SQL, Python, or Scala for data processing.
Experience with ETL/ELT design patterns and building scalable, distributed data architectures.
Deep understanding of data modelling, data warehousing, and data integration best practices.
Knowledge of Azure DevOps and infrastructure automation tools like Terraform or ARM templates.
Strong problem-solving skills and ability to work independently or in a team.
Experience with CI/CD pipelines and containerization technologies such as Docker and Kubernetes is a plus.
Preferred Qualifications:
Experience with big data technologies like Spark, Hadoop, or Kafka.
Knowledge of data governance, security, and compliance frameworks in the cloud.
Azure certifications such as Azure Data Engineer Associate or Azure Solutions Architect.
If this sounds of interest, click apply now and a member of our team will be in touch!