Title : Senior Data EngineerLocation : Onsite - Porto/LisbonJob Type : Full time (with our Client)You'll design and develop data engineering pipelines using the best tools to ensure data availability and consistency.
In this leadership role, you'll be responsible for preparing and refining sprint plans, ensuring clear goals and priorities for the team.
You will manage and support your data engineering team, fostering growth and collaboration, while also providing guidance to team members and offering support to the Project Manager.
Additionally, you will oversee the timely and quality delivery of sprint commitments and collaborate with cross-functional teams.If you're organized, motivated, and passionate about sustainability, we'd love to hear from you!Key Responsibilities• Data Integration: Integrate new data sources, ensuring data consistency, reliability and efficiency.• Database Management: Develop and optimize databases and data warehouses for top performance and reliability.• ETL Processes: Create and manage ETL processes to move and transform data effectively• Data Quality: Implement robust data quality checks to ensure data integrity throughout its lifecycle.• Performance Tuning: Optimize data systems and pipelines for peak performance and scalability• Documentation: Document data processes, architectures, and pipelines comprehensively• Compliance: Ensure all data practices comply with relevant privacy and security regulations• Collaboration: Work closely with data scientists, analysts, and stakeholders to understand data requirements and deliver effective solutions• Management: Oversee sprint refinement processes by thoroughly understanding business requirements, translating them into technical tasks, and ensuring quality in both execution and team performance.
Lead by example to ensure alignment with strategic goals.• Team Coordination and Communication: Maintain effective communication and synchronization within the team and with the project manager and other departments to ensure seamless collaboration and alignment.• Task Assignment and Resource Allocation: Assign tasks and responsibilities based on individual skills and strengths while ensuring work is balanced and resources are efficiently utilized.• Performance Monitoring and Delivery Oversight: Monitor team performance to ensure objectives are met, and take ownership of sprint and project deliveries by fostering accountability and prioritizing outcomes.• Feedback and Development: Implement regular feedback processes, offering constructive input to team members while supporting their personal and professional growth.• Mentoring and Coaching: Provide guidance and mentorship to help team members develop their skills, knowledge, and confidence.• Innovation: Stay up-to-date with trends, best practices, and emerging technologies to keep the team at the forefront of the industry.• Risk Management: Proactively identify potential risks and challenges that could impact projects, developing strategies to mitigate them effectively.Requirements• Hold a BSc, MSc, or PhD in Computer Science, Electronic Engineering or Systems Engineering• 5+ years of experience in data engineering or a related field, with at least 2 years in a leadership or senior-level position .• Proven experience with data pipelines design and orchestration, ideally with time-series data.• Proficiency in programming languages, mainly Python and SQL .
Experience with OOP, Unix, and Git is essential.• Experience specifically with MySQL, PostgreSQL, and TimescaleDB .• Experience managing and manipulating relational databases.
Knowledge of non-relational databases is a plus.• Basic knowledge of Docker is expected• Experience with APIs is an additional requirement• Strong knowledge of ETL processes and data warehousing .• Understanding of big data frameworks and tools is a plus.• Excellent problem-solving and analytical skills.• Strong communication and presentation abilities.• Ability to work collaboratively in a team environment.• Attention to detail and a commitment to data quality.