Description
We are looking for an experienced Data Engineer to join our team. Here at Mindera, we are continuously developing a fantastic team and would love for you to join us.As a Data Engineer, you will be responsible for building, maintaining, scaling, and integrating big data-based platforms. you will also be engaged with the Data Engineering team in setting up and automating the Data Science models/algorithms for production use.This is a fantastic opportunity for someone passionate about Data and excited to use different tools to provide data insight for further analysis and drive business decisions.
Requirements
You’re great at
- Python
- Pyspark
- Cloud - AWS/GCP
- SQL
- Airflow
- Data Bricks
- Data Governance
- Snowflake
- Data Modelling
- Pyspark
It also would be cool if you have
- Exposure to DBT would be preferable
- Experience working with modern data platforms such as redshift or snowflake would be preferable
- Experience working with Airflow, Docker, Terraform and CI/CD would be preferable
- Experience working with docker, Scala, and Kafka would be an added advantage
What you will be doing
- Implement/support new data solutions in the data lake/warehouse built on the snowflake
- Develop and design data pipelines using python.
- Design and Implement Continuous Integration/Continuous Deployments pipelines.
- Perform Data Modelling using downstream requirements.
- Develop transformation scripts using advanced SQL and DBT.
- Write test cases/scenarios to ensure incident-free production release.
- Collaborate closely with data analysts and different domains such as Finance, risk, compliance, product and engineering to fulfil requirements.
- Debug production and development issues and provide support to colleagues where necessary.
- Perform data quality checks to ensure the quality of the data exposed to the end users.
- Build strong relationships with team, peers and stakeholders.
- Contributes to overall data platform implementation.
Benefits
We offer
- Flexible working hours (self-managed)
- Competitive salary
- Annual bonus, subject to company performance
- Access to Udemy online training and opportunities to learn and grow within the role
At Mindera we use technology to build products we are proud of, with people we love.Software Engineering Applications, including Web and Mobile, are at the core of what we do at Mindera. We partner with our clients, to understand their products and deliver high-performance, resilient and scalable software systems that create an impact on their users and businesses across the world. You get to work with a bunch of great people, and the whole team owns the project together. Our culture reflects our lean and self-organisation attitude.
We encourage our colleagues to take risks, make decisions, work in a collaborative way and talk to everyone to enhance communication. We are proud of our work and we love to learn all and everything while navigating through an Agile, Lean and collaborative environment.Check out our Blog: http://mindera.com/ and our Handbook: http://bit.ly/MinderaHandbook
Our offices are located:
Porto, Portugal | Aveiro, Portugal | Coimbra, Portugal | Leicester, UK | San Diego, USA | Chennai, India | Bengaluru, India
