Mactores is a trusted leader among businesses in providing modern data platform solutions. Since 2008, Mactores have been enabling businesses to accelerate their value through automation by providing End-to-End Data Solutions that are automated, agile, and secure. We collaborate with customers to strategize, navigate, and accelerate an ideal path forward with a digital transformation via assessments, migration, or modernization.
Mactores is seeking an AWS Data Engineer to join our team. The ideal candidate will have extensive experience in PySpark and SQL and have worked with data pipelines using Amazon EMR or Amazon Glue. The candidate needs expertise in developing and managing data pipelines, particularly in a DataBricks DeltaLake format. The candidate must also have experience in data modelling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, Presto, and orchestration experience using Airflow.
What you will do?
- Map cross-functional business processes and identify data locations.
- Define data models based on query/export interfaces and reporting requirements.
- Develop data pipelines to consolidate, transform, and ensure data quality.
- Collaborate with Business Analysts to address key business questions.
- Review and evaluate the organization’s current and desired state of Data Governance.
- Develop data products aligned with robust data governance principles.
- Establish a medallion-style definition for data in the data lake, enabling easy identification of authoritative data sources for analytics.
- Review, edit, and occasionally author new data pipelines.
- Implement unit tests for newly developed pipelines.
- Provide guidance on continuous integration and continuous deployment (CICD) processes related to data pipeline development.
- Act as a consultant to the business for ad-hoc analytic queries executed via Looker.
- Enable data-driven decision-making by providing expert guidance on data consumption and newly developed capabilities like data products.
- Establish gold-standard data sources.
- Implement data cleanliness pipelines and processes.
- Formalize model review and ownership processes.
- Publish access and interfaces to gold data through formal data products.
What are we looking for?
- Bachelor's degree in Computer Science, Engineering, or related field.
- 4+ years experience as a Data Architect with a focus on data governance.
- Strong proficiency in mapping business processes and defining data models.
- Expertise in developing and managing data pipelines, particularly in a DataBricks' DeltaLake format.
- Experience with Spark and Airflow for orchestration.
- Familiarity with Looker for analytics.
- Knowledge of best practices in unit testing and CICD for data pipelines.
- Excellent communication and collaboration skills.
You will be preferred if
- AWS Data Analytics Speciality Certification
- Experience with Agile development methodology
Life at Mactores
We care about creating a culture that makes a real difference in the lives of every Mactorian. Our 10 Core Leadership Principles that honor Decision-making, Leadership, Collaboration, and Curiosity drive how we work.1. Be one step ahead2. Deliver the best3. Be bold4. Pay attention to the detail5. Enjoy the challenge6. Be curious and take action7. Take leadership8. Own it9. Deliver value10. Be collaborativeWe would like you to read more details about the work culture on https://mactores.com/careersThe Path to Joining the Mactores TeamAt Mactores, our recruitment process is structured around three distinct stages:Pre-Employment Assessment:You will be invited to participate in a series of pre-employment evaluations to assess your technical proficiency and suitability for the role.Managerial Interview: The hiring manager will engage with you in multiple discussions, lasting anywhere from 30 minutes to an hour, to assess your technical skills, hands-on experience, leadership potential, and communication abilities.HR Discussion: During this 30-minute session, you'll have the opportunity to discuss the offer and next steps with a member of the HR team.At Mactores, we are committed to providing equal opportunities in all of our employment practices, and we do not discriminate based on race, religion, gender, national origin, age, disability, marital status, military status, genetic information, or any other category protected by federal, state, and local laws.
This policy extends to all aspects of the employment relationship, including recruitment, compensation, promotions, transfers, disciplinary action, layoff, training, and social and recreational programs. All employment decisions will be made in compliance with these principles.Note: Please answer as many questions as possible with this application to accelerate the hiring process. Apply for this job
