Data Engineer
: Contractor
Kaizen Analytix LLC, an analytics consulting services and product firm that gives clients unmatched speed to value through analytics solutions and actionable business insights, is seeking candidates for a talented Senior Data Engineer with advanced knowledge of PySpark to join our team.As a Data Engineer, you will be expected to work independently, collect requirements, perform data mapping to warehouse, hands on prototyping, ad hoc process of data files and transform them into structured data that can be ingested on a production basis.
The ideal candidate will have a strong background in data engineering, including experience with SQL Server, ETL processes, Python, PySpark, and cloud platforms.
Responsibilities:
- Perform Data Engineering related tasks utilizing Python & PySpark in a distributed environment on Azure..
- Work with data SME’s and data architects to create end user friendly data models to support data warehouse setup.
- Possesses excellent knowledge of Relational Database Management Systems (DBMS) and data warehouse front-end tools.
- Be proficient in creating and maintaining database objects and stored procedures.
- Contributing team member to the design and support of data architecture, database design and integration, transformations, and load processes.
Job Requirements:
- Bachelor’s or master’s degree in computer science, engineering, or a related field.
- 5+ years of experience working with SQL.
- 5+ years of experience working with Python and PySpark skills.
- Familiarity with the basic principles of distributed computing and data modeling.
- Excellent problem-solving and analytical skills, with the ability to troubleshoot complex data issues and optimize data processes.
- Working with other SQL database like PostGres and SQL Server is a plus.
- Strong written and verbal communication skills.
- Be open to receiving constructive feedback.
- Ability to work in a fast-paced, rapidly growing company and handle a wide variety of challenges, deadlines, and a diverse array of contacts.
