Hybrid in Houston Texas
Salary range 80K to 120K Annual Salary (see note below)All the benefits and perks you need:
- 100% Paid Healthcare Insurance
- Start accruing Paid Days Off from Day One
- Career Development
- Fitness Reimbursement
- Matching 401K Retirement Plan
- Mentoring Program
- Team Events
- And more….
SmartbridgeWe simplify business transformation, applying thought leadership and innovation to create digitally connected enterprises. From Strategy to Implementation, we bring our clients’ digital agenda to life. One of the keys to our success as a company is finding and hiring exemplary employees. We believe that each member of our team contributes directly to Smartbridge’s growth and success, and we take pride and celebrate with our employees as they continue to grow and succeed with their career paths as well.We are seeking an experienced Data Engineer who will work with clients and members of the consulting team on the architecture, design, and development of highly scalable data integration and data engineering processes.
The Consultant must have a strong understanding and experience with data & analytics solution architecture, including data warehousing, data lakes, ETL/ELT workload patterns, and related BI & analytics systems. Additional responsibilities of this role will include the following:
- Deliver consulting projects/work on-time, on-budget, and in a way that accomplishes client goals
- Develop and implement technical best practices for data ingestion, data quality, data cleansing, and other data integration/ETL/Engineering-related activities
- Understand and experience maintaining a multi-terabyte enterprise data warehouse with accompanying incremental data pipelines
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and modern cloud technologies.
- Conduct or participate in meetings with owners of key system components to fully understand current data and systems environments
- Resolve source data issues and refine transformation rules
- Analyze source system data to assess transformation logic and data quality through data profiling
- Leverage data quality processes to assist with data cleansing requirements
- Work with technical and business representatives to determine strategies for handling data anomalies that are identified
- Design ETL processes and develop source-to-target data mappings, integration workflows, and load processes
- Develop, test, integrate, and deploy data pipelines using a variety of tools and external programming/scripting languages as necessary
- Provide technical documentation and other artifacts for data pipelines, ingestion, integration or other data solutions
- Identify problems, develop ideas and propose solutions within differing situations requiring analytical, evaluative or constructive thinking in daily work
- Apply creative thinking to identify possible reporting solution alternatives
- Other duties assigned as needed
Requirements and Qualifications
- 3+ years hands-on experience with these data technologies:
- Azure Data Factory & Synapse
- Azure Databricks
- Lake first approach in building data solutions
- Experience building on-prem data warehousing solutions
- Experience with designing and developing ETL's, Data Marts, Star Schema's
- Experience with building data warehousing solutions in Azure
- Moving data from on-prem to cloud
- Designing a data warehouse solution using Synapse or Azure SQL DB
- Experience building pipelines using Synapse or Azure Data Factory to ingest data from various sources
- Understanding of integration run times available in Azure
- Lake first approach solutions in Azure leveraging Databricks, pySpark and delta format.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
- Expert with scripting languages like Python, Pyspark, Scala.
- Microsoft Azure Cloud platform certifications (nice to have)
- Must be able to travel to client locations based on project need
*Please note that the compensation information that follows is a good faith estimate for this position only and is provided pursuant to the Equal Pay Transparency Laws in numerous states we operate. It takes into consideration a candidate’s education, training, and experience, as well as the position’s work location, expected quality and quantity of work, required travel (if any), external market and internal value, including seniority and merit systems, and internal pay alignment when determining the salary level for potential new employees.
