logo inner

Data Engineer (Python)

softwaysolutionsBengaluru, IndiaOnsite
This job is no longer open

WHO ARE WE LOOKING FOR ?
Softway is on the lookout for a  Data Engineer in Python who is passionate about building products that our customers love. You will join a dynamic and fast-paced environment and work with cross-functional teams to design, build and roll-out products that deliver the company’s vision and strategy.We're seeking a Python-savvy Data Engineer with a growing interest in big data technologies to join our dynamic team. You'll use Python to build essential data pipelines, wrangle datasets, and collaborate with our data science team.

This is a fantastic opportunity to gain experience with PySpark and other in-demand tools while contributing to our data-driven initiatives.Responsibilities


  • Design and develop Python-based ETL/ELT processes, incorporating PySpark for larger datasets.

  • Clean, transform, and prepare data for analysis using Python (Pandas, NumPy) and PySpark.

  • Work with structured, semi-structured, and unstructured data from various sources.

  • Write SQL queries to effectively interact with relational databases.

  • Collaborate with data scientists and analysts to design and implement data solutions.

  • Explore and utilize cloud services for data storage and processing on AWS

  • Learn and contribute to best practices in data pipeline development and maintenance.

Required Skills:


  • Strong Python programming fundamentals and knowledge of core data manipulation libraries (Pandas, NumPy).

  • Basic understanding of PySpark for distributed data processing.

  • Proficiency in SQL for querying and working with relational data.

  • Familiarity with data warehousing and ETL/ELT principles.

  • Willingness to learn and grow within a collaborative environment.

Why Should You Work at Softway?Softway offers a dynamic and collaborative work environment where you'll have the opportunity to work with talented individuals who are passionate about what they do. We provide ample learning opportunities and support career growth without unnecessary struggle. Our culture promotes open communication and values your opinions. We take pride in fostering an ego-less workforce focused on bringing innovative solutions to life. In addition to competitive compensation, we offer flexible work environments, paid time off, gratuity, and great flexibility.Join us at Softway and be part of a team that works hard, plays harder, and continuously strives for excellence in everything we do!

Submit Your Application


You have successfully applied

  • You have errors in applying

Apply With Resume *First Name*Middle NameLast Name*Email*MobilePhoneReferred by: Name & comments if any: Social Network and Web LinksProvide us with links to see some of your work (Git/ Dribble/ Behance/ Pinterest/ Blog/ Medium) + Employer + Add Employer Education + Add Education How soon can you join us? (notice period in days) *Current CTC*Expected CTC*If not already in Bangalore, would you be willing to relocate? *Experience break-up: Relevant as against Overall*What inspired you to apply for this role at Softway?
{ "@context" : "http://schema.org/", "@type" : "JobPosting", "url" : "https://softwaysolutions.freshteam.com/jobs/eFzkco1CyznT/Data%20Engineer%20(Python)", "title" : "Data Engineer (Python)", "description" : "<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:700;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">WHO ARE WE LOOKING FOR ?</span></p><div><br></div><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Softway is on the lookout for a &nbsp;Data Engineer in Python who is passionate about building products that our customers love.

You will join a dynamic and fast-paced environment and work with cross-functional teams to design, build and roll-out products that deliver the company’s vision and strategy.</span></p><div><br></div><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">We're seeking a Python-savvy Data Engineer with a growing interest in big data technologies to join our dynamic team.

You'll use Python to build essential data pipelines, wrangle datasets, and collaborate with our data science team. This is a fantastic opportunity to gain experience with PySpark and other in-demand tools while contributing to our data-driven initiatives.</span></p><div><br></div><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Responsibilities</span></p><div><br></div><ul style="margin-top:0;margin-bottom:0;"><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Design and develop Python-based ETL/ELT processes, incorporating PySpark for larger datasets.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Clean, transform, and prepare data for analysis using Python (Pandas, NumPy) and PySpark.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Work with structured, semi-structured, and unstructured data from various sources.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Write SQL queries to effectively interact with relational databases.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Collaborate with data scientists and analysts to design and implement data solutions.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Explore and utilize cloud services for data storage and processing on AWS</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Learn and contribute to best practices in data pipeline development and maintenance.</span></p></li></ul><div><br></div><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:700;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Required Skills:</span></p><div><br></div><ul style="margin-top:0;margin-bottom:0;"><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Strong Python programming fundamentals and knowledge of core data manipulation libraries (Pandas, NumPy).</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Basic understanding of PySpark for distributed data processing.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Proficiency in SQL for querying and working with relational data.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Familiarity with data warehousing and ETL/ELT principles.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Willingness to learn and grow within a collaborative environment.</span></p></li></ul><div><br></div><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:700;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Why Should You Work at Softway?</span></p><div><br></div><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Softway offers a dynamic and collaborative work environment where you'll have the opportunity to work with talented individuals who are passionate about what they do.

We provide ample learning opportunities and support career growth without unnecessary struggle. Our culture promotes open communication and values your opinions. We take pride in fostering an ego-less workforce focused on bringing innovative solutions to life. In addition to competitive compensation, we offer flexible work environments, paid time off, gratuity, and great flexibility.</span></p><div><br></div><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial,sans-serif;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap;">Join us at Softway and be part of a team that works hard, plays harder, and continuously strives for excellence in everything we do!</span></p>", "datePosted" : "2024-04-24 02:47:40 UTC", "employmentType" : "FULL_TIME", "remote" : "false", "hiringOrganization" : { "@type":"Organization", "name":"Softway" }, "jobLocation" : { "@type": "Place", "address": { "@type": "PostalAddress", "streetAddress": "", "addressRegion": "Bengaluru", "postalCode": "", "addressLocality": "", "addressCountry": "India" } } } var translation = { 'employer_title': `Designation`, 'employer_company': `Company/Business name`, 'employer_start_date': `Start date`, 'employer_end_date': `End date`, 'employer_is_current': `I currently work here`, 'employer_summary': `Summary`, 'employer_remove': `Remove this employer`, 'education_degree': `Degree`, 'education_field_of_study': `Field of study/major`, 'education_school_name': `Institution/school name`, 'education_start_date': `Start date`, 'education_end_date': `End date`, 'education_is_current': `Currently pursuing`, 'education_grade': `Grade`, 'education_remove': `Remove this degree` };

This job is no longer open
Your tracker settings

We use cookies and similar methods to recognize visitors and remember their preferences. We also use them to measure ad campaign effectiveness, target ads and analyze site traffic. To learn more about these methods, including how to disable them, view our Cookie Policy or Privacy Policy.

By tapping `Accept`, you consent to the use of these methods by us and third parties. You can always change your tracker preferences by visiting our Cookie Policy.

Copyright © 2024