Intermediate Data Engineer/Developer to design, develop, and maintain robust Databricks streaming using Pyspark.
S.i. Systems
Toronto, ON-
Number of positions available : 1
- Salary To be discussed
-
Contract job
- Published on June 24th, 2024
-
Starting date : 1 position to fill as soon as possible
Description
Our downtown Calgary Oil & Gas client is seeking an Intermediate Data Engineer/Developer to design, develop, and maintain robust Databricks streaming using Pyspark.
Contract would be starting ASAP until December 31, 2024; with high probability of extension.
Must haves
- 3-5+ years experience with Databricks, Pyspark, and data warehousing
- Technical proficiency in Python and SQL
- Experience with Apache Airflow and Git
Nice to haves
- Experience with Azure DevOps and/or Atlassian products (Jira, Confluence) for streamlined development and collaboration
- Technical experience with Power BI
- Experience with cloud platforms, preferably Microsoft Azure
- Azure certifications
- Bachelor’s degree in computer science, engineering, or related field
- Oil & Gas experience an asset
Requirements
- Design, develop, and maintain robust Databricks streaming and batch jobs using Databricks and Pyspark
- Collaborate with cross functional teams to understand data requirements and translate them into efficient, reliable, and high quality data solutions
- Optimizing Databricks jobs for performance and cost efficiency
- Manage data ingestion process is of digital platform, handling high frequency and large volumes of data
Requirements
undetermined
undetermined
undetermined
undetermined
Other S.i. Systems's offers that may interest you
- Share this page
- Share on Facebook
- Share on Twitter
- Share on LinkedIn
- Print the offer
More similar jobs like "Intermediate Data Engineer/Developer to design, develop, and maintain robust Databricks streaming using Pyspark."
-
Front End Developer
Toronto,ON
Published since 5 day(s)
-
Sr Manager, IP Backbone Engineering
Markham,ON
Published since 15 day(s)
-
Automation Control Systems Specialist Job Details | Purolator
Etobicoke,ON
Published since 16 day(s)
See more similar jobs
Search more jobs
We create the perfect match
Jobillico displays the best jobs that fit your profile.
job seekers also viewed.
-
Apple Specialist - Retail Customer Service and Sales - (Seasonal)
Toronto,
-
Apple Specialist - Retail Customer Service and Sales - (Seasonal)
Mississauga,
-
Apple Specialist - Retail Customer Service and Sales - (Seasonal)
Toronto,
