Intermediate Data Engineer/Developer to design, develop, and maintain robust Databricks streaming using Pyspark.
S.i. Systèmes
Toronto, ON-
Nombre de poste(s) à combler : 1
- Salaire À discuter
-
Emploi Contrat
- Publié le 24 juin 2024
-
Date d'entrée en fonction : 1 poste à combler dès que possible
Description
Our downtown Calgary Oil & Gas client is seeking an Intermediate Data Engineer/Developer to design, develop, and maintain robust Databricks streaming using Pyspark.
Contract would be starting ASAP until December 31, 2024; with high probability of extension.
Must haves
- 3-5+ years experience with Databricks, Pyspark, and data warehousing
- Technical proficiency in Python and SQL
- Experience with Apache Airflow and Git
Nice to haves
- Experience with Azure DevOps and/or Atlassian products (Jira, Confluence) for streamlined development and collaboration
- Technical experience with Power BI
- Experience with cloud platforms, preferably Microsoft Azure
- Azure certifications
- Bachelor’s degree in computer science, engineering, or related field
- Oil & Gas experience an asset
Requirements
- Design, develop, and maintain robust Databricks streaming and batch jobs using Databricks and Pyspark
- Collaborate with cross functional teams to understand data requirements and translate them into efficient, reliable, and high quality data solutions
- Optimizing Databricks jobs for performance and cost efficiency
- Manage data ingestion process is of digital platform, handling high frequency and large volumes of data
Exigences
non déterminé
non déterminé
non déterminé
non déterminé
D'autres offres de S.i. Systèmes qui pourraient t'intéresser
- Partager cette page
- Partager sur Facebook
- Partager sur Twitter
- Partager sur LinkedIn
- Imprimer l'offre
Plus d'offres similaires à "Intermediate Data Engineer/Developer to design, develop, and maintain robust Databricks streaming using Pyspark."
-
Sr Manager, IP Backbone Engineering
Markham,ON
Publié il y a 15 jour(s)
-
Senior Data Engineer
Toronto,ON
Publié il y a 24 jour(s)
-
Data Engineer
Toronto,ON
Publié il y a 2 jour(s)
Voir plus d'offres similaires
Chercher d'autres emplois
On crée le match parfait
Jobillico te propose instantanément les offres d’emploi qui te correspondent.
Plus d'offres
-
Director, Data, Reporting and Insights
Toronto,
-
Senior ML Engineer
Toronto,
-
Intermediate AWS Engineer
Toronto,
