Data Engineer

Description

Job Summary:

Ledcor is hiring a Data Engineer to join us on a full-time permanent basis. As the Data Engineer, you will report to the Manager, Data Platform and be responsible for building, maintaining, and optimizing our data infrastructure to empower informed decision-making. As part of your new position, you will be building, testing, and refining data from diverse source systems using modern medallion data lakehouse architecture.

We are committed to the long-term success and wellbeing of our employees. Our total rewards package is designed to provide compensation and benefits programs that support your health, wellness, and financial security. Including items such as competitive salaries and profit-sharing program; exceptional health, dental, vision plans, life and disability coverages; comprehensive retirement plans, generous vacation and leave, family support benefits, mental health resources, and more. We offer ongoing employee training and development, team building and career growth opportunities.

This is a work from home position with the understanding you will be required in office as the business needs. Apply today to join our True Blue team in Edmonton, Vancouver or Toronto!

Essential Responsibilities

• Building, maintaining and supporting the connection and ingestion of data from source systems to the data platform, e.g. JDE to Databricks
• Monitor the performance and quality of data transfers between source and target systems
• Collaborate with Information Security team on securing connections
• Build the appropriate connections between source system and data lakehouse & troubleshoot any issues in relations to the connections
• Set up pipelines to enable efficient scheduled and triggered full and incremental data ingestion
• Design, build and test data pipelines within the data lakehouse
• Work closely with stakeholders to define objectives and expected outcomes
• Profile the source data to understand its structure, quality and relationships
• Support the Data Architect in defining data models and mapping logic for the lakehouse. This includes defining schemas, tables, and relationships to organize and store data efficiently, as well as source to target mapping and transformation logic.
• Assist the team in the development of comprehensive testing strategy covering various aspects such as data quality, accuracy, completeness, and performance. This may involve, integration testing, regression testing, and end-to-end testing
• ELT Development; Develop the Extract, Load, Transform (ELT) processes to transform raw data into the desired format.
• Use appropriate tools and technologies for data integration, manipulation, and transformation (Azure and Databricks).
• Build and test the data flows from source systems to the data lake house
• Implement batch and real-time data processing solutions Implement data partitioning, indexing, and compression techniques to optimize data storage and query performance.
• Develop processes and documentation for data collection and integration and support training and awareness
• Establish methods and procedures for tracking data quality, completeness, redundancy, and improvement

Qualifications

• 6+ years of relevant data engineering experience
• A bachelor’s degree in a relevant filed such as Computer Science, Statistics or Information Management
• Experience with business and technical requirements analysis, business process modelling, and methodology development and data mapping
• Strong project management skills using waterfall and agile methodologies
• Working experience with Azure, Databricks, Denodo, Snowflakes, Github, Hackolade and Qlik would be preferred
• Experience with data integration using APIs
• Computer programming skills, SQL and Python (Must have) and R, JSON, HTML, (Nice to have)
• Working knowledge in Agile, DevOps, CI/CD

Additional Information:

Company Description

The Ledcor Group of Companies is one of North America’s most diversified construction companies. Ledcor is a company built on a rich history of long-standing project successes.

But when you work for Ledcor, your experience will go far beyond the project. Do you want a career that means more? Join our True Blue team now!

Employment Equity

At Ledcor we believe diversity, equity, and inclusion should be part of everything we do. We are proud to be an equal-opportunity employer. All qualified individuals, regardless of race, color, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, Veteran status or any other identifying characteristic are encouraged to apply.

Our True Blue team consists of individuals from all backgrounds who contribute diverse perspectives and experiences to Ledcor. For more information about Ledcor’s Inclusion and Diversity initiatives, please visit our I&D page. Adjustments will be provided in all parts of our hiring process. Applicants need to make their needs known in advance by submitting a request via email.

7008 Roper Road NW, Edmonton, AB