Senior DataStage Developer to create and support ETL integrations using ETL and Hadoop with one of our major banking clients- 35064

Senior DataStage Developer to create and support ETL integrations using ETL and Hadoop with one of our major banking clients- 35064

Location Address: Hybrid (twice a week) - Toronto

Contract Duration: 10/21/2024 to 10/17/2025 (Chance of Extension)

Scheduled Hours: 37.5hrs per week.

Story Behind the Need:

• Business group: Retail Customer Platforms Technology The Retail Customer Platforms Technology team supports the ongoing enhancement, development, implementation, and day to day operational support of Offer Management platform (Customer Personalization Platform). The projects focus on offer management applications that provide offer configuration, tracking and fulfillment for bank customers across different retail products.
• Project - The ongoing project has multiple releases, dealing with Campaigns and Offer Management for retail customers and accounts. Campaigns can be mass or targeted to specific segments of customers and the offers range from fee waivers to cash bonuses. The DataStage Developer will work closely with the product owner, business analysts and Data Architects to understand the business functions and requirements and implement a solution to extract and transform the data from various source systems.

Typical Day in Role:

• You will write well designed, testable, efficient code by using best software development practices
• You will gather and refine specifications and requirements based on technical needs
• Create and maintain software documentation
• Develop strategies for Extraction, Transformation and Loading (ETL)mechanism.
• Design Server jobs using various types of stages like Sequential file, ODBC, Hashed file, Aggregator, Transformer, Sort, Link Partitioner and Link Collector.
• Analyze the data generated by the business process, defining the granularity, source to target mapping of the data elements, creating Indexes and Aggregate tables for the data warehouse design and development.
• Study the data dependencies using metadata stored in the repository and prepared batches for the existing sessions to facilitate scheduling of multiple sessions.
• Direct day-to-day activities in a manner consistent with our risk culture and the relevant risk appetite statement and limits and communicate it throughout the team.
• Create an environment in which your team pursues effective and efficient operations of their respective areas while ensuring the adequacy, adherence to and effectiveness of day-to-day business controls to meet obligations with respect to risk and compliance

Must-Have skills:

• Overall 10+ years of experience in development with at least 5+ years of deep experience creating and supporting ETL integrations (batch and real-time)
• You have 3+ years of experience Hands-on experience with Parallel jobs like Join, Merge, Lookup, remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XM
• You have 3+ years of hands-on experience with DataStage Manager, Designer, Administrator, and Director
• You have 3+ years of hands-on experience with Big Data concept and platforms, such as Hadoop/ Hive/Beeline/EDL
• You are an expert in UNIX shell scripts using K-shell for the automation of processes and scheduling DataStage jobs

Nice-To-Have Skills:

• You have Data Warehousing skills and experience in dimensional modeling.
• You have experience in Data Modeling as well as reverse engineering using tools like Erwin and MS Visio as an asset.
• You have experience in integration of various data sources (DB2-UDB, PL/SQL, Hadoop data) into data staging area.
• You have experience in performance tuning and enhancement as an asset.

Best vs. Average Candidate:

• Bets candidate has experience in ETL and HADOOP.

Education:

• Bachelors in computer science or comp engineer

Candidate Review & Selection

• One round - MS Teams video interview - Panel (1 hour) - HM + Panel behavioral and technical