Senior Data Engineer to lead the delivery of data on data and analytics platform

Our valued client is looking for a Senior Data Engineer to lead the delivery of data on data and analytics platform

This is a remote opportunity, based in EST time-zone

Tasks Include:

• Increase the overall speed in which data is onboarded to the Data and Analytics platform.
• Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform
• Increase the overall quality of data pipeline development through DevSecOps

Must haves:

• Eligible for reliability clearance with the Federal Government
• Programming experience in Spark using modern languages such as Scala
• Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes
• Experience leading Data Engineering principles within an organization/team.
• Experience within Azure environment

Nice to Have:

• Knowledge and expertise of database modeling techniques: Data Vaults, Star, Snowflake, 3NF, etc.
• Experience working with streaming data architecture and technologies for real-time: Spark Streaming, Kafka, Flink, Storm
• Experience working with relational and non-relational database technologies: SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase
• Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, Nexus
• Strong Scala and Spark experience