Dataops engineer specialist

Descripción del cargo

At ScotiaTech, we’re looking for our next DataOps Engineer Specialist, someone who is passionate about helping people and ready to build a meaningful career in a multicultural environment.


What will you do?

• Data Integration: Integrate data across sources—including legacy on-premises into Azure Databricks—and validate end-to-end data flow so data lands complete and usable.
• Pattern Deployment & Architecture: Deploy and reuse the team’s approved ingestion, transformation, and integration patterns, partnering with architecture and senior engineers to follow the target design and standards.
• DataOps & Automation: Support DataOps practices (Git, CI/CD, automated testing, monitoring) to keep pipelines reliable, available, and performant.
• Discovery & Mapping: Explore legacy and GCP data, produce source-to-target mappings to the Delta Lake model, and document lineage and dependencies to support migration.
• Data Quality & Reconciliation: Check data quality and reconcile source vs. target (parity), cleansing and preparing data across the medallion layers (Bronze?Silver?Gold).


What do we offer you?

Career growth opportunities within one of the top financial institutions.
A diverse, dynamic, and multicultural work environment.
Benefits that support your emotional and financial well-being.


What do you need?


• Relevant cloud or data engineering certifications (Databricks, GCP, Azure, AWS) are considered a plus.
• 3+ years of experience in DataOps, data integration, or data engineering support.
• Experience integrating and mapping data, and supporting data migration or cloud modernization (on-prem or GCP to Azure Databricks is an asset).
• Familiarity with DataOps practices (Git, CI/CD, automated testing, monitoring).
• Experience working with SMEs and cross-functional teams in an Agile environment.
• Strong proficiency in Apache Spark (PySpark) and Python for large-scale data processing.
Knowledge of data migration, cloud modernization, and platform transformation initiatives is highly desirable.