Data Integration Engineer

Syndigo · Gurugram, Haryana
Department Syndigo
Employment Type Full-Time
Minimum Experience Experienced

The Data Integration Engineer is responsible for implementing data ingestion, validation, and transformation pipelines at Syndigo.  In collaboration with the Product, Development, and Enterprise Data teams, the Data Integration Engineer will design and maintain batch and streaming integrations across a variety of data domains and platforms.  The ideal candidate is experienced in big data, cloud architecture, and is excited to advance innovative analytics solutions!


ESSENTIAL DUTIES AND RESPONSIBILITIES:


  • Work with stakeholders to define and develop data ingest, validation, and transform pipelines
  • Participate in solution and architecture design & planning
  • Troubleshoot data pipelines and resolve issues in alignment with SDLC
  • Ability to diagnose and troubleshoot data issues, recognizing common data integration and transformation patterns
  • Estimate, track, and communicate status of assigned items to a diverse group of stakeholders


REQUIREMENTS:


  • 3+ years experience in developing large scale data pipelines in a cloud environment
  • Demonstrated proficiency in Scala (Object Oriented Programming) or Python, SQL, or SPARK SQL
  • Experience with Databricks, including Delta Lake
  • Experience with Azure and cloud environments, including Azure Data Lake Storage (Gen2), Azure Blob Storage, Azure Synapse,Azure Tables, Azure SQL Database, Azure Data Factory
  • Experience with ETL/ELT patterns, preferably using Azure Data Factory and Databricks jobs
  • Fundamental knowledge of distributed data processing and storage
  • Fundamental knowledge of working with structured, unstructured, and semi-structured data
  • Excellent analytical and problem-solving skills
  • Ability to effectively manage time and adjust to changing priorities
  • Bachelor’s degree preferred, but not required

Thank You

Your application was submitted successfully.

  • Location
    Gurugram, Haryana
  • Department
    Syndigo
  • Employment Type
    Full-Time
  • Minimum Experience
    Experienced