Description

The Sr Data Engineer in the Data & AI Platform team is responsible for building and optimizing data pipelines and infrastructure to enable secure, scalable, and high-performance access to FX market data—particularly from platforms such as FX Spectrum. This role is instrumental in delivering high-quality, trusted data assets and analytics capabilities within Client’s modern Data & AI Platform to support data-driven and AI-enabled decision-making across the enterprise.

About the Role

  • Role: Senior Data Engineer
  • Skills: Apache Spark, Databricks, or Azure Data Factory, FX Trading Platform, Databricks, Azure Synapse, or Snowflake
  • Experience: 10+ years
  • Location: Remote.

Key Accountabilities

  • Build robust data pipelines: Design, develop, and maintain batch and real-time data pipelines for ingesting, transforming, and storing FX data.
  • Enable data-driven insights: Collaborate with analysts, data scientists, and business teams to ensure timely, reliable, and well-structured data is available to support analytics and AI use cases.
  • Integrate market data platforms: Work with internal and external systems to ensure smooth integration of FX Spectrum data feeds using industry protocols such as FIX and REST APIs.
  • Support platform scalability: Contribute to the development of reusable data models, ETL frameworks, and metadata-driven pipelines across the enterprise data ecosystem (e.g., Databricks, Azure Data Factory, Power BI).
  • Ensure data quality and governance: Apply rigorous data validation and quality assurance techniques, ensuring compliance with regulatory requirements and internal data governance standards.
  • Optimize data performance: Identify and implement performance improvements in data workflows, including indexing, partitioning, and data format optimization for large-scale FX data.

Qualifications

Education & Experience

  • Bachelor’s degree in Computer Science, Data Engineering, or related technical field.
  • 3–5 years of experience in data engineering or data platform development, preferably within capital markets or financial services.
  • Direct experience with FX Spectrum or similar FX trading platforms.

Technical Skills

  • Advanced proficiency in SQL and data pipeline development using tools such as Apache Spark, Databricks, or Azure Data Factory.
  • Experience with visualization tools such as Power BI or Tableau.
  • Familiarity with cloud data platforms (e.g., Databricks, Azure Synapse, or Snowflake).
  • Solid understanding of FX market data structures, FIX protocol, and integration of streaming or batch feeds.
  • Understanding of data governance concepts and tools (e.g., Microsoft Purview, Unity Catalog).

Core Competencies

  • Strong problem-solving and system design skills with the ability to build scalable, maintainable data solutions.
  • Effective communicator with the ability to collaborate across technical and business teams, translating data architecture into practical use cases.
  • Solid business acumen and understanding of financial or credit union operations, particularly FX trading workflows and post-trade processing.
  • Demonstrated ability to thrive in a fast-paced, regulated, data-driven environment.
  • Ability to collaborate in cross-functional teams and thrive in a data-driven culture.

Outcomes

  • Faster insight generation and decision-making across business units.
  • Improved adoption of governed, self-serve analytics capabilities.
  • Scalable and governed data pipelines that enable real-time and historical FX analysis.
  • Accelerated delivery of AI and analytics use cases through high-quality data infrastructure.
  • Increased adoption of trusted, self-serve FX data assets across trading, risk, and finance teams.

If you’re someone who thrives in fast-paced environments, takes initiative, and enjoys solving complex problems, we’d love to connect!

Apply now or reach out directly at narendra.bellam@coforge.com to learn more!