Data Engineer 5 (Python, SQL, Databricks, Snowflake) (Enterprise Platforms Technology)

Discover Financial
Richmond, Virginia, New York, Plano, Illinois
Full timeUSD 209,000 - 238,500 annuallyFunction: Solutions Engineering & Sales EngineeringExperience: 6+ yearsEducation: bachelorsSkills: ["Technical leadership","Hands-on execution","Cross-functional collaboration","Data governance mindset","Performance optimization"]

Design and implement an AI-enabling data ecosystem by building resilient, scalable batch and real-time pipelines and streaming architectures for LLM workflows, RAG pipelines, and predictive ML models. Lead the Top of House AI data layer blueprint, mentor engineers on coding standards, and partner on data governance, privacy, and lineage. Optimize cross-cloud pipeline performance and costs, and deliver executive-facing decisioning through feature stores and production-ready solutions.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 day ago

Data Engineer 5 (Python, SQL, Databricks, Snowflake) (Enterprise Platforms Technology)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Design and implement an AI-enabling data ecosystem by building resilient, scalable batch and real-time pipelines and streaming architectures for LLM workflows, RAG pipelines, and predictive ML models. Lead the Top of House AI data layer blueprint, mentor engineers on coding standards, and partner on data governance, privacy, and lineage. Optimize cross-cloud pipeline performance and costs, and deliver executive-facing decisioning through feature stores and production-ready solutions.
Location: Richmond, Virginia, New York, Plano, Illinois
Employment Type: Full time
Job Function: Solutions Engineering & Sales Engineering

Key Responsibilities

  • •Architect, build, and scale clean, reliable, latency-optimized batch and real-time data pipelines for AI/ML and LLM applications.
  • •Contribute to the architectural blueprint for the Top of House AI data layer and mentor junior/mid-level engineers on coding standards and design patterns.
  • •Partner with Enterprise Security and Data Governance to implement data classification, privacy safeguards, and automated lineage tracking for AI models and training datasets.
  • •Build and maintain scalable feature stores supporting real-time inferencing and offline model training for executive-facing predictive models.
  • •Audit and optimize cross-cloud data pipeline performance, query performance, and storage infrastructure for efficiency, cost management, and reliability.

Pay and Benefits

Salary: USD 209,000 - 238,500 annually

Key Requirements

  • •Bachelor’s degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering).
  • •At least 6 years of experience in application development (internship experience does not apply).
  • •At least 4 years of experience in distributed data and designing/building data pipelines.
  • •At least 4 years of experience with SQL and at least 4 years of programming with Python, Java, or Scala.
  • •At least 2 years of experience in data modeling and designing end-to-end data solutions using relational and non-relational databases.
Experience:6+ yearsData engineeringDistributed systemsAIMachine learningCloud
Education:Bachelor's in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
Skills:Technical leadershipHands-on executionCross-functional collaborationData governance mindsetPerformance optimization
Tech Stack:PythonSQLDatabricksSnowflakeRAGLLMsReal-time streamingFeature storesScalaJavaAWSMicrosoft AzureGoogle CloudClaudeGemini

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn