Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)

Discover Financial
New York, Virginia, Richmond
Full timeUSD 179,400 - 245,600 annuallyFunction: DevOps, Cloud & InfrastructureExperience: 4+ yearsEducation: bachelorsSkills: ["Collaboration","Mentoring","Experimenting","Code quality","Performance tuning"]

Build and support data engineering solutions that power hyper-personalized omnichannel messaging. Collaborate with Agile teams to design and implement data movement systems, optimize data models and information systems, and tune code for performance. Use Python, SQL, and distributed computing technologies (Spark, Kafka) with cloud and data warehousing platforms such as AWS, Snowflake, and Databricks. Mentor engineers, unit-test your work, and help deliver robust cloud-based experiences at scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
3 weeks ago

Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Build and support data engineering solutions that power hyper-personalized omnichannel messaging. Collaborate with Agile teams to design and implement data movement systems, optimize data models and information systems, and tune code for performance. Use Python, SQL, and distributed computing technologies (Spark, Kafka) with cloud and data warehousing platforms such as AWS, Snowflake, and Databricks. Mentor engineers, unit-test your work, and help deliver robust cloud-based experiences at scale.
Location: New York, Virginia, Richmond
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Sr. Manager level

Key Responsibilities

  • •Collaborate with Agile teams to design, develop, test, implement, and support data movement solutions
  • •Lead a team of developers focused on data movement, distributed computing, and full-stack systems
  • •Build pipelines using Python, SQL, and cloud-based services including Snowflake and Databricks
  • •Optimize data systems for end-users and downstream application consumers using sound data design practices
  • •Perform unit tests and code reviews to ensure high-quality, well-tuned implementations while mentoring other engineers

Pay and Benefits

Salary: USD 179,400 - 245,600 annually

Key Requirements

  • •Bachelor’s degree
  • •At least 4 years of experience in application development
  • •At least 2 years of experience in big data technologies
  • •At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
  • •Experience with unit tests and code reviews to ensure rigorous design and performance tuning
Experience:4+ yearsBig dataCloud computingDistributed computingData warehousingReal-time data streaming
Education:Bachelor's
Skills:CollaborationMentoringExperimentingCode qualityPerformance tuning
Tech Stack:PythonAWSSparkKafkaSQLSnowflakeDatabricksOpen SourceRDBMSNoSQLAzureGoogle CloudCloud computingCloud-based data warehousingData movement toolsData modelingData qualityGovernanceETL toolsAWS Glue

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn