Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)

Discover Financial
New York, Richmond
Workplace: OnsiteFull timeUSD 197,300 - 225,100 annuallyFunction: DevOps, Cloud & InfrastructureExperience: 4+ yearsEducation: bachelorsSkills: ["Collaboration","Mentoring","Staying current with technology trends","Experimenting with new technologies","Code review"]

Build and support data pipelines for hyper-personalized marketing and messaging experiences, working across Agile teams to design and deliver technical solutions. Lead development with expertise in data movement, distributed computing, and full-stack systems. Apply Python, SQL, and cloud-based warehousing tools (Snowflake, Databricks) while optimizing data design for end users and downstream consumers. Perform unit tests and reviews, mentor engineers, and continuously explore emerging technologies.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
3 weeks ago

Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Build and support data pipelines for hyper-personalized marketing and messaging experiences, working across Agile teams to design and deliver technical solutions. Lead development with expertise in data movement, distributed computing, and full-stack systems. Apply Python, SQL, and cloud-based warehousing tools (Snowflake, Databricks) while optimizing data design for end users and downstream consumers. Perform unit tests and reviews, mentor engineers, and continuously explore emerging technologies.
Location: New York, Richmond
Workplace: Onsite
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure

Key Responsibilities

  • •Collaborate across Agile teams to design, develop, test, implement, and support data movement solutions.
  • •Lead development with expertise in data movement, distributed computing, and full-stack systems.
  • •Use Python, SQL, and RDBMS/NoSQL technologies, along with cloud data warehousing services like Snowflake and Databricks.
  • •Optimize data design practices to improve downstream application consumers and end-user experiences.
  • •Perform unit tests and code reviews; mentor other members of the engineering community and stay current with tech trends.

Pay and Benefits

Salary: USD 197,300 - 225,100 annually

Key Requirements

  • •Bachelor’s Degree.
  • •At least 4 years of experience in application development.
  • •At least 2 years of experience in big data technologies.
  • •At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud).
  • •At least 2 years of experience with Agile engineering practices.
Experience:4+ yearsBig dataData engineeringData warehousingStreamingDistributed computing
Education:Bachelor's
Skills:CollaborationMentoringStaying current with technology trendsExperimenting with new technologiesCode review
Tech Stack:PythonAWSSparkKafkaSQLSnowflakeDatabricksGenAIOpen Source RDBMSNoSQLMicrosoft AzureGoogle CloudETLAWS GlueMapReduceHadoopHiveEMRMySQLUNIX/Linux

Eligibility

Visa:H1BF-1 OPTF-1 STEM OPTF-1 CPTJ-1TNE-3O-1
Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn