Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)

Discover Financial
Richmond, New York
Full timeUSD 179,400 - 204,700 annuallyFunction: DevOps, Cloud & InfrastructureExperience: 4+ yearsEducation: bachelorsSkills: ["Collaboration","Mentoring","Continuous learning","Unit testing","Code reviews"]

Build and lead data engineering solutions for the Marketing and Messaging team, delivering hyper-personalized omnichannel experiences. Partner with Agile teams to design, develop, test, implement, and support data pipelines using Python, SQL, Spark, Kafka, Snowflake, and Databricks. Optimize data design for end users and downstream consumers, perform unit testing and code reviews, and mentor engineers while collaborating with digital product managers.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
3 weeks ago

Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Build and lead data engineering solutions for the Marketing and Messaging team, delivering hyper-personalized omnichannel experiences. Partner with Agile teams to design, develop, test, implement, and support data pipelines using Python, SQL, Spark, Kafka, Snowflake, and Databricks. Optimize data design for end users and downstream consumers, perform unit testing and code reviews, and mentor engineers while collaborating with digital product managers.
Location: Richmond, New York
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Mid level

Key Responsibilities

  • •Collaborate with Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies
  • •Lead developers working on data movement, distributed computing, and full-stack systems
  • •Utilize Python and SQL with relational and NoSQL databases and cloud data warehousing services like Snowflake and Databricks
  • •Optimize data design to support end-users and downstream application consumers
  • •Perform unit tests and code reviews, and mentor other members of the engineering community

Pay and Benefits

Salary: USD 179,400 - 204,700 annually

Key Requirements

  • •Bachelor’s degree
  • •At least 4 years of experience in application development
  • •At least 2 years of experience in big data technologies
  • •At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
  • •Use of data movement, distributed computing, and full-stack systems (experience described for the lead developer role)
Experience:4+ yearsBig dataCloudDistributed computingData engineeringStreamingData warehousingReal-time data
Education:Bachelor's
Skills:CollaborationMentoringContinuous learningUnit testingCode reviews
Tech Stack:PythonAWSSparkKafkaSQLSnowflakeDatabricksOpen Source RDBMSNoSQLAzureGoogle CloudETL toolsAWS GlueMapReduceHadoopHiveEMRMySQLUNIXLinux

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn