Lead Data Engineer (Python, Spark, AWS)

Discover Financial
Virginia
Workplace: OnsiteFull timeUSD 197,300 - 225,100 annuallyFunction: DevOps, Cloud & InfrastructureExperience: 4+ yearsEducation: bachelorsSkills: ["Collaboration","Problem-solving","Mentoring","Performance tuning","Continuous learning"]

Design, develop, test, implement, and support full-stack data engineering solutions in collaboration with Agile teams. Work with engineers experienced in machine learning, distributed microservices, and full stack systems. Build cloud-based solutions using Java, Scala, Python, and data platforms such as Redshift and Snowflake, leveraging SQL and NoSQL technologies. Perform unit testing and reviews to ensure well-designed, high-performing code while mentoring others and staying current with emerging technologies.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 day ago

Lead Data Engineer (Python, Spark, AWS)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 44 minutes agoStatus: Live

Job Summary

Design, develop, test, implement, and support full-stack data engineering solutions in collaboration with Agile teams. Work with engineers experienced in machine learning, distributed microservices, and full stack systems. Build cloud-based solutions using Java, Scala, Python, and data platforms such as Redshift and Snowflake, leveraging SQL and NoSQL technologies. Perform unit testing and reviews to ensure well-designed, high-performing code while mentoring others and staying current with emerging technologies.
Location: Virginia
Workplace: Onsite
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Sr. Manager level

Key Responsibilities

  • •Collaborate with Agile teams to design, develop, test, implement, and support full-stack technical solutions.
  • •Work with engineers to build systems involving machine learning, distributed microservices, and full stack architecture.
  • •Utilize Java, Scala, Python, RDBMS/NoSQL databases, and cloud data warehousing services such as Redshift and Snowflake.
  • •Collaborate with digital product managers to deliver robust cloud-based solutions for customer impact.
  • •Perform unit tests and code reviews to ensure rigor, performance, and elegant implementation.

Pay and Benefits

Salary: USD 197,300 - 225,100 annually

Key Requirements

  • •Bachelor’s Degree
  • •At least 4 years of experience in application development (internship experience does not apply)
  • •At least 2 years of experience in big data technologies
  • •At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
  • •Perform unit tests and participate in code reviews to ensure performance and quality
Experience:4+ yearsBig dataCloudDistributed systemsStreamingData warehousing
Education:Bachelor's
Skills:CollaborationProblem-solvingMentoringPerformance tuningContinuous learning
Tech Stack:JavaScalaPythonOpen Source RDBMSNoSQLAWSMicrosoft AzureGoogle CloudRedshiftSnowflakeMapReduceHadoopHiveEMRKafkaSparkGurobiMySQLMongoCassandra

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn