Lead Data Engineer (Python, Spark, AWS, ETL)

Discover Financial
Richmond
Workplace: OnsiteFull timeUSD 179,400 - 204,700 annuallyFunction: DevOps, Cloud & InfrastructureExperience: 4+ yearsEducation: bachelorsSkills: ["Collaboration","Problem-solving","Mentoring","Code review","Performance tuning"]

Build and support cloud-based data solutions by collaborating with Agile teams to design, develop, test, implement, and tune full-stack data systems. Work with developers experienced in machine learning, distributed microservices, and data engineering to deliver robust experiences that empower millions. Use technologies such as Java, Scala, Python, Spark/PySpark, Open Source databases, and cloud data warehousing (Redshift, Snowflake), while mentoring and reviewing code for performance and quality.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
23 hours ago

Lead Data Engineer (Python, Spark, AWS, ETL)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Build and support cloud-based data solutions by collaborating with Agile teams to design, develop, test, implement, and tune full-stack data systems. Work with developers experienced in machine learning, distributed microservices, and data engineering to deliver robust experiences that empower millions. Use technologies such as Java, Scala, Python, Spark/PySpark, Open Source databases, and cloud data warehousing (Redshift, Snowflake), while mentoring and reviewing code for performance and quality.
Location: Richmond
Workplace: Onsite
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Sr. Manager level

Key Responsibilities

  • •Collaborate with Agile teams to design, develop, test, implement, and support technical solutions.
  • •Work with developers on machine learning, distributed microservices, and full-stack systems.
  • •Use programming languages and data technologies (e.g., Java, Scala, Python, databases, Redshift, Snowflake) to deliver cloud-based solutions.
  • •Perform unit tests and code reviews to ensure performance, quality, and tuning.
  • •Stay current with technology trends, experiment with new technologies, and mentor other engineers.

Pay and Benefits

Salary: USD 179,400 - 204,700 annually
Perks:Health Insurance401kPaid LeaveInsurance

Key Requirements

  • •Bachelor’s Degree.
  • •At least 4 years of experience in application development (internship experience does not apply).
  • •At least 2 years of experience in big data technologies.
  • •At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud).
  • •Preferred: 7+ years of application development experience including Python, Spark, or PySpark.
Experience:4+ yearsBig dataCloud computingMachine learningDistributed systemsStreaming dataData warehousingNoSQLAgile
Education:Bachelor's
Skills:CollaborationProblem-solvingMentoringCode reviewPerformance tuning
Tech Stack:JavaScalaPythonOpen Source RDBMSNoSQLRedshiftSnowflakeAWSMicrosoft AzureGoogle CloudMapReduceHadoopHiveEMRKafkaSparkGurobiMySQLDynamoDBMongoDB

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn