Lead Data Engineer (Python, Scala, Spark)

Discover Financial
Virginia, Richmond
Workplace: OnsiteFull timeUSD 179,400 - 225,100 annuallyFunction: Administration & Executive AssistanceExperience: 4+ yearsEducation: bachelorsSkills: ["Collaboration","Mentoring","Problem-solving","Staying current","Code review"]

Design, develop, test, implement, and support big data solutions in Agile teams, partnering with developers across machine learning, distributed microservices, and ETL systems. Use Java, Scala, Python, and a mix of relational and NoSQL databases along with cloud data warehousing services such as Redshift and Snowflake. Build robust cloud-based experiences with digital product managers, mentor others, and ensure high performance through unit testing and code reviews.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 month ago

Lead Data Engineer (Python, Scala, Spark)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Design, develop, test, implement, and support big data solutions in Agile teams, partnering with developers across machine learning, distributed microservices, and ETL systems. Use Java, Scala, Python, and a mix of relational and NoSQL databases along with cloud data warehousing services such as Redshift and Snowflake. Build robust cloud-based experiences with digital product managers, mentor others, and ensure high performance through unit testing and code reviews.
Location: Virginia, Richmond
Workplace: Onsite
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Mid level

Key Responsibilities

  • •Collaborate with Agile teams to design, develop, test, implement, and support technical big data solutions.
  • •Work with developers on machine learning, distributed microservices, and ETL systems.
  • •Use programming languages and databases plus cloud data warehousing services to deliver robust solutions.
  • •Mentor other members of the engineering community and participate in internal and external tech communities.
  • •Perform unit tests and conduct code reviews to ensure performance-tuned, well-designed code.

Pay and Benefits

Salary: USD 179,400 - 225,100 annually

Key Requirements

  • •Bachelor’s Degree.
  • •At least 4 years of experience in application development (internship experience does not apply).
  • •At least 2 years of experience in big data technologies.
  • •At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud).
  • •Unit tests and code reviews to ensure code is rigorously designed and tuned for performance.
Experience:4+ yearsBig dataCloudMachine learningETLStreamingData warehousingAgile
Education:Bachelor's
Skills:CollaborationMentoringProblem-solvingStaying currentCode review
Tech Stack:JavaScalaPythonOpen Source RDBMSNoSQLRedshiftSnowflakeAWSMicrosoft AzureGoogle CloudETLMachine LearningDistributed microservicesMapReduceHadoopHiveEMRKafkaSparkGurobi

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn