Lead Data Engineer (Python, PySpark, AWS)

Discover Financial
Richmond
Workplace: OnsiteFull timeUSD 197,300 - 225,100 annuallyFunction: DevOps, Cloud & InfrastructureEducation: bachelorsSkills: []

Design, develop, test, implement, and support cloud-based data solutions with Agile teams, working alongside engineers experienced in machine learning, distributed microservices, and full-stack systems. Use Python, Java, Scala, and SQL with RDBMS/NoSQL technologies to build performance-tuned data pipelines and applications. Leverage AWS services and data warehousing platforms like Redshift and Snowflake, mentor peers, and collaborate with product managers to deliver outcomes for financial empowerment.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
3 weeks ago

Lead Data Engineer (Python, PySpark, AWS)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Design, develop, test, implement, and support cloud-based data solutions with Agile teams, working alongside engineers experienced in machine learning, distributed microservices, and full-stack systems. Use Python, Java, Scala, and SQL with RDBMS/NoSQL technologies to build performance-tuned data pipelines and applications. Leverage AWS services and data warehousing platforms like Redshift and Snowflake, mentor peers, and collaborate with product managers to deliver outcomes for financial empowerment.
Location: Richmond
Workplace: Onsite
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Mid level

Key Responsibilities

  • •Collaborate with Agile teams to design, develop, test, implement, and support full-stack data solutions.
  • •Work with engineers on machine learning, distributed microservices, and full-stack systems.
  • •Build using programming languages such as Java, Scala, and Python with RDBMS/NoSQL and cloud data warehousing services like Redshift and Snowflake.
  • •Perform unit tests and code reviews to ensure performance-tuned, well-designed implementations.
  • •Partner with digital product managers to deliver robust cloud-based solutions and mentor other members of the engineering community.

Pay and Benefits

Salary: USD 197,300 - 225,100 annually

Key Requirements

  • •Bachelor’s degree.
  • •At least 4 years of experience in application development (internship experience does not apply).
  • •At least 2 years of experience in big data technologies.
  • •At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud).
  • •At least 2 years of experience with Agile engineering practices.
Experience:Big dataCloud computingDistributed data/computingData warehousingReal-time data
Education:Bachelor's
Tech Stack:PythonPySparkAWSJavaScalaOpen Source RDBMSNoSQLRedshiftSnowflakeAzureGoogle CloudMapReduceHadoopHiveEMRKafkaSparkGurobiMySQLMongo

Eligibility

Visa:H1BF-1 OPTF-1 STEM OPTF-1 CPTJ-1TNE-2E-3L-1O-1
Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn