Data Engineer 4 (Python, PySpark, AWS)

Discover Financial
United States
Full timeUSD 197,300 - 225,100 annuallyFunction: DevOps, Cloud & InfrastructureExperience: 4+ yearsEducation: bachelorsSkills: ["Collaboration","Mentoring","Communication","Problem-solving"]

Design, develop, test, implement, and support cloud-first data solutions in a full-stack environment. Collaborate with Agile teams to build scalable lakehouse and distributed microservices-based data platforms using Python and Spark, along with relational and NoSQL databases. Architect reusable data engineering patterns, enforce data security (encryption and fine-grained access control), and deliver efficient, resilient pipelines that enable powerful experiences for millions of customers.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 day ago

Data Engineer 4 (Python, PySpark, AWS)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Design, develop, test, implement, and support cloud-first data solutions in a full-stack environment. Collaborate with Agile teams to build scalable lakehouse and distributed microservices-based data platforms using Python and Spark, along with relational and NoSQL databases. Architect reusable data engineering patterns, enforce data security (encryption and fine-grained access control), and deliver efficient, resilient pipelines that enable powerful experiences for millions of customers.
Location: United States
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Mid level

Key Responsibilities

  • •Collaborate with Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.
  • •Influence developers, data analysts, and data scientists with experience in machine learning, distributed microservices, lakehouse architecture, and full-stack systems.
  • •Design and build cloud data pipelines and platforms focused on scalability, resilience, and operational efficiency.
  • •Architect and enforce common data engineering design patterns to ensure code quality, maintainability, and reusability across pipelines and platforms.
  • •Implement data security standards including encryption at rest/transit and fine-grained access control to meet data privacy regulations.

Pay and Benefits

Salary: USD 197,300 - 225,100 annually

Key Requirements

  • •Bachelor’s degree or higher in Computer Science or a related quantitative field.
  • •At least 4 years of experience in application development (internship experience does not apply).
  • •At least 2 years of experience in distributed data.
  • •At least 2 years of experience with SQL.
  • •At least 2 years of experience with a programming language (Python, Java, or Scala) and data pipeline design/development, including data modeling across relational and non-relational databases.
Experience:4+ yearsData engineeringDistributed systemsCloud data warehousingData pipelinesLakehouse
Education:Bachelor's in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
Skills:CollaborationMentoringCommunicationProblem-solving
Tech Stack:PythonSparkSQLDatabricksSnowflakeAWSMicrosoft AzureGoogle CloudEMRGlueKubernetesMongoDBCassandraDynamoDBRedshiftAirflowDagsterMonte CarloSplunkNoSQL

Eligibility

Visa:H1BF-1 OPTF-1 STEM OPTF-1 CPTJ-1TNE-3O-1
Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn