Lead Software Engineer, Full Stack

Discover Financial
Plano
Full timeUSD 179,400 - 225,100 annuallyFunction: Software EngineeringExperience: 4+ yearsEducation: bachelorsSkills: ["Collaboration","Problem-solving","Iterative delivery"]

Own the lifecycle of a high-velocity data ecosystem, maintaining and optimizing a Cloudera-based production stack while migrating to a modern AWS-native, serverless/managed architecture. Lead phased migration of billions of records with zero data loss and minimal downtime, enable application teams to refactor data consumers from HBase APIs, and enforce data governance and security. Modernize ingestion by transitioning legacy NiFi/Kafka workflows into cloud-native pipelines using AWS services.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
3 weeks ago

Lead Software Engineer, Full Stack

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live
Reposted: similar role first listed 4 weeks ago

Job Summary

Own the lifecycle of a high-velocity data ecosystem, maintaining and optimizing a Cloudera-based production stack while migrating to a modern AWS-native, serverless/managed architecture. Lead phased migration of billions of records with zero data loss and minimal downtime, enable application teams to refactor data consumers from HBase APIs, and enforce data governance and security. Modernize ingestion by transitioning legacy NiFi/Kafka workflows into cloud-native pipelines using AWS services.
Location: Plano
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Maintain and optimize the current Cloudera/HBase/Kafka production environment to keep it performant and stable during the transition.
  • •Design and execute phased migration of billions of records to an AWS-native architecture with zero data loss and minimal downtime.
  • •Partner with internal application teams to refactor data consumers and enable cutover from HBase APIs to new AWS-native access patterns.
  • •Implement and maintain strict data governance and security protocols, including encryption, auditing, and lineage.
  • •Transition legacy NiFi and Kafka workflows into streamlined cloud-native pipelines using AWS MSK, Lambda, and Glue.

Pay and Benefits

Salary: USD 179,400 - 225,100 annually
Perks:Health Insurance

Key Requirements

  • •Bachelor’s degree.
  • •At least 4 years of software engineering experience (internship experience does not apply).
  • •At least 1 year of cloud computing experience with AWS, Microsoft Azure, or Google Cloud.
  • •5+ years of experience in the Hadoop ecosystem, specifically HBase and NiFi.
  • •Experience architecting and deploying AWS DocumentDB or DynamoDB at multi-billion record scale.
Experience:4+ yearsHadoop ecosystem
Education:Bachelor's
Skills:CollaborationProblem-solvingIterative delivery
Certifications:AWS Certified Data Engineer (Associate)AWS Certified Solutions Architect (Professional)AWS Certified CloudOps Engineer (Associate)SysOps Administrator
Tech Stack:AWSAmazon EC2ClouderaHBaseKafkaNiFiAWS MSKAWS LambdaAWS GlueAWS DocumentDBDynamoDBServerlessManaged architectureEncryptionAuditingData lineageInteractive AI tooling

Eligibility

Visa:H1BF-1 OPTF-1 STEM OPTF-1 CPTJ-1TNE-3O-1
Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn