Lead Data Engineer

Discover Financial
Plano
Full timeUSD 179,400 - 204,700 annuallyFunction: Administration & Executive AssistanceExperience: 4+ yearsEducation: bachelorsSkills: ["Collaboration","Mentoring","Unit testing","Code review","Performance tuning"]

Design and build an enterprise streaming data platform that delivers scalable, low-latency, fault-tolerant insights. Build distributed streaming data pipelines and analytics stores using Flink, Spark Streaming, and modern programming languages like Java, Scala, and Python. Lead engineering efforts across big data technologies (Spark, Flink, Kafka, Snowflake, AWS, Redshift), influence data architecture best practices, and collaborate with Agile teams, product managers, and Cyber & Security partners.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
1 week ago

Lead Data Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 18 hours agoStatus: Live
Reposted: similar role first listed 3 months ago

Job Summary

Design and build an enterprise streaming data platform that delivers scalable, low-latency, fault-tolerant insights. Build distributed streaming data pipelines and analytics stores using Flink, Spark Streaming, and modern programming languages like Java, Scala, and Python. Lead engineering efforts across big data technologies (Spark, Flink, Kafka, Snowflake, AWS, Redshift), influence data architecture best practices, and collaborate with Agile teams, product managers, and Cyber & Security partners.
Location: Plano
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Sr. Manager level

Key Responsibilities

  • •Lead design and build of an enterprise scalable, low-latency, fault-tolerant streaming data platform
  • •Build distributed streaming data pipelines and analytics data stores using Flink and Spark Streaming
  • •Lead engineering efforts for data pipelines using Spark, Flink, Kafka, Snowflake, AWS Big Data Services, and Redshift
  • •Influence best practices for data pipeline design and data architecture for structured and unstructured data
  • •Collaborate with Agile teams and partner groups to design, test, implement, and support robust cloud-based solutions

Pay and Benefits

Salary: USD 179,400 - 204,700 annually

Key Requirements

  • •Bachelor’s Degree
  • •At least 4 years of experience in application development (internship experience does not apply)
  • •At least 2 years of experience in big data technologies
  • •At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
  • •At least 4 years of experience working on real-time data and streaming applications
Experience:4+ yearsBig dataReal-time streamingCloud computingDistributed data computing
Education:Bachelor's
Skills:CollaborationMentoringUnit testingCode reviewPerformance tuning
Tech Stack:JavaScalaPythonSQLFlinkSpark StreamingKafkaSnowflakeAWS Big Data ServicesRedshiftDynamoDBOpenSearchUNIXLinuxShell scriptingAgileCI/CDMicroservicesMachine learning

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn