Lead Data Engineer

Discover Financial
Plano
Workplace: OnsiteFull timeUSD 179,400 - 204,700 annuallyFunction: Administration & Executive AssistanceExperience: 4+ yearsEducation: bachelorsSkills: ["Collaboration","Mentoring","Agile execution","Designing for performance","Influencing best practices"]

Lead the design and build of an enterprise streaming data platform delivering low-latency, fault-tolerant insights. Own distributed streaming data pipelines and analytics data stores using Flink and Spark Streaming, collaborating across agile teams and cyber/security partners. Guide engineers building data pipelines with Spark, Kafka, Snowflake, AWS big data services, and Redshift, while shaping data architecture best practices and ensuring high-quality, performance-tuned code through testing and reviews.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
3 months ago

Lead Data Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Lead the design and build of an enterprise streaming data platform delivering low-latency, fault-tolerant insights. Own distributed streaming data pipelines and analytics data stores using Flink and Spark Streaming, collaborating across agile teams and cyber/security partners. Guide engineers building data pipelines with Spark, Kafka, Snowflake, AWS big data services, and Redshift, while shaping data architecture best practices and ensuring high-quality, performance-tuned code through testing and reviews.
Location: Plano
Workplace: Onsite
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Sr. Manager level

Key Responsibilities

  • •Lead the design and build of a scalable, low-latency, fault-tolerant streaming data platform for timely insights.
  • •Build distributed streaming data pipelines and analytics data stores using Flink and Spark Streaming with Java, Scala, and Python.
  • •Lead a group of engineers building data pipelines with Spark, Flink, Kafka, Snowflake, AWS Big Data Services, and Redshift on large datasets.
  • •Influence best practices for data pipeline design and data architecture for structured and unstructured data.
  • •Ensure code quality and performance through unit tests, peer reviews, and collaboration across agile teams and cyber/security partners.

Pay and Benefits

Salary: USD 179,400 - 204,700 annually

Key Requirements

  • •Bachelor’s degree.
  • •At least 4 years of experience in application development.
  • •At least 2 years of experience in big data technologies.
  • •At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud).
  • •Preferred: 7+ years of experience in application development including Java, Python, SQL, or Scala.
Experience:4+ yearsBig dataStreamingCloud computingData warehousingReal-time data
Education:Bachelor's
Skills:CollaborationMentoringAgile executionDesigning for performanceInfluencing best practices
Tech Stack:JavaScalaPythonSQLFlinkSpark StreamingSparkKafkaSnowflakeAWS Big Data ServicesRedshiftDynamoDBOpenSearchUNIX/LinuxShell scriptingCI/CDMicroservicesAgileAzureGoogle Cloud

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn