Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI)

Discover Financial
Virginia
Workplace: OnsiteFull timeUSD 229,900 - 262,400 annuallyFunction: DevOps, Cloud & InfrastructureExperience: 6+ yearsEducation: bachelorsSkills: ["Collaboration","Mentoring","Problem-solving","Continuous learning","Quality focus"]

Build and support data pipelines for hyper-personalized marketing and messaging experiences, partnering with Agile teams and mentoring other engineers. Lead technical design and development of data movement and distributed computing solutions, using Python, SQL, and cloud data warehousing such as Snowflake and Databricks. Optimize data design for end-user and downstream applications, write well-tested, high-performance code, and stay current with emerging data and AI-enabled technologies.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
2 months ago

Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 18 minutes agoStatus: Live

Job Summary

Build and support data pipelines for hyper-personalized marketing and messaging experiences, partnering with Agile teams and mentoring other engineers. Lead technical design and development of data movement and distributed computing solutions, using Python, SQL, and cloud data warehousing such as Snowflake and Databricks. Optimize data design for end-user and downstream applications, write well-tested, high-performance code, and stay current with emerging data and AI-enabled technologies.
Location: Virginia
Workplace: Onsite
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Mid level

Key Responsibilities

  • •Collaborate with Agile teams to design, develop, test, implement, and support technical data movement solutions.
  • •Lead development with a team focused on data movement, distributed computing, and full-stack systems.
  • •Use Python and SQL with relational and NoSQL databases plus cloud data warehousing services like Snowflake and Databricks.
  • •Apply sound data design practices to optimize systems for end users and downstream application consumers.
  • •Perform unit tests and code reviews to ensure robust, well-tuned performance and participate in mentoring and tech community learning.

Pay and Benefits

Salary: USD 229,900 - 262,400 annually

Key Requirements

  • •Bachelor’s degree.
  • •At least 6 years of experience in application development (internship experience does not apply).
  • •At least 2 years of experience in big data technologies.
  • •At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud).
  • •Experience with distributed data/computing tools and/or real-time/streaming data is preferred.
Experience:6+ yearsBig dataDistributed computingData pipelinesData warehousingReal-time/streamingNoSQL
Education:Bachelor's
Skills:CollaborationMentoringProblem-solvingContinuous learningQuality focus
Tech Stack:PythonSQLOpen Source RDBMSNoSQLSnowflakeDatabricksAWSMicrosoft AzureGoogle CloudDynamoDBSparkKafkaETL toolsAWS GlueMapReduceHadoopHiveEMRMySQLMongo

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn