Data Engineer II

American Express
Bengaluru
Workplace: HybridFull timeFunction: Software EngineeringExperience: 3+ yearsEducation: bachelorsSkills: ["Problem-solving","Communication","Collaboration","Ownership mindset","Ability to work in Agile"]

Design and develop reusable Python-based frameworks and scalable batch and real-time data pipelines for cloud-native ingestion, transformation, orchestration, and lifecycle management. Build observable, production-grade systems on Google Cloud using distributed processing and containerized services. Create platform components including data quality, schema validation, metadata-driven ingestion, and RESTful APIs/microservices, while collaborating across architects, product owners, data and ML teams to deliver reliable enterprise data platforms with AI/ML capabilities.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
American Express
American Express
21 hours ago

Data Engineer II

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Design and develop reusable Python-based frameworks and scalable batch and real-time data pipelines for cloud-native ingestion, transformation, orchestration, and lifecycle management. Build observable, production-grade systems on Google Cloud using distributed processing and containerized services. Create platform components including data quality, schema validation, metadata-driven ingestion, and RESTful APIs/microservices, while collaborating across architects, product owners, data and ML teams to deliver reliable enterprise data platforms with AI/ML capabilities.
Location: Bengaluru
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and develop reusable Python-based frameworks for batch and real-time data ingestion from APIs, files, event streams, webhooks, and messaging systems.
  • •Build scalable data pipelines on Google Cloud using cloud-native services and modern distributed data processing technologies.
  • •Develop reliable, observable, production-grade data pipelines with monitoring, auditing, lineage, and operational excellence.
  • •Create reusable libraries and platform components for onboarding, transformation, orchestration, and pipeline lifecycle management.
  • •Build cloud-native microservices and APIs and contribute to platform observability through metrics, dashboards, and alerting.

Pay and Benefits

Perks:Health InsuranceDentalVisionLife InsuranceDisabilityRetirementAnnual BonusPaid ParentalFlexible WorkingCounseling Support

Key Requirements

  • •Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical discipline with 3+ years of experience in software or data engineering.
  • •Strong proficiency in Python and SQL, building scalable, reusable, production-grade applications.
  • •Hands-on experience building batch and real-time data pipelines using APIs, files, event streams, or messaging systems.
  • •Experience with cloud platforms (GCP preferred) and cloud-native technologies including Docker, Kubernetes, CI/CD, and Git.
  • •Good understanding of distributed data processing, data modeling, data quality, and data engineering best practices, plus RESTful APIs/microservices experience.
Experience:3+ yearsData engineeringBatch dataReal-time dataDistributed systemsCloud data platforms
Education:Bachelor's
Skills:Problem-solvingCommunicationCollaborationOwnership mindsetAbility to work in Agile
Languages:English
Tech Stack:PythonSQLGoogle Cloud PlatformGCPDockerKubernetesCI/CDGitRESTful APIsMicroservicesAPIsEvent streamsMessaging systemsOAuth2JWTIAMBigQueryPub/SubGCSGKE

Company Brief

American Express
Provides global payment, credit, and travel-related financial services for consumers and businesses. Best known for its charge and credit cards, merchant payment network, and premium customer rewards and servicing.
Industry: Payments
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: New York City, United States
Founded: 1850
WebsiteLinkedIn