Data Engineer - Data Platform (Spark/Kafka/Flink/Scala/Java) - Onsite Hybrid

NTT
Cupertino
Workplace: HybridFull timeUSD 96,492 - 144,738 annuallyFunction: Software EngineeringExperience: 8+ yearsEducation: bachelorsSkills: ["Automation mindset","Collaboration","Troubleshooting","Engineering best practices","Operational excellence"]

Design and develop scalable real-time and batch data pipelines for enterprise-scale data movement. Build Kafka/Spark/Flink-based processing engines and Kubernetes-hosted streaming and batch platforms, plus metadata-driven self-service ingestion and reusable connectors. Lead cloud migration to Microsoft Azure, optimize performance and reliability for mission-critical workloads, and collaborate with product, architects, and cloud teams to modernize and automate CI/CD and platform operations.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NTT
NTT
4 days ago

Data Engineer - Data Platform (Spark/Kafka/Flink/Scala/Java) - Onsite Hybrid

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 17 hours agoStatus: Live

Job Summary

Design and develop scalable real-time and batch data pipelines for enterprise-scale data movement. Build Kafka/Spark/Flink-based processing engines and Kubernetes-hosted streaming and batch platforms, plus metadata-driven self-service ingestion and reusable connectors. Lead cloud migration to Microsoft Azure, optimize performance and reliability for mission-critical workloads, and collaborate with product, architects, and cloud teams to modernize and automate CI/CD and platform operations.
Location: Cupertino
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and support scalable real-time and batch data pipelines using Apache Spark, Apache Flink, Apache Kafka, and Airflow.
  • •Build metadata-driven self-service data integration platforms, reusable connectors, and support connector development for multiple enterprise data stores.
  • •Design, deploy, and operate Kubernetes-based streaming and batch processing platforms for data movement.
  • •Lead cloud migration from on-premise environments to Microsoft Azure and develop cloud-native solutions for enterprise data processing.
  • •Drive performance tuning, scalability, reliability improvements, and production troubleshooting for critical data platforms, including CI/CD and modernization initiatives.
Travel: Low travel

Pay and Benefits

Salary: USD 96,492 - 144,738 annually
Perks:Health InsuranceDentalVision401kPaid LeaveLife InsuranceDisability Coverage

Key Requirements

  • •8+ years of overall Software Engineering or Data Engineering experience.
  • •5+ years with Apache Spark for large-scale batch and streaming data processing.
  • •5+ years with Apache Kafka, including event-driven architectures and real-time streaming solutions.
  • •3+ years with Apache Flink for stream processing and real-time analytics workloads.
  • •Hands-on experience with Java and/or Scala plus complex SQL optimization for large-scale systems.
Experience:8+ yearsData engineeringDistributed systemsStreaming dataCloud migration
Education:Bachelor's
Skills:Automation mindsetCollaborationTroubleshootingEngineering best practicesOperational excellence
Tech Stack:Apache SparkApache FlinkApache KafkaAirflowKafkaKubernetesMicrosoft AzureScalaJavaSQLPostgreSQLCassandraYugabyteDBGitLabGitHubCI/CDDevSecOpsInfrastructure as codeObservability

Company Brief

NTT
Dimension Data, operating under NTT Ltd, provides managed IT services, cloud and data center solutions, networking, cybersecurity, and digital transformation services to enterprise customers worldwide.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Valuation: Public Company (Market Cap in USD)
Headquarters: London, United Kingdom
Founded: 1983
WebsiteLinkedIn