Databricks Engineer

General Dynamics
United States
Workplace: HybridFull timeUSD 140,250 - 189,750 annuallyFunction: Software EngineeringExperience: 7+ yearsEducation: bachelorsSkills: ["Communication","Collaboration","Problem-solving","Data quality focus"]

Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks and Spark to support governed access to sensitive datasets in the NIA Data Enclave. Build and maintain Databricks notebooks, workflows, and ingestion/validation processes, migrate legacy workloads, and tune performance for high-volume analytics. Implement testing, monitoring, logging, and CI/CD automation with Git and Azure DevOps or GitHub Actions while collaborating with data scientists, researchers, and platform teams.

This position is no longer accepting applications.

  • See live roles at General Dynamics
  • Search all live jobs
  • Browse companies, collections, and locations hiring now
Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa

This position is no longer accepting applications.

See live roles at General DynamicsSearch all live jobsBrowse companies, collections, and locations hiring now

General Dynamics
General Dynamics
2 days ago

Databricks Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 14 hours agoStatus: Closed

Job Summary

Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks and Spark to support governed access to sensitive datasets in the NIA Data Enclave. Build and maintain Databricks notebooks, workflows, and ingestion/validation processes, migrate legacy workloads, and tune performance for high-volume analytics. Implement testing, monitoring, logging, and CI/CD automation with Git and Azure DevOps or GitHub Actions while collaborating with data scientists, researchers, and platform teams.
Location: United States
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design, build, and optimize scalable ETL/ELT pipelines using Databricks, PySpark, SQL, and Delta Lake.
  • •Develop and maintain Databricks notebooks, jobs, and workflows for high-volume analytical workloads.
  • •Create reliable data ingestion, transformation, validation, and integration processes.
  • •Migrate and modernize existing data workloads to improve scalability, performance, and maintainability.
  • •Implement automated testing, monitoring/logging, and operational processes; troubleshoot production issues with root-cause analysis.
Travel: Medium travel

Pay and Benefits

Salary: USD 140,250 - 189,750 annually
Perks:Health InsuranceDentalVision401kPaid LeaveParental Leave

Key Requirements

  • •Bachelor's degree in computer science, software engineering, data engineering, or a related technical field.
  • •7+ years of related experience with 5+ years of data engineering, including significant hands-on Databricks experience.
  • •Strong experience with PySpark, SQL, Apache Spark, Delta Lake, and Databricks.
  • •Experience developing production-grade data pipelines, workflows, and troubleshooting production data workloads.
  • •Experience with cloud-based data platforms/storage (AWS S3, Azure Data Lake Storage, or Google Cloud Storage) and Git/CI/CD practices.
Experience:7+ yearsData engineering
Education:Bachelor's
Skills:CommunicationCollaborationProblem-solvingData quality focus
Tech Stack:DatabricksDatabricks LakeflowDatabricks Unity CatalogPySparkSQLApache SparkDelta LakeDelta Live TablesAWS S3Azure Data Lake StorageGoogle Cloud StorageGitAzure DevOpsGitHub ActionsTerraformCI/CD

Eligibility

Work Authorization:Sponsorship available.

Company Brief

General Dynamics
Provides IT, systems engineering, cybersecurity, cloud, and mission support services to U.S. federal civilian and defense agencies, delivering large-scale technology solutions and managed services for national security and government operations.
Industry: Defense Technology
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Headquarters: Tysons / Fairfax, United States
WebsiteLinkedIn