Databricks SME (Remote)

GovCIO
United States
Workplace: RemoteFull timeUSD 175,000 - 195,000 annuallyFunction: Software EngineeringExperience: 12+ yearsEducation: bachelorsSkills: ["Troubleshooting","Problem-solving","Collaboration","Communication","Documentation"]

Support the VA Data Modernization initiative as a Databricks SME, guiding data scientists, analysts, and infrastructure specialists to deliver production-ready data solutions. Own workspace automation and usability: configure linked services, mounts, catalogs, and permissions; develop and optimize PySpark/Spark jobs, notebooks, and ETL/ELT pipelines using Azure Databricks Lakehouse features. Provide white-glove onboarding and troubleshooting while partnering with Customer Success, Business Analysts, and Platform Engineering to accelerate cloud migration.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
GovCIO
GovCIO
1 month ago

Databricks SME (Remote)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 11 hours agoStatus: Live

Job Summary

Support the VA Data Modernization initiative as a Databricks SME, guiding data scientists, analysts, and infrastructure specialists to deliver production-ready data solutions. Own workspace automation and usability: configure linked services, mounts, catalogs, and permissions; develop and optimize PySpark/Spark jobs, notebooks, and ETL/ELT pipelines using Azure Databricks Lakehouse features. Provide white-glove onboarding and troubleshooting while partnering with Customer Success, Business Analysts, and Platform Engineering to accelerate cloud migration.
Location: United States
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Implement and manage linked services, mount points, and catalog configuration within Databricks and VA’s VHA Data Lake.
  • •Develop and optimize PySpark (Python/Scala) jobs, notebooks, and workflows in Databricks.
  • •Build ETL/ELT pipelines using Azure Databricks Lakehouse features and design Spark-based processing for analytics workloads.
  • •Optimize Databricks Spark jobs for performance, cost, and scalability (partitioning, caching, tuning).
  • •Provide white-glove customer success including onboarding support and troubleshoot issues related to data access, workspace configuration, pipelines, cataloging, or permissions.

Pay and Benefits

Salary: USD 175,000 - 195,000 annually

Key Requirements

  • •Bachelor’s degree in Information Technology or related field (or commensurate experience).
  • •12+ years of experience in business analysis, project management, or similar roles.
  • •Strong experience with Databricks and Azure data services, including workspace administration, catalog creation, linked services, storage mounts, and access configuration.
  • •Proficiency in data engineering fundamentals including ETL/ELT pipeline development and data modeling for structured and unstructured datasets.
  • •Ability to automate provisioning workflows and infrastructure using scripting or infrastructure-as-code tools (Python, PowerShell, Bash, Terraform, ARM, or Bicep).
Experience:12+ yearsData lakehouseData engineeringCloud data engineeringFederalHealthcare
Education:Bachelor's in Information Technology
Skills:TroubleshootingProblem-solvingCollaborationCommunicationDocumentation
Certifications:Azure Databricks and Spark for Data EngineersPySpark and SQLMicrosoft Azure CertDatabricks DABDatabricks Unity CatalogDatabricks lakflow pipelines
Tech Stack:DatabricksAzure DatabricksPySparkPythonScalaSparkETLELTAzureDelta LakeSynapseAzure Data FactoryAzure Data Lake StorageSQL ServerTerraformARMBicepPowerShellBashLakehouse

Eligibility

Security Clearance:Public Trust

Company Brief

GovCIO
Provides IT modernization, cloud, cybersecurity, data analytics, and managed services to U.S. federal civilian and defense agencies, delivering technology solutions and mission support to improve government operations and security.
Industry: Professional Services
Growth: Established Company
Headquarters: Herndon, United States
WebsiteLinkedIn