Staff Data Engineer, Core Migrations

Machinify
United States
Workplace: RemoteFull timeUSD 180,000 - 220,000 annuallyFunction: Data Analytics & Business IntelligenceExperience: 8+ yearsSkills: ["Cross-functional coordination","Technical communication","Critical evaluation of AI output","Mentorship","Problem-solving"]

Own the end-to-end technical delivery of client migrations, from deep-dive legacy analysis and lineage/risk mapping to production deployment and go-live/hypercare. Lead discovery and due diligence, reverse-engineer undocumented ETL and stored-procedure logic, and architect migration pipelines using Airflow DAGs and Spark jobs on the Machinify platform. Build automated reconciliation to prove row-level correctness, and codify migration knowledge via runbooks, retrospectives, and mentoring.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Machinify
Machinify
2 months ago

Staff Data Engineer, Core Migrations

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Own the end-to-end technical delivery of client migrations, from deep-dive legacy analysis and lineage/risk mapping to production deployment and go-live/hypercare. Lead discovery and due diligence, reverse-engineer undocumented ETL and stored-procedure logic, and architect migration pipelines using Airflow DAGs and Spark jobs on the Machinify platform. Build automated reconciliation to prove row-level correctness, and codify migration knowledge via runbooks, retrospectives, and mentoring.
Location: United States
Workplace: Remote
Employment Type: Full time
Job Function: Data Analytics & Business Intelligence
Seniority: Sr. Manager level

Key Responsibilities

  • •Lead discovery and technical due diligence of poorly documented legacy systems, reconstruct business logic, and capture it in lineage maps, mapping specs, and risk analyses.
  • •Reverse-engineer complex, undocumented legacy systems (e.g., SSIS packages and stored procedures) and translate intent into modern, stable equivalents.
  • •Architect and build migration pipelines with production-grade Airflow DAGs and Spark jobs, handling ingestion-to-reconciliation and steady-state handoff.
  • •Make and document critical architectural decisions (pipeline design, partitioning strategy, validation approach) with clear rationale.
  • •Build automated reconciliation frameworks to prove correctness at scale and own the program end to end through go-live and hypercare.

Pay and Benefits

Salary: USD 180,000 - 220,000 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVision401kEquityPaid Leave

Key Requirements

  • •8+ years as a hands-on Data Engineer or Software Engineer, independently owning complex, multi-stakeholder technical projects from start to finish.
  • •Strong Python and SQL experience working with complex, unfamiliar legacy code.
  • •Deep experience with Apache Spark, including distributed processing, performance tuning, partitioning, and debugging at scale.
  • •Advanced ability to design and author production Apache Airflow DAG architectures.
  • •Proficiency with AWS (including S3) and experience translating legacy ETL (e.g., SSIS, SQL Server stored procedures/T-SQL) into modern stacks with strong data validation and reconciliation.
Experience:8+ yearsHealthcareHealth plansData engineeringMigrationsLegacy systems
Skills:Cross-functional coordinationTechnical communicationCritical evaluation of AI outputMentorshipProblem-solving
Languages:English
Tech Stack:PythonSQLApache SparkApache AirflowAWSS3ETLSSISStored proceduresT-SQLLineage mapsAirflow DAGsSpark jobsUATClaudeCopilotCursor

Company Brief

Machinify
Provides AI-driven predictive maintenance and asset-monitoring solutions for manufacturing and industrial operations, using IoT sensor data and machine learning to reduce downtime, optimize performance, and extend equipment life.
Industry: Industrial Automation
Website