Distributed Cloud | Data Pipeline Specialist

Devoteam
Portugal
Workplace: OnsiteFull timeFunction: Data Analytics & Business IntelligenceExperience: 5+ yearsSkills: ["Communication","Problem-solving","Teamwork","Analytical thinking","Attention to detail"]

Senior Data Engineer role focusing on designing, building, and optimizing ETL/ELT data pipelines across batch and real-time processing. You’ll work with Spark and Cloudera, develop in Python (Scala valued), and collaborate with Data Architects to translate complex requirements into scalable data models and solutions. Based in Lisboa or Porto, focusing on robust, high-performance data environments.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Devoteam
Devoteam
10 months ago

Distributed Cloud | Data Pipeline Specialist

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 21 hours agoStatus: Live

Job Summary

Senior Data Engineer role focusing on designing, building, and optimizing ETL/ELT data pipelines across batch and real-time processing. You’ll work with Spark and Cloudera, develop in Python (Scala valued), and collaborate with Data Architects to translate complex requirements into scalable data models and solutions. Based in Lisboa or Porto, focusing on robust, high-performance data environments.
Location: Portugal
Workplace: Onsite
Employment Type: Full time
Job Function: Data Analytics & Business Intelligence
Seniority: Mid level

Key Responsibilities

  • •Design, build, and optimize ETL/ELT data pipelines for batch and real-time processing.
  • •Work with Big Data technologies and distributed computing frameworks (e.g., Spark) to process large datasets efficiently.
  • •Develop, test, and deploy code primarily using Python (and ideally Scala), focusing on high performance and data integrity.
  • •Manage and maintain data environments built on various platforms, including Cloudera and traditional data warehouses like Teradata.
  • •Collaborate with Data Architects and Analysts to translate complex requirements into technical data models and solutions.

Key Requirements

  • •5+ years of proven experience as a Data Engineer, ETL Developer, or Big Data Engineer.
  • •Strong expertise in building data pipelines and extensive knowledge of ETL/ELT methodologies.
  • •Proficiency in SQL and strong programming skills in Python (experience with Scala is highly valued).
  • •Demonstrable experience with at least one Big Data ecosystem, such as Spark or the Cloudera platform.
  • •Experience with traditional data warehousing platforms like Teradata is a strong advantage.
Experience:5+ yearsData engineeringBig dataETLCloud
Skills:CommunicationProblem-solvingTeamworkAnalytical thinkingAttention to detail
Languages:English
Tech Stack:PythonScalaSQLSparkClouderaTeradataAWSAzureGCP

Company Brief

Devoteam
Devoteam is an IT consulting firm specializing in digital transformation, cloud, cybersecurity, and data solutions for enterprise clients across Europe and the Middle East, combining technology partnerships with management consulting services.
Industry: Consulting
Company Size: Enterprise (1,001+ employees)
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Paris, France
Founded: 1995
WebsiteLinkedIn