Big Data Developer (Black Lotus Labs)

Lumen
United States
Workplace: RemoteFull timeUSD 132,232 - 193,940 annuallyFunction: Software EngineeringSkills: ["Analytical and problem-solving","Attention to detail","Communication","Leadership","Teamwork","Continuous learning"]

Build and optimize large-scale big data solutions to identify and disrupt malicious threats across the Internet. Design and implement scalable data pipelines using Spark, Kafka, Hadoop, and related technologies, handling data extraction, transformation, and loading from sources like databases, APIs, and JSON/XML/CSV. Ensure data quality, integrity, and security, develop systems for real-time validation, and run PoCs for new technologies while mentoring junior developers.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Lumen
Lumen
16 hours ago

Big Data Developer (Black Lotus Labs)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Build and optimize large-scale big data solutions to identify and disrupt malicious threats across the Internet. Design and implement scalable data pipelines using Spark, Kafka, Hadoop, and related technologies, handling data extraction, transformation, and loading from sources like databases, APIs, and JSON/XML/CSV. Ensure data quality, integrity, and security, develop systems for real-time validation, and run PoCs for new technologies while mentoring junior developers.
Location: United States
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Design, develop, and implement big data solutions to identify and disrupt malicious threats on the Internet.
  • •Architect and build scalable, reliable data pipelines using technologies like Spark, Kafka, Hadoop, and other big data technologies.
  • •Collaborate with cross-functional teams to understand data requirements and provide solutions aligned to business objectives.
  • •Extract, transform, and load data from sources and formats including relational databases, APIs, JSON, XML, and CSV.
  • •Ensure data quality, integrity, and security, develop real-time validation systems, run PoCs for new solutions, and mentor junior developers.

Pay and Benefits

Salary: USD 132,232 - 193,940 annually
Perks:Health InsuranceDentalVision401kGym MembershipLearning Budget

Key Requirements

  • •Master’s or Bachelor’s degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience.
  • •Prior experience building data ingestion, data processing, and analytical pipelines with big data technologies such as Spark, Kafka, Hadoop, Hive.
  • •Proficiency in programming languages such as Python, Java, Scala, or SQL.
  • •Experience with DevOps practices and tools.
  • •Strong analytical/problem-solving skills with attention to detail.
Education:
Skills:Analytical and problem-solvingAttention to detailCommunicationLeadershipTeamworkContinuous learning
Tech Stack:SparkKafkaHadoopHivePythonJavaScalaSQLDevOpsJSONXMLCSVAPIsRelational databasesPoC

Company Brief

Lumen
Provides integrated communications, network, edge cloud, and security services to enterprise, government, and carrier customers, operating a global fiber network and delivering connectivity and managed IT solutions.
Industry: Telecommunications
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Monroe, United States
WebsiteLinkedIn