Lead Data Platform Architect (Databricks / Data Mesh Architecture)

Job description

To be leaders in digital modernization by helping companies embrace latest cutting edge technologies to optimize their business with the help of our talented experts.

🚀 Lead Data Platform Architect (Databricks/ Data Mesh Architecture)

 Location: European Union (Remote or Hybrid)
 Full-Time

Join the Future of Digital Tech with Kolomolo

At Kolomolo, we don’t just follow trends - we set them.

As a global supplier of IT services and digital modernization solutions, we help businesses embrace cutting-edge technology to optimize their operations.

Now, we are growing and looking for fresh talent to grow with us.

Are you proactive, tech-savvy, and eager to build your career in IT?

This role could be your perfect fit.

About the Role

As a Lead Data Platform Engineer, you will drive the design, development, and governance of Kolomolo’s next-generation data platform, with a huge focus on Databricks.
This is not a typical data platform position, its is a technical leadership and architecture role where you will define standards, guide implementation, and enable distributed data ownership through a Data Mesh approach.

You will:

• Architect and evolve Kolomolo’s lakehouse-based data platform (Databricks, Delta Lake, cloud-native storage).
  
  

• Define domain-oriented data products aligned with data mesh principles.
  
  

• Lead the design and rollout of data platform capabilities, which involves ingestion, transformation, cataloging, governance, observability, and lineage.
  
  

• Partner with business domain teams to enable self-service data access and stewardship.
  
  

 What You’ll Be Doing

• 
  Design, build and maintain data pipelines, data modeling and transformation workflows on the Databricks platform (batch & streaming) to ingest, process and deliver data at scale.

• Lead the architecture and roadmap for the data platform and its evolution toward a federated, domain-driven model by focusing a lot on the ecosystem.


• Work with cloud services (e.g., AWS / Azure / GCP) and infrastructure tools (Terraform, CI/CD pipelines) to deploy and manage data platform components.


• Implement and optimise data models, schemas, and storage (e.g., Delta Lake) for structured and semi-structured datasets.


• Promote platform observability - logging, monitoring, cost optimization, and data quality tracking.


• Collaborate closely with data scientists, analysts, BI teams and business stakeholders to translate business requirements into technical solutions.


• Ensure high data quality, governance, security and observability in all data artefacts and processes.


• Deal with high-quality documentation, and data governance.
  
  


• Troubleshoot performance, scalability, reliability issues of data pipelines, tuning Spark/Databricks job performance as required.


• Contribute to best practices around data engineering (e.g., code reviews, version control, documentation, test automation).


• Mentor junior engineers and help build a culture of continuous improvement in data platform engineering.

 What We Are Looking For

Core: Databricks (PySpark, Delta Lake, Unity Catalog), Spark SQL, Airflow, Data Mesh, Platform-focused, ETL, data processing, etc.

• 7+ years of professional experience in data platform and platform architecture, with at least 3 years of hands-on Databricks experience.


• Strong experience with Databricks (e.g., PySpark/Scala, Spark SQL, Delta Lake) in production environments.
  
  


• Proficiency in Python, SQL, and preferably experience with Scala or Java.


• Deep understanding of cloud platforms (AWS/Azure/GCP) including data/analytics services, storage, compute, networking.


• Hands-on with infrastructure-as-code tools (e.g., Terraform), CI/CD pipelines and DevOps practices.


• Experience with both batch and streaming data processing and modern data architectures (e.g., lakehouse, Medallion architecture).


• Solid problem-solving skills, attention to detail, and ability to work in a fast-moving, collaborative environment.


• Excellent communication skills and ability to interface with technical and non-technical stakeholders.

What is in It for You

🌟 Why Join Kolomolo?

At Kolomolo, we prioritize innovation, agility, and autonomy.

Our teams have the freedom to own their work, share ideas, and make meaningful contributions.

Inspired by Scandinavian values, we believe in work-life harmony and creating an inclusive culture where everyone thrives.

You will be part of a passionate, skilled, and friendly team that works hard and celebrates together.

Here, you can build your career on your own terms, with opportunities to grow, learn, and make a real impact.

Our Flat Structure & The Culture of Inclusion 

At Kolomolo, we break the corporate mold.

We offer:

• Agile Teams & Autonomy: No micromanagement.
  
  You’ll own your projects and enjoy the freedom to innovate.


• Work-Life Harmony: Inspired by Scandinavian values, we prioritize balance and flexibility, where remote work and asynchronous collaboration are in our DNA.


• Learning & Growth: Continuous learning is at our core.
  
  We reward hard work, value smart ideas, and foster an environment of mutual respect and trust.


• Inclusive Culture: We believe in DEI: diversity, equity and inclusion.
  
  We are committed to creating an environment where every individual, regardless of background, identity, or experience feels valued, respected, and empowered to thrive.

Join Kolomolo and elevate your career with cutting-edge technology, a supportive team, and a company that truly values your input.

Ready for the next step?

Apply now and start an exciting journey of growth and innovation with us!

Required Skill Profession

Computer Occupations