Data Platform Architect (Databricks)

About us

GetInData | Part of Xebia is a leading data company working for international Clients, delivering innovative projects related to Data, AI, Cloud, Analytics, ML/LLM, and GenAI. The company was founded in 2014 by data engineers and today brings together 120 Data & AI experts. Our Clients are both fast-growing scaleups and large corporations that are industry leaders. In 2022, we joined forces with Xebia Group to broaden our horizons and bring new international opportunities.

What about the projects we work with?
We run a variety of projects in which our sweepmasters can excel. Advanced Analytics, Data Platforms, Streaming Analytics Platforms, Machine Learning Models, Generative AI and more. We like working with top technologies and open-source solutions for Data & AI and ML/AI. In our portfolio, you can find Clients from many industries, e.g., media, e-commerce, retail, fintech, banking, and telcos, such as Truecaller, Spotify, ING, Acast, Volt, Play, and Allegro. You can read some customer stories here.

What else do we do besides working on projects?
We conduct many initiatives like Guilds and Labs and other knowledge-sharing initiatives. We build a community around Data & AI, thanks to our conference Big Data Technology Warsaw Summit, meetup Warsaw Data Tech Talks, Radio Data podcast, and DATA Pill newsletter.

Data & AI projects that we run and the company's philosophy of sharing knowledge and ideas in this field make GetInData | Part of Xebia not only a great place to work but also a place that provides you with a real opportunity to boost your career.

If you want to be up to date with the latest news from us, please follow up on our LinkedIn profile.

About role
A core part of our value proposition in projects we do is to bring the best expert knowledge in the applications of Big Data & AI. We mentor clients on what problems they can solve with modern technologies, how to architect and implement reliable solutions with the best engineering standards, and how to deliver them effectively. Being a solution architect is to be the ambassador of the company by setting technological direction, roadmap, architecture, and feasibility in multiple projects, especially at their earliest stages. The goal is to make sure our clients get the best possible solution to their real-world challenges and a path to get there.

Responsibilities

• Building a Data Platform in the Azure cloud providing multiple Data teams with the ability to start and maintain projects in an automated fashion
• Mentoring and delegating tasks to 2-3 engineers who will help in building the Data Platform
• Evaluating and optimizing costs for Databricks workloads
• Selecting and configuring clusters tailored to specific workload requirements
• Integrating Databricks into the existing Azure network setup
• Automating the deployment and management of Databricks environments using Azure DevOps Pipelines
• Using Terraform as the primary Infrastructure as Code (IaC) tool for managing resources
• Implementing secure data-sharing solutions within Databricks

• Extensive experience working with Azure cloud provider
• Great knowledge of DevOps practices and tools, including Docker, Terraform, CI/CD
• Experience working with Databricks platform
• Strong engineering background, preferred in fields such as Computer Science, Mathematics, Software Engineering, Physics, and Data Science
• Great fundamental knowledge of Software Engineering, Data Engineering, building whole data platforms and solutions
• Understanding complexity and relationships between businesses, suppliers, partners, competitors, and clients
• Experience or interest in working with and using large-scale data to solve valuable business problems
• Experience in preparing presentations, design documents, and architecture diagrams

• Salary: 200 - 240 PLN net + VAT/h B2B (depending on knowledge and experience)

• 100% remote work

• Flexible working hours

• Possibility to work from the office located in the heart of Warsaw

• Opportunity to learn and develop with the best Big Data experts

• International projects

• Possibility of conducting workshops and training

• Certifications

• Co-financing sport card

• Co-financing health care

• All equipment needed for work