Solution Architect - Data Platform
NEEDED!
28 000 - 32 000 PLN + VAT (B2B) per month
Join the team of Experts that transform businesses into data-driven organizations by providing new generation of Business Intelligence solutions including Artificial Intelligence and Machine Learning based on Microsoft Azure and Power Platform.
We are a group of dedicated technology enthusiasts, passionate about data processing, and extracting valuable information for clients that are essential for making strategic business decisions.
Elitmind’s founders are two data geeks whose professional path is dedicated to the Data. They still are actively involved in cooperation with clients.
Our experience, exceptional skills and knowledge have leveraged us to the leader position in Data Analytics – we are running multiple projects for the biggest global and Polish companies.
We are excited about using the potential of AI and Machine Learning in Business Intelligence solutions. We are experts in creating solutions based on the latest technologies of our key partner, Microsoft, in particular Azure Cloud Services.
Our goal is to become the first-choice partner for clients around the world when it comes to analytics and artificial intelligence. We know that we will not achieve this without the strong Team!
We are seeking a Solution Architect - Data Platform to join our team!
Architecture Design:
- Design and implement scalable, reliable, and secure data platform architectures using Azure services and Azure Databricks.
- Define end-to-end data processing pipelines, including ingestion, transformation, and consumption layers.
- Review and optimize current solution based on Medalion Architecture principles
Stakeholder Collaboration:
- Collaborate with Product Owners, Data Engineers, Data Scientists, and Business Stakeholders to align the platform’s architecture with business objectives.
- Provide technical leadership and guidance to cross-functional teams.
Optimization and Scalability:
- Optimize Databricks workloads and resource management for performance and cost-efficiency.
- Architect solutions that scale for growing datasets and evolving business needs.
Governance and Security:
- Ensure compliance with data governance and security standards.
- Implement best practices for managing data privacy, access control, and auditability.
Innovation and Best Practices:
- Stay updated on the latest Azure and Databricks features and identify opportunities to enhance the data platform.
- Establish architectural standards and reusable frameworks
- Leading the Data Engineering competency domain that are targeted for delivery optimization and our team of Data Engineers in Elitmind
- Stay ahead of industry trends and best practices, conducting research and executing new techniques
- Setting up and developing internal procedures and standards for development and operations
- Manage internal Center of Excellence initiatives in DevOps tribe. Gather best practices, frameworks and standards to provide as much reusable components as possible
- Provide a technical roadmap and architecture for Data platforms that will be proposed to our customers
- Be trusted advisor for customers
- Gather customer requirements and prepare work estimation for offers
- Participate in creation of Data Platform services offer and selling strategy in area of data platform administration and maintenance
Technical Expertise:
- Strong hands-on experience with Azure services, including but not limited to:
- Azure Databricks
- Azure Data Factory
- Azure Synapse Analytics
- Azure Data Lake (Gen2)
- Azure Blob Storage
- Azure Functions
- Azure Key Vault
- Proficiency in designing and implementing ETL/ELT pipelines with Databricks notebooks and workflows.
- Expertise in Spark, SQL, and Python programming within Databricks.
Cloud-Native Data Solutions:
- In-depth understanding of cloud-native data architectures, including serverless computing, distributed systems, and storage optimization in Azure.
Data Modeling & Integration:
- Experience in designing normalized and de-normalized data models.
- Hands-on experience with integrating various data sources, APIs, and real-time streaming solutions (e.g., Event Hub, Kafka).
Performance Tuning and Monitoring:
- Proficiency in optimizing Databricks clusters and Spark jobs
- Knowledge of monitoring tools like Azure Monitor, Log Analytics, and Datadog for performance analysis.
Security and Compliance:
- Familiarity with Azure-native security features, such as Key Vault, Managed Identities, and role-based access control (RBAC).
- Knowledge and understanding of Databricks Unity Catalog
Leadership Skills:
- Ability to lead architectural discussions, resolve conflicts, and drive consensus across technical teams.
- Mentorship and upskilling of engineering teams on Azure and Databricks best practices.
- 5+ years of experience in configuration/release management, deployment, maintenance and familiarity with various Data Platforms and practices in data area
- Experience in creating frameworks, using automation tools and executing best practices in real world Data Platform implementation projects
- Knowledge of enterprise architectures and technology trends, with specific focus on the Microsoft ecosystem
- Very good coding skills with knowledge of best practices in SQL, Python
- Conceptual and technical knowledge on CI/CD Pipelines, Automation Practices, Technical Operations Monitoring
- Experience in Azure Data services, Databricks, MS Fabric
- Experience managing both pre-sales (offering and solutioning), managing the capability and being responsible for the delivery quality.
- Working knowledge of English (spoken and written)
- Open minded, self-driven, eager to learn new technologies and put newly acquired knowledge into practice.
Nice to have:
- Experience with Snowflake, dbt
- Experience with Lakehouse automation tools and frameworks
Ability to work remotely
Private medical care or Multisport (you choose)
Flexible working hours
Paid holidays
Unlimited access to Microsoft/Snowflake Technology
Comfortable and spacious office