Data Architect

Vedi l’offerta su Go Lavoro: golavoro.it/annuncio-lavoro/8ieimo

About the Role
We partner with global enterprises to design and build large-scale data platforms that power the products and operations at the center of their business. This engagement is a modernization program that moves production data workloads off legacy Dataiku and Cloudera/Hadoop environments and onto Databricks on Azure.

You will join a joint team of client and Lumenalta engineers, embedded alongside the client's data, cloud and infrastructure teams. The client owns the migration and sets its priorities and timeline. The team needs one hands-on technical lead who guides the solution design, sets the Databricks patterns everyone builds on, and keeps work moving across workstreams.

That is this role. You will guide design across a batch pipeline migration and a real-time streaming ingestion effort. You will stay hands-on, step in wherever a blocker comes up, and help the client's engineers grow into owning the platform long term.

What You'll Do
• Guide the overall solution design for the platform, working with the client's project lead to align on priorities as they evolve.




• Define the Databricks patterns and standards the joint team follows, including medallion architecture (bronze, silver, gold) and pipeline conventions.
• Lead the migration of a production pipeline from Dataiku and Cloudera/Hadoop to Databricks across the silver and gold layers, following a lift-and-shift approach first and optimization later.
• Keep production outputs running throughout the transition through parallel runs, data reconciliation and safe cutover, since business-critical operations depend on this pipeline.
• Guide the evaluation and design of real-time event ingestion from Azure Event Hubs, Event Grid and Azure Data Explorer into Databricks, comparing approaches such as Spark Structured Streaming and Databricks ZeroBus.
• Support the transition of Power BI dashboards to Databricks dashboards.
• Work hands-on across workstreams, review designs and code, and step in to unbl

Vedi l’offerta su Go Lavoro: golavoro.it/annuncio-lavoro/8ieimo