Databricks Jobs

I need an experienced Power Automate specialist to perform an HTTP request using a personal access token. The task involves connecting to my organization's Databricks to retrieve a sales metrics dashboard. The raw data from this dashboard needs to be exported to an Excel file on SharePoint. Since I am not allowed to share my credentials this job is to be done in-person in New Jersey in a public place Requirements: - Create HTTP request in Power Automate - Use personal access token for Databricks - Retrieve sales metrics dashboard - Export raw data to SharePoint Excel file Ideal Skills: - Proficiency in Power Automate - Experience with Databricks and HTTP requests - Familiarity with SharePoint and Excel integration - Ability to work onsite in New Jersey

I’m ready to move my real-time data processing into Databricks and need a specialist who can build a robust streaming pipeline end-to-end. The source will be Apache Kafka; events arrive continuously and must be processed, transformed, and stored inside the Databricks environment with low latency and solid fault tolerance. You’ll design the job structure, configure Structured Streaming, handle schema evolution, and implement checkpoints so that the pipeline restarts cleanly after failures. I also want concise notebook-based documentation that shows how the pipeline is triggered, how it scales, and where metrics can be monitored in the workspace. Deliverables • A working Databricks notebook (or repo) that ingests from our existing Kafka topics, performs necessary tra...