Azure Databricks Engineer Job at Lorven technologies, Remote

TGk1N3dZcy9SVEpmenNLc0hzQldIMDN1K3c9PQ==
  • Lorven technologies
  • Remote

Job Description

Position: Azure Databricks Engineer

Location: Remote

Job Mode: Contract

Job Description:

  • Data Pipeline Development: Design, develop, and maintain scalable data pipelines and ETL processes using Azure Databricks, Azure Data Factory, and other Azure services
  • Data Processing: Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks
  • Integration: Integrate data from various sources, such as databases, APIs, and streaming data, into the Databricks environment, often using tools like Azure Data Factory or Databricks Workflows
  • Performance Optimization: Enhance the performance of data processing tasks by optimizing Spark jobs, managing cluster resources, and implementing best practices for data storage and retrieval
  • Collaboration: Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure the solutions meet business needs
  • Data Governance: Implement data governance policies and ensure data security and compliance with relevant regulations
  • CI/CD Integration: Utilize Azure DevOps and CI/CD best practices to automate the deployment and management of data pipelines and infrastructure
  • Technical Proficiency: Expertise in Azure Databricks, Azure Data Factory, Spark, Python, and SQL

Job Tags

Contract work, Remote job,

Similar Jobs

P3 Health Partners

Medical Records Clerk Job at P3 Health Partners

Overall Purpose Our company is seeking a Medical Records Clerk to assist with chart management. In this role, you will respond to release...  ...work, transactions, processes, and compliance requirements. Reviews source documents to determine accuracy and completeness of... 

Allianz

Underwriting Specialist - Insurance Agents & Brokers Job at Allianz

 ...We are currently looking for an Underwriting Specialist Insurance Agents & Brokers based in New York. The Impact You Will Have...  ...$134,147 - $229,966. The annual base salary range represents nationwide market range. The actual salary for this position may be above... 

Alaffia Health

Itemized Bill and Medical Record Reviewer Job at Alaffia Health

 ...healthcare system suffers from over $500B in wasted spending due to medical billing fraud, waste, and administrative burden. At Alaffia, we...  ...& What Youll Be Doing We are looking for a Medical Bill reviewer to join our team! Do you have experience reviewing claim forms... 

QT Express Transportation, LLC

Box Truck Driver for Dedicated Postal Route Job at QT Express Transportation, LLC

 ...Box Truck Driver/delivery needed for Centralia Post Office contract. 22-26$ per hour. Qualifications: Must be located in Centralia, IL area for a dedicated route. Monday - Saturday 5-6 hours per day. Clean driving record. Must pass Federal background check... 

The Batter Up Bakery

Cake Decorator Job at The Batter Up Bakery

 ...Successful candidates will have the ability to pay close attention to detail, work in a time-driven, team environment, and follow strict food safety guidelines. Food Handlers Card Weekends are Mandatory We are looking forward to receiving your application. Thank...