Title: Azure Databricks Lead
Location: Cincinnati, Ohio
Duration: 6 Months+
Key Responsibilities:
Data Pipeline Design and Development
Designing developing and maintaining scalable data pipelines and ETL processes using Azure Databricks Data Factory and other Azure services
Spark Job Implementation and Optimization
Implementing and optimizing Spark jobs data transformations and workflows within Databricks
Data Model Development
Developing and maintaining data models and data dictionaries
Data Quality and Governance
Developing and maintaining data quality checks governance policies and security procedures
ETL Process Design and Maintenance
Designing and creating ETL processes to supply data to various destinations including data warehouses
Data Integration
Integrating data from various sources into Azure Databricks
Collaboration
Working with other teams including data engineers data scientists and analysts to ensure data quality and consistency
Monitoring and Optimization
Implementing effective monitoring processes to track performance and optimize workflows
Data Lakehouse Solutions
Contributing to the design and implementation of data lakehouse solutions using Databricks
Skills and Qualifications
Azure Databricks Proficiency Experience with Azure Databricks PySpark and Spark
Programming Languages Proficiency in languages like Python SQL and Scala
ETL and Data Warehousing Strong understanding of ETL processes data warehousing concepts and data modeling
Cloud Platforms Experience with cloud platforms particularly Microsoft Azure
Data Engineering Experience in data engineering data pipelines and data integration
Data Governance and Security Knowledge of data governance policies and procedures
Excellent problem solving and debugging skills
Strong communication and teamwork skills
Exp Level: 10-14 years
Skills
Mandatory Skills : ANSI-SQL, Azure BLOB, Azure Data Factory, AZURE DATA LAKE, Azure Functions, Azure SQL, Azure Synapse Analytics, Databricks, Java, Python, Scala, Snowflake
...SuperiorX Investigations (Command Investigations) is seeking qualified, driven, and experienced candidates to join our special investigations... ...Investigations is the premier servicer for insurers and defense attorneys throughout Michigan, and our Assigned Claims Plan (...
05 - 175866 mp We are seeking Welder/Fabricators who will perform Mig and Tig Fabrication work. There is an opening on both first and second shifts with the possibility of overtime every week. Qualified candidates must have experience with MIG, Tig Welding and Fabrication...
...Staff (EHRA NF) Vacancy ID: NF0009070 Salary Range: $110,000 - $118,368 Position Summary/Description: The Compliance Investigator investigates complaints of violations of University policies, including, but not limited to the Policy on Prohibited Discrimination...
...Families Working Title: ADULT PROTECTIVE INVESTIGATOR - 60020898Pay Plan: Career Service... ..., Floridians hail from a wide range of backgrounds, cultures, ethnicities, and walks of... ...and requirements applicable to state and federal laws or procedures. We hire only U.S...
...Delphi Healthcare is seeking a Certified Registered Nurse Anesthetist (CRNA) for a long-term locums opportunity in Buffalo, NY starting in April... ...starting at $125/hour (W2 or 1099 options available) Travel & lodging provided (Preference for local candidates)...