Job Description

Title: Senior Azure Databricks Developer

Duration: Fulltime Permanent Hire
Location : Chicago IL

Job Description

Overall 10 years of experience as developer in Big data technologies like Databricks/Spark and Hadoop ecosystems
Experience in developing Spark applications using sparkSQL in Databricks for data extraction transformation and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into the customer usage patterns
Extract transform and load from sources system to Azure Data Storage services using a combination of Azure Data factory TSQL Pyspark and USQL Axure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data Lake Azure Storage Azure SQL Azure DW) and processing the data in Azure Databricks
Hands on experience on developing SQL scripts for automation
Extensive handson experience implementing Lake house architecture using Data bricks Data Engineering platform SQL Analytics Delta Lake and Unity Catalog
Good understanding of spark architecture with Databricks structured streaming setting up Azure with Databricks managing clusters in Databricks
Excellent interpersonal verbal and written communication skills
Bachelors degree or equivalent work experience

Responsible for estimating the cluster size monitoring and troubleshooting of spark databrick cluster
Drive analysis architecture design governance and development of data warehouse data lake and business intelligence solutions
Research synthesize recommend and select technical approaches for solving difficult migration development and integration problems
Conduct and support workshops design sessions and project meetings as needed playing a key role in client relations
Develop and optimize ETL processes using Databricks and related tools like Apache Spark
Collaborate applications teams/Business users to develop new pipe lines with Cloud data migration methodologies and processes including tools like Azure Data Factory Event Hub etc
Experience working in agile development projects and sprint deliver

Job Tags

Permanent employment, Full time, Work experience placement,

Similar Jobs

American Transport Team

Dedicated | No Touch | CDL-A Truck Driver | Local Job at American Transport Team

...verage 2200 Miles Weekly Drivers WillEarn $1545-$1780+ Weekly... ...Assigned 2022 orNewer Automatic Truck Attend 3 Days OfPaid Orientation... ...~6 Monthsof OTR CDL-A tractor-trailer experience... ...truck driver is paired with a dedicated and caring driver manager. Truck...

Skillsearch Limited

Blockchain Developer Job at Skillsearch Limited

...Do you have Blockchain developer experience, and are you seeking a new job? Skillsearch is looking for a full-time Blockchain Developer, and the full-time remote role comes with an attractive salary and benefits package. As a Blockchain Developer, you will build and...

Genpact

Sourcing Manager - Indirect Sourcing - Professional Services categories Job at Genpact

...Sourcing Manager Indirect Sourcing Professional Services categories - HIG019820 Genpact (NYSE: G) is a global professional services and solutions firm... ...high level of customer service. About Genpact: Provides Business Process Management Services to Clients in multiple...

EX Squared LATAM

Python Developer Job at EX Squared LATAM

...Become an Outcoder as Python Developer We are seeking a Python Developer to build functional and efficient server-side applications.... ...customer needs. What you'll need to be successful: Solid experience as Python Developer Experience with Python frameworks (e....

Southwest Minnesota State University

Assistant Professor of Exercise Science - Part-Time Faculty | Southwest Minnesota State University Job at Southwest Minnesota State University

...Job Description The SMSU Exercise Science Program, as a part of the Science Department, is looking for someone to teach Anatomical Kinesiology and Biomechanics in our Twin Cities Partnership Program. Starting AY 2025-26, the faculty member?s primary teaching...

Senior Azure Databricks Developer Job at Siri InfoSolutions Inc, Chicago, IL

bU53UUdTMDZtbXZmNGVIcVhjWXJ2emVBZ3c9PQ==