Job Description

Design and implement data ingestion, transformation, and movement using Azure Data Factory (ADF), Azure Synapse, and Data Lake.
Collaborate with business stakeholders, data scientists, and engineers to build robust data solutions.
Develop and manage high-volume, real-time, and batch data ingestion pipelines using Azure Data Factory (ADF).
Implement event-driven architectures for real-time data movement and processing.
Develop large-scale data processing solutions using Azure Databricks and Apache Spark with PySpark, Scala, or Python.
Optimize data partitioning, caching, and indexing for efficient performance.
Manage complex transformations and aggregations for structured and unstructured datasets.
Design and implement high-performance data models in Azure Synapse Analytics using dedicated SQL Pools and Spark Pools.
Optimize query performance, workload management, and cost efficiency in Synapse Analytics.
Implement column store indexes, partitioning strategies, and data caching to enhance performance.
Design and manage secure, scalable data lakes using Azure Data Lake Storage Gen2 (ADLS Gen2).
Implement RBAC (Role-Based Access Control), encryption, and data masking to ensure security.
Implement Azure Monitor, Log Analytics, and Application Insights for data pipeline monitoring and troubleshooting.
Optimize cost management, auto-scaling, and performance tuning across Azure services.

Requirements

8+ years of experience in data engineering, ETL development, and cloud-based data integration,
Strong experience with Azure Data Factory (ADF): ETL/ELT pipeline orchestration and data movement.
Azure Databricks: Large-scale data transformation and big data processing with Apache Spark, PySpark, Scala, or Python.
Azure Synapse Analytics: Data warehousing, SQL Pools, Spark Pools, and performance tuning.
Azure Data Lake Storage Gen2 (ADLS Gen2): Secure, scalable data lake architecture.
SQL Server: Advanced T-SQL, stored procedures, indexing, and query optimization.
Power BI, Tableau, or other BI tools for data visualization.
Financial/Banking experience.

Job Tags

Full time,

Similar Jobs

North Kern State Prison

MUSLIM CHAPLAIN Job at North Kern State Prison

...Job Description and Duties Under the direct supervision of the Community Resource Manager, the Muslim Chaplain will provide and supervise Muslim religious activities for the prison inmate population. The Muslim Chaplain interviews and counsels incarcerated people on...

Biz Voice Boost

Entry Level Marketing Assistant Job at Biz Voice Boost

Job Title: Entry Level Marketing Assistant Location: Austin, TX Employment Type: Full-Time Reports To: Marketing Manager Job Overview: We are seeking a dynamic and enthusiastic Entry Level Marketing Assistant to join our growing team. This role is designed...

KSPS PBS

Major Giving Manager Job at KSPS PBS

...application. Job Summary The KSPS PBS team seeks an experienced philanthropy professional with a strong background in the local nonprofit development space to fill the role of Major Giving Manager. This individual will play a vital role in our fundraising efforts,...

Journey To Prosperity

HR Recruiter - Remote Job at Journey To Prosperity

Exciting Career Opportunity: Unlock Your Potential with Our Global Team Are you driven, self-motivated, and ready to take your career to new heights? If you're passionate about personal growth, leadership development, and making an impact, we want you to be part of...

Two95 International Inc.

Search Engine Optimisation - Specialist (Senior) Job at Two95 International Inc.

...Hiring Immediately " Senior Search Engine Optimisation Specialist" - Casino Industry for a well reputed company @ Mont Kiara Chinese... ...To be able to implement, evaluate and report onsite SEO To manage a team that is specific to the above requirements Requirements...

Sr Azure Data Engineer Job at Zapcom, Dallas, TX

bU5RU0hDdzZtMm5kNys3dVdjUXB1RDJKaFE9PQ==