Data Architect (Databricks) Job at VDart Inc, Dallas, TX

bnRJWEhpNHdrMkhjNytIc1djOHB2aktCZ0E9PQ==
  • VDart Inc
  • Dallas, TX

Job Description

Job Title: Data Architect (Databricks)

Location: Dallas, TX (Onsite)

Duration: / Term: Fulltime

Job Description:

Experience Desired: 10+ Years.

Responsibilities:

Interview process - 3 interview round and 1 client round.

Required Skills/Qualifications:

  • 10-14 years of relevant experience
  • Bachelor's and/or master's degree in computer science or equivalent experience.
  • Strong communication, analytical and problem-solving skills with a high attention to detail.

Desired Experience:

  • At least two years of experience building and leading highly complex, technical engineering teams.
  • Strong hands-on experience in Databricks
  • Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python . The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.
  • Experience managing distributed teams preferred.
  • Comfortable working with ambiguity and multiple stakeholders.
  • Comfortable working cross functionality with product management and directly with customers; ability to deeply understand product and customer personas.
  • Expertise on Azure Cloud platform
  • Good SQL knowledge
  • Knowledge on orchestrating workloads on cloud
  • Ability to set and lead the technical vision while balancing business drivers
  • Strong experience with PySpark, Python programming
  • Proficiency with APIs, containerization and orchestration is a plus
  • Experience handling large and complex sets of data from various sources and databases
  • Solid grasp of database engineering and design principles.
  • Experience with Unity Catalog.
  • Familiarity with CI/CD methods desired
  • Good to have Teradata Experience (not Mandatory)

Responsibilities:

  • Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders
  • Follow the Agile development methodology; think strategically and execute methodically
  • Develop and manage capacity and growth projection forecasts of the environment within budgets
  • Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements
  • Drive optimization, testing and tooling to improve quality of solutions
  • Manage teams that build and operate high volume distributed systems in a SaaS environment
  • Great at devising efficient processes that increase velocity and quality
  • Train counterparts in the data pipelining and preparation techniques, which make it easier for them to integrate and consume the data they need for their own use cases.
  • Promote the available data and analytics capabilities and expertise to business unit leaders and educate them in leveraging these capabilities in achieving their business goals.
  • Accountable for operational effectiveness in performance, uptime, release management of the enterprise data platform

Key Skills:

Databricks, Azure, Apache Spark, and Python

Job Tags

Full time,

Similar Jobs

M/I Homes

Email Marketing Specialist Job at M/I Homes

 ...national leader in a single generation with divisions in 17 markets, including Austin, Charlotte, Chicago, Cincinnati,...  ...Tampa. Job Summary: The primary responsibility of the Email Marketing Specialist is to drive interactions via email marketing. This includes... 

Loginsoft Consulting LLC

Databricks Data Engineer (Remote) Job at Loginsoft Consulting LLC

 ...NOTE: THIS POSITION IS TO JOIN AS W2 ONLY. Databricks Data Engineer Location: Richardson, TX (Remote) Duration: 6 Months Technology requirements: SQL GCP AWS Years experience: ~10+ years of experience as a Software Engineer... 

Sideworx Connect USA

Safety Watch & Rescue Personell Job at Sideworx Connect USA

 ...Job Title: Safety Watch and Rescue Personnel Location: Bakken Oilfield, Williston North Dakota Company : Sideworx Connect Job Type: Temporary Safety watch & Rescue(Turnaround/Shutdown Work) Wage: Dependent on experience and job type Job Description... 

Dropoff, Inc.

*CARGO VAN Owner Operators* Wed-Fri routes in Buffalo, NY! Job at Dropoff, Inc.

 ...license and clean driving record ~ Tech savvy -- youre comfortable using a smartphone and apps Fill out the form below to indicate your interest in becoming a driver for Dropoff! All fields are required. Powered by JazzHR PI64d11c646879-26289-34064186... 

Mayo Clinic

Escort - SMH Job at Mayo Clinic

Why Mayo Clinic Mayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation...