Data Engineer with Databricks Developer (W2 Position)
Location: Washington, DC
Duration: 6+ Months
Job description :
Need 10+ years of experience as a Data Engineer
Databricks & AWS Big Data Architecture Certification would be plus.
Solid experience with SQL-based database is required.
Two-year experience with Hadoop/Spark in either an administrative, development or support role is required.
Experience in engineering practices such as development, code refactoring, and leveraging design patterns, CI/CD, and building highly scalable data applications and processes.
Knowledge of advanced data engineering concepts such as dimensional modeling, ETL, data governance, data warehousing involving structured and unstructured data
Must have excellent coding skills either Python or Scala.
Must have experience in Data Engineering domain.
Must have implemented at least 2 project end-to-end in Databricks.
Must have experience on Databricks which consists of various components as below.
Delta lake
dbConnect
db API 2.0
Databricks workflows orchestration
Must be well versed with Databricks Lakehouse concept, Medallion architecture and its implementation in enterprise environments.
Must have good understanding to create complex data pipeline.
Must have extensive knowledge of Spark and Hive data processing framework.
Preferred Qualifications/Skills
Good to have Unity catalog and basic governance knowledge.
Good to have MicroStrategy or Tableau reporting experience.
Good to have knowledge of docker and Kubernetes.
Good to have Linux/Unix Admin or development skills.
Please share profile's to sudheer@anveta.com
...Static timing analysis tools (e.g., Nanotime, Primetime, etc.) Modeling of digitally assisted analog adaptive loops (using C, Matlab or Python, etc.) Able to build VerilogA/AMS behavioral models Able to analyze and lead characterization data from lab and volume...
...Job Overview: We are looking for a talented MATLAB Developer with experience in User Interface (UI) design and development to join our team. The ideal candidate will have a strong background in programming with MATLAB, combined with experience in creating intuitive and...
...About Our Company We're a physician-led, patient-centric network committed to simplifying health care and bringing a more connected... ...to be! We are seeking a Board Certified/Board Eligible Internal Medicine Physician to join our expanding department. We offer:...
...Job description ** Please apply with a PDF version of your resume" or something similar that you would prefer** Title: RADIOLOGICAL TECHNOLOGIST Location: near Chapmanville, West Virginia Are you considering a career change? Looking for a smaller community(2...
...Job Description Job Requirements: As a Laundry Aide you will wash, dry and fold clean linen according to procedures. Deliver clean and sanitary linen and personal clothing to designated areas. Responsible for keeping work area clean and sanitary. Demonstrate...