HI,

I have this below mentioned roles with my clients in NJ,OH and GA. So kindly send me your updated resume in word document along with it please mention your minimum expected hourly rate or yearly salary, visa status, current location and availability to start a new project. Please let me know if you would like to work on 1099/CTC/W2. Please email the resumes to varma@hermitageinfotech.com or call varma at 908-247-0950 for any questions.

Lead Data Engineer

Client Tavant/Disney
Location NYC/Remote
Timezone: EST

As a Lead Data Engineer, you will be expected to provide expert level data solutions by using software to process, store, and provision quality data. Responsible for leading, instructing and mentoring a team of data engineers and are expected to have the oversight of all deliverables to ensure the designed data pipelines are scalable, repeatable, and secure.

Responsibilities:

• Leads all phases of solution development. Designs and codes complex ETL (Extract / Transform / Load) processes and adhoc queries. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.
• Integrates complex and large scale data from a variety of sources for business partners to generate insight and make decisions.
• Must be a forward thinker that sees the larger picture; looks beyond the current, anticipates what could happen or what the future needs will be.
• Translates business specifications into design specifications and code.
• Assesses data quality and tests code thoroughly for accuracy of intended purpose.
• Educates and mentors a team of data engineers on the team while applying quality control to their work.
• Develops data engineering standards.
• Troubleshoots software and processes for data consistency and integrity.

Experience:
• Expert level Data Engineer with solution architecture experience
• Well-seasoned in data modeling, data intake, and data-curation procedures
• In-depth practical experience and demonstrated comprehensive know-how in designing and implementing modern cloud architectures based on micro-services and continuous delivery
• Experience with data protection regulations (e.g. GDPR), data masking techniques and the concepts of k-anonymity and i-diversity
• Ability to develop a holistic approach and to abstract reasoning, as well as the ability to communicate complex issues to internal and external non-professionals in an easily understandable way
• Strong service orientation, target driven, high degree of intercultural competence, team player with highest commitment
• Strong leadership and interpersonal skills
• Ability to schedule and prioritize workload demands on a team


Required Skills

SQL
Python
Spark - SQL and Python

Tools
AWS (S3 - IAM - Kinesis - SNS - SQS)
Databricks
Terraform (or very good experience with Cloudformation)
Airflow

Experience with setting up data pipelines in the AWS cloud
Experience with setting up data pipelines with Databricks
Experience with Monitoring and Alerting

Regards
Varma
908-247-0950
varma@hermitageinfotech.com