Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

V3lRRnNPRzc5NG1mVUZCYlJuV1J5b2xzNGc9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

SOUTHEAST ASIA MARKET, LLC

Cargo Van Delivery Driver (CDL Not Required) - Brooklyn, NY Job at SOUTHEAST ASIA MARKET, LLC

 ...corporate cafeterias and catering services in New York, New Jersey, and Connecticut. We are seeking an experienced cargo van driver in making deliveries in Manhattan, NY. Applicant must be available to work six (6) days a week between the hours of 5:00 AM - 7:00 PM.... 

Greenwood County Hospital Board

Community Health Educator, Prevention and Wellness, Full Time Job at Greenwood County Hospital Board

 ...Job Description Job Description Special Qualifications B.S. degree in health related or similar educational field; three years of relevant work experience in a health related setting, proficiency in educational and instructional skills; a working knowledge of... 

Poly6

Manufacturing Materials Engineer - Aerospace 3D Printing Job at Poly6

 ...manufacturing environment, working with ceramic materials and/or 3D printing technologies. Working knowledge of Six Sigma principles,...  ...Benefits include: Bonus program eligibility Comprehensive medical, dental, and vision insurance 401(k) with company match Paid... 

UBREAKIFIX - North Little Rock

Cell Phone Repair Technician Job at UBREAKIFIX - North Little Rock

 ...a wide range of devices, including smartphones, tablets, computers, and more. Whether you need a same-day repair for your iPhone, Samsung Galaxy, Mac, iPad, or other electronics, our expert technicians are here to help. In addition to repairs, we also offer high-quality... 

Packaging Corporation of America

IT Systems Engineer I Job at Packaging Corporation of America

 ...business seeks to be the leader in helping our customers large and small package, transport...  ...providing the highest level of customer service and operational excellence. We have...  ...laptops, tablets, servers, mobile units, virtual machine environment. Knowledge of...