Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

cklJRkFWckxiZE0rZkZKV1NTUnlETENTQXc9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

SimpleCiti Companies

Property Manager Job at SimpleCiti Companies

 ...Excellent communication and interpersonal skills. Ability to work independently and as part of a team. Proficiency in Yardi property management software. Knowledge of local, state, and federal property regulations. Strong problem-solving skills and... 

Lockheed Martin

Multi Functional Manufacturing Supervisor (Level 3) Job at Lockheed Martin

**Description:** **We are** _Lockheed Martin_At Lockheed Martin Aeronautics, we are driven by a commitment to excellence, innovation, and teamwork\. We are seeking a Multi\-Functional Manufacturing Supervisor \(Level 3\) to provide strategic leadership across three shifts... 

Anytime Fitness - Stephenville, TX

AF Personal Trainer Job at Anytime Fitness - Stephenville, TX

 ...through health and fitness. This is a position to help grow our Personal Training department by working in a creative, fun and upbeat...  ...atmosphere where every day is different.Anytime Fitness Personal TrainerThe Personal Trainers focus is on helping the member Get to... 

Next Step Healthcare

Clinical Liaison Job at Next Step Healthcare

 ...Next Step Healthcare is seeking an experienced Clinical Liaison to oversee and direct patient referral efforts in Western Massachusetts, specifically the Berkshire/Vermont markets. The Clinical Liaison is responsible for growth and development of his/her assigned territory... 

Kaw Valley Greenhouses

Garden Center Employee Job at Kaw Valley Greenhouses

 ...Garden Center Employee Job Description Basic Function: To accurately perform duties in sales and customer service, receiving and stocking freight, building and maintaining displays, plant care, follow all policies/procedures and operate the cash register. This is a...