Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

TngvZXdaR3lBUWVZWTZzMFdJZ29kbG5RUmc9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Vulcan

Storeperson & Forklift Driver Job at Vulcan

 ...Counting and checking stock Putting stock away Unloading and loading trucks Operational duties as required Requirements Forklift licence and experience (essential) Experience with overhead cranes (desired) HUBTEX experience an advantage Ability to lift... 

Destinee Travel

Customer Service Agent - Work From Home Job at Destinee Travel

 ...or elevate your career in travel. Position Details: Start Date: Immediate openings available! Work Environment: 100% remote position. Flexibility: Part-time or full-time options. Training: Comprehensive company-provided training included. Requirements... 

Reeder Excavation

Excavation Operator/Laborer Job at Reeder Excavation

 ...Job Title: Excavation Operator & Laborer Excavation company seeking Experienced operators as well as General Laborers. Offering opportunity...  ...for Quick Advancement. Specializing in New Development, Pipeline Work, and Earth Work Responsibilities: Daily Tasks... 

NavitsPartners

Registered Nurse - RN25-21329 Job at NavitsPartners

 ...Job Title: Registered Nurse (RN) Location: Ithaca, NY 14850 Shift: Day Shift (Start times: 7 AM, 8 AM, or 9 AM) | Flexible Scheduling (5x8s or 4x10s) | On-Call Required Job Summary: We are seeking an experienced Registered Nurse (RN) with expertise in... 

Domino's Franchise

Pizza Delivery Driver - up to $20-$26 / hr Full/Part Time Job at Domino's Franchise

 ...you be more efficient which allows you to take more deliveries per hour than other delivery places, increasing your tips! Tips and mileage...  ...between 4pm-6pm and ending 8pm-10pm, 3-4 nights per week. $20/ hour is wage, mileage, and tips combined. You may not make...