PySpark Developer W2 Contracts Hybrid positions in Iselin, NJ Job at CDRP Technologies, Iselin, NJ

QTlnc3R3ZSswTWRQdW5hWCtScTVFVEhvR2c9PQ==
  • CDRP Technologies
  • Iselin, NJ

Job Description

Responsibilities:

  • Develop, maintain, and optimize data processing pipelines using PySpark on Azure Cloud.
  • Collaborate with cross-functional teams to understand data requirements and translate business needs into technical specifications.
  • Design and implement scalable data models and data architecture to support analytical and reporting needs.
  • Perform data cleansing, transformation, and enrichment processes to enhance data quality and usability.
  • Monitor and troubleshoot data processing jobs, ensuring high availability and performance.
  • Implement best practices for data governance and security within Azure Cloud.
  • Stay up-to-date with emerging technologies in big data, cloud computing, and the financial services industry.

Requirements:

  • Minimum of 9 years of experience in PySpark development.
  • Proven experience working with Azure Cloud services (Azure Data Factory, Azure Databricks, etc.).
  • Prior experience in the banking, investment banking, or financial services sector is mandatory.
  • Proficient in PySpark for data processing and ETL tasks.
  • Experience with SQL and NoSQL databases.
  • Familiarity with data warehousing concepts and tools.
  • Knowledge of Azure services related to big data and analytics.

Preferred, but not required:

  • Experience with containerization technologies (e.g., Docker, Kubernetes).
  • Familiarity with machine learning frameworks (e.g., MLlib, TensorFlow).

Job Tags

Similar Jobs

COLSA Corporation

Cabling and Infrastructure Technician (MSIC/SCOAA) Job at COLSA Corporation

Join our team as a Cabling and Infrastructure Technician, where you will play a key role in installing and maintaining structured cabling...  ...and connectivity.+ Perform troubleshooting and repair of network cabling issues.+ Maintain and organize cable pathways, racks,... 

HonorVet Technologies

Local Contract Nurse RN - Stepdown Job at HonorVet Technologies

 ...Description HonorVet Technologies is seeking a local contract nurse RN Stepdown for a local contract nursing job in Cleveland, Ohio...  ...: 9500 Euclid Ave, Cleveland, OH 44195 Requirements: Experience: Minimum 18 months recent Cardiac Stepdown RN experience (PCU... 

Amazon Web Services, Inc.

Principal Account Executive, Navy DoD Sales Team Job at Amazon Web Services, Inc.

 ...responsibilities Develop a growing book of business in the Navy and/or Marine Corps as part of a Navy sales team. Drive business...  ...them to drive an engagement and interact at senior military and civilian levels. Have a technical background that enables them to... 

Mike Wiegele Helicopter Skiing

Full Time Head of Housekeeping Job at Mike Wiegele Helicopter Skiing

 ...of Employment Include: ~ Subsidized staff accommodation in private or shared residence ~ Fitness center ~ Family and friends'...  ...off retail items in our specialized boutique Position: Housekeeping Supervisor Location: Blue River, BC Type: Seasonal, Full... 

Zifty.com

Catering Delivery Driver Job at Zifty.com

Catering Delivery Drivers Needed! Earn an average of $37 per delivery!Catering deliveries will be completed within 10 miles of Eaton.Live, dedicated driver support is available to help when you need it, via chat or phoneChoose your deliveries in advanceZifty deposits...