PySpark Developer W2 Contracts Hybrid positions in Iselin, NJ Job at CDRP Technologies, Iselin, NJ

QTlnc3R3ZSswTWRQdW5hWCtScTVFVEhvR2c9PQ==
  • CDRP Technologies
  • Iselin, NJ

Job Description

Responsibilities:

  • Develop, maintain, and optimize data processing pipelines using PySpark on Azure Cloud.
  • Collaborate with cross-functional teams to understand data requirements and translate business needs into technical specifications.
  • Design and implement scalable data models and data architecture to support analytical and reporting needs.
  • Perform data cleansing, transformation, and enrichment processes to enhance data quality and usability.
  • Monitor and troubleshoot data processing jobs, ensuring high availability and performance.
  • Implement best practices for data governance and security within Azure Cloud.
  • Stay up-to-date with emerging technologies in big data, cloud computing, and the financial services industry.

Requirements:

  • Minimum of 9 years of experience in PySpark development.
  • Proven experience working with Azure Cloud services (Azure Data Factory, Azure Databricks, etc.).
  • Prior experience in the banking, investment banking, or financial services sector is mandatory.
  • Proficient in PySpark for data processing and ETL tasks.
  • Experience with SQL and NoSQL databases.
  • Familiarity with data warehousing concepts and tools.
  • Knowledge of Azure services related to big data and analytics.

Preferred, but not required:

  • Experience with containerization technologies (e.g., Docker, Kubernetes).
  • Familiarity with machine learning frameworks (e.g., MLlib, TensorFlow).

Job Tags

Similar Jobs

ROMAN EXECUTIVE PROTECTION SERVICES

Funeral Escort Driver Job at ROMAN EXECUTIVE PROTECTION SERVICES

 ...Job Description Job Description Benefits: Flexible schedule Training & development Job Brief The Funeral Car Driver is responsible for providing compassionate and professional transportation services for grieving families and their loved ones. This... 

Aptino, Inc.

CSR / Customer Service / Chat Support / Fresher / Entry Level / Junior / Trainee / Email & Chat Support / Intern / Data Entry / Clerk / Admin / Associate / Assistant / Administrator / Call Center Job at Aptino, Inc.

 ...Role: Customer Care Representative / CSR - (Email & Chat Support) Location: Plano, TX "Full Time + Hybrid Job"(Fresher/ Experienced...  ...This hybrid role offers a mix of in-office collaboration and remote flexibility (3 days in office). Training is conducted in-office... 

Premier Services

Remote Life Insurance Agent Job at Premier Services

 ...Join our fast-growing, family-operated independent insurance agency as a Life Insurance Agent, where you can work from anywhere while making a meaningful impact in the lives of families. We are seeking motivated, purpose-driven professionals who are ready to take control... 

Trulieve

Brand Ambassador Job at Trulieve

 ...about our company, please visit our website; Requisition ID: 16785 Remote Work Available: No Job Title: Brand Ambassador Department: Wholesale Operations Position Location: Cincinnati, OH Travel: Up to 90% throughout Cincinatti/Dayton... 

Jackson Hewitt Inc.

In Office - Seasonal Entry Level Tax Preparer Position Job at Jackson Hewitt Inc.

Jackson Hewitt - EntryLevel Seasonal Tax PreparersNo experience needed! Whether you're looking for a side gig or the start of a new career, weve got you covered.BenefitsCompetitive salaryFlexible scheduleTraining & developmentWhat Youll DoInterview clients...