Data engineer Job at ESolutions, Inc., Mountain View, CA

QTlzdnRnMjgzYzlOdlhlVitCRzFHakhzRVE9PQ==
  • ESolutions, Inc.
  • Mountain View, CA

Job Description

Role : AWS Data Engineer

Location : Mountain view CA Fully onsite

Must have : AWS , Terraform , Spark , python

JD :

The team will be working in one of the following areas:

Multi-cloud data exploration

Terraform infrastructure-as-code for managing AWS infrastructure and deep integration between enterprise tools (Starburst, Privacera, and Databricks) and Intuit services (LDAP, data decryption)

Testing user flows for data analysis, processing, and visualization with Python Spark notebooks and SQL running on distributed compute to join data between AWS S3 and Google Cloud Platform BigQuery

Developing data pipelines in Python Spark or SQL to push structured enterprise tool telemetry to our data lake

Fine-grained access control for data exploration

Terraform infrastructure-as-code for managing AWS infrastructure and deep integration between enterprise tools (Databricks and Privacera)

Evaluating Databricks capabilities to sync Hive, Glue, and Unity Catalogs

Evaluating Privacera capabilities or building new capabilities (AWS Lambda with Python) to sync Intuit access policies with Unity Catalog

Testing user flows for data analysis, processing, and visualization with Python Spark notebooks on distributed compute or Databricks' serverless SQL runtime

Responsibilities

Develop and implement operational capabilities, tools, and processes that enable highly available, scalable, and reliable customer experiences

Resolve defects/bugs during QA testing, pre-production, production, and post-release patches

Work cross-functionally with various Intuit teams including: product management, analysts, data scientists, and data infrastructure

Work with external enterprise support engineers from Databricks, Starburst, and Privacera to resolve integration questions and issues

Experience with Agile Development, SCRUM, or Extreme Programming methodologies

Qualifications

8+ year's experience designing and developing web, software, or mobile applications.

3+ year's experience building and operating cloud infrastructure solutions.

BS/MS in computer science or equivalent work experience.

Expertise with any of the following Object Oriented Languages (OOD): Java/J2EE, C#, VB.NET, Python, or sometimes C++. Java and Python preferred.

Expertise with AWS (IAM, VPC), Spark, and Terraform are preferred. Expertise with Databricks is a strong bonus.

Expertise with the entire Software Development Life Cycle (SDLC), including: system design, code review, unit/integration/performance testing, build and deploy automation

Operational excellence: minimizes costs and maximizes uptime

Excellent communication skills: demonstrated ability to explain complex technical topics in an engaging way to both technical and non-technical audiences, both written and verbally


AWS Data engineer1AWSN/AC2C,W-2,1099,C2H,Part Time,Full Time,Other,Intern,Seasonal,Contract,Permanent Full Time,Contract Only,Hourly,Salaried,Full Time W2,SubCon/C2C,SOLUTIONS,Contract to Perm,Sub-conUnited States

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Report this job
  • Dice Id: 10211255
  • Position Id: 2024-201407

Job Tags

Hourly pay, Permanent employment, Full time, Contract work, Part time, Work experience placement,

Similar Jobs

Get It - Marketing

Customer Relations Representative - State Farm Agent Team Member - Remote Job at Get It - Marketing

Position Overview Are you a friendly, customer-focused professional who enjoys connecting...  ...play a key part in providing exceptional service and offering personalized solutions to...  .... Additional Information This is a remote position that offers the flexibility to work... 

GAMURS Group

Operation Sports: Affiliate Writer (Contract) Job at GAMURS Group

 ...We're Hiring: Affiliate Writer (Freelance) at Operation Sports Operation Sports is the internet's premier destination for sports video game coveragewhere hardcore sports fans and sim gamers come together. Now, we're expanding our content strategy to include gear,... 

Uxdmurals

CREATIVE PRODUCER Job at Uxdmurals

CREATIVE PRODUCER01 OpeningType: Hybrid Contract | Location: Houston, TX**This is not a film, video, or TV production focused role**UXD is a growing creative studio + agency that's bringing together the most talented artists from around the world to create one... 

Family Dollar

STORE MANAGER Job at Family Dollar

Store Family DollarFamily Dollar wants you to join our team of, energetic, and hard-working associates and leaders! We are seeking **Full-Time Store Managers** for full time opportunities in a fast paced work environment!Work where you love to shop! Family Dollar is hiring... 

Six Flags

Hotel Housekeeping Attendant Job at Six Flags

Overview:**$18.25 / hour****Effectively cleans and maintains the hotel guest rooms on a daily basis. The goal of the position is to produce...  ..., and responding to the requests of team leaders. Completes deep clean projects (as assigned).+ Ensures that all assigned areas,...