Role : AWS Data Engineer
Location : Mountain view CA Fully onsite
Must have : AWS , Terraform , Spark , python
JD :
The team will be working in one of the following areas:
Multi-cloud data exploration
Terraform infrastructure-as-code for managing AWS infrastructure and deep integration between enterprise tools (Starburst, Privacera, and Databricks) and Intuit services (LDAP, data decryption)
Testing user flows for data analysis, processing, and visualization with Python Spark notebooks and SQL running on distributed compute to join data between AWS S3 and Google Cloud Platform BigQuery
Developing data pipelines in Python Spark or SQL to push structured enterprise tool telemetry to our data lake
Fine-grained access control for data exploration
Terraform infrastructure-as-code for managing AWS infrastructure and deep integration between enterprise tools (Databricks and Privacera)
Evaluating Databricks capabilities to sync Hive, Glue, and Unity Catalogs
Evaluating Privacera capabilities or building new capabilities (AWS Lambda with Python) to sync Intuit access policies with Unity Catalog
Testing user flows for data analysis, processing, and visualization with Python Spark notebooks on distributed compute or Databricks' serverless SQL runtime
Responsibilities
Develop and implement operational capabilities, tools, and processes that enable highly available, scalable, and reliable customer experiences
Resolve defects/bugs during QA testing, pre-production, production, and post-release patches
Work cross-functionally with various Intuit teams including: product management, analysts, data scientists, and data infrastructure
Work with external enterprise support engineers from Databricks, Starburst, and Privacera to resolve integration questions and issues
Experience with Agile Development, SCRUM, or Extreme Programming methodologies
Qualifications
8+ year's experience designing and developing web, software, or mobile applications.
3+ year's experience building and operating cloud infrastructure solutions.
BS/MS in computer science or equivalent work experience.
Expertise with any of the following Object Oriented Languages (OOD): Java/J2EE, C#, VB.NET, Python, or sometimes C++. Java and Python preferred.
Expertise with AWS (IAM, VPC), Spark, and Terraform are preferred. Expertise with Databricks is a strong bonus.
Expertise with the entire Software Development Life Cycle (SDLC), including: system design, code review, unit/integration/performance testing, build and deploy automation
Operational excellence: minimizes costs and maximizes uptime
Excellent communication skills: demonstrated ability to explain complex technical topics in an engaging way to both technical and non-technical audiences, both written and verbally
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this jobSIGNING BONUS PAID DURING FIRST YEAR OF EMPLOYMENT!Expanding disaster Restoration company is Seeking experienced drywall finishers and painters. Applicants must be professional at drywall finishing and be able to complete the task timely. At least 3 to 5 years...
...perform these essential functions. Conducting Adjunctive Therapy assessments to document history and identify preliminary issues... ...equivalent discipline) Masters Degree in relevant field (e.g. art therapy, dance/movement therapy, drama therapy) Bachelors...
...accommodation at any step in our recruitment process, you are encouraged to contact (***) ***-**** (TTY/TTD: 711), or email ada.coordinator@dhr.idaho.gov . Preference may be given to veterans who qualify under state and federal laws and regulations. To apply, visit...
...Brite Star Uniforms is seeking a HR Associate / Recruiter to join our growing team. Job Description : The HR Associate / Recruiter will be responsible for the end-to-end recruiting process along with various other HR and office related tasks. As an HR Associate /...
...Occupational Therapist (OT) Home Health Aveannas highly skilled pediatric therapy team provides our patients a full range of care to help them make the most of their care or recovery. We offer our industry-leading pediatric therapy for kids of all ages in multiple...