ETL Developer (AbInitio) with Cloud

Title: ETL Developer (AbInitio) with Cloud
Pay Rate: Up to 100/hour on W2 (for the right candidate)
Location: Onsite in Riverwoods, IL – Must be onsite 3 days on site with flexibility to work 1 day in the Chicago downtown office
Duration: 6-12 Months
Visa: USC, GC

Must have: Ab Initio Apache Spark AWS DevOps, CI/CD NoSQL OCP, Kubernetes PySpark Python Programming Snowflake Data Warehouse SQL Teradata Unix, PL/SQl, Oracle, Rest API, Java, Linux,, Shell Scripting

Nice To Have: Agile Methodology AWS Certified Developer Associate Data Analysis Data Governance Enterprise Data Management JIRA Agile Tableau

Job Description – 8+ years’ experience:

• Proven experience and Strong knowledge in ETL/ELT Tools (On Prem- AbInitio)( Cloud- PySpark, Spark & Open source technologies)
• Cloud Tools and Databases (AWS, Snowflake)
• Other programming languages (Unix scripting, Python, etc.)
• Leverage CI/CD framework for data integration, Open Source
• Experience working in cloud platforms (AWS, GCP, Azure)
• Extensive experience in optimizing SQL both relational and nosql
• Develops and troubleshoots data integration solutions with complex data transformations and provides guidance to other team members
• Demonstrates strong technical aptitude across data engineering practices: o Utilizing variety of tools to profile, secure the data in transit and at rest; and to enforce data Governance Controls and Alerting o Designing advanced SQL queries o Leveraging metadata-driven framework for solutions o Developing test scripts for unit and integration testing
• Develops test methodologies for specific products
• Leads code review sessions and other process and operational improvement initiatives
• Exhibits fluency with use of supplemental tools and technologies involved in data integration (Unix/Linux, TWS/Control-M or alike)
• Works on holistic solutions, driving feature and story delivery (Agile)
• Identifies and effectively communicates upstream and downstream impacts for changes in the data pipeline
• Participates in the on-call rotation for support
• Demonstrates effective and clear communication in team and cross-functional meetings, and lead tech communities
• Builds strong collaborative working relationship both within the team and cross-functionally