Description
- Develop and maintain ETL pipelines to support data processing, analytics and visualization needs.
- Analyze large, complex data sets to identify patterns, trends, and insights.
- Collaborate with cross-functional teams to understand business requirements and provide data-driven solutions.
- Manage multiple disparate data sources and integrate them into a cohesive data platform and dashboards.
- Develop and implement validation processes to ensure data accuracy and consistency.
- Utilize pyspark, spark, sql, and Databricks to optimize data processing and querying performance.
- Design and implement scalable, fault-tolerant data processing systems in Amazon Web Services
- Work independently and be comfortable walking through code with the team lead
- Document all processes, code, and work, as well as be willing to ask questions and raise issues when roadblocks are encountered.
Requirements:
- Bachelor's or Master's degree in Computer Science, Data Science, or related field
- At least 5 years of experience in data science or related field
- Strong proficiency in python, ETL, pyspark, spark, and sql
- Experience with Amazon Web Services, specifically with data processing services such as S3, EC2, Lambda, and Glue
- Experience in Databricks for data processing and analysis
- Experience in data visualization tools such as Tableau
- Experience in Machine Learning is an added plus
- Strong problem-solving skills and attention to detail
- Ability to work independently and in a team environment
- Excellent written and verbal communication skills
- Strong documentation processes and ability to maintain code
- Flexible with night shifts
- Develop and maintain ETL pipelines to support data processing, analytics and visualization needs.
- Analyze large, complex data sets to identify patterns, trends, and insights.
- Collaborate with cross-functional teams to understand business requirements and provide data-driven solutions.
- Manage multiple disparate data sources and integrate them into a cohesive data platform and dashboards.
- Develop and implement validation processes to ensure data accuracy and consistency.
- Utilize pyspark, spark, sql, and Databricks to optimize data processing and querying performance.
- Design and implement scalable, fault-tolerant data processing systems in Amazon Web Services
- Work independently and be comfortable walking through code with the team lead
- Document all processes, code, and work, as well as be willing to ask questions and raise issues when roadblocks are encountered.
Requirements:
- Bachelor's or Master's degree in Computer Science, Data Science, or related field
- At least 5 years of experience in data science or related field
- Strong proficiency in python, ETL, pyspark, spark, and sql
- Experience with Amazon Web Services, specifically with data processing services such as S3, EC2, Lambda, and Glue
- Experience in Databricks for data processing and analysis
- Experience in data visualization tools such as Tableau
- Experience in Machine Learning is an added plus
- Strong problem-solving skills and attention to detail
- Ability to work independently and in a team environment
- Excellent written and verbal communication skills
- Strong documentation processes and ability to maintain code
- Flexible with night shifts
Diversity, Equity, Inclusion & Equal Employment Opportunity at ADP: ADP affirms that inequality is detrimental to our associates, our clients, and the communities we serve. Our goal is to impact lasting change through our actions. Together, we unite for equality and equity. ADP is committed to equal employment opportunities regardless of any protected characteristic, including race, color, genetic information, creed, national origin, religion, sex, affectional or sexual orientation, gender identity or expression, lawful alien status, ancestry, age, marital status, or protected veteran status and will not discriminate against anyone on the basis of a disability. We support an inclusive workplace where associates excel based on personal merit, qualifications, experience, ability, and job performance.
Ethics at ADP: ADP has a long, proud history of conducting business with the highest ethical standards and full compliance with all applicable laws. We also expect our people to uphold our values with the highest level of integrity and behave in a manner that fosters an honest and respectful workplace. Click https://jobs.adp.com/life-at-adp/ to learn more about ADP’s culture and our full set of values.