data engineer.
malvern , pennsylvania
posted today
job detailssummary
$55 - $57 per hour
contract
no requirements
category computer and mathematical occupations
reference1072028
job detailsjob summary:Role Summary:The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.Key Responsibilities:Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.Collaborate with the Data Architect to implement data models and ensure data integrity.Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.Monitor and optimize data processing workflows, ensuring efficient resource usage.Skills and Qualifications:Bachelor's degree in Computer Science, Engineering, or related field.7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.strong skills in SQL and data pipeline development.Experience leading data engineering teams and optimizing ETL workflows.location: Malvern, Pennsylvaniajob type: Contractsalary: $55 - 57 per hourwork hours: 8am to 4pmeducation: No Degree Requiredresponsibilities:Role Summary:The Data Engineer will be responsible for building and maintaining the data pipelines that process data from CSV files through various transformation stages, following the Architect's data model designs. This role requires hands-on experience with data transformations, working with large datasets, and implementing robust ETL processes within AWS.Key Responsibilities:Develop ETL pipelines to process and transform data across bronze, silver, and gold layers.Implement data cleansing, validation, and transformation processes to support analytics-ready datasets.Collaborate with the Sr. Data Engineer and Data Architect to ensure alignment with data models.Optimize data workflows to improve processing times and resource utilization.Skills and Qualifications:Bachelor's degree in Data Engineering, Computer Science, or related field.3-5 years of experience in data engineering, preferably within AWS environments.Proficiency in PySpark, SQL, AWS Glue, and S3.Strong problem-solving skills and attention to detail.qualifications:
Experience level: Experienced
Minimum 5 years of experience
Education: No Degree Required
skills:
Data Analysis
Data WarehouseEqual Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact [email protected] offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).This posting is open for thirty (30) days.