New York Life Insurance Co
Lebanon, NJ, USA
Location Designation: Hybrid - 3 days per week Summary Build, expand, and optimize data pipeline architecture using Amazon Web Services cloud, Python and Pyspark. Utilize tools like Amazon Relational Database Service (AWS DMS), AWS Database Migration Service (AWS DMS), AWS Glue, Amazon Simple Storage Service (AWS S3), AWS Lambda triggers & functions, etc. Leverage Data Engineering strategies, Data Lake/Lakehouse/Data Warehouse technologies, and streaming/real-time data. Use SQL for data analysis. Proficient in other cloud technologies like databricks etc. Responsibilities • Design and develop enterprise infrastructure and platforms required for data engineering. • Use AWS Cloud technologies to support data needs for expansion of Machine Learning/Data Science capabilities, applications/mobile apps/systems, BI/analytics, and cross-functional teams. • Create methods and routines to transition data from on-premise systems to the AWS Cloud. • Store data in AWS Cloud...