Data Engineer

Data Engineer Career Category Engineering Job Description Data Engineer : Job Description As a Data Engineer supporting data strategy , you will design, build, and maintain scalable data pipelines that integrate data from legal systems into Amgen’s enterprise data fabric . You will enable high-quality, governed datasets that support analytics, reporting, and emerging AI/ML use cases for Legal and Compliance teams. This role requires strong hands-on engineering skills, familiarity with modern data platforms (e.g., Databricks), and the ability to work closely with Legal stakeholders, Data Architects, and AI/Analytics teams. Key Responsibilities Data Engineering & Pipeline Development Build and optimize databricks pipelines using modern frameworks (Databricks, Spark) Implement reliable, scalable, and production-ready data pipelines using engineering best practices, monitoring, and automated validation frameworks Integrate structured and unstructured legal data into the enterprise data fabric Ensure reliability, scalability, and performance of data pipelines Databricks & Modern Data Platform Develop pipelines using Databricks (Delta Lake, Spark, notebooks) Implement data transformation and orchestration workflows Support migration and modernization of legacy data solutions to cloud-native platforms Contribute to reusable data engineering patterns and components Optimize Delta Lake and Spark workloads for scalable, cost-efficient, and high-performance enterprise data processing Data Quality, Governance & Compliance Implement data quality checks, validation rules, and monitoring Implement governance, lineage, and security controls for sensitive legal and compliance datasets Ensure compliance with data governance, privacy Collaboration & Delivery Work with Legal stakeholders to understand data needs and translate into technical solutions Partner with Data Architects to align with enterprise data fabric strategy Participate in Agile development processes (sprint planning, estimation, delivery) Document pipelines, models, and technical decisions Basic Qualifications Master's or Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field 5-8 years of experience in data engineering or related technical role Must-Have Technical Skills Strong experience with SQL and relational databases Programming experience in Python (required), PySpark preferred Hands-on experience with Databricks / Apache Spark Understanding of data modeling and data warehousing concepts Preferred / Strategic Skills (Aligned to Future Data Strategy) Certification: Relevant certifications in Databricks, cloud platforms (AWS/Azure/GCP), or modern data engineering technologies are a plus Experience with: Delta Lake / Lakehouse architectures Data Fabric / Data Mesh concepts Familiarity with: Streaming data (Kafka, event-driven pipelines) Data orchestration tools (Airflow, Databricks Workflows) Exposure to: AI/ML data pipelines and feature engineering Unstructured data processing Understanding of: Data governance frameworks and cataloging tools Security and privacy controls for sensitive data Functional Skills Strong problem-solving and analytical thinking Ability to work with large, complex datasets Effective communication with both technical and non-technical stakeholders Ability to operate in a fast-paced Agile environment . Experience Level Senior Level