Big Data Engineer
Intel Corporation
Kulim, Malaysia
Job posting number: #7289654 (Ref:JR0268084)
Posted: October 27, 2024
Job Description
Job Description
Job Description:The Intel Foundry Manufacturing and Supply chain FMSC Automation team is looking for a highly motivated Big Data Engineer with strong data engineering skills for data integration of various manufacturing data. You will be responsible for engaging with customers and driving development from ideation to deployment and beyond. This position is a technical role that requires the direct design and development of robust, scalable, performant systems for world-class manufacturing data engineering.
Responsibilities include:
� Create and maintain optimal data architecture
� Assemble large, complex data sets that meet functional and non-functional business requirements
� Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
� Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
� Work with stakeholders including the users, cross functional teams to assist with data-related technical issues and support their data infrastructure needs.
� Standard process to keep data secure with right access and authorization
� Focus on automated testing and robust monitoring
The ideal candidate must exhibit the following behavioral traits:
� Excellent problem solving and interpersonal communication skills
� Strong desire to learn and share knowledge with others.
� Be inquisitive, innovative, and a team player with a strong focus on quality workmanship.
� Troubleshooting skills and root cause analysis for performance issues
� Ability to lean, adopt and implement new skills to drive innovation and excellence.
� Ability to work with cross functional teams in dynamic environment
Qualifications
Minimum Qualifications:
� A bachelor's with 5+ years of experience in CS/CE or a related field
� Experience building and optimizing big data pipelines
� Experience with skills pf handling unstructured data
� Experience with data transformations, structures, metadata, workload management
� Experience with big data tools: Spark, Kafka, NIFI, etc.
� Experience with at least programming languages: Python, C#, .NET
� Experience with relational SQL and NOSQL DBs
� Experience in leveraging open-source packages
� Experience in cloud native skills such as Docker, Kubernetes, Rancher etc.
Good to have skills:
� Experience with semiconductor manufacturing
� Experience of data engineering on cloud
� Experience in developing AI/ML Solutions