Data Engineer
University of Michigan
Ann Arbor, MI
Job posting number: #7289769
Posted: October 28, 2024
Application Deadline: Open Until Filled
Job Description
Job SummaryThe University of Michigan is providing public health data analysis and visualization platforms for use by the public and local health officials. These projects support vaccine outreach and education efforts and tracking the extent and effect of COVID-19 in Michigan. Continued support of these projects will require a substantial amount of experienced data engineering work.
By developing data systems on a series of salient COVID-19 technologies in collaboration with the Michigan Department of Health and Human Services, the data engineer will develop our highest priority cloud-based features and contribute to a team providing essential technologies to major partners.
Reporting to the leads of the MDHHS-UM collaboration for pandemic and public health response technologies, you will work with diverse teams, including public health officials, data scientists, and IT personnel, to manage large-scale datasets, create meaningful insights, and ensure secure and efficient data access. You will also conduct work transitioning existing platforms to more scalable and efficient technologies such as DataFusion and Polars. Knowledge of public health principles is necessary for this role, as it directly impacts the interpretation and transformation of health-related data.
Who We Are
The School of Information is a progressive, interdisciplinary professional school that offers five academic programs. UMSI delivers innovative, elegant and ethical solutions connecting people, information and technology. The school was one of the first iSchools in the nation and is the premier institution studying and using technology to improve human computer interactions. Our school mission is to create and share knowledge so that people will use information - with technology - to build a better world.
Why Work at Michigan?
In addition to a career filled with purpose and opportunity, the University of Michigan offers a comprehensive benefits package to help you stay well, protect yourself and your family and plan for a secure future. Benefits include:
Generous time off (Vacation, Holidays, Season Days, Family Leave)
A retirement plan that provides two-for-one matching contributions after 12 months of eligible service, with immediate vesting
Many choices for comprehensive health insurance
Dental and vision insurance
Life insurance
Long-term disability coverage
Flexible spending accounts for healthcare and dependent care expenses
Tuition support program
Responsibilities*
Design and implement secure data pipelines to ingest and manage large datasets from state databases, ensuring high availability, minimal downtime, and smooth data flow.
Use Amazon Web Services (such as S3, Lambda, and others) for scalable data storage, processing, and management.
Write code using Rust and Python for secure data processing.
Build a backend infrastructure to ensure secure, efficient access to transformed vaccination data, supporting multiple data retrieval and analysis needs.
Collaborate with diverse teams, including public health officials, data scientists, and IT, to understand project requirements and create tailored solutions that address specific needs.
Required Qualifications*
Bachelor's degree in Computer Science.
Minor in Business is required.
Proficiency in AWS, Python, and Rust.
3 to 5 years experience building data pipelines, APIs, and backend services.
Must have knowledge of public health principles.
Familiarity with Extract, Transform, and Load processes, data validation, and transformation techniques.