Neural Magic is an early-stage AI software company democratizing high performance for deep learning models. Our goal is to reduce the cost and increase the performance of end-users deploying deep learning applications. Based on decades of research at MIT, Neural Magic has developed a software platform that allows developers to sparsify deep learning models to minimize footprint and run on CPUs at GPU speeds. Please look through our website and GitHub repos to get a feel of what we are about.

Founded by an award-winning team of computer scientists and researchers out of MIT, we are a venture-backed company headquartered in Davis Square, Somerville, MA. Our investors include Amdocs, Andreessen Horowitz, Comcast Ventures, NEA, and Pillar VC.

We are seeking an ML Ops engineer to work closely with our product and research teams to scale SOTA deep learning products and software. As an ML Ops engineer, you will work closely with our technical and research teams to manage training and deployment pipelines, create DevOps and CI/CD infrastructure, and scale our current technology stack. If you are someone who wants to contribute to solving challenging technical problems at the forefront of deep learning, this is the role for you!


-Use your understanding of ML Ops to tackle meaningful technical problems
-Collaborate with research and product development teams to scale machine learning products for internal and external applications
-Create and manage training and deployment pipelines
-Test software to ensure responsiveness and efficiency
-Troubleshoot, debug and upgrade DevOps pipelines
-Collaborate with a cross-functional team about market requirements and best practices
-Keep abreast of the latest technologies and standards in the field

-Proven experience as an ML Ops engineer or similar role (1+ years)
-Solid knowledge of ML Ops fundamentals with experience in training and deployment pipelines for deep learning workflows
-Proficiency with container and scaling solutions (e.g. Docker, Kubernetes, ECS)
-Proficiency with CI/CD and general DevOps technologies and solutions
-Strong programming skills with proven experience implementing Python-based machine learning solutions
-Creative, collaborative, and innovation-focused
-Strong sense of project ownership and personal responsibility
-Bachelor’s in Computer Science, Mathematics or similar field

-Health Care Plan (Medical, Dental & Vision)
-Retirement Plan (401k, IRA)
-Paid Time Off (Vacation, Sick & Public Holidays)
-Family Leave (Maternity, Paternity)
-Short Term & Long Term Disability
-Training & Development
-Work From Home
-Free Food & Snacks
-Wellness Resources
-Stock Option Plan

We are an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.