Machine Learning Model Serving Patterns and Best Practices
A definitive guide to deploying, monitoring, and providing accessibility to ML models in production
Md Johirul Islam
BIRMINGHAM—MUMBAI
Machine Learning Model Serving Patterns and Best Practices
Copyright © 2022 Packt Publishing
All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.
Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author , nor Packt Publishing or its dealers and distributors, will be held liable for any damages caused or alleged to have been caused directly or indirectly by this book.
Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.
Group Product Manager: Ali Abidi
Publishing Product Manager: Ali Abidi
Senior Editor: Tiksha Lad
Technical Editor: Rahul Limbachiya
Copy Editor: Safis Editing
Project Coordinator: Aparna Ravikumar Nair
Proofreader: Safis Editing
Indexer: Pratik Shirodkar
Production Designer: Shyam Sundar Korumilli
Marketing Coordinator: Shifa Ansari
First published: December 2022
Production reference: 3060223
Published by Packt Publishing Ltd.
Livery Place
35 Livery Street
Birmingham
B3 2PB, UK.
ISBN 978-1-80324-990-2
Contributors
About the author
Md Johirul Islam is a data scientist and engineer at Amazon. He has a PhD in computer science and is also an adjunct professor at Purdue University. His expertise is focused on designing explainable, maintainable, and robust data science pipelines, applying software design principles, and helping organizations deploy machine learning models into production at scale.
About the reviewer
Quan V. Dang is a machine learning engineer with experience in various domains, including finance, e-commerce, and logistics. He started his professional career as a researcher at the University of Aizu, where he mainly worked on classical machine learning and evolutionary algorithms. After graduating from university, he shifted his focus to deploying AI products and managing machine learning infrastructure. He is also the founder of the MLOps VN community, with over 5,000 people discussing MLOps and machine learning engineering. In his free time, he often writes technical blogs, hangs out, and goes traveling.