Pretrain Vision and Large Language Models in Python
End-to-end techniques for building and deploying foundation models on AWS
Delivery estimate
Please enter a valid 4-digit Australian postcode.
to ·
Delivery estimate
Please enter a valid 4-digit Australian postcode.
to ·
Pretrain Vision and Large Language Models in Python
Description
Master the art of training vision and large language models with conceptual fundaments and industry-expert guidance. Learn about AWS services and design patterns, with relevant coding examples
Key Features:
- Learn to develop, train, tune, and apply foundation models with optimized end-to-end pipelines.
- Explore large-scale distributed training for models and datasets with AWS and SageMaker examples.
- Evaluate, deploy, and operationalize your custom models with bias detection and pipeline monitoring.
Book Description:
Foundation models have forever changed machine learning. From BERT to ChatGPT, CLIP to Stable Diffusion, when billions of parameters are combined with large datasets and hundreds to thousands of GPUs, the result is nothing short of record-breaking. The recommendations, advice, and code samples in this book will help you pretrain and fine-tune your own foundation models from scratch on AWS and Amazon SageMaker, while applying them to hundreds of use cases across your organization.
With advice from seasoned AWS and machine learning expert Emily Webber, this book helps you learn everything you need to go from project ideation to dataset preparation, training, evaluation, and deployment for large language, vision, and multimodal models. With step-by-step explanations of essential concepts and practical examples, you'll go from mastering the concept of pretraining to preparing your dataset and model, configuring your environment, training, fine-tuning, evaluating, deploying, and optimizing your foundation models.
You will learn how to apply the scaling laws to distributing your model and dataset over multiple GPUs, remove bias, achieve high throughput, and build deployment pipelines.
By the end of this book, you'll be well equipped to embark on your own project to pretrain and fine-tune the foundation models of the future.
What You Will Learn:
- Find the right use cases and datasets for pretraining and fine-tuning
- Prepare for large-scale training with custom accelerators and GPUs
- Configure environments on AWS and SageMaker to maximize performance
- Select hyperparameters based on your model and constraints
- Distribute your model and dataset using many types of parallelism
- Avoid pitfalls with job restarts, intermittent health checks, and more
- Evaluate your model with quantitative and qualitative insights
- Deploy your models with runtime improvements and monitoring pipelines
Who this book is for:
If you're a machine learning researcher or enthusiast who wants to start a foundation modelling project, this book is for you. Applied scientists, data scientists, machine learning engineers, solution architects, product managers, and students will all benefit from this book. Intermediate Python is a must, along with introductory concepts of cloud computing. A strong understanding of deep learning fundamentals is needed, while advanced topics will be explained. The content covers advanced machine learning and cloud techniques, explaining them in an actionable, easy-to-understand way.
Shipping & Processing
This item is in stock with our supplier and usually ships within 3–5 business days.
Processing times
- In stock: Items marked “In Stock” are on our shelves. We pick, pack and ship them within 1–2 business days.
- In stock with our supplier: Items not marked “In Stock” are held by one of our Australian or overseas suppliers. We order them in for you and they usually dispatch within 2–5 business days (3–5 for some suppliers). The estimate next to the price is for this item.
- Special orders: Some supplier items, such as specialist and imported items, titles awaiting reprint and print-on-demand titles, take longer to arrive. If your order includes one, we’ll update you as soon as we hear from our supplier.
- Supplier delays: Occasionally a supplier is delayed, or their stock information turns out to be inaccurate. We’ll keep your order open for up to 60 days. If an item hasn’t shipped or isn’t on its way to us by then, we’ll cancel that item and refund it.
How accurate is availability?
Availability is based on the stock levels our suppliers tell us they hold, and we update it regularly. If a supplier issue affects your order, we’ll let you know with an updated estimate.
Delivery
- As soon as your order ships you’ll get an email with tracking.
- Australia Post usually delivers within 2–10 business days of shipping (around 4 in metro areas and around 6 in regional areas).
- If your order has more than one item, we hold the in-stock items until everything is ready, so we can ship your whole order together in one parcel.
- Shipping cost: Free on orders over $100 within Australia, otherwise $9.95 flat rate per order however many items you buy. Free shipping applies to Australian addresses only; delivery to New Zealand is $14.95 per order.
- Check your address: If an order goes to an incorrect address you gave us, or isn’t collected and Australia Post returns it to us, you’ll need to pay the postage to send it again.
Cancellations
Need to change or cancel an order? Contact us as soon as possible at contact@bookloop.com.au or through our contact page.
- Within 30 minutes: You can change or cancel your order for a full refund within 30 minutes of placing it.
- After 30 minutes: Your order is already being processed, so it can no longer be changed or cancelled. If we can accept a late cancellation, we may offer store credit instead of a refund.
- Items in transit: Once an item is on its way, either from our supplier to us or from us to you, it can’t be cancelled. If you no longer want it once it arrives, you can return it as a change of mind, with return postage at your cost. See Returns.
- Separate orders can’t be combined once they’ve been placed, and adding or swapping items can change the delivery estimate.
- Supplier delays: Occasionally a supplier is delayed, or their stock information turns out to be inaccurate. We’ll keep your order open for up to 60 days. If an item hasn’t shipped or isn’t on its way to us by then, we’ll cancel that item and refund it.
Faulty or damaged items are always covered. See Returns.
Returns
Damaged or incorrect items (within 30 days)
If an item arrives damaged or isn’t what you ordered, contact us within 30 days of delivery. We may ask for a photo, and if we need the item back we’ll send a prepaid return label, so it costs you nothing. You’ll receive a replacement or refund, as guaranteed under the Australian Consumer Law.
Change of mind (within 30 days)
We offer a refund or store credit for change of mind within 30 days of purchase when:
- you have your proof of purchase;
- the item is unused and in its original condition and packaging;
- it isn’t a sale item, special order, custom item or gift voucher.
You pay the postage to return change-of-mind items. Change-of-mind returns aren’t available for print-on-demand titles or bulk orders with special pricing.
Returned to sender
If an order is sent to an incorrect address you gave us, or isn’t collected and Australia Post returns it to us, you’ll need to pay the postage to send it again.