Building a Large Language Model From Scratch

Embark on a comprehensive journey to master the art of constructing large language models from the ground up.

Expert

Created by Ram Niwas Sangwan Last Updated 31/12/2024 21:43

₹45,000.00 ₹50,000.00 10.00% off

What's Included

  • 40 Lectures
  • Access on tablet and phone
  • Certificate of completion

What you'll learn

  • Fundamental principles of large language models (LLMs) and their architecture.
  • Step-by-step guidance in coding and developing LLMs from scratch.
  • Deep understanding of attention mechanisms within GPT models.
  • Techniques for pre-training LLMs on unlabeled data.
  • Methods for finetuning LLMs for text classification purposes.
  • Advanced finetuning strategies to make models capable of instruction-following.
  • Utilization of pretrained model weights for various applications.
  • Hands-on experience with coding exercises, examples, and diagrams.
  • Practical knowledge of running LLMs on conventional hardware with GPU support.

Course Curriculum

Expand all Collapse all

41 Lectures

00:00

Introduction to Large Language Models 1 Lectures

Introduction to Large Language Models

Requirements

  • Basic understanding of programming concepts.
  • Familiarity with the Python programming language.
  • Prior experience in machine learning is beneficial but not mandatory.
  • Access to a laptop or computer with internet connectivity.
  • Willingness to install required Python packages and libraries.
  • Curiosity and interest in learning about large language models and AI.

Description

Embark on a comprehensive journey to master the art of constructing large language models from the ground up. This course provides an in-depth exploration into the inner workings of GPT-like language models, guiding you through each developmental stage with precision and clarity.

By enrolling, participants will gain hands-on experience in developing, pretraining, and finetuning a functional language model tailored for educational use. The techniques and approaches mirrored in this curriculum are reminiscent of those employed in the creation of large-scale foundational models, including those pivotal to innovations like ChatGPT. Additionally, learners will have access to scripts for loading pretrained model weights, facilitating finetuning tasks.

Instructors

RN

(4.45)

20 Courses

196 Students

2901 Reviews

Ram Niwas Sangwan
I have spent 30 years in IT Industry as an Educationist. I have been a software developer/corporate trainer and an information systems specialist with a record of developing and supporting solutions incorporating a wide range of applications. I have an entrepreneurial-mindset and a track record of success in recognizing opportunities spanning more than 26 years. Developing innovative and creative approaches, I have trained top level executives of companies driving revenue growth and enhancing long-term profitability. I have been motivating my team to ensure project success and on-time delivery. I, have time and again proven my ability at managing multiple priorities in fast-paced environments.
Businessman Leading a team of Professionals in the Area of Software Development with more than 1200 Satisfied Client. Currently I am managing www.theskillpedia.com and www.skillpedia.ai