Introduction to LLM

Total of 8 articles available. Currently on page 1 of 1.

1.3 Entropy and Information: Quantifying Uncertainty

A clear, intuitive exploration of entropy, information, and uncertainty in Large Language Models. Learn how information theory shapes next-token prediction, why entropy matters for creativity and coherence, and how cross-entropy connects probability to learning. This section concludes Chapter 1 and prepares readers for the conceptual foundations in Chapter 2.
2025-09-06

1.1 Getting Comfortable with Mathematical Notation

A clear and accessible guide to understanding the mathematical notation used in Large Language Models. Learn how tokens, sequences, functions, and conditional probability expressions form the foundation of LLM reasoning. This chapter prepares readers for probability, entropy, and information theory in later sections.
2025-09-04

4.4 How LLMs Write Code: The Rise of AI-Powered Programming Assistants

Explore how large language models (LLMs) generate and complete code from natural-language prompts, and what it means for the future of software development.
2024-09-27

2.0 The Basics of Large Language Models (LLMs): Transformer Architecture and Key Models

Learn about the foundational elements of Large Language Models (LLMs), including the transformer architecture and attention mechanism. Explore key LLMs like BERT, GPT, and T5, and their applications in NLP.
2024-09-06

1.3 Differences Between Large Language Models (LLMs) and Traditional Machine Learning

Understand the key differences between Large Language Models (LLMs) and traditional machine learning models. Explore how LLMs utilize transformer architecture, offer scalability, and leverage transfer learning for versatile NLP tasks.
2024-09-05

1.2 The Role of Large Language Models (LLMs) in Natural Language Processing (NLP)

Discover the impact of Large Language Models (LLMs) on natural language processing tasks. Learn how LLMs excel in text generation, question answering, translation, summarization, and even code generation.
2024-09-04

1.0 What is an LLM? A Guide to Large Language Models in NLP

Discover the basics of Large Language Models (LLMs) in natural language processing (NLP). Learn how LLMs like GPT and BERT are trained, their roles, and how they differ from traditional machine learning models.
2024-09-02

A Guide to LLMs (Large Language Models): Understanding the Foundations of Generative AI

Learn about large language models (LLMs), including GPT, BERT, and T5, their functionality, training processes, and practical applications in NLP. This guide provides insights for engineers interested in leveraging LLMs in various fields.
2024-09-01

Category

Tags

Search History

Authors

SHO

CTO of Receipt Roller Inc., he builds innovative AI solutions and writes to make large language models more understandable, sharing both practical uses and behind-the-scenes insights.