Leanpub Header

Skip to main content

Linear and Nonlinear Regression in Artificial Intelligenc VOL-1

Mathematical Foundations, Regularization Techniques & Predictive Modeling

This book is 100% completeLast updated on 2026-06-03

Every intelligent prediction begins with a simple question:

Can we model the relationship between data and outcomes?

Regression is the foundation upon which modern predictive analytics, machine learning systems, and countless AI applications are built.

From linear regression and regularization techniques to neural network regression, Gaussian processes, explainable AI, and real-world predictive systems, this book provides a complete roadmap for understanding how machines learn to predict.

In Linear and Nonlinear Regression in Artificial Intelligence, Anshuman Mishra combines mathematical rigor, practical implementation, and real-world applications to help readers master one of the most powerful tools in Artificial Intelligence.

Discover the mathematics behind prediction—and the science behind intelligent decision-making.

Minimum price

$9.99

$19.99

You pay

Author earns

$
PDF
EPUB
About

About

About the Book

Linear and Nonlinear Regression in Artificial Intelligence

Mathematical Foundations, Regularization Techniques & Predictive Modeling (Vol-I)

Artificial Intelligence is fundamentally about learning patterns from data and transforming those patterns into actionable predictions. Among the many techniques that power modern AI systems, regression remains one of the most influential, versatile, and widely used methodologies.

From predicting housing prices and financial risks to estimating medical outcomes, forecasting energy demand, understanding customer behavior, and optimizing intelligent systems, regression models form the backbone of predictive analytics and machine learning.

Linear and Nonlinear Regression in Artificial Intelligence: Mathematical Foundations, Regularization Techniques & Predictive Modeling (Vol-I) is a comprehensive guide that takes readers from the mathematical foundations of regression to advanced machine learning models used in contemporary AI applications.

Unlike traditional statistics textbooks that focus primarily on theory, or machine learning books that emphasize implementation without sufficient mathematical depth, this volume bridges both worlds. It combines rigorous mathematical explanations with practical machine learning techniques, algorithmic insights, and real-world AI applications.

Readers will explore:

• Mathematical Foundations of Regression Modeling

• Linear Algebra, Optimization, and Statistical Learning

• Probability Theory and Bayesian Concepts

• Simple and Multiple Linear Regression

• Least Squares Estimation and Gradient Descent

• Regularization Techniques (Ridge, Lasso, Elastic Net)

• Polynomial and Nonlinear Regression Models

• Logistic Regression and Classification

• Generalized Linear Models (GLMs)

• Decision Tree Regression and Ensemble Methods

• Support Vector Regression (SVR)

• Neural Network-Based Regression Models

• Bayesian Regression and Gaussian Processes

• Large-Scale Regression for Big Data Systems

• Explainable AI and Regression Interpretability

• End-to-End Regression Projects using Python

This book emphasizes both theoretical understanding and practical implementation. Each concept is supported by mathematical derivations, intuitive explanations, worked examples, case studies, and industry-oriented applications.

Whether the goal is academic learning, research exploration, interview preparation, or professional AI development, this book provides a complete framework for mastering regression-based predictive modeling.

Who Should Read This Book?

• BCA, MCA, B.Tech, M.Tech and Computer Science Students

• Artificial Intelligence and Machine Learning Learners

• Data Scientists and Analytics Professionals

• Researchers and PhD Scholars

• Software Engineers and AI Developers

• Business Intelligence and Predictive Analytics Professionals

• UGC-NET, GATE and Technical Interview Aspirants

• Anyone seeking a strong foundation in predictive modeling

What Makes This Book Unique?

✔ Combines mathematics, statistics, machine learning, and AI in one unified framework

✔ Covers both linear and advanced nonlinear regression methods

✔ Includes modern ensemble, kernel, neural network, and Bayesian approaches

✔ Emphasizes model explainability and ethical AI practices

✔ Provides practical Python implementations and industry case studies

✔ Suitable for both academic and professional learning

This volume serves as both a university-level textbook and a professional reference guide for understanding how regression powers intelligent decision-making systems across modern Artificial Intelligence.

Bundle

Bundles that include this book

Author

About the Author

Anshuman Mishra

Anshuman Kumar Mishra, M.Tech (Computer Science) Assistant Professor, Doranda College, Ranchi University

Prolific Author of 50+ Books on AI, Machine Learning & Computer Science | 20+ Years Experience

Anshuman Kumar Mishra is a dedicated educator, researcher, and highly prolific author with over 20 years of experience in Computer Science and Information Technology. Holding an M.Tech in Computer Science from BIT Mesra, he brings a rare combination of academic depth and practical teaching expertise.

Currently serving as Assistant Professor at Doranda College under Ranchi University, he has mentored thousands of students, helping them build strong foundations in programming, data science, and artificial intelligence. His student-centric teaching style emphasizes conceptual clarity, hands-on practice, and real-world application.

Anshuman is a prolific author with more than 50 books published across a wide spectrum of computer science and emerging technology domains. From foundational programming languages to advanced topics in Artificial Intelligence, Machine Learning, Reinforcement Learning, Decision Theory, and Computer Vision — his books are widely appreciated by students, educators, and professionals for their clear explanations, strong theoretical foundation, and practical approach.

His extensive body of work reflects his deep commitment to making complex subjects accessible and meaningful for learners at all levels. He is particularly recognized for creating well-structured learning paths that help readers progress from beginner to advanced levels with confidence.

Driven by the mission to democratize quality technical education, Anshuman continues to write and update books that bridge the gap between academic theory and industry practice.

When not teaching or writing, he actively follows and explores new developments in AI, Quantum Machine Learning, and Ethical Intelligence systems.

Contents

Table of Contents

Book Title Linear and Nonlinear Regression in Artificial Intelligence: Mathematical Foundations, Regularization Techniques & Predictive Modeling VOL-1 ________________________________________ Table of Contents ________________________________________ Unit–I: Foundations of Regression & Mathematical Concepts Chapter 1: Introduction to Regression in AI 1-26 1.1 What Is Regression? 1.2 Role of Regression in Machine Learning & AI 1.3 Types of Regression Models 1.4 Supervised Learning and Predictive Analytics 1.5 Differences Between Parameteric & Non-Parametric Regression Chapter 2: Essential Mathematical Foundations 27-49 2.1 Functions, Vectors, Matrices and Notations 2.2 Matrix Algebra for Regression 2.3 Norms, Metrics & Distances 2.4 Rank, Inverses & Determinants 2.5 Eigenvalues, Eigenvectors & SVD in Regression 2.6 Vector Calculus—Gradient, Jacobian, Hessian 2.7 Optimization Basics for Regression Models Chapter 3: Probability & Statistics for Regression 50-76 3.1 Random Variables, Distributions & Density Functions 3.2 Expectation, Variance, Covariance 3.3 Sampling & Estimation Theory 3.4 Bias–Variance Tradeoff 3.5 Maximum Likelihood Estimation (MLE) 3.6 Bayesian Modeling Concepts ________________________________________ Unit–II: Linear Regression Models Chapter 4: Simple Linear Regression (SLR) 77-106 4.1 Model Formulation 4.2 Least Squares Estimation 4.3 Analytical Solution vs. Gradient Descent 4.4 Statistical Properties: R², Adjusted R² 4.5 Confidence Intervals & Hypothesis Testing 4.6 Practical Examples in Python Chapter 5: Multiple Linear Regression (MLR) 107-138 5.1 Multivariate Model Formulation 5.2 Correlation & Multicollinearity 5.3 Variance Inflation Factor (VIF) 5.4 Model Diagnostics & Residual Analysis 5.5 Interaction Terms and Polynomial Features 5.6 Case Studies Chapter 6: Regularization in Linear Models 139-168 6.1 Need for Regularization 6.2 Ridge Regression (L2) 6.3 Lasso Regression (L1) 6.4 Elastic Net Regression 6.5 Feature Selection using L1 6.6 Cross-Validation 6.7 Comparison and Practical Use-Cases ________________________________________ Unit–III: Nonlinear Regression Models Chapter 7: Polynomial & Basis Expansion Regression 169-196 7.1 Polynomial Regression 7.2 Overfitting & Underfitting 7.3 Bias–Variance Effects 7.4 Kernel Trick Basics 7.5 Fourier & Wavelet Bases Chapter 8: Logistic Regression for Classification 197-228 8.1 Logistic Function & Odds 8.2 Maximum Likelihood in Logistic Regression 8.3 Multiclass Logistic Regression 8.4 Regularized Logistic Models 8.5 Applications in NLP, Fraud Detection, Medical AI Chapter 9: Generalized Linear Models (GLM) 229-259 9.1 Exponential Family 9.2 Link Functions 9.3 Poisson & Gamma Regression 9.4 Logistic vs. Probit Model 9.5 GLM in Real-World AI Systems ________________________________________ Unit–IV: Advanced Nonlinear Regression in AI Chapter 10: Decision Tree Regression & Ensemble Models 260-289 10.1 CART for Regression 10.2 Random Forest Regressor 10.3 Gradient Boosting Regression 10.4 XGBoost, LightGBM, CatBoost 10.5 Hyperparameter Tuning Chapter 11: Support Vector Regression (SVR) 11.1 Linear SVR 11.2 Kernel SVR (RBF, Polynomial, Sigmoid) 11.3 Epsilon-Insensitive Loss Function 11.4 Practical Examples Chapter 12: Neural Network Regression Models 12.1 Linear Unit & Perceptron 12.2 MLP Regression 12.3 Activation Functions 12.4 Backpropagation Mathematics 12.5 Deep Learning Models for Regression 12.6 Dropout & Regularization ________________________________________ Unit–V: Probabilistic, Bayesian, and Modern Regression Models Chapter 13: Bayesian Regression 13.1 Priors & Posterior 13.2 Bayesian Linear Regression 13.3 MAP vs. MLE 13.4 Bayesian Ridge & Lasso 13.5 Hierarchical Bayesian Models Chapter 14: Gaussian Process Regression (GPR) 14.1 Kernel Functions 14.2 Covariance Matrices 14.3 Predictions with Uncertainty 14.4 GPR in Optimization & Robotics ________________________________________ Unit–VI: Regression in Real-World AI & Big Data Systems Chapter 15: Regression with Large Datasets 15.1 Stochastic Gradient Descent (SGD) 15.2 Mini-Batch Optimization 15.3 Online Learning 15.4 Distributed Regression using Spark ML Chapter 16: Explainability in Regression Models 16.1 SHAP & LIME 16.2 Feature Importance 16.3 Interpretable Regression Models 16.4 Ethical Use Chapter 17: Applications of Regression in AI 17.1 Computer Vision 17.2 NLP & Text Analytics 17.3 Healthcare Predictive Models 17.4 Finance & Stock Market 17.5 Time-Series Modeling & Forecasting 17.6 Engineering, Climate & Scientific Research ________________________________________ Unit–VII: Practical Implementation with Python & Case Studies Chapter 18: Implementing Regression Models in Python 18.1 Numpy, Pandas, Matplotlib 18.2 Scikit-Learn Implementation 18.3 TensorFlow & PyTorch Examples 18.4 Hyperparameter Tuning (Optuna, GridSearchCV, RandomSearch) Chapter 19: End-to-End Regression Projects 19.1 Housing Price Prediction 19.2 Customer Churn Prediction 19.3 Sentiment Score Regression 19.4 Medical Risk Prediction Model 19.5 Energy Consumption Forecasting Chapter 20: Interview Questions & Research Directions 20.1 Top 100 Interview Questions 20.2 Common Errors & Debugging Tips 20.3 Current Research Trends 20.4 Future of Regression in AI

The Leanpub 60 Day 100% Happiness Guarantee

Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.

Now, this is technically risky for us, since you'll have the book or course files either way. But we're so confident in our products and services, and in our authors and readers, that we're happy to offer a full money back guarantee for everything we sell.

You can only find out how good something is by trying it, and because of our 100% money back guarantee there's literally no risk to do so!

So, there's no reason not to click the Add to Cart button, is there?

See full terms...

Earn $8 on a $10 Purchase, and $16 on a $20 Purchase

We pay 80% royalties on purchases of $7.99 or more, and 80% royalties minus a 50 cent flat fee on purchases between $0.99 and $7.98. You earn $8 on a $10 sale, and $16 on a $20 sale. So, if we sell 5000 non-refunded copies of your book for $20, you'll earn $80,000.

(Yes, some authors have already earned much more than that on Leanpub.)

In fact, authors have earned over $15 million writing, publishing and selling on Leanpub.

Learn more about writing on Leanpub

Free Updates. DRM Free.

If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).

Most Leanpub books are available in PDF (for computers) and EPUB (for phones, tablets and Kindle). The formats that a book includes are shown at the top right corner of this page.

Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.

Learn more about Leanpub's ebook formats and where to read them

Write and Publish on Leanpub

You can use Leanpub to easily write, publish and sell in-progress and completed ebooks and online courses!

Leanpub is a powerful platform for serious authors, combining a simple, elegant writing and publishing workflow with a store focused on selling in-progress ebooks.

Leanpub is a magical typewriter for authors: just write in plain text, and to publish your ebook, just click a button. (Or, if you are producing your ebook your own way, you can even upload your own PDF and/or EPUB files and then publish with one click!) It really is that easy.

Learn more about writing on Leanpub