RAG-LLM Evaluation & Test Automation for Beginners

سرفصل های دوره

Understand, Evaluate & Test RAG - LLM's (AI based Systems) from Scratch using RAGAS-Python-Pytest Framework

1 - Introduction to AI concepts - LLMs & RAG LLMs

1 -What this course offers FAQs -Must Watch

2 -Introduction to Artificial Intelligence and LLMs - How they work

2 - Course outcome - Setting the stage of expectation.html

3 -Overview of popular LLMs and Challenges with these general LLMs

4 -What is Retrieval Augmented Generation (RAG) Understand its Architecture

5 -End to end flow in RAG Architecture and its key advantages

2 - Understand RAG (Retrieval Augmented Generation) - LLM Architecture with Usecase

1 -Misconceptions - Why RAG LLM's - cant we solve problem with traditional methods

2 -Optional - Overview how code looks in building RAG LLM's applications

3 - Getting started with Practice LLMs and the approach to evaluate Test

1 -Demo of Practice RAG LLM's to evaluate and write test automation scripts

1 -LLM Evaluation_Resources.zip

1 - Course resources download.html

2 -Understanding implementation part of practice RAG LLM's to understand context

3 -Understand conversational LLM scenarios and how they are applied to RAG Arch

4 -Understand the Metric benchmarks for Document Retrieval system in LLM

4 - Setup Python & Pytest Environment with RAGAS LLM Evaluation Package Libraries

1 -Install and set the path of Python in windows OS

2 -Install and set the path of Python in MAC OS

3 -Install RAGAS Framework packages and setup the LLM Test project

4 - Python & Pytest Basics - Where to find them in the tutorial.html

5 - Programmatic solution to evaluate LLM Metrics with Langchain and RAGAS Libraries

1 -Making connection with OpenAI using Langchain Framework for RAGAS

2 -End to end -Evaluate LLM for ContextPrecision metric with SingleTurn Test data

3 -Communicate with LLM's using API Post call to dynamically get responses

3 -metrics.docx

3 - Metrics document download.html

4 -Evaluate LLM for Context Recall Metric with RAGAS Pytest Test example

6 - Optimize LLM Evaluation tests with Pytest Fixtures & Parameterization techniques

1 -Build Pytest fixtures to isolate OpenAI and LLM Wrapper common utils from test

2 -Introduction to Pytest Parameterization fixtures to drive test data externally

3 -Reusable utils to isolate API calls of LLM and have test only on Metric logic

139,000 تومان

افزودن به سبد خرید

خرید دانلودی فوری

در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

تولید کننده: Udemy