Repository navigation

Support for the Deepeval dataset (LLMTestCase) for LLM tests - #401

Merged

AnilSorathiya merged 68 commits into

mainfrom

anilsorathiya/sc-11452/support-for-the-deepeval-dataset-llmtestcase

Sep 12, 2025

Commits on Jun 24, 2025
- support agent use case
  AnilSorathiya
  committed
  1b3f67a
- wrapper function for agent
  AnilSorathiya
  committed
  723fcab
Commits on Jun 30, 2025
- ragas metrics
  AnilSorathiya
  committed
  28d9fbb
- update ragas metrics
  AnilSorathiya
  committed
  ecf8e09
- fix lint error
  AnilSorathiya
  committed
  53e8879
Commits on Jul 1, 2025
- create helper functions
  AnilSorathiya
  committed
  1662368
Commits on Jul 2, 2025
- Merge branch 'main' into anilsorathiya/sc-10863/add-support-for-llm-agentic-model-in-vm-library
  AnilSorathiya
  committed
  cc84cbc
- delete old notebook
  AnilSorathiya
  committed
  6f09780
- update description for each section
  AnilSorathiya
  committed
  0bb731e
Commits on Jul 9, 2025
- simplify agent
  AnilSorathiya
  committed
  e758979
Commits on Jul 10, 2025
- simple demo notebook using langchain agent
  AnilSorathiya
  committed
  7c35cfe
- Update description of the simplified langgraph agent demo notebook
  AnilSorathiya
  committed
  9bb70e9
Commits on Jul 14, 2025
- add brief description to tests
  AnilSorathiya
  committed
  894d52a
- add brief description to tests
  AnilSorathiya
  committed
  d86a9af
Commits on Jul 17, 2025
- Allow dict return type predict_fn
  AnilSorathiya
  committed
  884000f
Commits on Jul 18, 2025
- update notebook and refactor utils
  AnilSorathiya
  committed
  fbd5aa9
- lint fix
  AnilSorathiya
  committed
  daceabf
- Merge branch 'main' into anilsorathiya/sc-11324/extend-the-predict-fn-in-the-init-model-to
  AnilSorathiya
  committed
  5f8823a
- fix the test failure
  AnilSorathiya
  committed
  70a5636
- new unit tests for multiple columns return in assign_predictions
  AnilSorathiya
  committed
  33b06fb
- update notebooks to return multiple values in predict_fn
  AnilSorathiya
  committed
  8e12bd2
Commits on Jul 23, 2025
- general plotting and stats tests
  AnilSorathiya
  committed
  e38929d
- clear output
  AnilSorathiya
  committed
  e900a65
Commits on Jul 24, 2025
- Merge branch 'main' into anilsorathiya/sc-11380/add-generlize-plots-and-statistical-tests
  AnilSorathiya
  committed
  a08e881
- remove duplicate tests
  AnilSorathiya
  committed
  16f4700
- update notebook
  AnilSorathiya
  committed
  bb9f9af
Commits on Jul 25, 2025
- Integration between deepeval and validmind
  AnilSorathiya
  committed
  5078a7a
Commits on Aug 12, 2025
- Merge branch 'main' into anilsorathiya/sc-11452/support-for-the-deepeval-dataset-llmtestcase
  AnilSorathiya
  committed
  2eb6abb
Commits on Aug 15, 2025
- add MetricValues class for metric return type
  AnilSorathiya
  committed
  ad0b719
- Return MetricValues in the unit tests
  AnilSorathiya
  committed
  94ca006
- update all the unit metric tests
  AnilSorathiya
  committed
  c4c885a
- add unit tests for MetricValues class
  AnilSorathiya
  committed
  a1f3220
- update result to support MetricValues for unit metric tests
  AnilSorathiya
  committed
  1a7d0b6
- add copyright statement
  AnilSorathiya
  committed
  1d785ba
- add deepeval lib as an extra dependency
  AnilSorathiya
  committed
  271e85b
- fix the error
  AnilSorathiya
  committed
  f806fc6
Commits on Aug 18, 2025
- demo draft change
  AnilSorathiya
  committed
  61c7ef6
- demo draft change
  AnilSorathiya
  committed
  b646d0b
- fix api issue
  AnilSorathiya
  committed
  dda4ced
Commits on Aug 21, 2025
- Merge branch 'main' into anilsorathiya/sc-11452/support-for-the-deepeval-dataset-llmtestcase
  AnilSorathiya
  committed
  dd8e0df
Commits on Aug 22, 2025
- separate unit metrics and row metrics
  AnilSorathiya
  committed
  81249c2
- draft notebook
  AnilSorathiya
  committed
  794a322
- Merge branch 'main' into anilsorathiya/sc-11452/support-for-the-deepeval-dataset-llmtestcase
  AnilSorathiya
  committed
  a27bc48
- update assign_score notebook
  AnilSorathiya
  committed
  84dfa2f
Commits on Sep 1, 2025
- update assign score notebook
  AnilSorathiya
  committed
  7aa2acc
- rename notebook
  AnilSorathiya
  committed
  247eacc
- update deepeval and VM integration notebook
  AnilSorathiya
  committed
  394c57c
Commits on Sep 4, 2025
Commits on Sep 5, 2025
- remove MetricValue class
  AnilSorathiya
  committed
  d8a48c8
- support complex output for scorer
  AnilSorathiya
  committed
  d425576
Commits on Sep 9, 2025
- remove simple testcases
  AnilSorathiya
  committed
  9c7e7e9
- fix the list_scorers
  AnilSorathiya
  committed
  bbd6cd4
- update notebook
  AnilSorathiya
  committed
  c7b83f3
- remove circular dependency of load_test
  AnilSorathiya
  committed
  a33f2a4
- remove circular dependency of load_test
  AnilSorathiya
  committed
  30c3abc
- move the AnswerRelevancy scorer in deepeval namespace
  AnilSorathiya
  committed
  e91e6e4
- unit metric can return int and float only
  AnilSorathiya
  committed
  a284cd1
- update notebook
  AnilSorathiya
  committed
  1ec1c75
- fix lint error
  AnilSorathiya
  committed
  427ddf5
Commits on Sep 10, 2025
- remove scores listing from list_tests interface
  AnilSorathiya
  committed
  917831c
- add custom scorer support
  AnilSorathiya
  committed
  58b3bde
Commits on Sep 11, 2025
- full path required to run scorer
  AnilSorathiya
  committed
  cb52104
- remove circular dependency
  AnilSorathiya
  committed
  36f2f96
- make model parameter option in the assign_scores function
  AnilSorathiya
  committed
  439bd1d
- fix lint error
  AnilSorathiya
  committed
  66dde16

Commits

Commits on Jun 24, 2025

Commits on Jun 30, 2025

Commits on Jul 1, 2025

Commits on Jul 2, 2025

Commits on Jul 9, 2025

Commits on Jul 10, 2025

Commits on Jul 14, 2025

Commits on Jul 17, 2025

Commits on Jul 18, 2025

Commits on Jul 23, 2025

Commits on Jul 24, 2025

Commits on Jul 25, 2025

Commits on Aug 12, 2025

Commits on Aug 15, 2025

Commits on Aug 18, 2025

Commits on Aug 21, 2025

Commits on Aug 22, 2025

Commits on Sep 1, 2025

Commits on Sep 4, 2025

Commits on Sep 5, 2025

Commits on Sep 9, 2025

Commits on Sep 10, 2025

Commits on Sep 11, 2025