Code

Code Refactoring #7

Code

Closed

prabha-git wants to merge 18 commits intogkamradt:maingkamradt/LLMTest_NeedleInAHaystack:mainfrom prabha-git:mainprabha-git/LLMTest_NeedleInAHaystack:mainCopy head branch name to clipboard

+397-239

Commits

Commits on Jan 2, 2024

• Code seperation for each model providers

  prabha-git

  committed
  a7b96d7

  Copy full SHA for a7b96d7

• Code Seperation for each provider

  prabha-git

  committed
  8938e86

  Copy full SHA for 8938e86

• Merge pull request #1 from prabha-git/refactor_models_seperate_class

  Show description for 374e8bf
  prabha-git

  authored
  374e8bf

  Copy full SHA for 374e8bf

• updated the readme

  prabha-git

  committed
  b238046

  Copy full SHA for b238046

• Merge pull request #2 from prabha-git/refactor_models_seperate_class

  Show description for 4501c01
  prabha-git

  authored
  4501c01

  Copy full SHA for 4501c01

Commits on Jan 9, 2024

• issuecomment-1877803162 - Updating the code based on feedback

  prabha-git

  committed
  9b093f2

  Copy full SHA for 9b093f2

• Merge pull request #3 from prabha-git/remove_hardcoding_substring_eval

  Show description for dc7b715
  prabha-git

  authored
  dc7b715

  Copy full SHA for dc7b715

Commits on Jan 10, 2024

• Added a check to ensure substring validation words is in needle

  prabha-git

  committed
  13ce6b0

  Copy full SHA for 13ce6b0

• Merge pull request #4 from prabha-git/remove_hardcoding_substring_eval

  Show description for 933eeff
  prabha-git

  authored
  933eeff

  Copy full SHA for 933eeff

• instating evaluation model with gpt4 only evaluation_method is set to gpt4

  prabha-git

  committed
  e471807

  Copy full SHA for e471807

Commits on Feb 28, 2024

• Directly included the prompt in AnthropicEvaluator

  prabha-git

  committed
  aa20790

  Copy full SHA for aa20790

Commits on Feb 29, 2024

• refactored the code to use pathlib instead of os.path

  prabha-git

  committed
  c7b0dce

  Copy full SHA for c7b0dce

• Updated the Anthropic to 0.16.0 , Since API has changed

  prabha-git

  committed
  59a82e7

  Copy full SHA for 59a82e7

• updates save_results method to save json output in single line

  prabha-git

  committed
  b242a5c

  Copy full SHA for b242a5c

• remove f-string where is it not requried in print_ongoing_status

  prabha-git

  committed
  dc47cc9

  Copy full SHA for dc47cc9

• Added pre-commit with trailing-whitespace,end-of-file-fixer

  prabha-git

  committed
  9f49f2c

  Copy full SHA for 9f49f2c

• Fix with end-of-file-fixer

  prabha-git

  committed
  7e86887

  Copy full SHA for 7e86887

• added black hook to pre-commit

  prabha-git

  committed
  4a77764

  Copy full SHA for 4a77764