🧪3️⃣ test: level 3 refinement

This commit is contained in:
Florian Hönicke
2023-05-01 23:14:21 +02:00
parent ebb5797982
commit 8a2360da7a
3 changed files with 19 additions and 4 deletions

View File

@@ -542,7 +542,7 @@ Test scenario:
def replace_with_gpt_3_5_turbo_if_possible(pkg):
if pkg in ['allennlp', 'bertopic', 'fasttext', 'flair', 'gensim', 'nltk',
'pattern', 'polyglot', 'pytorch-transformers', 'rasa', 'sentence-transformers',
'spacy', 'stanza', 'textblob', 'textstat', 'transformers']:
'spacy', 'stanza', 'summarizer', 'textblob', 'textstat', 'transformers']:
return 'gpt_3_5_turbo_api'
return pkg

View File

@@ -139,7 +139,7 @@ contains example: yes (<insert example here>)
```json
{{
"input": "<input here>",
"assertion": "the output is of type <type here>"
"assertion": "the output contains the result that is of type <type here>"
}}
```

View File

@@ -268,7 +268,22 @@ You are given the following files:
{all_files_string}
To solve this error, you should determine the list of packages that need to be installed via `apt-get install` in the Dockerfile.
Output them as a white space separated list:'''
Output the apt-get packages that need to me placed at {{apt_get_packages}} as json in the following format:
**apt-get-packages.json**
```json
{{"packages": ["<package1>", "<package2>"]}}
```
Example for the following requirements.txt file:
**requirements.txt**
```
numpy==1.19.5
fitz
```
The output would be:
**apt-get-packages.json**
```json
{{"packages": []}}
```'''
)
@@ -433,7 +448,7 @@ Example for the case where the example is already mentioned in the refined descr
```json
{{
"input": "<input here>",
"assertion": "the output is of type <type here>"
"assertion": "the output contains the result that is of type <type here>"
}}
```
Note that your response must be either prompt.json or final.json. You must not write both.