🧪 test: level 2

This commit is contained in:
Florian Hönicke
2023-04-30 18:39:44 +02:00
parent 810fe67d78
commit 930d755d38
2 changed files with 4 additions and 3 deletions

View File

@@ -430,7 +430,7 @@ gptdeploy deploy --path {self.microservice_root_path}
messages,
'test',
'''Note that the test scenario must not contain information that was already mentioned in the microservice description.
Note that the test scenario must contain the full description of the concrete example in case it was mentioned in the microservice description.'''
Note that you must not ask for information that were already mentioned before.'''
)
break
except self.TaskRefinementException as e:
@@ -453,7 +453,8 @@ Test scenario:
agent_response_raw = conversation.chat(
template_refinement.format(
user_input=user_input,
_optional_test=' test' if refinement_type == 'test' else '',
final_placeholder='''input: "<input here>"
weak assertion of output: "<weak assertion of output here>"''' if refinement_type == 'test' else '<microservice description here>',
custom_suffix=custom_suffix,
),
role='user'

View File

@@ -367,7 +367,7 @@ Either ask for clarification like this:
Or write the summarized microservice{_optional_test} description like this:
**final.txt**
```text
<microservice{_optional_test} description here>
{final_placeholder}
```
Note that your response must be either prompt.txt or final.txt. You must not write both.
Note that you must obey the double asterisk and tripple backtick syntax from above.