Compare each response with your benchmark
See how every submission measures up against the standard you care about.
Trigger
New Form Response
Triggers when a respondent completes and submits the form.
Action
Execute Code
Execute python code in a sandbox and return any result, stdout, stderr, and error. use /home/user folder to write/read files. try to not use plt.show() as the code is executed remotely. use files for image/chart output instead.
Why this helps
Manual comparisons are inconsistent when reviewers use different interpretations of the benchmark.
- Apply one standard
- Expose gaps quickly
- Support consistent decisions
Setup
Build it in a few focused steps.
- 1Connect Typeform and Codeinterpreter once in Notis.
- 2Create the automation and provide the benchmark or rubric in the instruction.
- 3Pick the Typeform New Form Response trigger.
- 4Select a report channel and test with one benchmarked response.
Questions about this workflow
Where does the benchmark come from?
You must provide the benchmark, rubric, or baseline in the instruction or referenced files.
Can it explain the score?
Yes. Ask for a criterion by criterion explanation.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Typeform to Codeinterpreter. A trigger fires from one place; an action lands in another.
Typeform triggers
Codeinterpreter actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Create Sandbox
Create a sandbox to execute python code in a jupyter notebook cell. this is useful for agents to communicate, execute code, see output, read files, write files, etc. it's like you own personal computer, but in the cloud. use /home/user folder to write/read files.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Execute Code
Execute python code in a sandbox and return any result, stdout, stderr, and error. use /home/user folder to write/read files. try to not use plt.show() as the code is executed remotely. use files for image/chart output instead.
New Form Response
Triggers when a respondent completes and submits the form.
Get File
Get a file from the sandbox and returns the file. the files should be read from /home/user folder.
Run Terminal Command
Run a command in the terminal and returns the stdout, stderr, and error code. use /home/user folder to write/read files.
Upload File
Upload a file to the sandbox environment. the files should be uploaded to the /home/user folder.
Connect any two apps with Notis in the middle.
Typeform and Codeinterpreter, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Codeinterpreter.