Quickstart
Click here to quickly start your first batch. You will learn how you connect to an endpoint, create a prompt, upload your documents and start a batch.
Quickstart
Click here to quickly start your first batch. You will learn how you connect to an endpoint, create a prompt, upload your documents and start a batch.
What model should I use?
This depends on the complexity of your tasks. For most prompts small models like
gemini-2.5-flash, gpt-4o-mini or claude-haiku-4-5-20251001 will be good enough.
Scientific evaluation
Batch4LLM works perfectly to evaluate