Skip to content

Batch4LLM Documentation

This is the official user documentation for Batch4LLM. You will find a quickstart guide and explanations of the different settings.

Quickstart

Click here to quickly start your first batch. You will learn how you connect to an endpoint, create a prompt, upload your documents and start a batch.

What model should I use?

This depends on the complexity of your tasks. For most prompts small models like gemini-2.5-flash, gpt-4o-mini or claude-haiku-4-5-20251001 will be good enough.

Scientific evaluation

Batch4LLM works perfectly to evaluate