Ollama model : llama2 : No code block found in the response. The model is unable to generate code to complete the task.

[Abdelkrim]

setup

I am running ollama and data formulator locally on WSL/Ubuntu

here is the configuration of the models

how to reproduce

1. use sample database movies
2. select scatter plot
3. Set x-axis to Production_Budget
4. Set y-axis to US_Gross
5. set the formulate data with show top 5

the error

(chart builder) Data formulation failed, please try again.
[details]

No code block found in the response. The model is unable to generate code to complete the task. 

[Chenglong-MS]

Thanks for trying it out! Unfortunately some of the smaller models (like llama2 7b) cannot follow instructions in the agent well enough to produce code to transform data.

Ideally such tasks require models with stronger code generation capability (e.g., models as strong or stronger than gpt-4.1-mini). Large models like gpt-5, gpt-4.1 and claude-sonnet-4 are known to perform best in these tasks.

[Chenglong-MS]

This motivates me to think we should publish a benchmark to guide community use of models.