Show HN: Fine-tune llama3 model to support function calling

by michaelnnyon 6/11/2024, 9:13 AMwith 5 comments

Few weeks ago, we were tasked to make llama3 model to do function calling and build an API similar/compatible with OpenAI's python client.

While we're still improving our dataset and FastAPI backend server (which can't be open-sourced), we're happy to share with the community our open-sourced project of how to properly fine-tune llama3 model to support function calling, all following OpenAI's best practices.

We hope this will help other people with similar tasks/needs, happy to answer any questions.

by michaelnnyon 6/13/2024, 9:26 AM

In case anyone is interested, we have a very simple notebook which try to trick GPT-4o to reveal the structure of the prompt/response related to function calling, and it's located at:

https://github.com/michaelnny/Llama3-FunctionCalling/blob/ma...

by K0INon 6/12/2024, 9:49 AM

The link seems to be broken

by david1542on 6/12/2024, 8:50 PM

link is broken