Skip to content

Conversation

@MaartenGr
Copy link
Owner

Implements ollama. This is also a first attempt at standardizing the LLM-based representations to make it easier for further development. I might add more features as I continue working on this or merge as is.

Done

  • Added ollama as a representation
  • Added structured output for ollama but it only extracts the topic label for now

To Do

  • Add ollama documentation
  • Add more structured generations other than the topic label

This will be tricky to implement since each topic representation is typically added independently (multiple instances of LiteLLM for example) rather than a single topic representation (one instance of Ollama generating multiple representations).

I'm thinking of creating (data)classes for a single Topic as a way to more easily generate multiple representations and track them. This, however, requires significant changes to the codebase...

@MaartenGr
Copy link
Owner Author

It seems that downloading the data gives back errors, although it works without any issues locally... Perhaps it has something to do with how the containers are configured in gh-actions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants