I've been hard at work on Kiln (3k Github stars, ~10k users):
- Gihub: https://github.com/Kiln-AI/Kiln
- Demo Video: https://getkiln.ai#demo
It's goal is to makes AI model+product development processes better in a bunch of ways:
- Truly intuitive desktop apps, on top of our open-source python library
- Rapid prototyping: Quickly try a range of state of the art models+techniques (no code needed)
- Task specific evals: How does the system perform on your goals (not just global benchmarks)
- Iterate with confidence: update to better+faster models/techniques, knowing it works on all past evals/tests
- Team collaboration: get the entire team (PM/QA/Eng/Design/DS) engaged early and often. Shared datasets+evals you can sync with Git.
Features include:
- Fine tune dozens of models
- Interactive synthetic data generation to build train/eval datasets
- Powerful custom evals: LLM as Judge and G-Eval
- Collaboration: share with Git or shared drives
- Runs any LLM: locally or remote
- Private: it's local software
- Open Source Python library
- Completely free
- Much more: dataset management, ratings, prompt generators, JSON support, LLM repairs, reasoning models...
Happy to answer any questions!
Comments URL: https://news.ycombinator.com/item?id=43525610
Points: 2
# Comments: 0