All Projects

ZenCoder: Your Own MLOps Engineer

Transform your ML workflow with an AI assistant that actually understands ZenML. This project fine-tunes open-source LLMs to generate production-ready MLOps pipelines.
Project
ZenCoder: Your Own MLOps Engineer
project id
zencoder-your-own-mlops-engineer
Use this id to create a new project in ZenML
GITHUB REPOSITORY
https://github.com/zenml-io/zenml-projects/tree/main/zencoder
Pipelines

Deployment Pipeline

This pipeline pushes the model to the hub.

Finetune Starcoder

This pipeline finetunes the starcoder model.

Generate Code Dataset

This pipeline generates the code dataset.

Recommended Stack

Stack Components

  • Orchestrator: default
  • Artifact Store: default
  • Step Operator: gcp
Details

ZenCoder transforms ML workflow development by fine-tuning open-source LLMs to generate production-ready MLOps pipelines with ZenML.

What It Does

ZenCoder acts as your personal MLOps engineer that deeply understands ZenML syntax and best practices. It automates the tedious process of converting manual scripts into deployable pipelines, saving time and reducing errors compared to general-purpose code assistants that may provide outdated syntax.

How It Works

  • Collects training data from ZenML repositories using a data generation pipeline
  • Fine-tunes open-source LLMs (like StarCoder) with QLoRA and PEFT techniques
  • Deploys the trained model to HuggingFace inference endpoints or locally via vLLM
  • Integrates with VS Code extensions for seamless coding assistance
  • Provides contextually relevant code suggestions based on the latest ZenML syntax
  • Updates automatically as ZenML evolves through continuous training
Gallery