Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
burtenshaw 's Collections
RL Environments
VLMs playing atari
🪀 Kids Coding Skills
🔥 Kimi K2 🔥
MCP Tools 4 AI
Tools 4 learning AI
Tools 4 Agents
Fine-tuned Python Coder
Fine-tuned to think on code
Open Image Genereration Models
Finetune Open source LLMs
Gemma HelpSteer

Gemma HelpSteer

updated Jun 26, 2025

A work in progress collection of resources related to a project to finetune Gemma 2 2b for helpfulness with Helpsteer2.

Upvote
1

  • nvidia/HelpSteer2

    Viewer • Updated Dec 18, 2024 • 21.4k • 4.99k • 452

    Note I opened a PR on this dataset repo to include Argilla configs: https://huggingface.co/datasets/nvidia/HelpSteer2/discussions/4


  • google/gemma-2-2b

    Text Generation • Updated Aug 7, 2024 • 259k • • 642

  • HelpSteer2: Open-source dataset for training top-performing reward models

    Paper • 2406.08673 • Published Jun 12, 2024 • 20

  • HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM

    Paper • 2311.09528 • Published Nov 16, 2023 • 2

  • Running on CPU Upgrade
    47

    Argilla Space

    ✍
    47

    Note I pushed some records of HelpSteer 2 to this Argilla space: https://huggingface.co/proxy/argilla-argilla-template-space.hf.space/dataset/3349bf8d-0755-403c-9964-a2e30544b97a/annotation-mode?page=1&status=pending

Upvote
1
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs