dataset-builder

weighted category-balanced dataset builder for LLM fine-tuning

Minimal text dataset builder for ML students - zero dependencies, simple API, auto deduplication

Warehouse execution engine for KPubData.

A modular open-source framework for downloading, converting, validating, enriching, and merging instruction-tuning datasets for Large Language Models (LLMs).

Scalable pipeline for building Moroccan Darija NLP datasets for LLM training.

KimiBrain Dataset Builder by Mohammed Ali Abdulla Al Marzooqi

Dataset builder is an application that allows users to build datasets up to 5 dimensions visually through an intuitive MS-Paint-like interface and store the dataset in a MySQL data base for effective data-wrangling. Furthermore, the application allows users to export the datasets to a CSV file.

🖼️ A Python tool to automatically crawl and download images from Google Images using keywords. Ideal for building datasets or conducting visual research.

Automate the preparation, validation, and merging of high-quality instruction-tuning datasets for Large Language Models.

高效的 WebUI 图片数据集自动构建工具：压缩包批处理、去重、1024 画幅裁切/对齐、关键点辅助、自动/半自动打标与导出。A fast WebUI for building portrait photo datasets: batch import from archives, deduplication, square (1024) crop/alignment, keypoint-assisted annotation, auto/semi-auto tagging & export.

csv dataset converter tool

A Windows-native offline workspace for turning customer conversations into reviewed intent datasets, local ML.NET intent classifiers, evaluations, recommendations, and business reports.

AI-powered web intelligence system that crawls websites, extracts structured content, and builds LLM-ready datasets for RAG pipelines.

Dataset Builder/Image Scraper using Bash as part of the UNIX course project

Training and fine-tuning LLMs from GitHub code repositories with automated ingestion, preprocessing, dataset building, checkpointing, and inference pipeline.

Build a local public MM-Mix-style dataset for ODB examples