Top Repositories on Github with TechGarden

MoBA: Mixture of Block Attention for Long-Context LLMs

This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?"

Official Repo for Open-Reasoner-Zero

An AI chat bot for small and medium-sized teams, supporting models such as Deepseek, Open AI, Claude, and Gemini. 专为中小团队设计的 AI 聊天应用，支持 Deepseek、Open AI、Claude、Gemini 等模型。

Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper

Official repository for "Crawl4LLM: Efficient Web Crawling for LLM Pretraining"

Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.