LMSYS

United States Founded: 2023 • Age: 3 yrs
Develops large language models and tools for AI evaluation and serving.

About LMSYS

LMSYS is a company based in United States founded in 2023. It operates as a SaaS and Open Source Development. LMSYS offers products and services including Vicuna, Chatbot Arena, SGLang, LMSYS-Chat-1M, and FastChat. LMSYS operates in a competitive market with competitors including Together AI, Anysphere, Imbue, Bria and Predibase, among others.

  • Headquarter United States
  • Sectors
    Technology
  • Website category Computers Electronics and Technology · Programming and Developer Software
  • Website lmsys.org
  • Social X

Products & Services of LMSYS

LMSYS offers a comprehensive portfolio of products and services, including Vicuna, Chatbot Arena, SGLang, LMSYS-Chat-1M, and FastChat.

Vicuna
Chatbot

High-quality chatbot achieving 90% of ChatGPT's performance in various sizes.

Chatbot Arena
Evaluation Platform

Gamified system for crowdsourced assessment of large language models.

SGLang
Serving Engine

Fast engine designed for serving large language and vision models.

LMSYS-Chat-1M
Dataset

Large-scale dataset of real-world conversations for LLM training.

FastChat
Training Platform

Open platform for training and evaluating LLM-based chatbots.

MT-Bench
Benchmark Tool

Set of multi-turn questions for challenging chatbot evaluations.

Arena Hard Auto
Benchmark Pipeline

Automatic pipeline to convert data into high-quality chatbot benchmarks.

RouteLLM
Framework

Open-source framework for serving and evaluating LLM routers.

Competitors of LMSYS

LMSYS operates in a dynamic and competitive business environment, facing competition from various established players and emerging companies in the market. The competitive landscape includes prominent companies such as Together AI, Anysphere, Imbue, Bria and Predibase, among others.

Company NameDomainFoundedHQ LocationTotal fundingEmployeesDescription
together.ai2022San Francisco, United States$553.5M–
AI research and model development services
anysphere.inc2022San Francisco, United States$1.08B–
AI tools and assistants to augment human capabilities
imbue.com2020San Francisco, United States$232M–
Imbue is focused on building AI-driven coding environments.
bria.ai2020Tel Aviv, Israel$64M–
AI-based solutions are provided for creating customized visual content.
predibase.com2020San Francisco, United States$12.2M–
Provider of a low-code and cloud-based AI application development platform
goodfire.ai2024San Francisco, United States$57M–
Interpretability tools for generative AI models are developed and provided.
distyl.ai2022San Francisco, United States$202M–
Generative AI solutions are developed by Distyl for data transformation.
letta.com1997San Francisco, United States$10M–
Letta is focused on developing stateful AI agent platforms.
Premium access

Detailed competitors of LMSYS

The full competitor set, operating metrics and side-by-side benchmarks require an active premium plan.

  • Full competitor set
  • Operating metrics
  • Benchmarks
  • Competitive positioning

Verified entity values are shown only after access is granted.

Web traffic of LMSYS

The website of LMSYS (lmsys.org) receives about 278.6K visits a month and ranks #192,303 among all websites worldwide, #4,421 in Programming and Developer Software.

  • Monthly visits
    278.6K

    ▲ 6.6% vs previous month

  • Unique visitors
    122.1K

    per month

  • Global rank
    #192,303

    among all websites

  • Category rank
    #4,421

    Computers Electronics and Technology · Programming and Developer Software

Similar websites

Websites whose visitors overlap most with LMSYS. Affinity shows how closely the audiences match.

WebsiteDomainAudience affinityMonthly visitsGlobal rankProfile
lmarena.ai
100%
24.5M#1,733View details
withmartian.com
89%
19.1K–View details
promptfoo.dev
87%
152K#319,722View details
baseten.co
86%
197.3K#239,764View details
h2o.ai
85%
241.5K#172,356View details
β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’.comβ€’β€’%β€’.β€’M#‒‒‒‒‒–
β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’.comβ€’β€’%β€’.β€’M#‒‒‒‒‒–
β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’β€’.comβ€’β€’%β€’.β€’M#‒‒‒‒‒–
Premium access

All 10 similar websites and full traffic analytics for LMSYS

The complete similar-websites list, audience overlap and engagement analytics require an active premium plan.

  • 10 similar websites
  • Audience overlap
  • Engagement analytics
  • Traffic by brand

Verified entity values are shown only after access is granted.

Latest news on Lmsys

Premium access

Complete news archive for LMSYS

Full article history, source details, and older brand coverage require an active premium plan.

  • Full article archive
  • Source and publication date
  • Older coverage
  • Brand-specific news history

Verified entity values are shown only after access is granted.

Similar companies to LMSYS

10 companies that operate in the same segment as LMSYS (AI in Legal), ranked by their profile score on The Company Check.

CompanyDescriptionFoundedLocationTotal fundingRevenueEmployees
AI-based search engine for efficient legal information retrieval.
2018Gurugram, Haryana, India–USD 10.85 M313
Offers AI-based software for contract lifecycle management and compliance processes.
2014Mumbai, Maharashtra, India–USD 201.16 K–
AI-powered tools for immigration law research and drafting are provided.
2020Memphis, Tennessee, United StatesUSD 1.6 M––
Provides mobile app, website, software development, and AI services.
2023Chennai, Tamil Nadu, India–––
Provides litigation funding, data-driven insights, and chatbot for legal disputes in India.
2020Kolkata, West Bengal, India–USD 26.77 K8
AI platform for legal advice, document drafting, background checks, and research tools.
2019Mumbai, Maharashtra, India–––
Provider of online legal assistant
1939––––
Offers AI-powered tools for legal analysis, document processing, and workflows.
2021Bengaluru, Karnataka, India–USD 138.88 K3
Provides AI risk assessment, data privacy, and regulatory compliance expertise.
2011Bengaluru, Karnataka, India–USD 319.5 K4
Delivers cloud and AI-based solutions for legal research management.
2020Panaji, Goa, India–––
Upgrade to premium

Unlock complete access to The Company Check

Get unrestricted viewing across everything we track β€” from companies and brands to investors, funding rounds, acquisitions, financials, and more.

Upgrade to Premium No viewing limits. Your plan controls exports and screening usage.
Included in your Premium account
  • βœ“
    Unlimited viewing on all profiles Companies, investors, financials, funding, acquisitions & directors
  • βœ“
    Full access to every database India & global coverage, advanced filters and rich profile details
  • βœ“
    Always-on access from your team account Single premium plan for everything you see on the portal

Frequently Asked Questions about LMSYS

LMSYS was founded in 2023.

LMSYS is headquartered in United States.

LMSYS Org focuses on creating open-source large model systems, including chatbots like Vicuna that rival advanced AI models. They develop platforms for evaluating and serving large language models, such as Chatbot Arena for crowdsourced assessments and SGLang for fast engine deployment. Their activities involve datasets like LMSYS-Chat-1M and frameworks for training and benchmarking AI chatbots, promoting scalable and accessible technology without specified locations or clients.

LMSYS's top competitors include Goodfire, Bria and Predibase.

LMSYS offers Vicuna, Chatbot Arena, SGLang, LMSYS-Chat-1M, and 4 more products and services.

The website of LMSYS receives about 279 thousand visits a month and ranks #192,303 among all websites worldwide.

Explore millions of companies β€” effortlessly

Access structured, verified intelligence on 7M+ companies across industries, sectors, and global markets. From early-stage startups to large enterprises, discover ownership, leadership, funding, financials, acquisitions, and market signals β€” all in one powerful platform.

Free account with essential features Instant access to company reports Enterprise solutions available